[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:16:45.122447 16192 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.208.62:35363
I20260709 13:16:45.124135 16192 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:16:45.125355 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:45.143738 16199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:45.143745 16198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:45.143784 16201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:45.145327 16192 server_base.cc:1061] running on GCE node
I20260709 13:16:46.395605 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:46.395871 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:46.396029 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603006396013 us; error 0 us; skew 500 ppm
I20260709 13:16:46.396812 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:46.402305 16192 webserver.cc:533] Webserver started at http://127.15.208.62:36803/ using document root <none> and password file <none>
I20260709 13:16:46.403204 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:46.403412 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:46.403805 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:46.409816 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/master-0-root/instance:
uuid: "0b775cbd90d84e958cdcddcdb369c3b5"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-w3b1"
I20260709 13:16:46.418131 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:16:46.424096 16207 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.425531 16192 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:16:46.425923 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/master-0-root
uuid: "0b775cbd90d84e958cdcddcdb369c3b5"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-w3b1"
I20260709 13:16:46.426306 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:46.513517 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:46.515162 16192 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:16:46.515663 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:46.588765 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.62:35363
I20260709 13:16:46.588913 16258 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.62:35363 every 8 connection(s)
I20260709 13:16:46.597664 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.622182 16259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5: Bootstrap starting.
I20260709 13:16:46.628651 16259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.630776 16259 log.cc:826] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5: Log is configured to *not* fsync() on all Append() calls
I20260709 13:16:46.635885 16259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5: No bootstrap required, opened a new log
I20260709 13:16:46.659353 16259 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b775cbd90d84e958cdcddcdb369c3b5" member_type: VOTER }
I20260709 13:16:46.659979 16259 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.660245 16259 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b775cbd90d84e958cdcddcdb369c3b5, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.661265 16259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b775cbd90d84e958cdcddcdb369c3b5" member_type: VOTER }
I20260709 13:16:46.661784 16259 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:46.662065 16259 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:46.662376 16259 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.667042 16259 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b775cbd90d84e958cdcddcdb369c3b5" member_type: VOTER }
I20260709 13:16:46.667809 16259 leader_election.cc:304] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b775cbd90d84e958cdcddcdb369c3b5; no voters: 
I20260709 13:16:46.669679 16259 leader_election.cc:290] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:46.670074 16262 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.673120 16262 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 1 LEADER]: Becoming Leader. State: Replica: 0b775cbd90d84e958cdcddcdb369c3b5, State: Running, Role: LEADER
I20260709 13:16:46.674185 16262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b775cbd90d84e958cdcddcdb369c3b5" member_type: VOTER }
I20260709 13:16:46.675290 16259 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:46.687637 16263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b775cbd90d84e958cdcddcdb369c3b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b775cbd90d84e958cdcddcdb369c3b5" member_type: VOTER } }
I20260709 13:16:46.687460 16264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b775cbd90d84e958cdcddcdb369c3b5. Latest consensus state: current_term: 1 leader_uuid: "0b775cbd90d84e958cdcddcdb369c3b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b775cbd90d84e958cdcddcdb369c3b5" member_type: VOTER } }
I20260709 13:16:46.688313 16263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:46.688401 16264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:46.691784 16272 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:46.703706 16272 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:46.707412 16192 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:46.721583 16272 catalog_manager.cc:1383] Generated new cluster ID: fc71a33c07a448178c2c6c08a30dc904
I20260709 13:16:46.721948 16272 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:46.740546 16272 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:46.742203 16272 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:46.758718 16272 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5: Generated new TSK 0
I20260709 13:16:46.759922 16272 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:46.774488 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:46.783813 16281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:46.786175 16282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:46.789954 16192 server_base.cc:1061] running on GCE node
W20260709 13:16:46.790344 16284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:46.791436 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:46.791756 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:46.792039 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603006792012 us; error 0 us; skew 500 ppm
I20260709 13:16:46.792984 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:46.797578 16192 webserver.cc:533] Webserver started at http://127.15.208.1:33329/ using document root <none> and password file <none>
I20260709 13:16:46.798404 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:46.798697 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:46.799080 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:46.800784 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-0-root/instance:
uuid: "25c58b683c064d6797b8b0ea6defb350"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-w3b1"
I20260709 13:16:46.808648 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:16:46.814572 16289 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.815526 16192 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:16:46.815845 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-0-root
uuid: "25c58b683c064d6797b8b0ea6defb350"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-w3b1"
I20260709 13:16:46.816198 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:46.838268 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:46.839663 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:46.842113 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:46.846796 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:46.847078 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.847357 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:46.847553 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.954466 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.1:43155
I20260709 13:16:46.954535 16351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.1:43155 every 8 connection(s)
I20260709 13:16:46.962323 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:46.973088 16356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:46.979417 16357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:46.985677 16192 server_base.cc:1061] running on GCE node
W20260709 13:16:46.987257 16359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:46.988452 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:46.988739 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:46.988987 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603006988962 us; error 0 us; skew 500 ppm
I20260709 13:16:46.989580 16352 heartbeater.cc:344] Connected to a master server at 127.15.208.62:35363
I20260709 13:16:46.989796 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:46.990113 16352 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:46.991433 16352 heartbeater.cc:507] Master 127.15.208.62:35363 requested a full tablet report, sending...
I20260709 13:16:46.993045 16192 webserver.cc:533] Webserver started at http://127.15.208.2:44297/ using document root <none> and password file <none>
I20260709 13:16:46.993722 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:46.993968 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:46.994306 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:46.994736 16224 ts_manager.cc:194] Registered new tserver with Master: 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155)
I20260709 13:16:46.995829 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-1-root/instance:
uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-w3b1"
I20260709 13:16:46.997107 16224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47432
I20260709 13:16:47.002552 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:16:47.008296 16364 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:47.009266 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:16:47.009644 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-1-root
uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-w3b1"
I20260709 13:16:47.010011 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:47.037783 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:47.039551 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:47.042128 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:47.045804 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:47.046066 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:47.046347 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:47.046557 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:47.152370 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.2:38057
I20260709 13:16:47.152776 16426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.2:38057 every 8 connection(s)
I20260709 13:16:47.159543 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:47.167815 16430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:47.173527 16431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:47.176184 16427 heartbeater.cc:344] Connected to a master server at 127.15.208.62:35363
I20260709 13:16:47.176693 16427 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:47.177523 16192 server_base.cc:1061] running on GCE node
I20260709 13:16:47.177832 16427 heartbeater.cc:507] Master 127.15.208.62:35363 requested a full tablet report, sending...
W20260709 13:16:47.179709 16433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:47.179891 16224 ts_manager.cc:194] Registered new tserver with Master: 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:47.180927 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:47.181183 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:47.181385 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603007181369 us; error 0 us; skew 500 ppm
I20260709 13:16:47.181826 16224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47448
I20260709 13:16:47.182132 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:47.185241 16192 webserver.cc:533] Webserver started at http://127.15.208.3:41973/ using document root <none> and password file <none>
I20260709 13:16:47.185726 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:47.185886 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:47.186218 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:47.187367 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-2-root/instance:
uuid: "2180d2c18b174d2481ff75b5b2d27239"
format_stamp: "Formatted at 2026-07-09 13:16:47 on dist-test-slave-w3b1"
I20260709 13:16:47.192278 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:16:47.195976 16438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:47.197014 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:16:47.197371 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-2-root
uuid: "2180d2c18b174d2481ff75b5b2d27239"
format_stamp: "Formatted at 2026-07-09 13:16:47 on dist-test-slave-w3b1"
I20260709 13:16:47.197744 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603004946521-16192-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:47.211086 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:47.212416 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:47.214002 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:47.217003 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:47.217248 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:47.217500 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:47.217697 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:47.307631 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.3:40699
I20260709 13:16:47.307811 16500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.3:40699 every 8 connection(s)
I20260709 13:16:47.326507 16501 heartbeater.cc:344] Connected to a master server at 127.15.208.62:35363
I20260709 13:16:47.327004 16501 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:47.328106 16501 heartbeater.cc:507] Master 127.15.208.62:35363 requested a full tablet report, sending...
I20260709 13:16:47.330746 16224 ts_manager.cc:194] Registered new tserver with Master: 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:47.330958 16192 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018232968s
I20260709 13:16:47.332711 16224 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47458
I20260709 13:16:47.385370 16224 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47460:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:47.389477 16224 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:47.493269 16466 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2ba227ed424f80b3ffdc689e4375eb (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:47.493489 16465 tablet_service.cc:1511] Processing CreateTablet for tablet d9e3db183b3147e896382c0270fc7457 (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:47.497555 16466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2ba227ed424f80b3ffdc689e4375eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.498742 16465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e3db183b3147e896382c0270fc7457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.499493 16464 tablet_service.cc:1511] Processing CreateTablet for tablet b1c595b9a2b142c0a55eea08f3dac88a (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:47.501183 16464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c595b9a2b142c0a55eea08f3dac88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.505829 16463 tablet_service.cc:1511] Processing CreateTablet for tablet 538ecd12f8514667b13bd8354cf2c1aa (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:47.507400 16463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538ecd12f8514667b13bd8354cf2c1aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.512157 16462 tablet_service.cc:1511] Processing CreateTablet for tablet 5e477a794c094947a219fbd1586bbd2b (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:47.515988 16462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e477a794c094947a219fbd1586bbd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.526316 16461 tablet_service.cc:1511] Processing CreateTablet for tablet a2738f4ef9534ea288d6b48702306870 (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:47.531106 16461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2738f4ef9534ea288d6b48702306870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.554531 16388 tablet_service.cc:1511] Processing CreateTablet for tablet 5e477a794c094947a219fbd1586bbd2b (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:47.554582 16460 tablet_service.cc:1511] Processing CreateTablet for tablet 79204942fd2e4ab598224496f72b5e7d (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:47.572999 16388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e477a794c094947a219fbd1586bbd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.564860 16316 tablet_service.cc:1511] Processing CreateTablet for tablet d9e3db183b3147e896382c0270fc7457 (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:47.563599 16392 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2ba227ed424f80b3ffdc689e4375eb (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:47.579270 16460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79204942fd2e4ab598224496f72b5e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.568054 16314 tablet_service.cc:1511] Processing CreateTablet for tablet 538ecd12f8514667b13bd8354cf2c1aa (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:47.578456 16312 tablet_service.cc:1511] Processing CreateTablet for tablet a2738f4ef9534ea288d6b48702306870 (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:47.581488 16391 tablet_service.cc:1511] Processing CreateTablet for tablet d9e3db183b3147e896382c0270fc7457 (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:47.572223 16389 tablet_service.cc:1511] Processing CreateTablet for tablet 538ecd12f8514667b13bd8354cf2c1aa (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:47.585180 16316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e3db183b3147e896382c0270fc7457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.583583 16317 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2ba227ed424f80b3ffdc689e4375eb (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:47.576813 16313 tablet_service.cc:1511] Processing CreateTablet for tablet 5e477a794c094947a219fbd1586bbd2b (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:47.582842 16390 tablet_service.cc:1511] Processing CreateTablet for tablet b1c595b9a2b142c0a55eea08f3dac88a (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:47.588150 16311 tablet_service.cc:1511] Processing CreateTablet for tablet 79204942fd2e4ab598224496f72b5e7d (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:47.591619 16391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e3db183b3147e896382c0270fc7457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.578415 16315 tablet_service.cc:1511] Processing CreateTablet for tablet b1c595b9a2b142c0a55eea08f3dac88a (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:47.594091 16310 tablet_service.cc:1511] Processing CreateTablet for tablet 71c2dd8dd67f4346acf9cb4001de126d (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:47.590111 16387 tablet_service.cc:1511] Processing CreateTablet for tablet a2738f4ef9534ea288d6b48702306870 (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:47.590087 16386 tablet_service.cc:1511] Processing CreateTablet for tablet 79204942fd2e4ab598224496f72b5e7d (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:47.596304 16385 tablet_service.cc:1511] Processing CreateTablet for tablet 71c2dd8dd67f4346acf9cb4001de126d (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:47.600299 16387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2738f4ef9534ea288d6b48702306870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.601747 16390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c595b9a2b142c0a55eea08f3dac88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.605908 16392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2ba227ed424f80b3ffdc689e4375eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.603384 16312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2738f4ef9534ea288d6b48702306870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.608291 16385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c2dd8dd67f4346acf9cb4001de126d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.613517 16389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538ecd12f8514667b13bd8354cf2c1aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.616258 16317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2ba227ed424f80b3ffdc689e4375eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.618208 16314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538ecd12f8514667b13bd8354cf2c1aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.628049 16309 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc7c594ebfc4282a689f97000d6cbfa (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:47.629776 16386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79204942fd2e4ab598224496f72b5e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.630708 16310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c2dd8dd67f4346acf9cb4001de126d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.633482 16384 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc7c594ebfc4282a689f97000d6cbfa (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:47.669718 16384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc7c594ebfc4282a689f97000d6cbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.672787 16459 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc7c594ebfc4282a689f97000d6cbfa (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:47.689078 16311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79204942fd2e4ab598224496f72b5e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.691174 16315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c595b9a2b142c0a55eea08f3dac88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.689401 16459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc7c594ebfc4282a689f97000d6cbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.694533 16309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc7c594ebfc4282a689f97000d6cbfa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:47.697065 16271 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:47.698688 16313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e477a794c094947a219fbd1586bbd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.634259 16465 tablet_service.cc:1511] Processing CreateTablet for tablet 71c2dd8dd67f4346acf9cb4001de126d (DEFAULT_TABLE table=test-workload [id=40f9b26c70ce46e9bb2f76144bdd3485]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:47.705822 16465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c2dd8dd67f4346acf9cb4001de126d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:47.799474 16519 tablet_bootstrap.cc:492] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239: Bootstrap starting.
I20260709 13:16:47.853906 16520 tablet_bootstrap.cc:492] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf: Bootstrap starting.
I20260709 13:16:47.869019 16519 tablet_bootstrap.cc:654] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.906596 16521 tablet_bootstrap.cc:492] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350: Bootstrap starting.
I20260709 13:16:47.913666 16519 tablet_bootstrap.cc:492] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239: No bootstrap required, opened a new log
I20260709 13:16:47.914234 16519 ts_tablet_manager.cc:1403] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239: Time spent bootstrapping tablet: real 0.168s	user 0.013s	sys 0.014s
I20260709 13:16:47.916752 16520 tablet_bootstrap.cc:654] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.916985 16521 tablet_bootstrap.cc:654] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.917563 16519 raft_consensus.cc:359] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:47.918484 16519 raft_consensus.cc:385] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.918816 16519 raft_consensus.cc:740] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.919643 16519 consensus_queue.cc:260] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:47.928567 16501 heartbeater.cc:499] Master 127.15.208.62:35363 was elected leader, sending a full tablet report...
I20260709 13:16:47.929109 16521 tablet_bootstrap.cc:492] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350: No bootstrap required, opened a new log
I20260709 13:16:47.929141 16520 tablet_bootstrap.cc:492] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf: No bootstrap required, opened a new log
I20260709 13:16:47.929703 16519 ts_tablet_manager.cc:1434] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.010s
I20260709 13:16:47.929725 16520 ts_tablet_manager.cc:1403] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.007s
I20260709 13:16:47.929726 16521 ts_tablet_manager.cc:1403] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.010s
I20260709 13:16:47.930867 16519 tablet_bootstrap.cc:492] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239: Bootstrap starting.
I20260709 13:16:47.933336 16520 raft_consensus.cc:359] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:47.934106 16520 raft_consensus.cc:385] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.934420 16520 raft_consensus.cc:740] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.935199 16520 consensus_queue.cc:260] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:47.938068 16519 tablet_bootstrap.cc:654] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.944024 16427 heartbeater.cc:499] Master 127.15.208.62:35363 was elected leader, sending a full tablet report...
I20260709 13:16:47.945549 16520 ts_tablet_manager.cc:1434] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.002s
I20260709 13:16:47.946981 16520 tablet_bootstrap.cc:492] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf: Bootstrap starting.
I20260709 13:16:47.951112 16519 tablet_bootstrap.cc:492] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239: No bootstrap required, opened a new log
I20260709 13:16:47.951687 16519 ts_tablet_manager.cc:1403] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.002s
I20260709 13:16:47.954047 16520 tablet_bootstrap.cc:654] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.933121 16521 raft_consensus.cc:359] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:47.955343 16521 raft_consensus.cc:385] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.955262 16519 raft_consensus.cc:359] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:47.955833 16521 raft_consensus.cc:740] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.956132 16519 raft_consensus.cc:385] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.956640 16519 raft_consensus.cc:740] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.957662 16519 consensus_queue.cc:260] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:47.959213 16521 consensus_queue.cc:260] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:47.960754 16519 ts_tablet_manager.cc:1434] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:16:47.965119 16520 tablet_bootstrap.cc:492] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf: No bootstrap required, opened a new log
I20260709 13:16:47.965582 16520 ts_tablet_manager.cc:1403] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:16:47.966097 16519 tablet_bootstrap.cc:492] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239: Bootstrap starting.
I20260709 13:16:47.969082 16520 raft_consensus.cc:359] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:47.971179 16520 raft_consensus.cc:385] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.971491 16520 raft_consensus.cc:740] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.972227 16520 consensus_queue.cc:260] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:47.973583 16519 tablet_bootstrap.cc:654] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.974925 16520 ts_tablet_manager.cc:1434] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:47.975020 16525 raft_consensus.cc:493] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.975540 16525 raft_consensus.cc:515] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:47.976022 16520 tablet_bootstrap.cc:492] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf: Bootstrap starting.
I20260709 13:16:47.978732 16525 leader_election.cc:290] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155)
I20260709 13:16:47.983255 16520 tablet_bootstrap.cc:654] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.989993 16521 ts_tablet_manager.cc:1434] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.006s
I20260709 13:16:47.990974 16352 heartbeater.cc:499] Master 127.15.208.62:35363 was elected leader, sending a full tablet report...
I20260709 13:16:47.995388 16521 tablet_bootstrap.cc:492] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350: Bootstrap starting.
I20260709 13:16:48.005358 16521 tablet_bootstrap.cc:654] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.008297 16519 tablet_bootstrap.cc:492] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239: No bootstrap required, opened a new log
I20260709 13:16:48.008934 16519 ts_tablet_manager.cc:1403] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.006s
I20260709 13:16:48.012760 16519 raft_consensus.cc:359] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.013826 16519 raft_consensus.cc:385] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.014214 16519 raft_consensus.cc:740] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.015172 16519 consensus_queue.cc:260] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.018504 16519 ts_tablet_manager.cc:1434] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:16:48.019757 16519 tablet_bootstrap.cc:492] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239: Bootstrap starting.
I20260709 13:16:48.026918 16520 tablet_bootstrap.cc:492] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf: No bootstrap required, opened a new log
I20260709 13:16:48.027490 16520 ts_tablet_manager.cc:1403] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.010s
I20260709 13:16:48.028558 16519 tablet_bootstrap.cc:654] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.030889 16520 raft_consensus.cc:359] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:48.031740 16520 raft_consensus.cc:385] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.042860 16519 tablet_bootstrap.cc:492] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239: No bootstrap required, opened a new log
I20260709 13:16:48.043568 16519 ts_tablet_manager.cc:1403] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:16:48.045884 16526 raft_consensus.cc:493] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.032081 16520 raft_consensus.cc:740] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.046386 16526 raft_consensus.cc:515] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.046993 16519 raft_consensus.cc:359] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.047725 16519 raft_consensus.cc:385] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.047712 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
I20260709 13:16:48.048199 16519 raft_consensus.cc:740] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.048991 16519 consensus_queue.cc:260] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.049933 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" is_pre_election: true
I20260709 13:16:48.052387 16519 ts_tablet_manager.cc:1434] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:16:48.053602 16519 tablet_bootstrap.cc:492] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239: Bootstrap starting.
I20260709 13:16:48.048573 16520 consensus_queue.cc:260] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
W20260709 13:16:48.056638 16441 leader_election.cc:343] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.057446 16402 raft_consensus.cc:2468] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 0.
I20260709 13:16:48.059206 16526 leader_election.cc:290] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.059743 16526 raft_consensus.cc:493] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.060200 16526 raft_consensus.cc:515] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:48.065429 16526 leader_election.cc:290] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699), 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155)
I20260709 13:16:48.066258 16441 leader_election.cc:304] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.067454 16525 raft_consensus.cc:2804] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.068020 16525 raft_consensus.cc:493] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.068368 16525 raft_consensus.cc:3060] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:48.069512 16502 tablet.cc:2406] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:48.074841 16520 ts_tablet_manager.cc:1434] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.008s
I20260709 13:16:48.076017 16520 tablet_bootstrap.cc:492] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf: Bootstrap starting.
I20260709 13:16:48.084475 16519 tablet_bootstrap.cc:654] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.087854 16521 tablet_bootstrap.cc:492] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350: No bootstrap required, opened a new log
I20260709 13:16:48.088382 16521 ts_tablet_manager.cc:1403] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.032s
I20260709 13:16:48.088387 16525 raft_consensus.cc:515] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:48.097827 16521 raft_consensus.cc:359] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.100219 16521 raft_consensus.cc:385] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.100797 16521 raft_consensus.cc:740] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.102265 16521 consensus_queue.cc:260] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.103931 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
I20260709 13:16:48.106431 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
W20260709 13:16:48.108538 16367 leader_election.cc:343] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:48.110416 16367 leader_election.cc:343] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.110532 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:48.111166 16402 raft_consensus.cc:3060] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.111490 16521 ts_tablet_manager.cc:1434] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.005s
I20260709 13:16:48.114326 16521 tablet_bootstrap.cc:492] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350: Bootstrap starting.
I20260709 13:16:48.115837 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:48.114673 16525 leader_election.cc:290] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155)
W20260709 13:16:48.117482 16441 leader_election.cc:343] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.118158 16519 tablet_bootstrap.cc:492] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239: No bootstrap required, opened a new log
I20260709 13:16:48.118732 16519 ts_tablet_manager.cc:1403] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.008s
I20260709 13:16:48.120380 16520 tablet_bootstrap.cc:654] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.122251 16519 raft_consensus.cc:359] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.123080 16519 raft_consensus.cc:385] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.124128 16519 raft_consensus.cc:740] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.127509 16519 consensus_queue.cc:260] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.128367 16521 tablet_bootstrap.cc:654] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.128772 16402 raft_consensus.cc:2468] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 1.
I20260709 13:16:48.130169 16519 ts_tablet_manager.cc:1434] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:16:48.131220 16519 tablet_bootstrap.cc:492] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239: Bootstrap starting.
I20260709 13:16:48.135043 16520 tablet_bootstrap.cc:492] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf: No bootstrap required, opened a new log
I20260709 13:16:48.130143 16441 leader_election.cc:304] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.135696 16520 ts_tablet_manager.cc:1403] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.000s
I20260709 13:16:48.136221 16525 raft_consensus.cc:2804] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.141976 16520 raft_consensus.cc:359] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.142150 16476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239" is_pre_election: true
I20260709 13:16:48.142794 16520 raft_consensus.cc:385] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.143159 16520 raft_consensus.cc:740] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.143235 16476 raft_consensus.cc:2468] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 0.
I20260709 13:16:48.143959 16520 consensus_queue.cc:260] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.145226 16475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239" is_pre_election: true
I20260709 13:16:48.147153 16368 leader_election.cc:304] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.152427 16519 tablet_bootstrap.cc:654] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.157125 16520 ts_tablet_manager.cc:1434] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:16:48.158154 16520 tablet_bootstrap.cc:492] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf: Bootstrap starting.
I20260709 13:16:48.161944 16545 raft_consensus.cc:493] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.162535 16545 raft_consensus.cc:515] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.167374 16525 raft_consensus.cc:697] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Becoming Leader. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:48.168427 16540 raft_consensus.cc:2804] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.168860 16540 raft_consensus.cc:493] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.169224 16540 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.170113 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
I20260709 13:16:48.175004 16401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" is_pre_election: true
I20260709 13:16:48.176358 16540 raft_consensus.cc:515] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.178687 16540 leader_election.cc:290] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.179839 16476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:48.180130 16521 tablet_bootstrap.cc:492] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350: No bootstrap required, opened a new log
I20260709 13:16:48.179634 16525 consensus_queue.cc:237] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:48.180481 16476 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.180598 16521 ts_tablet_manager.cc:1403] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350: Time spent bootstrapping tablet: real 0.066s	user 0.041s	sys 0.015s
I20260709 13:16:48.184307 16521 raft_consensus.cc:359] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.185070 16521 raft_consensus.cc:385] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.185379 16521 raft_consensus.cc:740] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.185879 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:48.186095 16521 consensus_queue.cc:260] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.187278 16545 leader_election.cc:290] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
W20260709 13:16:48.188678 16367 leader_election.cc:343] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:48.179859 16441 leader_election.cc:343] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:48.190943 16441 leader_election.cc:343] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.191403 16441 leader_election.cc:304] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239; no voters: 25c58b683c064d6797b8b0ea6defb350, 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:48.195376 16521 ts_tablet_manager.cc:1434] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:16:48.195536 16476 raft_consensus.cc:2468] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 1.
I20260709 13:16:48.196182 16519 tablet_bootstrap.cc:492] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239: No bootstrap required, opened a new log
I20260709 13:16:48.196655 16519 ts_tablet_manager.cc:1403] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.002s
I20260709 13:16:48.196743 16368 leader_election.cc:304] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.197599 16540 raft_consensus.cc:2804] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.197904 16545 raft_consensus.cc:2749] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.198264 16540 raft_consensus.cc:697] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:48.199107 16540 consensus_queue.cc:237] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.202890 16521 tablet_bootstrap.cc:492] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350: Bootstrap starting.
I20260709 13:16:48.205041 16520 tablet_bootstrap.cc:654] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.207540 16368 leader_election.cc:304] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.208412 16526 raft_consensus.cc:2749] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.210297 16521 tablet_bootstrap.cc:654] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.211284 16519 raft_consensus.cc:359] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.212038 16519 raft_consensus.cc:385] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.214612 16224 catalog_manager.cc:5697] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "2180d2c18b174d2481ff75b5b2d27239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.212349 16519 raft_consensus.cc:740] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.216506 16525 raft_consensus.cc:493] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.217027 16525 raft_consensus.cc:515] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.220578 16525 leader_election.cc:290] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:48.221347 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7c594ebfc4282a689f97000d6cbfa" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
I20260709 13:16:48.218281 16519 consensus_queue.cc:260] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.224912 16520 tablet_bootstrap.cc:492] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf: No bootstrap required, opened a new log
I20260709 13:16:48.225476 16520 ts_tablet_manager.cc:1403] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.003s
I20260709 13:16:48.225948 16519 ts_tablet_manager.cc:1434] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:16:48.222470 16326 raft_consensus.cc:2468] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 0.
I20260709 13:16:48.225088 16222 catalog_manager.cc:5697] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 1 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.227481 16441 leader_election.cc:304] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:48.227715 16519 tablet_bootstrap.cc:492] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239: Bootstrap starting.
I20260709 13:16:48.222072 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7c594ebfc4282a689f97000d6cbfa" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" is_pre_election: true
I20260709 13:16:48.228363 16525 raft_consensus.cc:2804] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.228952 16402 raft_consensus.cc:2468] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 0.
I20260709 13:16:48.229140 16525 raft_consensus.cc:493] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.230049 16525 raft_consensus.cc:3060] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.233089 16520 raft_consensus.cc:359] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.234301 16520 raft_consensus.cc:385] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.236475 16519 tablet_bootstrap.cc:654] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.240981 16520 raft_consensus.cc:740] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.242038 16520 consensus_queue.cc:260] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.243209 16525 raft_consensus.cc:515] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.245019 16520 ts_tablet_manager.cc:1434] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.003s
I20260709 13:16:48.248131 16520 tablet_bootstrap.cc:492] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf: Bootstrap starting.
I20260709 13:16:48.249711 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7c594ebfc4282a689f97000d6cbfa" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:48.250298 16326 raft_consensus.cc:3060] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.252442 16525 leader_election.cc:290] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:48.255204 16521 tablet_bootstrap.cc:492] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350: No bootstrap required, opened a new log
I20260709 13:16:48.256400 16521 ts_tablet_manager.cc:1403] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.004s
I20260709 13:16:48.256565 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc7c594ebfc4282a689f97000d6cbfa" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:48.257625 16402 raft_consensus.cc:3060] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.266387 16326 raft_consensus.cc:2468] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 1.
I20260709 13:16:48.270210 16441 leader_election.cc:304] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:48.269922 16402 raft_consensus.cc:2468] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 1.
I20260709 13:16:48.271263 16525 raft_consensus.cc:2804] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.273732 16525 raft_consensus.cc:697] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Becoming Leader. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:48.274538 16525 consensus_queue.cc:237] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.277572 16520 tablet_bootstrap.cc:654] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.280958 16519 tablet_bootstrap.cc:492] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239: No bootstrap required, opened a new log
I20260709 13:16:48.282202 16519 ts_tablet_manager.cc:1403] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.008s
I20260709 13:16:48.276583 16521 raft_consensus.cc:359] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:48.285893 16521 raft_consensus.cc:385] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.286322 16521 raft_consensus.cc:740] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.287106 16521 consensus_queue.cc:260] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:48.289759 16521 ts_tablet_manager.cc:1434] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:16:48.291085 16521 tablet_bootstrap.cc:492] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350: Bootstrap starting.
I20260709 13:16:48.298622 16529 raft_consensus.cc:493] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.299252 16529 raft_consensus.cc:515] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.304908 16529 leader_election.cc:290] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.306800 16519 raft_consensus.cc:359] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.308876 16519 raft_consensus.cc:385] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.309182 16519 raft_consensus.cc:740] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.310088 16519 consensus_queue.cc:260] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.334256 16224 catalog_manager.cc:5697] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "2180d2c18b174d2481ff75b5b2d27239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.335361 16519 ts_tablet_manager.cc:1434] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:16:48.336758 16519 tablet_bootstrap.cc:492] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239: Bootstrap starting.
I20260709 13:16:48.343147 16521 tablet_bootstrap.cc:654] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.347406 16525 raft_consensus.cc:493] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.347959 16525 raft_consensus.cc:515] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.344614 16519 tablet_bootstrap.cc:654] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.350194 16525 leader_election.cc:290] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:48.350872 16520 tablet_bootstrap.cc:492] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf: No bootstrap required, opened a new log
I20260709 13:16:48.351459 16520 ts_tablet_manager.cc:1403] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent bootstrapping tablet: real 0.104s	user 0.018s	sys 0.006s
I20260709 13:16:48.352595 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e477a794c094947a219fbd1586bbd2b" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" is_pre_election: true
I20260709 13:16:48.354794 16402 raft_consensus.cc:2468] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 0.
I20260709 13:16:48.357091 16441 leader_election.cc:304] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:48.357904 16525 raft_consensus.cc:2804] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.358366 16525 raft_consensus.cc:493] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.358774 16525 raft_consensus.cc:3060] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.364800 16519 tablet_bootstrap.cc:492] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239: No bootstrap required, opened a new log
I20260709 13:16:48.365304 16519 ts_tablet_manager.cc:1403] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.005s
I20260709 13:16:48.366482 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" is_pre_election: true
I20260709 13:16:48.369709 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e477a794c094947a219fbd1586bbd2b" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
I20260709 13:16:48.370343 16326 raft_consensus.cc:2468] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 0.
I20260709 13:16:48.368723 16519 raft_consensus.cc:359] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
W20260709 13:16:48.370646 16292 leader_election.cc:343] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.371120 16519 raft_consensus.cc:385] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.371421 16519 raft_consensus.cc:740] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.372715 16475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239" is_pre_election: true
I20260709 13:16:48.373759 16519 consensus_queue.cc:260] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.374650 16475 raft_consensus.cc:2468] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 0.
I20260709 13:16:48.374351 16520 raft_consensus.cc:359] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.375316 16520 raft_consensus.cc:385] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.375694 16520 raft_consensus.cc:740] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.376655 16293 leader_election.cc:304] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:48.377699 16525 raft_consensus.cc:515] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.378563 16529 raft_consensus.cc:2804] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.378908 16529 raft_consensus.cc:493] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.379221 16529 raft_consensus.cc:3060] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.379734 16525 leader_election.cc:290] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:48.376551 16520 consensus_queue.cc:260] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.380767 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e477a794c094947a219fbd1586bbd2b" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:48.381450 16402 raft_consensus.cc:3060] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.382925 16520 ts_tablet_manager.cc:1434] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.003s
I20260709 13:16:48.383915 16520 tablet_bootstrap.cc:492] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf: Bootstrap starting.
I20260709 13:16:48.386315 16529 raft_consensus.cc:515] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.387969 16402 raft_consensus.cc:2468] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 1.
I20260709 13:16:48.388533 16529 leader_election.cc:290] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.389241 16441 leader_election.cc:304] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:48.389334 16401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:48.390450 16519 ts_tablet_manager.cc:1434] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.004s
W20260709 13:16:48.390740 16292 leader_election.cc:343] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.391351 16519 tablet_bootstrap.cc:492] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239: Bootstrap starting.
I20260709 13:16:48.391314 16475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:48.391997 16475 raft_consensus.cc:3060] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.395290 16525 raft_consensus.cc:2804] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.395818 16525 raft_consensus.cc:697] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Becoming Leader. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:48.396647 16525 consensus_queue.cc:237] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.397904 16519 tablet_bootstrap.cc:654] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.403770 16521 tablet_bootstrap.cc:492] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350: No bootstrap required, opened a new log
I20260709 13:16:48.400509 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e477a794c094947a219fbd1586bbd2b" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:48.405937 16520 tablet_bootstrap.cc:654] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.406020 16521 ts_tablet_manager.cc:1403] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350: Time spent bootstrapping tablet: real 0.115s	user 0.022s	sys 0.005s
I20260709 13:16:48.406095 16326 raft_consensus.cc:3060] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.409497 16521 raft_consensus.cc:359] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.410593 16521 raft_consensus.cc:385] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.410966 16521 raft_consensus.cc:740] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.412058 16521 consensus_queue.cc:260] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.413425 16326 raft_consensus.cc:2468] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 1.
I20260709 13:16:48.414997 16521 ts_tablet_manager.cc:1434] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:48.400031 16475 raft_consensus.cc:2468] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 1.
I20260709 13:16:48.416066 16521 tablet_bootstrap.cc:492] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350: Bootstrap starting.
I20260709 13:16:48.416498 16293 leader_election.cc:304] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:48.417392 16529 raft_consensus.cc:2804] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.419377 16520 tablet_bootstrap.cc:492] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf: No bootstrap required, opened a new log
I20260709 13:16:48.419828 16520 ts_tablet_manager.cc:1403] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.005s
I20260709 13:16:48.420782 16545 raft_consensus.cc:493] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.426638 16545 raft_consensus.cc:515] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.429168 16520 raft_consensus.cc:359] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.430059 16520 raft_consensus.cc:385] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.428701 16545 leader_election.cc:290] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:48.430385 16520 raft_consensus.cc:740] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.430390 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
I20260709 13:16:48.431201 16326 raft_consensus.cc:2468] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 0.
I20260709 13:16:48.431254 16520 consensus_queue.cc:260] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.430389 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" is_pre_election: true
I20260709 13:16:48.433768 16520 ts_tablet_manager.cc:1434] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:48.433887 16441 leader_election.cc:304] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:48.434804 16545 raft_consensus.cc:2804] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.434859 16402 raft_consensus.cc:2468] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 0.
I20260709 13:16:48.434983 16520 tablet_bootstrap.cc:492] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf: Bootstrap starting.
I20260709 13:16:48.435487 16545 raft_consensus.cc:493] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.435923 16545 raft_consensus.cc:3060] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.429153 16222 catalog_manager.cc:5697] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "2180d2c18b174d2481ff75b5b2d27239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.442970 16545 raft_consensus.cc:515] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.445729 16520 tablet_bootstrap.cc:654] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.451069 16519 tablet_bootstrap.cc:492] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239: No bootstrap required, opened a new log
I20260709 13:16:48.451514 16519 ts_tablet_manager.cc:1403] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.007s
I20260709 13:16:48.451696 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:48.452262 16326 raft_consensus.cc:3060] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.455113 16519 raft_consensus.cc:359] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.456046 16519 raft_consensus.cc:385] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.456386 16519 raft_consensus.cc:740] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.457314 16519 consensus_queue.cc:260] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.459587 16519 ts_tablet_manager.cc:1434] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:48.459705 16326 raft_consensus.cc:2468] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 1.
I20260709 13:16:48.461759 16529 raft_consensus.cc:697] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 1 LEADER]: Becoming Leader. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:48.462612 16520 tablet_bootstrap.cc:492] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf: No bootstrap required, opened a new log
I20260709 13:16:48.463166 16520 ts_tablet_manager.cc:1403] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.009s
I20260709 13:16:48.462586 16529 consensus_queue.cc:237] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.465757 16520 raft_consensus.cc:359] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.466605 16520 raft_consensus.cc:385] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.466957 16520 raft_consensus.cc:740] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.467774 16520 consensus_queue.cc:260] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.469128 16441 leader_election.cc:304] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:48.469990 16525 raft_consensus.cc:2804] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.470472 16525 raft_consensus.cc:697] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Becoming Leader. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:48.471596 16545 leader_election.cc:290] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:48.471261 16525 consensus_queue.cc:237] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.473491 16521 tablet_bootstrap.cc:654] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.475839 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:48.476493 16402 raft_consensus.cc:3060] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.478135 16520 ts_tablet_manager.cc:1434] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:16:48.479074 16520 tablet_bootstrap.cc:492] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf: Bootstrap starting.
I20260709 13:16:48.484927 16520 tablet_bootstrap.cc:654] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.486986 16521 tablet_bootstrap.cc:492] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350: No bootstrap required, opened a new log
I20260709 13:16:48.487557 16521 ts_tablet_manager.cc:1403] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.000s
I20260709 13:16:48.490841 16521 raft_consensus.cc:359] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.491667 16521 raft_consensus.cc:385] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.492002 16521 raft_consensus.cc:740] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.492900 16521 consensus_queue.cc:260] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.495162 16521 ts_tablet_manager.cc:1434] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:48.496155 16521 tablet_bootstrap.cc:492] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350: Bootstrap starting.
I20260709 13:16:48.502916 16402 raft_consensus.cc:2468] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 1.
I20260709 13:16:48.503489 16224 catalog_manager.cc:5697] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "2180d2c18b174d2481ff75b5b2d27239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.508169 16521 tablet_bootstrap.cc:654] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.508504 16520 tablet_bootstrap.cc:492] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf: No bootstrap required, opened a new log
I20260709 13:16:48.508977 16520 ts_tablet_manager.cc:1403] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent bootstrapping tablet: real 0.030s	user 0.026s	sys 0.003s
I20260709 13:16:48.511510 16520 raft_consensus.cc:359] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.512159 16520 raft_consensus.cc:385] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.512533 16520 raft_consensus.cc:740] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.513170 16520 consensus_queue.cc:260] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.515143 16520 ts_tablet_manager.cc:1434] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:48.521183 16222 catalog_manager.cc:5697] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "25c58b683c064d6797b8b0ea6defb350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.522768 16540 raft_consensus.cc:493] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.523277 16521 tablet_bootstrap.cc:492] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350: No bootstrap required, opened a new log
I20260709 13:16:48.523211 16540 raft_consensus.cc:515] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.523801 16521 ts_tablet_manager.cc:1403] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 13:16:48.525424 16540 leader_election.cc:290] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.526985 16475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239" is_pre_election: true
I20260709 13:16:48.527655 16475 raft_consensus.cc:2468] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 0.
I20260709 13:16:48.528661 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
I20260709 13:16:48.530141 16368 leader_election.cc:304] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:48.530889 16540 raft_consensus.cc:2804] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.531247 16540 raft_consensus.cc:493] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.531572 16540 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:48.532004 16367 leader_election.cc:343] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.530557 16521 raft_consensus.cc:359] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.535176 16521 raft_consensus.cc:385] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.535470 16521 raft_consensus.cc:740] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.536213 16521 consensus_queue.cc:260] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.538180 16540 raft_consensus.cc:515] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.538712 16521 ts_tablet_manager.cc:1434] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:16:48.539741 16521 tablet_bootstrap.cc:492] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350: Bootstrap starting.
I20260709 13:16:48.540174 16540 leader_election.cc:290] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.542627 16475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:48.543187 16475 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.545240 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
W20260709 13:16:48.546461 16367 leader_election.cc:343] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.548056 16521 tablet_bootstrap.cc:654] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.551596 16475 raft_consensus.cc:2468] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 1.
I20260709 13:16:48.552925 16521 tablet_bootstrap.cc:492] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350: No bootstrap required, opened a new log
I20260709 13:16:48.552834 16368 leader_election.cc:304] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.553894 16521 ts_tablet_manager.cc:1403] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 13:16:48.553805 16540 raft_consensus.cc:2804] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.554425 16540 raft_consensus.cc:697] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:48.555430 16540 consensus_queue.cc:237] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.556746 16521 raft_consensus.cc:359] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.557443 16521 raft_consensus.cc:385] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.557720 16521 raft_consensus.cc:740] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.558393 16521 consensus_queue.cc:260] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.560482 16521 ts_tablet_manager.cc:1434] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:48.566346 16521 tablet_bootstrap.cc:492] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350: Bootstrap starting.
I20260709 13:16:48.567387 16222 catalog_manager.cc:5697] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 1 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.570286 16540 raft_consensus.cc:493] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.570740 16540 raft_consensus.cc:515] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.572090 16521 tablet_bootstrap.cc:654] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.573695 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
I20260709 13:16:48.574323 16326 raft_consensus.cc:2468] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 0.
I20260709 13:16:48.575486 16367 leader_election.cc:304] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25c58b683c064d6797b8b0ea6defb350, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:48.576476 16526 raft_consensus.cc:2804] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.576886 16526 raft_consensus.cc:493] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.577198 16526 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.581983 16525 raft_consensus.cc:493] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.582463 16525 raft_consensus.cc:515] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.584450 16525 leader_election.cc:290] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:48.586246 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
W20260709 13:16:48.588917 16441 leader_election.cc:343] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.590657 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" is_pre_election: true
I20260709 13:16:48.591313 16402 raft_consensus.cc:2468] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 0.
I20260709 13:16:48.592674 16475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239" is_pre_election: true
I20260709 13:16:48.593297 16475 raft_consensus.cc:2468] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 0.
I20260709 13:16:48.595599 16441 leader_election.cc:304] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.596673 16525 raft_consensus.cc:2804] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.597025 16529 raft_consensus.cc:493] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.597056 16525 raft_consensus.cc:493] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.597652 16529 raft_consensus.cc:515] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:48.599187 16521 tablet_bootstrap.cc:492] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350: No bootstrap required, opened a new log
I20260709 13:16:48.599653 16521 ts_tablet_manager.cc:1403] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.025s
I20260709 13:16:48.599810 16529 leader_election.cc:290] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:48.597651 16525 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.601055 16475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239" is_pre_election: true
I20260709 13:16:48.601037 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" is_pre_election: true
I20260709 13:16:48.602908 16521 raft_consensus.cc:359] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.603178 16402 raft_consensus.cc:2393] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25c58b683c064d6797b8b0ea6defb350 in current term 1: Already voted for candidate 2180d2c18b174d2481ff75b5b2d27239 in this term.
I20260709 13:16:48.603850 16521 raft_consensus.cc:385] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.604136 16521 raft_consensus.cc:740] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.604331 16292 leader_election.cc:304] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25c58b683c064d6797b8b0ea6defb350; no voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:48.604804 16521 consensus_queue.cc:260] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.605191 16529 raft_consensus.cc:3060] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.606864 16521 ts_tablet_manager.cc:1434] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:48.612059 16540 leader_election.cc:290] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.612673 16529 raft_consensus.cc:2749] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.588768 16526 raft_consensus.cc:515] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.614876 16525 raft_consensus.cc:515] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.617120 16526 leader_election.cc:290] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.618253 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:48.618829 16326 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.618999 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:48.619439 16475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:48.619570 16327 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.620014 16475 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.626291 16327 raft_consensus.cc:2468] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 1.
I20260709 13:16:48.626279 16475 raft_consensus.cc:2468] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 1.
I20260709 13:16:48.627527 16441 leader_election.cc:304] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:48.627950 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:48.628515 16402 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.628428 16368 leader_election.cc:304] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:48.629258 16526 raft_consensus.cc:2804] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.629505 16544 raft_consensus.cc:2804] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.630066 16544 raft_consensus.cc:697] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Becoming Leader. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:48.626266 16326 raft_consensus.cc:2468] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 1.
I20260709 13:16:48.630921 16544 consensus_queue.cc:237] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.626857 16525 leader_election.cc:290] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 1 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:48.630054 16526 raft_consensus.cc:697] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:48.633852 16526 consensus_queue.cc:237] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.636819 16402 raft_consensus.cc:2468] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 1.
I20260709 13:16:48.642575 16525 consensus_queue.cc:1048] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.656313 16222 catalog_manager.cc:5697] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "2180d2c18b174d2481ff75b5b2d27239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.661389 16326 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.674321 16544 consensus_queue.cc:1048] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.676613 16526 consensus_queue.cc:1048] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.680171 16223 catalog_manager.cc:5697] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 1 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.710949 16540 consensus_queue.cc:1048] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.732772 16525 consensus_queue.cc:1048] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.737655 16526 raft_consensus.cc:493] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.738425 16526 raft_consensus.cc:515] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.741436 16526 leader_election.cc:290] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.745406 16476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239" is_pre_election: true
I20260709 13:16:48.746050 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25c58b683c064d6797b8b0ea6defb350" is_pre_election: true
I20260709 13:16:48.746446 16476 raft_consensus.cc:2393] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in current term 1: Already voted for candidate 25c58b683c064d6797b8b0ea6defb350 in this term.
I20260709 13:16:48.747910 16368 leader_election.cc:304] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.748735 16526 raft_consensus.cc:3060] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.759732 16526 raft_consensus.cc:2749] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.774468 16545 consensus_queue.cc:1048] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.794881 16529 raft_consensus.cc:493] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.795434 16529 raft_consensus.cc:515] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.797485 16475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb"
dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
mode: GRACEFUL
new_leader_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:37334
I20260709 13:16:48.797668 16529 leader_election.cc:290] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.798280 16475 raft_consensus.cc:606] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Received request to transfer leadership to TS 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.798869 16476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2180d2c18b174d2481ff75b5b2d27239" is_pre_election: true
I20260709 13:16:48.799640 16476 raft_consensus.cc:2393] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25c58b683c064d6797b8b0ea6defb350 in current term 1: Already voted for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in this term.
I20260709 13:16:48.803279 16402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" is_pre_election: true
I20260709 13:16:48.804867 16292 leader_election.cc:304] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25c58b683c064d6797b8b0ea6defb350; no voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:48.806185 16529 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.812810 16529 raft_consensus.cc:2749] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.819684 16402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
mode: GRACEFUL
new_leader_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:39912
I20260709 13:16:48.820399 16402 raft_consensus.cc:606] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Received request to transfer leadership to TS 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.826646 16476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a"
dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
mode: GRACEFUL
new_leader_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:37334
I20260709 13:16:48.827252 16476 raft_consensus.cc:606] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Received request to transfer leadership to TS 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.833473 16402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
mode: GRACEFUL
new_leader_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:39912
I20260709 13:16:48.834147 16402 raft_consensus.cc:606] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Received request to transfer leadership to TS 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.840153 16476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e477a794c094947a219fbd1586bbd2b"
dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
mode: GRACEFUL
new_leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:37334
I20260709 13:16:48.840770 16476 raft_consensus.cc:606] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Received request to transfer leadership to TS 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:48.846729 16476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870"
dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
mode: GRACEFUL
new_leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:37334
I20260709 13:16:48.847301 16476 raft_consensus.cc:606] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Received request to transfer leadership to TS 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:48.863055 16326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
mode: GRACEFUL
new_leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:40834
I20260709 13:16:48.863782 16326 raft_consensus.cc:606] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 1 LEADER]: Received request to transfer leadership to TS 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:48.864820 16545 consensus_queue.cc:1048] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.874253 16525 raft_consensus.cc:993] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239: : Instructing follower 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:48.874735 16525 raft_consensus.cc:1081] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Signalling peer 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:48.877794 16401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e477a794c094947a219fbd1586bbd2b"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:39894
I20260709 13:16:48.878428 16401 raft_consensus.cc:493] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.878782 16401 raft_consensus.cc:3060] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.880501 16544 consensus_queue.cc:1048] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.887384 16401 raft_consensus.cc:515] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.890511 16402 raft_consensus.cc:1240] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Rejecting Update request from peer 2180d2c18b174d2481ff75b5b2d27239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:48.891886 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e477a794c094947a219fbd1586bbd2b" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:48.894732 16544 consensus_queue.cc:1059] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.897444 16476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e477a794c094947a219fbd1586bbd2b" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:48.896777 16544 raft_consensus.cc:3055] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:48.898476 16544 raft_consensus.cc:740] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:48.899317 16544 consensus_queue.cc:260] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.900527 16544 raft_consensus.cc:3060] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.904935 16401 leader_election.cc:290] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 2 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:48.912304 16476 raft_consensus.cc:2468] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 2.
I20260709 13:16:48.914053 16368 leader_election.cc:304] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:48.914789 16526 raft_consensus.cc:2804] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:48.915302 16526 raft_consensus.cc:697] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:48.916085 16526 consensus_queue.cc:237] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:48.924820 16223 catalog_manager.cc:5697] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 1 to 2, leader changed from 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3) to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 2 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.964533 16526 consensus_queue.cc:1048] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.972424 16540 raft_consensus.cc:993] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf: : Instructing follower 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:48.975605 16529 consensus_queue.cc:1048] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.977905 16591 raft_consensus.cc:1081] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Signalling peer 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:48.983151 16326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:40822
I20260709 13:16:48.983803 16326 raft_consensus.cc:493] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.984179 16326 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.985028 16526 consensus_queue.cc:1048] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.025254 16544 consensus_queue.cc:1048] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.026954 16596 consensus_queue.cc:1048] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.042630 16544 consensus_queue.cc:1048] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.044951 16326 raft_consensus.cc:515] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.062139 16544 raft_consensus.cc:993] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239: : Instructing follower 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:49.063105 16525 raft_consensus.cc:1081] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Signalling peer 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:49.063936 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:49.064560 16400 raft_consensus.cc:3055] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.064881 16400 raft_consensus.cc:740] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:49.067798 16400 consensus_queue.cc:260] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.068902 16400 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.060653 16564 raft_consensus.cc:993] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350: : Instructing follower 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:49.073140 16564 raft_consensus.cc:1081] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 1 LEADER]: Signalling peer 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:49.075053 16402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:39904
I20260709 13:16:49.075628 16402 raft_consensus.cc:493] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.076006 16402 raft_consensus.cc:3060] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.082762 16402 raft_consensus.cc:515] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.085676 16401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:39894
I20260709 13:16:49.085943 16474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:49.086339 16401 raft_consensus.cc:493] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.086529 16474 raft_consensus.cc:3060] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.086972 16401 raft_consensus.cc:3060] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.093786 16474 raft_consensus.cc:2468] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 2.
I20260709 13:16:49.095010 16368 leader_election.cc:304] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:49.096367 16326 leader_election.cc:290] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 2 election: Requested vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:49.096607 16540 raft_consensus.cc:2804] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.097103 16540 raft_consensus.cc:697] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:49.097890 16540 consensus_queue.cc:237] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.098732 16402 leader_election.cc:290] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 2 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
W20260709 13:16:49.099068 16293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:40699, user_credentials={real_user=slave}} blocked reactor thread for 91435.7us
I20260709 13:16:49.100705 16474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:49.101275 16474 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.103729 16525 consensus_queue.cc:1048] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.104185 16544 consensus_queue.cc:1048] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.106076 16401 raft_consensus.cc:515] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.112097 16326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:49.112679 16326 raft_consensus.cc:3055] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.113022 16326 raft_consensus.cc:740] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:49.113711 16474 raft_consensus.cc:2468] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 2.
I20260709 13:16:49.114338 16540 consensus_queue.cc:1048] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.115168 16475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:49.116407 16475 raft_consensus.cc:3055] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.116745 16475 raft_consensus.cc:740] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:49.117565 16475 consensus_queue.cc:260] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.118079 16401 leader_election.cc:290] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 2 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:49.118500 16475 raft_consensus.cc:3060] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.118923 16224 catalog_manager.cc:5697] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 1 to 2, leader changed from 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1) to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 2 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.115744 16400 raft_consensus.cc:2468] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 2.
I20260709 13:16:49.122084 16292 leader_election.cc:304] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25c58b683c064d6797b8b0ea6defb350, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:49.122257 16325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:49.123126 16326 consensus_queue.cc:260] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.124336 16326 raft_consensus.cc:3060] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.126323 16529 raft_consensus.cc:2804] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.126792 16529 raft_consensus.cc:697] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Becoming Leader. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:49.127564 16529 consensus_queue.cc:237] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.136250 16326 raft_consensus.cc:2468] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 2.
I20260709 13:16:49.142978 16475 raft_consensus.cc:2468] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 2.
I20260709 13:16:49.144168 16368 leader_election.cc:304] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:49.144985 16540 raft_consensus.cc:2804] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.145478 16540 raft_consensus.cc:697] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:49.146431 16593 raft_consensus.cc:993] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf: : Instructing follower 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:49.146291 16540 consensus_queue.cc:237] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.146878 16593 raft_consensus.cc:1081] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Signalling peer 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:49.148782 16327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:40822
I20260709 13:16:49.149480 16327 raft_consensus.cc:493] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.151315 16327 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.155470 16224 catalog_manager.cc:5697] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 1 to 2, leader changed from 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3) to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 2 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.158281 16327 raft_consensus.cc:515] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.161489 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:49.162259 16400 raft_consensus.cc:3055] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.162614 16400 raft_consensus.cc:740] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:49.162979 16475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:49.163483 16400 consensus_queue.cc:260] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.164253 16475 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.166797 16544 raft_consensus.cc:993] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239: : Instructing follower 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:49.164568 16400 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.167239 16544 raft_consensus.cc:1081] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Signalling peer 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:49.170379 16323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:40820
I20260709 13:16:49.170950 16323 raft_consensus.cc:493] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.171277 16323 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.173972 16400 raft_consensus.cc:2468] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 2.
I20260709 13:16:49.175233 16292 leader_election.cc:304] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25c58b683c064d6797b8b0ea6defb350, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:49.176093 16529 raft_consensus.cc:2804] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.176556 16529 raft_consensus.cc:697] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Becoming Leader. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:49.177736 16529 consensus_queue.cc:237] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.177619 16223 catalog_manager.cc:5697] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 reported cstate change: term changed from 1 to 2, leader changed from 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2) to 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "25c58b683c064d6797b8b0ea6defb350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.179013 16323 raft_consensus.cc:515] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.181120 16323 leader_election.cc:290] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 2 election: Requested vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:49.183375 16327 leader_election.cc:290] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 2 election: Requested vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:49.185118 16591 consensus_queue.cc:1048] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.190771 16476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:49.191581 16476 raft_consensus.cc:3055] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.191987 16476 raft_consensus.cc:740] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:49.193094 16476 consensus_queue.cc:260] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.194387 16476 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.198648 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:49.199245 16400 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.200356 16224 catalog_manager.cc:5697] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 reported cstate change: term changed from 1 to 2, leader changed from 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2) to 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "25c58b683c064d6797b8b0ea6defb350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.203260 16544 raft_consensus.cc:993] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239: : Instructing follower 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:49.203720 16544 raft_consensus.cc:1081] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Signalling peer 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:49.205783 16324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:40820
I20260709 13:16:49.206384 16324 raft_consensus.cc:493] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.206727 16324 raft_consensus.cc:3060] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.213924 16324 raft_consensus.cc:515] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:49.220259 16476 raft_consensus.cc:2468] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 2.
I20260709 13:16:49.205807 16400 raft_consensus.cc:2468] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 2.
I20260709 13:16:49.221725 16293 leader_election.cc:304] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:49.222229 16475 raft_consensus.cc:2468] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 2.
I20260709 13:16:49.222924 16529 raft_consensus.cc:2804] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.223534 16529 raft_consensus.cc:697] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Becoming Leader. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:49.223875 16324 leader_election.cc:290] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 2 election: Requested vote from peers 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:49.224352 16529 consensus_queue.cc:237] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:49.225457 16476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:49.226102 16476 raft_consensus.cc:3055] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.226441 16476 raft_consensus.cc:740] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:49.227347 16476 consensus_queue.cc:260] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:49.229372 16476 raft_consensus.cc:3060] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.233206 16224 catalog_manager.cc:5697] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 reported cstate change: term changed from 1 to 2, leader changed from 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3) to 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "25c58b683c064d6797b8b0ea6defb350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.234754 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:49.235306 16400 raft_consensus.cc:3060] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.241575 16400 raft_consensus.cc:2468] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 2.
I20260709 13:16:49.242838 16292 leader_election.cc:304] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25c58b683c064d6797b8b0ea6defb350, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:49.243805 16529 raft_consensus.cc:2804] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:49.244189 16476 raft_consensus.cc:2468] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 2.
I20260709 13:16:49.244302 16529 raft_consensus.cc:697] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Becoming Leader. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:49.245203 16529 consensus_queue.cc:237] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:49.252020 16224 catalog_manager.cc:5697] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 reported cstate change: term changed from 1 to 2, leader changed from 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3) to 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "25c58b683c064d6797b8b0ea6defb350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.341374 16324 raft_consensus.cc:3060] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.348361 16324 raft_consensus.cc:1275] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.349925 16526 consensus_queue.cc:1048] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.361877 16476 raft_consensus.cc:1275] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.363497 16526 consensus_queue.cc:1048] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.599674 16474 raft_consensus.cc:1275] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.600975 16526 consensus_queue.cc:1048] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.610001 16324 raft_consensus.cc:3060] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.616397 16324 raft_consensus.cc:1275] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.617755 16591 consensus_queue.cc:1048] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.628629 16474 raft_consensus.cc:1275] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.630038 16591 consensus_queue.cc:1048] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.633612 16476 raft_consensus.cc:1275] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.635537 16529 consensus_queue.cc:1048] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.641428 16324 raft_consensus.cc:1275] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.645634 16593 consensus_queue.cc:1048] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.652761 16400 raft_consensus.cc:1275] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.654381 16605 consensus_queue.cc:1048] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.666312 16400 raft_consensus.cc:1275] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.672058 16605 consensus_queue.cc:1048] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:49.685794 16474 raft_consensus.cc:1275] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.687572 16529 consensus_queue.cc:1048] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.691844 16476 raft_consensus.cc:1275] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.693426 16605 consensus_queue.cc:1048] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.705288 16400 raft_consensus.cc:1275] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.706952 16595 consensus_queue.cc:1048] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.715502 16400 raft_consensus.cc:1275] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.717314 16595 consensus_queue.cc:1048] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:49.724785 16476 raft_consensus.cc:1275] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.727211 16607 consensus_queue.cc:1048] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:51.904083 16192 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:16:51.904992 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:51.920212 16400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
mode: GRACEFUL
new_leader_uuid: "2180d2c18b174d2481ff75b5b2d27239"
 from {username='slave'} at 127.0.0.1:39914
I20260709 13:16:51.920676 16400 raft_consensus.cc:606] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Received request to transfer leadership to TS 2180d2c18b174d2481ff75b5b2d27239
I20260709 13:16:51.931799 16327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
mode: GRACEFUL
new_leader_uuid: "2180d2c18b174d2481ff75b5b2d27239"
 from {username='slave'} at 127.0.0.1:40850
I20260709 13:16:51.932396 16327 raft_consensus.cc:606] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Received request to transfer leadership to TS 2180d2c18b174d2481ff75b5b2d27239
I20260709 13:16:51.933768 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:51.934319 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:52.320412 16614 raft_consensus.cc:993] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350: : Instructing follower 2180d2c18b174d2481ff75b5b2d27239 to start an election
I20260709 13:16:52.320983 16614 raft_consensus.cc:1081] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Signalling peer 2180d2c18b174d2481ff75b5b2d27239 to start an election
I20260709 13:16:52.322501 16476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457"
dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
 from {username='slave'} at 127.0.0.1:37328
I20260709 13:16:52.323079 16476 raft_consensus.cc:493] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.323472 16476 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.328110 16476 raft_consensus.cc:515] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:52.329757 16476 leader_election.cc:290] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 3 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:52.330751 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:52.331271 16327 raft_consensus.cc:3055] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:52.331182 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:52.331634 16327 raft_consensus.cc:740] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:52.331864 16400 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.332401 16327 consensus_queue.cc:260] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:52.333424 16327 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.336826 16400 raft_consensus.cc:2468] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 3.
I20260709 13:16:52.337997 16327 raft_consensus.cc:2468] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 3.
I20260709 13:16:52.338069 16441 leader_election.cc:304] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:52.339025 16525 raft_consensus.cc:2804] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.339839 16525 raft_consensus.cc:697] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 LEADER]: Becoming Leader. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:52.340478 16525 consensus_queue.cc:237] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:52.349296 16221 catalog_manager.cc:5697] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 reported cstate change: term changed from 2 to 3, leader changed from 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1) to 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3). New cstate: current_term: 3 leader_uuid: "2180d2c18b174d2481ff75b5b2d27239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.373646 16593 raft_consensus.cc:993] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf: : Instructing follower 2180d2c18b174d2481ff75b5b2d27239 to start an election
I20260709 13:16:52.374116 16621 raft_consensus.cc:1081] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Signalling peer 2180d2c18b174d2481ff75b5b2d27239 to start an election
I20260709 13:16:52.375924 16476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d"
dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
 from {username='slave'} at 127.0.0.1:37316
I20260709 13:16:52.376595 16476 raft_consensus.cc:493] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.376921 16476 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.381732 16476 raft_consensus.cc:515] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:52.383634 16476 leader_election.cc:290] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 2 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:52.384440 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:52.384893 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:52.385120 16327 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.385524 16400 raft_consensus.cc:3055] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:52.385900 16400 raft_consensus.cc:740] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:52.386762 16400 consensus_queue.cc:260] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:52.387972 16400 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.391580 16327 raft_consensus.cc:2468] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 2.
I20260709 13:16:52.392614 16441 leader_election.cc:304] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:52.393368 16525 raft_consensus.cc:2804] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:52.393316 16400 raft_consensus.cc:2468] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 2.
I20260709 13:16:52.393877 16525 raft_consensus.cc:697] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 LEADER]: Becoming Leader. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:52.394618 16525 consensus_queue.cc:237] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:52.402817 16221 catalog_manager.cc:5697] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 reported cstate change: term changed from 1 to 2, leader changed from 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2) to 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "2180d2c18b174d2481ff75b5b2d27239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.777601 16400 raft_consensus.cc:1275] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Refusing update from remote peer 2180d2c18b174d2481ff75b5b2d27239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:52.779320 16525 consensus_queue.cc:1048] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:52.797418 16327 raft_consensus.cc:1275] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Refusing update from remote peer 2180d2c18b174d2481ff75b5b2d27239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:52.799158 16626 consensus_queue.cc:1048] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:52.802786 16400 raft_consensus.cc:1275] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Refusing update from remote peer 2180d2c18b174d2481ff75b5b2d27239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:52.804322 16525 consensus_queue.cc:1048] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.817051 16327 raft_consensus.cc:1275] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Refusing update from remote peer 2180d2c18b174d2481ff75b5b2d27239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:52.821702 16525 consensus_queue.cc:1048] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.935194 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:52.945883 16327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
mode: GRACEFUL
new_leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:40834
I20260709 13:16:52.946466 16327 raft_consensus.cc:606] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Received request to transfer leadership to TS 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:52.951715 16476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457"
dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
mode: GRACEFUL
new_leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:37334
I20260709 13:16:52.952261 16476 raft_consensus.cc:606] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 LEADER]: Received request to transfer leadership to TS 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:52.957247 16327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
mode: GRACEFUL
new_leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:40834
I20260709 13:16:52.957787 16327 raft_consensus.cc:606] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Received request to transfer leadership to TS 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:52.962535 16327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
mode: GRACEFUL
new_leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:40834
I20260709 13:16:52.963176 16327 raft_consensus.cc:606] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Received request to transfer leadership to TS 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:52.976017 16476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d"
dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
mode: GRACEFUL
new_leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:37334
I20260709 13:16:52.976962 16476 raft_consensus.cc:606] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 LEADER]: Received request to transfer leadership to TS 2e7ed3bc5a414e72803d64a9b42a3eaf
I20260709 13:16:53.011121 16614 raft_consensus.cc:993] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350: : Instructing follower 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:53.011590 16631 raft_consensus.cc:1081] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Signalling peer 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:53.013334 16400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:39904
I20260709 13:16:53.013909 16400 raft_consensus.cc:493] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.014226 16400 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.018813 16400 raft_consensus.cc:515] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.020454 16400 leader_election.cc:290] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 3 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:53.021514 16476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:53.022192 16476 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.022120 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:53.022850 16327 raft_consensus.cc:3055] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:53.023126 16327 raft_consensus.cc:740] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:53.023768 16327 consensus_queue.cc:260] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.024645 16327 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.027269 16476 raft_consensus.cc:2468] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 3.
I20260709 13:16:53.028474 16368 leader_election.cc:304] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:53.029345 16327 raft_consensus.cc:2468] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 3.
I20260709 13:16:53.029367 16621 raft_consensus.cc:2804] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:53.032509 16621 raft_consensus.cc:697] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:53.033363 16621 consensus_queue.cc:237] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.039736 16221 catalog_manager.cc:5697] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 2 to 3, leader changed from 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1) to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 3 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.304883 16614 raft_consensus.cc:993] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350: : Instructing follower 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:53.305307 16631 raft_consensus.cc:1081] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Signalling peer 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:53.306689 16400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:39904
I20260709 13:16:53.307194 16400 raft_consensus.cc:493] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.307472 16400 raft_consensus.cc:3060] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.311829 16400 raft_consensus.cc:515] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:53.313474 16400 leader_election.cc:290] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 3 election: Requested vote from peers 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699), 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155)
I20260709 13:16:53.314240 16476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:53.314481 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ba227ed424f80b3ffdc689e4375eb" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:53.314888 16476 raft_consensus.cc:3060] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.315008 16327 raft_consensus.cc:3055] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:53.315376 16327 raft_consensus.cc:740] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:53.316020 16327 consensus_queue.cc:260] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:53.316988 16327 raft_consensus.cc:3060] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.320574 16476 raft_consensus.cc:2468] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 3.
I20260709 13:16:53.321719 16368 leader_election.cc:304] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:53.322570 16621 raft_consensus.cc:2804] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:53.322956 16327 raft_consensus.cc:2468] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 3.
I20260709 13:16:53.323679 16621 raft_consensus.cc:697] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:53.324321 16615 raft_consensus.cc:993] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239: : Instructing follower 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:53.324784 16626 raft_consensus.cc:1081] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 LEADER]: Signalling peer 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:53.324501 16621 consensus_queue.cc:237] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } }
I20260709 13:16:53.326934 16401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:39894
I20260709 13:16:53.327483 16401 raft_consensus.cc:493] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.327960 16401 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:53.328181 16626 raft_consensus.cc:993] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239: : Instructing follower 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:53.328717 16626 raft_consensus.cc:1081] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 LEADER]: Signalling peer 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:53.330340 16400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:39894
I20260709 13:16:53.330924 16400 raft_consensus.cc:493] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.331275 16400 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.332710 16221 catalog_manager.cc:5697] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 2 to 3, leader changed from 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1) to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 3 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.333659 16401 raft_consensus.cc:515] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.336215 16401 leader_election.cc:290] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 4 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:53.336247 16327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:53.337055 16327 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:53.337988 16476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3db183b3147e896382c0270fc7457" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:53.338507 16476 raft_consensus.cc:3055] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:53.338780 16476 raft_consensus.cc:740] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:53.339073 16400 raft_consensus.cc:515] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.339461 16476 consensus_queue.cc:260] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.340592 16476 raft_consensus.cc:3060] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:53.341116 16400 leader_election.cc:290] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 3 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:53.342672 16324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:53.343264 16324 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.343747 16327 raft_consensus.cc:2468] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 4.
I20260709 13:16:53.345139 16367 leader_election.cc:304] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25c58b683c064d6797b8b0ea6defb350, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:53.346088 16474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:53.346696 16474 raft_consensus.cc:3055] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:53.346932 16632 raft_consensus.cc:2804] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:53.347008 16474 raft_consensus.cc:740] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:53.347546 16632 raft_consensus.cc:697] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:53.347934 16474 consensus_queue.cc:260] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.348417 16632 consensus_queue.cc:237] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.349220 16474 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.350291 16324 raft_consensus.cc:2468] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 3.
I20260709 13:16:53.353679 16367 leader_election.cc:304] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25c58b683c064d6797b8b0ea6defb350, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:53.354261 16631 raft_consensus.cc:993] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350: : Instructing follower 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:53.354632 16632 raft_consensus.cc:2804] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:53.355274 16632 raft_consensus.cc:697] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:53.354681 16631 raft_consensus.cc:1081] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Signalling peer 2e7ed3bc5a414e72803d64a9b42a3eaf to start an election
I20260709 13:16:53.355557 16221 catalog_manager.cc:5697] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 3 to 4, leader changed from 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3) to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 4 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.357517 16632 consensus_queue.cc:237] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.358376 16400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
 from {username='slave'} at 127.0.0.1:39904
I20260709 13:16:53.358879 16400 raft_consensus.cc:493] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.359233 16400 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.368682 16400 raft_consensus.cc:515] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.371181 16476 raft_consensus.cc:2468] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 4.
I20260709 13:16:53.371693 16324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:53.372259 16324 raft_consensus.cc:3055] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:53.372586 16324 raft_consensus.cc:740] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:53.373389 16324 consensus_queue.cc:260] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.374101 16400 leader_election.cc:290] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 3 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:53.374455 16324 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.375020 16474 raft_consensus.cc:2468] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 3.
I20260709 13:16:53.375336 16221 catalog_manager.cc:5697] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 2 to 3, leader changed from 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3) to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 3 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.377017 16474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a" candidate_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:53.377579 16474 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.380347 16324 raft_consensus.cc:2468] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 3.
I20260709 13:16:53.381403 16367 leader_election.cc:304] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25c58b683c064d6797b8b0ea6defb350, 2e7ed3bc5a414e72803d64a9b42a3eaf; no voters: 
I20260709 13:16:53.382130 16632 raft_consensus.cc:2804] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:53.382577 16632 raft_consensus.cc:697] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Becoming Leader. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:53.383275 16632 consensus_queue.cc:237] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:53.386809 16474 raft_consensus.cc:2468] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7ed3bc5a414e72803d64a9b42a3eaf in term 3.
I20260709 13:16:53.391022 16221 catalog_manager.cc:5697] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf reported cstate change: term changed from 2 to 3, leader changed from 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1) to 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2). New cstate: current_term: 3 leader_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.522557 16474 raft_consensus.cc:1275] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:53.523741 16632 consensus_queue.cc:1048] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.534242 16324 raft_consensus.cc:1275] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:53.535833 16632 consensus_queue.cc:1048] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.855612 16324 raft_consensus.cc:1275] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:53.857254 16632 consensus_queue.cc:1048] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.866654 16474 raft_consensus.cc:1275] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:53.868254 16632 consensus_queue.cc:1048] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.875901 16474 raft_consensus.cc:1275] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:53.877218 16632 consensus_queue.cc:1048] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.888018 16324 raft_consensus.cc:1275] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:53.889519 16639 consensus_queue.cc:1048] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.909009 16474 raft_consensus.cc:1275] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:53.910378 16632 consensus_queue.cc:1048] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.920661 16324 raft_consensus.cc:1275] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:53.922128 16647 consensus_queue.cc:1048] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.949095 16474 raft_consensus.cc:1275] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:53.950366 16647 consensus_queue.cc:1048] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:53.956557 16324 raft_consensus.cc:1275] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Refusing update from remote peer 2e7ed3bc5a414e72803d64a9b42a3eaf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:53.959059 16632 consensus_queue.cc:1048] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:55.982438 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:55.990988 16400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
mode: GRACEFUL
new_leader_uuid: "2180d2c18b174d2481ff75b5b2d27239"
 from {username='slave'} at 127.0.0.1:39914
I20260709 13:16:55.991776 16400 raft_consensus.cc:606] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Received request to transfer leadership to TS 2180d2c18b174d2481ff75b5b2d27239
I20260709 13:16:55.994835 16400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
mode: GRACEFUL
new_leader_uuid: "2180d2c18b174d2481ff75b5b2d27239"
 from {username='slave'} at 127.0.0.1:39914
I20260709 13:16:55.995398 16400 raft_consensus.cc:606] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Received request to transfer leadership to TS 2180d2c18b174d2481ff75b5b2d27239
I20260709 13:16:55.998165 16400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
mode: GRACEFUL
new_leader_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:39914
I20260709 13:16:55.998678 16400 raft_consensus.cc:606] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Received request to transfer leadership to TS 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:56.001292 16400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
mode: GRACEFUL
new_leader_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:39914
I20260709 13:16:56.001794 16400 raft_consensus.cc:606] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Received request to transfer leadership to TS 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:56.004416 16400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a"
dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
mode: GRACEFUL
new_leader_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:39914
I20260709 13:16:56.004961 16400 raft_consensus.cc:606] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Received request to transfer leadership to TS 25c58b683c064d6797b8b0ea6defb350
I20260709 13:16:56.006100 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:56.006624 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:56.055792 16639 raft_consensus.cc:993] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf: : Instructing follower 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:56.056357 16656 raft_consensus.cc:1081] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Signalling peer 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:56.058001 16324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:40822
I20260709 13:16:56.058470 16324 raft_consensus.cc:493] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.058773 16324 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.064353 16324 raft_consensus.cc:515] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.066368 16324 leader_election.cc:290] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 4 election: Requested vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:56.067430 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:56.067637 16474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c595b9a2b142c0a55eea08f3dac88a" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:56.068161 16400 raft_consensus.cc:3055] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:56.068226 16474 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.068661 16400 raft_consensus.cc:740] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:56.069567 16400 consensus_queue.cc:260] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.070793 16400 raft_consensus.cc:3060] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.075786 16474 raft_consensus.cc:2468] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 4.
I20260709 13:16:56.077627 16400 raft_consensus.cc:2468] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 4.
I20260709 13:16:56.077503 16293 leader_election.cc:304] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:56.079604 16657 raft_consensus.cc:2804] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:56.080464 16657 raft_consensus.cc:697] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 4 LEADER]: Becoming Leader. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:56.081499 16657 consensus_queue.cc:237] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.088668 16222 catalog_manager.cc:5697] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 reported cstate change: term changed from 3 to 4, leader changed from 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2) to 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1). New cstate: current_term: 4 leader_uuid: "25c58b683c064d6797b8b0ea6defb350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.158773 16639 raft_consensus.cc:993] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf: : Instructing follower 2180d2c18b174d2481ff75b5b2d27239 to start an election
I20260709 13:16:56.159228 16656 raft_consensus.cc:1081] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Signalling peer 2180d2c18b174d2481ff75b5b2d27239 to start an election
I20260709 13:16:56.160669 16474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa"
dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
 from {username='slave'} at 127.0.0.1:37316
I20260709 13:16:56.161193 16474 raft_consensus.cc:493] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.161451 16474 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.166188 16474 raft_consensus.cc:515] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.167770 16474 leader_election.cc:290] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 4 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:56.168685 16324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:56.168846 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538ecd12f8514667b13bd8354cf2c1aa" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:56.169339 16324 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.169384 16400 raft_consensus.cc:3055] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:56.169787 16400 raft_consensus.cc:740] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:56.170396 16400 consensus_queue.cc:260] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.171239 16400 raft_consensus.cc:3060] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.175083 16324 raft_consensus.cc:2468] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 4.
I20260709 13:16:56.176357 16400 raft_consensus.cc:2468] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 4.
I20260709 13:16:56.176247 16441 leader_election.cc:304] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:56.177359 16637 raft_consensus.cc:2804] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:56.178490 16637 raft_consensus.cc:697] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 4 LEADER]: Becoming Leader. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:56.179354 16637 consensus_queue.cc:237] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.186564 16222 catalog_manager.cc:5697] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 reported cstate change: term changed from 3 to 4, leader changed from 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2) to 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3). New cstate: current_term: 4 leader_uuid: "2180d2c18b174d2481ff75b5b2d27239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.238183 16639 raft_consensus.cc:993] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf: : Instructing follower 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:56.238550 16639 raft_consensus.cc:1081] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Signalling peer 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:56.240024 16324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:40822
I20260709 13:16:56.240471 16324 raft_consensus.cc:493] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.240721 16324 raft_consensus.cc:3060] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.245396 16324 raft_consensus.cc:515] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.246963 16324 leader_election.cc:290] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 3 election: Requested vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:56.247828 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:56.248014 16474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79204942fd2e4ab598224496f72b5e7d" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:56.248384 16400 raft_consensus.cc:3055] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:56.248503 16474 raft_consensus.cc:3060] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.248730 16400 raft_consensus.cc:740] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:56.249553 16400 consensus_queue.cc:260] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.250701 16400 raft_consensus.cc:3060] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.255093 16474 raft_consensus.cc:2468] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 3.
I20260709 13:16:56.256225 16293 leader_election.cc:304] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:56.256393 16400 raft_consensus.cc:2468] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 3.
I20260709 13:16:56.256968 16657 raft_consensus.cc:2804] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:56.257472 16657 raft_consensus.cc:697] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 3 LEADER]: Becoming Leader. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:56.258235 16657 consensus_queue.cc:237] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.265537 16222 catalog_manager.cc:5697] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 reported cstate change: term changed from 2 to 3, leader changed from 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2) to 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "25c58b683c064d6797b8b0ea6defb350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.383400 16656 raft_consensus.cc:993] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf: : Instructing follower 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:56.383955 16639 raft_consensus.cc:1081] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Signalling peer 25c58b683c064d6797b8b0ea6defb350 to start an election
I20260709 13:16:56.385356 16324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870"
dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
 from {username='slave'} at 127.0.0.1:40822
I20260709 13:16:56.385805 16324 raft_consensus.cc:493] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.386107 16324 raft_consensus.cc:3060] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.391417 16324 raft_consensus.cc:515] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.392911 16324 leader_election.cc:290] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 3 election: Requested vote from peers 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057), 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3:40699)
I20260709 13:16:56.393867 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:56.393983 16474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2738f4ef9534ea288d6b48702306870" candidate_uuid: "25c58b683c064d6797b8b0ea6defb350" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
I20260709 13:16:56.394483 16400 raft_consensus.cc:3055] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:56.394577 16474 raft_consensus.cc:3060] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.394837 16400 raft_consensus.cc:740] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:56.395548 16400 consensus_queue.cc:260] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.396600 16400 raft_consensus.cc:3060] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.400727 16474 raft_consensus.cc:2468] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 3.
I20260709 13:16:56.401839 16293 leader_election.cc:304] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:56.402283 16400 raft_consensus.cc:2468] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c58b683c064d6797b8b0ea6defb350 in term 3.
I20260709 13:16:56.402586 16657 raft_consensus.cc:2804] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:56.403072 16657 raft_consensus.cc:697] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 3 LEADER]: Becoming Leader. State: Replica: 25c58b683c064d6797b8b0ea6defb350, State: Running, Role: LEADER
I20260709 13:16:56.403940 16657 consensus_queue.cc:237] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.410247 16222 catalog_manager.cc:5697] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 reported cstate change: term changed from 2 to 3, leader changed from 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2) to 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "25c58b683c064d6797b8b0ea6defb350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.528609 16656 raft_consensus.cc:993] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf: : Instructing follower 2180d2c18b174d2481ff75b5b2d27239 to start an election
I20260709 13:16:56.529157 16639 raft_consensus.cc:1081] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Signalling peer 2180d2c18b174d2481ff75b5b2d27239 to start an election
I20260709 13:16:56.530598 16474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d"
dest_uuid: "2180d2c18b174d2481ff75b5b2d27239"
 from {username='slave'} at 127.0.0.1:37316
I20260709 13:16:56.531046 16474 raft_consensus.cc:493] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.531347 16474 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.535430 16474 raft_consensus.cc:515] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.537026 16474 leader_election.cc:290] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 4 election: Requested vote from peers 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155), 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057)
I20260709 13:16:56.537923 16324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "25c58b683c064d6797b8b0ea6defb350"
I20260709 13:16:56.538180 16400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c2dd8dd67f4346acf9cb4001de126d" candidate_uuid: "2180d2c18b174d2481ff75b5b2d27239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf"
I20260709 13:16:56.538445 16324 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.538681 16400 raft_consensus.cc:3055] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:56.538971 16400 raft_consensus.cc:740] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e7ed3bc5a414e72803d64a9b42a3eaf, State: Running, Role: LEADER
I20260709 13:16:56.539575 16400 consensus_queue.cc:260] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.540375 16400 raft_consensus.cc:3060] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.542666 16324 raft_consensus.cc:2468] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 4.
I20260709 13:16:56.543637 16441 leader_election.cc:304] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2180d2c18b174d2481ff75b5b2d27239, 25c58b683c064d6797b8b0ea6defb350; no voters: 
I20260709 13:16:56.544307 16400 raft_consensus.cc:2468] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2180d2c18b174d2481ff75b5b2d27239 in term 4.
I20260709 13:16:56.544363 16637 raft_consensus.cc:2804] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:56.545025 16637 raft_consensus.cc:697] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 4 LEADER]: Becoming Leader. State: Replica: 2180d2c18b174d2481ff75b5b2d27239, State: Running, Role: LEADER
I20260709 13:16:56.545912 16637 consensus_queue.cc:237] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } }
I20260709 13:16:56.552886 16222 catalog_manager.cc:5697] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 reported cstate change: term changed from 3 to 4, leader changed from 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2) to 2180d2c18b174d2481ff75b5b2d27239 (127.15.208.3). New cstate: current_term: 4 leader_uuid: "2180d2c18b174d2481ff75b5b2d27239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.583160 16474 raft_consensus.cc:1275] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:56.584524 16657 consensus_queue.cc:1048] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.595024 16400 raft_consensus.cc:1275] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:56.598831 16671 consensus_queue.cc:1048] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:56.670956 16400 raft_consensus.cc:1275] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:56.672240 16671 consensus_queue.cc:1048] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.681767 16474 raft_consensus.cc:1275] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:56.683275 16671 consensus_queue.cc:1048] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:56.721510 16324 raft_consensus.cc:1275] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Refusing update from remote peer 2180d2c18b174d2481ff75b5b2d27239: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:56.723083 16637 consensus_queue.cc:1048] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.733315 16400 raft_consensus.cc:1275] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Refusing update from remote peer 2180d2c18b174d2481ff75b5b2d27239: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:56.735787 16678 consensus_queue.cc:1048] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:56.905364 16474 raft_consensus.cc:1275] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:56.906493 16671 consensus_queue.cc:1048] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2180d2c18b174d2481ff75b5b2d27239" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 40699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.917011 16400 raft_consensus.cc:1275] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Refusing update from remote peer 25c58b683c064d6797b8b0ea6defb350: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:56.918347 16671 consensus_queue.cc:1048] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.974211 16400 raft_consensus.cc:1275] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Refusing update from remote peer 2180d2c18b174d2481ff75b5b2d27239: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:56.975585 16678 consensus_queue.cc:1048] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7ed3bc5a414e72803d64a9b42a3eaf" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.985457 16324 raft_consensus.cc:1275] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Refusing update from remote peer 2180d2c18b174d2481ff75b5b2d27239: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:56.987191 16637 consensus_queue.cc:1048] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c58b683c064d6797b8b0ea6defb350" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 43155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:57.007548 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:57.013633 16192 tablet_server.cc:179] TabletServer@127.15.208.1:0 shutting down...
I20260709 13:16:57.049422 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:57.050452 16192 tablet_replica.cc:333] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350: stopping tablet replica
I20260709 13:16:57.051203 16192 raft_consensus.cc:2243] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.051748 16192 raft_consensus.cc:2272] T d9e3db183b3147e896382c0270fc7457 P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.054188 16192 tablet_replica.cc:333] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350: stopping tablet replica
I20260709 13:16:57.054685 16192 raft_consensus.cc:2243] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.055115 16192 raft_consensus.cc:2272] T 71c2dd8dd67f4346acf9cb4001de126d P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.057703 16192 tablet_replica.cc:333] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350: stopping tablet replica
I20260709 13:16:57.058244 16192 raft_consensus.cc:2243] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.059031 16192 raft_consensus.cc:2272] T b1c595b9a2b142c0a55eea08f3dac88a P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.061075 16192 tablet_replica.cc:333] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350: stopping tablet replica
I20260709 13:16:57.061575 16192 raft_consensus.cc:2243] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.062278 16192 raft_consensus.cc:2272] T a2738f4ef9534ea288d6b48702306870 P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.064370 16192 tablet_replica.cc:333] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350: stopping tablet replica
I20260709 13:16:57.065055 16192 raft_consensus.cc:2243] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.065508 16192 raft_consensus.cc:2272] T 0f2ba227ed424f80b3ffdc689e4375eb P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.067111 16192 tablet_replica.cc:333] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350: stopping tablet replica
I20260709 13:16:57.067598 16192 raft_consensus.cc:2243] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.068063 16192 raft_consensus.cc:2272] T 538ecd12f8514667b13bd8354cf2c1aa P 25c58b683c064d6797b8b0ea6defb350 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.070641 16192 tablet_replica.cc:333] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350: stopping tablet replica
I20260709 13:16:57.071313 16192 raft_consensus.cc:2243] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.071749 16192 raft_consensus.cc:2272] T 3dc7c594ebfc4282a689f97000d6cbfa P 25c58b683c064d6797b8b0ea6defb350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.073472 16192 tablet_replica.cc:333] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350: stopping tablet replica
I20260709 13:16:57.073943 16192 raft_consensus.cc:2243] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.074609 16192 raft_consensus.cc:2272] T 79204942fd2e4ab598224496f72b5e7d P 25c58b683c064d6797b8b0ea6defb350 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.076604 16192 tablet_replica.cc:333] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350: stopping tablet replica
I20260709 13:16:57.077106 16192 raft_consensus.cc:2243] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.077585 16192 raft_consensus.cc:2272] T 5e477a794c094947a219fbd1586bbd2b P 25c58b683c064d6797b8b0ea6defb350 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.176366 16192 tablet_server.cc:196] TabletServer@127.15.208.1:0 shutdown complete.
W20260709 13:16:57.195760 16441 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.208.1:43155: connect: Connection refused (error 111)
I20260709 13:16:57.197338 16192 tablet_server.cc:179] TabletServer@127.15.208.2:0 shutting down...
W20260709 13:16:57.201885 16441 consensus_peers.cc:597] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 -> Peer 25c58b683c064d6797b8b0ea6defb350 (127.15.208.1:43155): Couldn't send request to peer 25c58b683c064d6797b8b0ea6defb350. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:43155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.223228 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:57.223850 16192 tablet_replica.cc:333] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf: stopping tablet replica
I20260709 13:16:57.224555 16192 raft_consensus.cc:2243] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.225106 16192 raft_consensus.cc:2272] T 79204942fd2e4ab598224496f72b5e7d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.227840 16192 tablet_replica.cc:333] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf: stopping tablet replica
I20260709 13:16:57.228336 16192 raft_consensus.cc:2243] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.229075 16192 raft_consensus.cc:2272] T d9e3db183b3147e896382c0270fc7457 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.230721 16192 tablet_replica.cc:333] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf: stopping tablet replica
I20260709 13:16:57.231161 16192 raft_consensus.cc:2243] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.231492 16192 raft_consensus.cc:2272] T b1c595b9a2b142c0a55eea08f3dac88a P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.233673 16192 tablet_replica.cc:333] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf: stopping tablet replica
I20260709 13:16:57.234158 16192 raft_consensus.cc:2243] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.234550 16192 raft_consensus.cc:2272] T a2738f4ef9534ea288d6b48702306870 P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.236680 16192 tablet_replica.cc:333] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf: stopping tablet replica
I20260709 13:16:57.237221 16192 raft_consensus.cc:2243] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.237609 16192 raft_consensus.cc:2272] T 71c2dd8dd67f4346acf9cb4001de126d P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.239516 16192 tablet_replica.cc:333] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf: stopping tablet replica
I20260709 13:16:57.240006 16192 raft_consensus.cc:2243] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.240715 16192 raft_consensus.cc:2272] T 0f2ba227ed424f80b3ffdc689e4375eb P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.242349 16192 tablet_replica.cc:333] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf: stopping tablet replica
I20260709 13:16:57.242797 16192 raft_consensus.cc:2243] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.243171 16192 raft_consensus.cc:2272] T 538ecd12f8514667b13bd8354cf2c1aa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.245452 16192 tablet_replica.cc:333] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf: stopping tablet replica
I20260709 13:16:57.245911 16192 raft_consensus.cc:2243] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.246280 16192 raft_consensus.cc:2272] T 3dc7c594ebfc4282a689f97000d6cbfa P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.247817 16192 tablet_replica.cc:333] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf: stopping tablet replica
I20260709 13:16:57.248231 16192 raft_consensus.cc:2243] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.249029 16192 raft_consensus.cc:2272] T 5e477a794c094947a219fbd1586bbd2b P 2e7ed3bc5a414e72803d64a9b42a3eaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.266791 16192 tablet_server.cc:196] TabletServer@127.15.208.2:0 shutdown complete.
I20260709 13:16:57.283119 16192 tablet_server.cc:179] TabletServer@127.15.208.3:0 shutting down...
W20260709 13:16:57.301208 16441 consensus_peers.cc:597] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 -> Peer 2e7ed3bc5a414e72803d64a9b42a3eaf (127.15.208.2:38057): Couldn't send request to peer 2e7ed3bc5a414e72803d64a9b42a3eaf. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:38057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.311195 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:57.312065 16192 tablet_replica.cc:333] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239: stopping tablet replica
I20260709 13:16:57.312727 16192 raft_consensus.cc:2243] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.313722 16192 raft_consensus.cc:2272] T 71c2dd8dd67f4346acf9cb4001de126d P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.315804 16192 tablet_replica.cc:333] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239: stopping tablet replica
I20260709 13:16:57.316340 16192 raft_consensus.cc:2243] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.316778 16192 raft_consensus.cc:2272] T 79204942fd2e4ab598224496f72b5e7d P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.319607 16192 tablet_replica.cc:333] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239: stopping tablet replica
I20260709 13:16:57.320178 16192 raft_consensus.cc:2243] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.320642 16192 raft_consensus.cc:2272] T b1c595b9a2b142c0a55eea08f3dac88a P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.324077 16192 tablet_replica.cc:333] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239: stopping tablet replica
I20260709 13:16:57.324702 16192 raft_consensus.cc:2243] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.325289 16192 raft_consensus.cc:2272] T a2738f4ef9534ea288d6b48702306870 P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.327636 16192 tablet_replica.cc:333] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239: stopping tablet replica
I20260709 13:16:57.328236 16192 raft_consensus.cc:2243] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.329097 16192 raft_consensus.cc:2272] T 538ecd12f8514667b13bd8354cf2c1aa P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.331290 16192 tablet_replica.cc:333] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239: stopping tablet replica
I20260709 13:16:57.331911 16192 raft_consensus.cc:2243] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.332759 16192 raft_consensus.cc:2272] T 3dc7c594ebfc4282a689f97000d6cbfa P 2180d2c18b174d2481ff75b5b2d27239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.334703 16192 tablet_replica.cc:333] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239: stopping tablet replica
I20260709 13:16:57.335218 16192 raft_consensus.cc:2243] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.335666 16192 raft_consensus.cc:2272] T 5e477a794c094947a219fbd1586bbd2b P 2180d2c18b174d2481ff75b5b2d27239 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.337594 16192 tablet_replica.cc:333] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239: stopping tablet replica
I20260709 13:16:57.338091 16192 raft_consensus.cc:2243] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.338531 16192 raft_consensus.cc:2272] T d9e3db183b3147e896382c0270fc7457 P 2180d2c18b174d2481ff75b5b2d27239 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.340243 16192 tablet_replica.cc:333] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239: stopping tablet replica
I20260709 13:16:57.340749 16192 raft_consensus.cc:2243] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.341362 16192 raft_consensus.cc:2272] T 0f2ba227ed424f80b3ffdc689e4375eb P 2180d2c18b174d2481ff75b5b2d27239 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.369416 16192 tablet_server.cc:196] TabletServer@127.15.208.3:0 shutdown complete.
I20260709 13:16:57.386708 16192 master.cc:562] Master@127.15.208.62:35363 shutting down...
I20260709 13:16:57.593634 16192 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.594151 16192 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.594436 16192 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0b775cbd90d84e958cdcddcdb369c3b5: stopping tablet replica
I20260709 13:16:57.613974 16192 master.cc:584] Master@127.15.208.62:35363 shutdown complete.
2180d2c18b174d2481ff75b5b2d27239  1
25c58b683c064d6797b8b0ea6defb350  4
2e7ed3bc5a414e72803d64a9b42a3eaf  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12538 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:16:57.657634 16192 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.208.62:38783
I20260709 13:16:57.658766 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:57.664947 16688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:57.664866 16689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:57.665742 16691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:57.666697 16192 server_base.cc:1061] running on GCE node
I20260709 13:16:57.667543 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:57.667726 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:57.667836 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603017667825 us; error 0 us; skew 500 ppm
I20260709 13:16:57.668346 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:57.670900 16192 webserver.cc:533] Webserver started at http://127.15.208.62:39667/ using document root <none> and password file <none>
I20260709 13:16:57.671427 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:57.671622 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:57.671911 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:57.673161 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/master-0-root/instance:
uuid: "d153b16f62f54c169f1cddaceeb153b7"
format_stamp: "Formatted at 2026-07-09 13:16:57 on dist-test-slave-w3b1"
I20260709 13:16:57.678288 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:16:57.682188 16696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:57.683105 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:16:57.683440 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/master-0-root
uuid: "d153b16f62f54c169f1cddaceeb153b7"
format_stamp: "Formatted at 2026-07-09 13:16:57 on dist-test-slave-w3b1"
I20260709 13:16:57.683722 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:57.699194 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:57.700507 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:57.744068 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.62:38783
I20260709 13:16:57.744191 16747 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.62:38783 every 8 connection(s)
I20260709 13:16:57.748555 16748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.758430 16748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7: Bootstrap starting.
I20260709 13:16:57.763185 16748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.767779 16748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7: No bootstrap required, opened a new log
I20260709 13:16:57.769982 16748 raft_consensus.cc:359] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d153b16f62f54c169f1cddaceeb153b7" member_type: VOTER }
I20260709 13:16:57.770377 16748 raft_consensus.cc:385] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.770565 16748 raft_consensus.cc:740] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d153b16f62f54c169f1cddaceeb153b7, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.771075 16748 consensus_queue.cc:260] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d153b16f62f54c169f1cddaceeb153b7" member_type: VOTER }
I20260709 13:16:57.771477 16748 raft_consensus.cc:399] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:57.771677 16748 raft_consensus.cc:493] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:57.771884 16748 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.776175 16748 raft_consensus.cc:515] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d153b16f62f54c169f1cddaceeb153b7" member_type: VOTER }
I20260709 13:16:57.776687 16748 leader_election.cc:304] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d153b16f62f54c169f1cddaceeb153b7; no voters: 
I20260709 13:16:57.777953 16748 leader_election.cc:290] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:57.778405 16751 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.779920 16751 raft_consensus.cc:697] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 1 LEADER]: Becoming Leader. State: Replica: d153b16f62f54c169f1cddaceeb153b7, State: Running, Role: LEADER
I20260709 13:16:57.780565 16751 consensus_queue.cc:237] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d153b16f62f54c169f1cddaceeb153b7" member_type: VOTER }
I20260709 13:16:57.781136 16748 sys_catalog.cc:565] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:57.786553 16752 sys_catalog.cc:455] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d153b16f62f54c169f1cddaceeb153b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d153b16f62f54c169f1cddaceeb153b7" member_type: VOTER } }
I20260709 13:16:57.786832 16753 sys_catalog.cc:455] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d153b16f62f54c169f1cddaceeb153b7. Latest consensus state: current_term: 1 leader_uuid: "d153b16f62f54c169f1cddaceeb153b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d153b16f62f54c169f1cddaceeb153b7" member_type: VOTER } }
I20260709 13:16:57.787643 16753 sys_catalog.cc:458] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:57.787618 16752 sys_catalog.cc:458] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:57.790096 16759 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:57.795369 16759 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:57.798512 16192 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:57.804571 16759 catalog_manager.cc:1383] Generated new cluster ID: f242b920b6ef44959b81b8a1304c6e70
I20260709 13:16:57.804966 16759 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:57.821022 16759 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:57.822345 16759 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:57.839955 16759 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7: Generated new TSK 0
I20260709 13:16:57.840792 16759 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:57.865726 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:57.871641 16769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:57.872651 16770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:57.874655 16772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:57.875378 16192 server_base.cc:1061] running on GCE node
I20260709 13:16:57.876207 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:57.876395 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:57.876516 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603017876506 us; error 0 us; skew 500 ppm
I20260709 13:16:57.877025 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:57.879550 16192 webserver.cc:533] Webserver started at http://127.15.208.1:41049/ using document root <none> and password file <none>
I20260709 13:16:57.880019 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:57.880173 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:57.880385 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:57.881539 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-0-root/instance:
uuid: "5ac85832e522403ca896409edbd19f6a"
format_stamp: "Formatted at 2026-07-09 13:16:57 on dist-test-slave-w3b1"
I20260709 13:16:57.886327 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:16:57.889843 16777 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:57.890833 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:57.891125 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-0-root
uuid: "5ac85832e522403ca896409edbd19f6a"
format_stamp: "Formatted at 2026-07-09 13:16:57 on dist-test-slave-w3b1"
I20260709 13:16:57.891412 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:57.918509 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:57.919862 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:57.921484 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:57.923811 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:57.924000 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:57.924306 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:57.924518 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:57.966758 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.1:41595
I20260709 13:16:57.966874 16839 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.1:41595 every 8 connection(s)
I20260709 13:16:57.971711 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:57.979249 16844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:57.980336 16845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:57.982935 16192 server_base.cc:1061] running on GCE node
W20260709 13:16:57.984153 16847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:57.985196 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:57.985513 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:57.985733 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603017985693 us; error 0 us; skew 500 ppm
I20260709 13:16:57.986361 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:57.989502 16192 webserver.cc:533] Webserver started at http://127.15.208.2:44719/ using document root <none> and password file <none>
I20260709 13:16:57.989753 16840 heartbeater.cc:344] Connected to a master server at 127.15.208.62:38783
I20260709 13:16:57.990118 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:57.990228 16840 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:57.990374 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:57.990738 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:57.991262 16840 heartbeater.cc:507] Master 127.15.208.62:38783 requested a full tablet report, sending...
I20260709 13:16:57.991984 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-1-root/instance:
uuid: "b23676daefc14e888648187016e1c7ea"
format_stamp: "Formatted at 2026-07-09 13:16:57 on dist-test-slave-w3b1"
I20260709 13:16:57.993865 16713 ts_manager.cc:194] Registered new tserver with Master: 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595)
I20260709 13:16:57.995750 16713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43560
I20260709 13:16:57.997316 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:16:58.001422 16852 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:58.002327 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:16:58.002684 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-1-root
uuid: "b23676daefc14e888648187016e1c7ea"
format_stamp: "Formatted at 2026-07-09 13:16:57 on dist-test-slave-w3b1"
I20260709 13:16:58.003036 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:58.031479 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:58.032979 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:58.034678 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:58.037264 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:58.037539 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:58.037839 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:58.038038 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:58.083531 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.2:37757
I20260709 13:16:58.083603 16914 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.2:37757 every 8 connection(s)
I20260709 13:16:58.091266 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:58.101384 16918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:58.102783 16919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:58.113022 16921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:58.113473 16192 server_base.cc:1061] running on GCE node
I20260709 13:16:58.114223 16915 heartbeater.cc:344] Connected to a master server at 127.15.208.62:38783
I20260709 13:16:58.114672 16915 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:58.114856 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:58.115216 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:58.115476 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603018115452 us; error 0 us; skew 500 ppm
I20260709 13:16:58.115638 16915 heartbeater.cc:507] Master 127.15.208.62:38783 requested a full tablet report, sending...
I20260709 13:16:58.116482 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:58.118525 16713 ts_manager.cc:194] Registered new tserver with Master: b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:58.120180 16192 webserver.cc:533] Webserver started at http://127.15.208.3:43673/ using document root <none> and password file <none>
I20260709 13:16:58.120687 16713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43568
I20260709 13:16:58.121119 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:58.121466 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:58.121850 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:58.123556 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-2-root/instance:
uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
format_stamp: "Formatted at 2026-07-09 13:16:58 on dist-test-slave-w3b1"
I20260709 13:16:58.129467 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:16:58.133126 16926 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:58.134027 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:16:58.134305 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-2-root
uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
format_stamp: "Formatted at 2026-07-09 13:16:58 on dist-test-slave-w3b1"
I20260709 13:16:58.134578 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603004946521-16192-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:58.160530 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:58.161962 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:58.163518 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:58.166064 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:58.166319 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:58.166594 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:58.166788 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:58.212251 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.3:33465
I20260709 13:16:58.212370 16988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.3:33465 every 8 connection(s)
I20260709 13:16:58.227129 16989 heartbeater.cc:344] Connected to a master server at 127.15.208.62:38783
I20260709 13:16:58.227468 16989 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:58.228235 16989 heartbeater.cc:507] Master 127.15.208.62:38783 requested a full tablet report, sending...
I20260709 13:16:58.230276 16713 ts_manager.cc:194] Registered new tserver with Master: 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:58.230367 16192 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014514883s
I20260709 13:16:58.231773 16713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43584
I20260709 13:16:58.256705 16713 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43598:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:58.259729 16713 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:58.328289 16954 tablet_service.cc:1511] Processing CreateTablet for tablet 942dd7457dbc44f298607013b6b8b66a (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:58.329862 16954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 942dd7457dbc44f298607013b6b8b66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.334039 16953 tablet_service.cc:1511] Processing CreateTablet for tablet 3729478edbae48cf9c8ef2ebc7ec0472 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:58.335543 16953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3729478edbae48cf9c8ef2ebc7ec0472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.335263 16880 tablet_service.cc:1511] Processing CreateTablet for tablet 942dd7457dbc44f298607013b6b8b66a (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:58.336555 16880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 942dd7457dbc44f298607013b6b8b66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.338007 16879 tablet_service.cc:1511] Processing CreateTablet for tablet 3729478edbae48cf9c8ef2ebc7ec0472 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:58.338745 16952 tablet_service.cc:1511] Processing CreateTablet for tablet f8f95ea5114e483f94009c0e4e4a9923 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:58.340036 16952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f95ea5114e483f94009c0e4e4a9923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.340443 16878 tablet_service.cc:1511] Processing CreateTablet for tablet f8f95ea5114e483f94009c0e4e4a9923 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:58.344719 16876 tablet_service.cc:1511] Processing CreateTablet for tablet e347d100d23f43a3a831de5163ad9768 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:58.346154 16877 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd59c6445024a8bbf09129996feabbd (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:58.347198 16951 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd59c6445024a8bbf09129996feabbd (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:58.348450 16951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd59c6445024a8bbf09129996feabbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.352085 16875 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5501a9f97842f6b5bd72b23d4d5865 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:58.353461 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5501a9f97842f6b5bd72b23d4d5865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.354621 16949 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5501a9f97842f6b5bd72b23d4d5865 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:58.355981 16949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5501a9f97842f6b5bd72b23d4d5865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.352079 16950 tablet_service.cc:1511] Processing CreateTablet for tablet e347d100d23f43a3a831de5163ad9768 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:58.358171 16950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e347d100d23f43a3a831de5163ad9768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.361186 16876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e347d100d23f43a3a831de5163ad9768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.361431 16948 tablet_service.cc:1511] Processing CreateTablet for tablet 58676102ea6548b494330c22fcb4e02b (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:58.362673 16948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58676102ea6548b494330c22fcb4e02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.365195 16878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f95ea5114e483f94009c0e4e4a9923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.369220 16877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd59c6445024a8bbf09129996feabbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.372553 16947 tablet_service.cc:1511] Processing CreateTablet for tablet ec93e87d659a42029e7032ccc0fb7638 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:58.373929 16947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec93e87d659a42029e7032ccc0fb7638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.377213 16879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3729478edbae48cf9c8ef2ebc7ec0472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.379021 16946 tablet_service.cc:1511] Processing CreateTablet for tablet 0d17526665334553b0669cca55028f81 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:58.380414 16946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d17526665334553b0669cca55028f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.382493 16874 tablet_service.cc:1511] Processing CreateTablet for tablet 58676102ea6548b494330c22fcb4e02b (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:58.384001 16874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58676102ea6548b494330c22fcb4e02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.386658 16873 tablet_service.cc:1511] Processing CreateTablet for tablet ec93e87d659a42029e7032ccc0fb7638 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:58.388025 16873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec93e87d659a42029e7032ccc0fb7638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.390123 16872 tablet_service.cc:1511] Processing CreateTablet for tablet 0d17526665334553b0669cca55028f81 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:58.391475 16872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d17526665334553b0669cca55028f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.393940 16871 tablet_service.cc:1511] Processing CreateTablet for tablet 65dcc248549f4351853e4860659e2a88 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:58.395196 16804 tablet_service.cc:1511] Processing CreateTablet for tablet 3729478edbae48cf9c8ef2ebc7ec0472 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:58.396515 16804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3729478edbae48cf9c8ef2ebc7ec0472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.397970 16803 tablet_service.cc:1511] Processing CreateTablet for tablet f8f95ea5114e483f94009c0e4e4a9923 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:58.399264 16803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f95ea5114e483f94009c0e4e4a9923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.393940 16805 tablet_service.cc:1511] Processing CreateTablet for tablet 942dd7457dbc44f298607013b6b8b66a (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:58.402283 16805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 942dd7457dbc44f298607013b6b8b66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.402777 16945 tablet_service.cc:1511] Processing CreateTablet for tablet 65dcc248549f4351853e4860659e2a88 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:58.404029 16945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65dcc248549f4351853e4860659e2a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.395664 16871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65dcc248549f4351853e4860659e2a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.412536 16802 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd59c6445024a8bbf09129996feabbd (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:58.414108 16800 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5501a9f97842f6b5bd72b23d4d5865 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:58.415383 16801 tablet_service.cc:1511] Processing CreateTablet for tablet e347d100d23f43a3a831de5163ad9768 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:58.414103 16802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd59c6445024a8bbf09129996feabbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.418040 16799 tablet_service.cc:1511] Processing CreateTablet for tablet 58676102ea6548b494330c22fcb4e02b (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:58.419515 16799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58676102ea6548b494330c22fcb4e02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.421242 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5501a9f97842f6b5bd72b23d4d5865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.423602 16797 tablet_service.cc:1511] Processing CreateTablet for tablet 0d17526665334553b0669cca55028f81 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:58.437667 16796 tablet_service.cc:1511] Processing CreateTablet for tablet 65dcc248549f4351853e4860659e2a88 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:58.445307 16798 tablet_service.cc:1511] Processing CreateTablet for tablet ec93e87d659a42029e7032ccc0fb7638 (DEFAULT_TABLE table=test-workload [id=211904d92e5d4e5588f043d9d8d68570]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:58.453454 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec93e87d659a42029e7032ccc0fb7638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.457406 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65dcc248549f4351853e4860659e2a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.458293 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d17526665334553b0669cca55028f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.461213 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e347d100d23f43a3a831de5163ad9768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.572762 17005 tablet_bootstrap.cc:492] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a: Bootstrap starting.
I20260709 13:16:58.573953 17004 tablet_bootstrap.cc:492] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d: Bootstrap starting.
I20260709 13:16:58.580824 17005 tablet_bootstrap.cc:654] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.598426 17006 tablet_bootstrap.cc:492] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea: Bootstrap starting.
I20260709 13:16:58.604193 17005 tablet_bootstrap.cc:492] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a: No bootstrap required, opened a new log
I20260709 13:16:58.604962 17005 ts_tablet_manager.cc:1403] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 13:16:58.606621 17006 tablet_bootstrap.cc:654] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.608307 17004 tablet_bootstrap.cc:654] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.608330 17005 raft_consensus.cc:359] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.609408 17005 raft_consensus.cc:385] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.610292 17005 raft_consensus.cc:740] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.611236 17005 consensus_queue.cc:260] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.617401 17004 tablet_bootstrap.cc:492] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d: No bootstrap required, opened a new log
I20260709 13:16:58.617980 17004 ts_tablet_manager.cc:1403] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.007s
I20260709 13:16:58.620471 16840 heartbeater.cc:499] Master 127.15.208.62:38783 was elected leader, sending a full tablet report...
I20260709 13:16:58.620862 17005 ts_tablet_manager.cc:1434] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:16:58.621155 17004 raft_consensus.cc:359] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:58.621738 17004 raft_consensus.cc:385] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.621778 17005 tablet_bootstrap.cc:492] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a: Bootstrap starting.
I20260709 13:16:58.622022 17004 raft_consensus.cc:740] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.622722 17004 consensus_queue.cc:260] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:58.624558 16989 heartbeater.cc:499] Master 127.15.208.62:38783 was elected leader, sending a full tablet report...
I20260709 13:16:58.625572 17004 ts_tablet_manager.cc:1434] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:58.626459 17004 tablet_bootstrap.cc:492] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d: Bootstrap starting.
I20260709 13:16:58.628305 17005 tablet_bootstrap.cc:654] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.633006 17004 tablet_bootstrap.cc:654] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.637450 17004 tablet_bootstrap.cc:492] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d: No bootstrap required, opened a new log
I20260709 13:16:58.638072 17004 ts_tablet_manager.cc:1403] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent bootstrapping tablet: real 0.012s	user 0.002s	sys 0.009s
I20260709 13:16:58.640211 17005 tablet_bootstrap.cc:492] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a: No bootstrap required, opened a new log
I20260709 13:16:58.637398 17006 tablet_bootstrap.cc:492] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea: No bootstrap required, opened a new log
I20260709 13:16:58.641233 17006 ts_tablet_manager.cc:1403] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.015s
I20260709 13:16:58.640921 17004 raft_consensus.cc:359] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.641650 17004 raft_consensus.cc:385] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.641923 17004 raft_consensus.cc:740] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.640692 17005 ts_tablet_manager.cc:1403] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:16:58.642705 17004 consensus_queue.cc:260] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.644477 17004 ts_tablet_manager.cc:1434] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:16:58.645259 17004 tablet_bootstrap.cc:492] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d: Bootstrap starting.
I20260709 13:16:58.645823 17005 raft_consensus.cc:359] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.646476 17005 raft_consensus.cc:385] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.646768 17005 raft_consensus.cc:740] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.647549 17005 consensus_queue.cc:260] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.649732 17005 ts_tablet_manager.cc:1434] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:16:58.650019 17010 raft_consensus.cc:493] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.650614 17005 tablet_bootstrap.cc:492] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a: Bootstrap starting.
I20260709 13:16:58.650502 17010 raft_consensus.cc:515] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.651247 17004 tablet_bootstrap.cc:654] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.655258 17006 raft_consensus.cc:359] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:58.656082 17006 raft_consensus.cc:385] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.656385 17006 raft_consensus.cc:740] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.661613 17005 tablet_bootstrap.cc:654] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.657271 17006 consensus_queue.cc:260] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:58.656818 17010 leader_election.cc:290] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:58.679780 16915 heartbeater.cc:499] Master 127.15.208.62:38783 was elected leader, sending a full tablet report...
I20260709 13:16:58.683643 17006 ts_tablet_manager.cc:1434] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.008s
I20260709 13:16:58.686741 17006 tablet_bootstrap.cc:492] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea: Bootstrap starting.
I20260709 13:16:58.688862 17004 tablet_bootstrap.cc:492] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d: No bootstrap required, opened a new log
I20260709 13:16:58.689442 17004 ts_tablet_manager.cc:1403] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.033s
I20260709 13:16:58.692389 17004 raft_consensus.cc:359] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.693222 17004 raft_consensus.cc:385] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.693634 17004 raft_consensus.cc:740] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.694610 17004 consensus_queue.cc:260] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.695171 17005 tablet_bootstrap.cc:492] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a: No bootstrap required, opened a new log
I20260709 13:16:58.695695 17005 ts_tablet_manager.cc:1403] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.012s
I20260709 13:16:58.698803 17005 raft_consensus.cc:359] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:58.699535 17005 raft_consensus.cc:385] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.699818 17005 raft_consensus.cc:740] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.700507 17005 consensus_queue.cc:260] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:58.702680 17005 ts_tablet_manager.cc:1434] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:16:58.703613 17005 tablet_bootstrap.cc:492] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a: Bootstrap starting.
I20260709 13:16:58.703622 17004 ts_tablet_manager.cc:1434] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:16:58.710769 17005 tablet_bootstrap.cc:654] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.710914 17004 tablet_bootstrap.cc:492] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d: Bootstrap starting.
I20260709 13:16:58.716322 17006 tablet_bootstrap.cc:654] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.717562 17004 tablet_bootstrap.cc:654] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.721853 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676102ea6548b494330c22fcb4e02b" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:16:58.728030 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676102ea6548b494330c22fcb4e02b" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
W20260709 13:16:58.730667 16778 leader_election.cc:343] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:58.732081 16780 leader_election.cc:343] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b23676daefc14e888648187016e1c7ea (127.15.208.2:37757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.732661 16780 leader_election.cc:304] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a; no voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea
I20260709 13:16:58.732925 17011 raft_consensus.cc:493] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.733619 17010 raft_consensus.cc:2749] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:58.733428 17011 raft_consensus.cc:515] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.737846 17005 tablet_bootstrap.cc:492] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a: No bootstrap required, opened a new log
I20260709 13:16:58.738343 17005 ts_tablet_manager.cc:1403] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.011s
I20260709 13:16:58.738737 17006 tablet_bootstrap.cc:492] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea: No bootstrap required, opened a new log
I20260709 13:16:58.739221 17006 ts_tablet_manager.cc:1403] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.008s
I20260709 13:16:58.741169 17005 raft_consensus.cc:359] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.741634 17011 leader_election.cc:290] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:58.741953 17005 raft_consensus.cc:385] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.742038 17006 raft_consensus.cc:359] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.742352 17005 raft_consensus.cc:740] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.743237 17005 consensus_queue.cc:260] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.745632 17005 ts_tablet_manager.cc:1434] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:58.746701 17005 tablet_bootstrap.cc:492] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a: Bootstrap starting.
I20260709 13:16:58.747792 17004 tablet_bootstrap.cc:492] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d: No bootstrap required, opened a new log
I20260709 13:16:58.748258 17004 ts_tablet_manager.cc:1403] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.017s
I20260709 13:16:58.742802 17006 raft_consensus.cc:385] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.751386 17006 raft_consensus.cc:740] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.751600 17004 raft_consensus.cc:359] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.752359 17004 raft_consensus.cc:385] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.752892 17004 raft_consensus.cc:740] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.752343 17006 consensus_queue.cc:260] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.753127 17005 tablet_bootstrap.cc:654] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.753753 17004 consensus_queue.cc:260] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.763293 17004 ts_tablet_manager.cc:1434] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:16:58.764405 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
W20260709 13:16:58.766088 16929 leader_election.cc:343] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b23676daefc14e888648187016e1c7ea (127.15.208.2:37757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.768594 17006 ts_tablet_manager.cc:1434] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 13:16:58.769373 17004 tablet_bootstrap.cc:492] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d: Bootstrap starting.
I20260709 13:16:58.772331 16815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
W20260709 13:16:58.774164 16928 leader_election.cc:343] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.774644 16928 leader_election.cc:304] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d; no voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea
I20260709 13:16:58.775774 17011 raft_consensus.cc:2749] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:58.776142 17004 tablet_bootstrap.cc:654] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.777549 17006 tablet_bootstrap.cc:492] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea: Bootstrap starting.
I20260709 13:16:58.786742 17006 tablet_bootstrap.cc:654] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.789151 17004 tablet_bootstrap.cc:492] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d: No bootstrap required, opened a new log
I20260709 13:16:58.789868 17004 ts_tablet_manager.cc:1403] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.010s
I20260709 13:16:58.791858 17005 tablet_bootstrap.cc:492] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a: No bootstrap required, opened a new log
I20260709 13:16:58.792498 17005 ts_tablet_manager.cc:1403] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.023s
I20260709 13:16:58.793126 17006 tablet_bootstrap.cc:492] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea: No bootstrap required, opened a new log
W20260709 13:16:58.793282 16761 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:58.792900 17004 raft_consensus.cc:359] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.793661 17006 ts_tablet_manager.cc:1403] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.006s
I20260709 13:16:58.793886 17004 raft_consensus.cc:385] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.794240 17004 raft_consensus.cc:740] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.794993 17004 consensus_queue.cc:260] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.795843 17005 raft_consensus.cc:359] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.796584 17005 raft_consensus.cc:385] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.796236 17006 raft_consensus.cc:359] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.796921 17005 raft_consensus.cc:740] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.797025 17006 raft_consensus.cc:385] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.797243 17004 ts_tablet_manager.cc:1434] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:58.797390 17006 raft_consensus.cc:740] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.797811 17005 consensus_queue.cc:260] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.798265 17004 tablet_bootstrap.cc:492] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d: Bootstrap starting.
I20260709 13:16:58.798252 17006 consensus_queue.cc:260] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.803447 17006 ts_tablet_manager.cc:1434] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:16:58.804862 17006 tablet_bootstrap.cc:492] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea: Bootstrap starting.
I20260709 13:16:58.805204 17005 ts_tablet_manager.cc:1434] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 13:16:58.806268 17005 tablet_bootstrap.cc:492] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a: Bootstrap starting.
I20260709 13:16:58.806290 17004 tablet_bootstrap.cc:654] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.812084 17006 tablet_bootstrap.cc:654] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.817979 17004 tablet_bootstrap.cc:492] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d: No bootstrap required, opened a new log
I20260709 13:16:58.818480 17004 ts_tablet_manager.cc:1403] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:16:58.819330 17010 raft_consensus.cc:493] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.819836 17010 raft_consensus.cc:515] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.821388 17004 raft_consensus.cc:359] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.822021 17010 leader_election.cc:290] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:58.822181 17005 tablet_bootstrap.cc:654] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.822145 17004 raft_consensus.cc:385] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.822700 17004 raft_consensus.cc:740] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.823746 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d17526665334553b0669cca55028f81" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:16:58.823632 17004 consensus_queue.cc:260] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.824426 16890 raft_consensus.cc:2468] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 0.
I20260709 13:16:58.825526 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d17526665334553b0669cca55028f81" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:16:58.826148 16964 raft_consensus.cc:2468] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 0.
I20260709 13:16:58.826802 17004 ts_tablet_manager.cc:1434] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:58.827464 16780 leader_election.cc:304] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:58.828172 17010 raft_consensus.cc:2804] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.828540 17010 raft_consensus.cc:493] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.828879 17010 raft_consensus.cc:3060] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.830715 17004 tablet_bootstrap.cc:492] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d: Bootstrap starting.
I20260709 13:16:58.833590 17006 tablet_bootstrap.cc:492] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea: No bootstrap required, opened a new log
I20260709 13:16:58.834720 17006 ts_tablet_manager.cc:1403] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.004s
I20260709 13:16:58.838011 17006 raft_consensus.cc:359] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.838749 17006 raft_consensus.cc:385] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.839046 17006 raft_consensus.cc:740] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.840320 17004 tablet_bootstrap.cc:654] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.839905 17006 consensus_queue.cc:260] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.844563 17006 ts_tablet_manager.cc:1434] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:16:58.845481 17006 tablet_bootstrap.cc:492] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea: Bootstrap starting.
I20260709 13:16:58.849622 17005 tablet_bootstrap.cc:492] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a: No bootstrap required, opened a new log
I20260709 13:16:58.850277 17005 ts_tablet_manager.cc:1403] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.015s
I20260709 13:16:58.851971 17006 tablet_bootstrap.cc:654] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.857685 17005 raft_consensus.cc:359] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.858718 17005 raft_consensus.cc:385] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.859109 17005 raft_consensus.cc:740] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.860023 17005 consensus_queue.cc:260] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.862279 17010 raft_consensus.cc:515] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.864259 17010 leader_election.cc:290] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:58.865041 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d17526665334553b0669cca55028f81" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:16:58.865357 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d17526665334553b0669cca55028f81" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:16:58.865747 16890 raft_consensus.cc:3060] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.865916 16964 raft_consensus.cc:3060] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.873242 16964 raft_consensus.cc:2468] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 1.
I20260709 13:16:58.874351 16778 leader_election.cc:304] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:16:58.875188 17010 raft_consensus.cc:2804] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.875684 17010 raft_consensus.cc:697] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 1 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:16:58.875813 16890 raft_consensus.cc:2468] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 1.
I20260709 13:16:58.876569 17010 consensus_queue.cc:237] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.877409 17004 tablet_bootstrap.cc:492] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d: No bootstrap required, opened a new log
I20260709 13:16:58.877907 17004 ts_tablet_manager.cc:1403] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.016s
I20260709 13:16:58.878268 17006 tablet_bootstrap.cc:492] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea: No bootstrap required, opened a new log
I20260709 13:16:58.878720 17006 ts_tablet_manager.cc:1403] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.006s
I20260709 13:16:58.880115 17004 raft_consensus.cc:359] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.880990 17004 raft_consensus.cc:385] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.881318 17004 raft_consensus.cc:740] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.881896 17006 raft_consensus.cc:359] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.882643 17006 raft_consensus.cc:385] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.882229 17004 consensus_queue.cc:260] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.882959 17006 raft_consensus.cc:740] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.884682 17004 ts_tablet_manager.cc:1434] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:16:58.884537 17006 consensus_queue.cc:260] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.885408 17005 ts_tablet_manager.cc:1434] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a: Time spent starting tablet: real 0.035s	user 0.017s	sys 0.003s
I20260709 13:16:58.886006 17004 tablet_bootstrap.cc:492] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d: Bootstrap starting.
I20260709 13:16:58.886471 17005 tablet_bootstrap.cc:492] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a: Bootstrap starting.
I20260709 13:16:58.887989 16713 catalog_manager.cc:5697] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 1 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.889743 17006 ts_tablet_manager.cc:1434] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 13:16:58.890802 17006 tablet_bootstrap.cc:492] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea: Bootstrap starting.
I20260709 13:16:58.894121 17004 tablet_bootstrap.cc:654] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.898059 17006 tablet_bootstrap.cc:654] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.898023 17005 tablet_bootstrap.cc:654] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.906397 17004 tablet_bootstrap.cc:492] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d: No bootstrap required, opened a new log
I20260709 13:16:58.907020 17004 ts_tablet_manager.cc:1403] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:16:58.914497 17004 raft_consensus.cc:359] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.915428 17004 raft_consensus.cc:385] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.915786 17004 raft_consensus.cc:740] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.918773 17006 tablet_bootstrap.cc:492] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea: No bootstrap required, opened a new log
I20260709 13:16:58.919436 17006 ts_tablet_manager.cc:1403] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.004s
I20260709 13:16:58.921916 17011 raft_consensus.cc:493] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.922437 17011 raft_consensus.cc:515] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.923146 17006 raft_consensus.cc:359] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.923826 17006 raft_consensus.cc:385] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.924098 17006 raft_consensus.cc:740] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.924576 17011 leader_election.cc:290] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:58.924995 17006 consensus_queue.cc:260] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.926291 16815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dcc248549f4351853e4860659e2a88" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:16:58.926887 16815 raft_consensus.cc:2468] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 0.
I20260709 13:16:58.927426 17006 ts_tablet_manager.cc:1434] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:16:58.928413 17006 tablet_bootstrap.cc:492] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea: Bootstrap starting.
I20260709 13:16:58.929000 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dcc248549f4351853e4860659e2a88" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:16:58.929612 16890 raft_consensus.cc:2468] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 0.
I20260709 13:16:58.931119 16928 leader_election.cc:304] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:16:58.932668 17011 raft_consensus.cc:2804] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.933136 17011 raft_consensus.cc:493] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.933532 17011 raft_consensus.cc:3060] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.935776 17006 tablet_bootstrap.cc:654] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.939196 17017 raft_consensus.cc:493] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.932374 17004 consensus_queue.cc:260] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.939736 17017 raft_consensus.cc:515] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.942543 17017 leader_election.cc:290] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:58.942380 17011 raft_consensus.cc:515] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.945637 17011 leader_election.cc:290] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:58.946300 16815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dcc248549f4351853e4860659e2a88" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:16:58.946856 16815 raft_consensus.cc:3060] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.952075 16815 raft_consensus.cc:2468] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 1.
I20260709 13:16:58.960282 17005 tablet_bootstrap.cc:492] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a: No bootstrap required, opened a new log
I20260709 13:16:58.961051 17005 ts_tablet_manager.cc:1403] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a: Time spent bootstrapping tablet: real 0.075s	user 0.032s	sys 0.031s
I20260709 13:16:58.961925 16928 leader_election.cc:304] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:16:58.964497 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dcc248549f4351853e4860659e2a88" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:16:58.964434 17005 raft_consensus.cc:359] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.965281 16890 raft_consensus.cc:3060] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.965456 17005 raft_consensus.cc:385] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.965967 17005 raft_consensus.cc:740] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.966727 17004 ts_tablet_manager.cc:1434] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent starting tablet: real 0.059s	user 0.015s	sys 0.003s
I20260709 13:16:58.966850 17005 consensus_queue.cc:260] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.967836 17004 tablet_bootstrap.cc:492] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d: Bootstrap starting.
I20260709 13:16:58.969597 17005 ts_tablet_manager.cc:1434] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:16:58.970602 17005 tablet_bootstrap.cc:492] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a: Bootstrap starting.
I20260709 13:16:58.974283 17004 tablet_bootstrap.cc:654] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.975729 16890 raft_consensus.cc:2468] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 1.
I20260709 13:16:58.976992 17005 tablet_bootstrap.cc:654] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.965011 17039 raft_consensus.cc:2804] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.978055 17039 raft_consensus.cc:697] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Becoming Leader. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:16:58.979266 17039 consensus_queue.cc:237] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.985276 17006 tablet_bootstrap.cc:492] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea: No bootstrap required, opened a new log
I20260709 13:16:58.985940 17006 ts_tablet_manager.cc:1403] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.006s
I20260709 13:16:58.988495 17005 tablet_bootstrap.cc:492] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a: No bootstrap required, opened a new log
I20260709 13:16:58.989046 17005 ts_tablet_manager.cc:1403] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:16:58.991843 17005 raft_consensus.cc:359] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.993073 17005 raft_consensus.cc:385] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.993412 17005 raft_consensus.cc:740] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.993486 17006 raft_consensus.cc:359] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.994285 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:16:58.994650 17006 raft_consensus.cc:385] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.995016 16964 raft_consensus.cc:2468] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 0.
I20260709 13:16:58.994616 17005 consensus_queue.cc:260] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.995217 17006 raft_consensus.cc:740] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.996680 16853 leader_election.cc:304] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:58.996452 17006 consensus_queue.cc:260] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:58.997457 17005 ts_tablet_manager.cc:1434] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:16:58.997860 17017 raft_consensus.cc:2804] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.998560 17005 tablet_bootstrap.cc:492] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a: Bootstrap starting.
I20260709 13:16:58.998415 17017 raft_consensus.cc:493] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.999019 17017 raft_consensus.cc:3060] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.008373 17006 ts_tablet_manager.cc:1434] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 13:16:59.012885 16815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:16:59.015491 16815 raft_consensus.cc:2468] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 0.
I20260709 13:16:59.015729 17005 tablet_bootstrap.cc:654] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.016760 17004 tablet_bootstrap.cc:492] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d: No bootstrap required, opened a new log
I20260709 13:16:59.017401 17004 ts_tablet_manager.cc:1403] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.014s
I20260709 13:16:59.019399 17006 tablet_bootstrap.cc:492] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea: Bootstrap starting.
I20260709 13:16:59.008533 17017 raft_consensus.cc:515] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.021842 17039 raft_consensus.cc:493] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.022401 17039 raft_consensus.cc:515] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.023293 17017 leader_election.cc:290] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:59.023563 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:16:59.024243 16964 raft_consensus.cc:3060] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.025676 16815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:16:59.026324 16815 raft_consensus.cc:2468] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 0.
I20260709 13:16:59.027500 16928 leader_election.cc:304] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:16:59.026327 17039 leader_election.cc:290] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:59.028306 17011 raft_consensus.cc:2804] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.028677 17011 raft_consensus.cc:493] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.029032 17011 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.029963 17004 raft_consensus.cc:359] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.030646 17004 raft_consensus.cc:385] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.030977 17004 raft_consensus.cc:740] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.031836 17004 consensus_queue.cc:260] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.034132 17004 ts_tablet_manager.cc:1434] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:16:59.035049 17004 tablet_bootstrap.cc:492] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d: Bootstrap starting.
I20260709 13:16:59.035928 17011 raft_consensus.cc:515] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.036592 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:16:59.037581 16890 raft_consensus.cc:2468] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 0.
I20260709 13:16:59.038044 17006 tablet_bootstrap.cc:654] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.041422 17004 tablet_bootstrap.cc:654] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.041651 16815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:16:59.042368 16815 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.044024 17017 raft_consensus.cc:493] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.045488 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:16:59.044577 17017 raft_consensus.cc:515] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.046268 16814 raft_consensus.cc:3060] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.048311 17017 leader_election.cc:290] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:59.049125 17039 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.049624 17039 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:59.048928 16711 catalog_manager.cc:5697] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.050498 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676102ea6548b494330c22fcb4e02b" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:16:59.051249 16963 raft_consensus.cc:2468] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 0.
I20260709 13:16:59.051651 17039 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595)
I20260709 13:16:59.052701 16853 leader_election.cc:304] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:59.054562 17017 raft_consensus.cc:2804] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.055017 17017 raft_consensus.cc:493] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.055428 17017 raft_consensus.cc:3060] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.057004 16813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676102ea6548b494330c22fcb4e02b" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:16:59.057606 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:16:59.057888 16813 raft_consensus.cc:2468] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 0.
I20260709 13:16:59.058365 16890 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 0.
I20260709 13:16:59.059407 16812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:16:59.063721 17017 raft_consensus.cc:515] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.043893 17032 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.065474 17032 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:59.067111 16812 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 0.
I20260709 13:16:59.068423 17017 leader_election.cc:290] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:59.069937 17032 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:59.071254 16928 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:16:59.072291 17039 raft_consensus.cc:2804] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.072644 17039 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.072572 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:16:59.073276 17039 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.073539 16815 raft_consensus.cc:2468] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 1.
I20260709 13:16:59.074718 16928 leader_election.cc:304] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:16:59.076902 16962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676102ea6548b494330c22fcb4e02b" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:16:59.077543 16962 raft_consensus.cc:3060] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.078680 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:16:59.079604 16890 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 0.
I20260709 13:16:59.080832 17039 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:59.081511 16780 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:59.082226 16963 raft_consensus.cc:2393] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ac85832e522403ca896409edbd19f6a in current term 1: Already voted for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in this term.
I20260709 13:16:59.082851 17032 raft_consensus.cc:2804] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.083380 17032 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.083910 17032 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.085175 16812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676102ea6548b494330c22fcb4e02b" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:16:59.086350 17039 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595)
I20260709 13:16:59.087041 17039 raft_consensus.cc:2804] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.087536 17039 raft_consensus.cc:697] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Becoming Leader. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:16:59.088668 17039 consensus_queue.cc:237] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.092411 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:16:59.093223 16889 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.119109 17039 raft_consensus.cc:493] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.122208 17039 raft_consensus.cc:515] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.136643 16964 raft_consensus.cc:2468] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 1.
I20260709 13:16:59.085736 16812 raft_consensus.cc:3060] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.144979 16853 leader_election.cc:304] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:59.146225 17017 raft_consensus.cc:2804] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.146904 17017 raft_consensus.cc:697] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Becoming Leader. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:16:59.148165 17017 consensus_queue.cc:237] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.154621 16962 raft_consensus.cc:2468] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 1.
I20260709 13:16:59.156201 16853 leader_election.cc:304] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:59.165371 17010 raft_consensus.cc:493] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.166185 17010 raft_consensus.cc:515] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.170737 17039 leader_election.cc:290] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:59.172067 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:16:59.172235 17047 raft_consensus.cc:2804] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.172866 16890 raft_consensus.cc:2468] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 0.
I20260709 13:16:59.175423 16780 leader_election.cc:304] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:59.177193 17039 raft_consensus.cc:493] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.177524 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:16:59.177913 17039 raft_consensus.cc:515] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.178580 17011 leader_election.cc:290] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
W20260709 13:16:59.179545 16929 leader_election.cc:343] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b23676daefc14e888648187016e1c7ea (127.15.208.2:37757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.180687 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:16:59.181705 16888 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.182369 16814 raft_consensus.cc:2468] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 1.
I20260709 13:16:59.182019 17039 leader_election.cc:290] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:59.183491 16887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:16:59.171324 16889 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 1.
W20260709 13:16:59.185148 16929 leader_election.cc:343] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b23676daefc14e888648187016e1c7ea (127.15.208.2:37757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.186045 16929 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
W20260709 13:16:59.187510 16928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:41595, user_credentials={real_user=slave}} blocked reactor thread for 112873us
I20260709 13:16:59.188637 17010 leader_election.cc:290] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:59.189303 17010 raft_consensus.cc:2804] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.189700 16815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:16:59.189865 17010 raft_consensus.cc:493] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.190703 17010 raft_consensus.cc:3060] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.197487 16962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:16:59.198428 16962 raft_consensus.cc:2468] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 0.
I20260709 13:16:59.207190 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:16:59.208161 16814 raft_consensus.cc:2468] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 0.
I20260709 13:16:59.211716 16813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:16:59.215093 17005 tablet_bootstrap.cc:492] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a: No bootstrap required, opened a new log
I20260709 13:16:59.215859 17005 ts_tablet_manager.cc:1403] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a: Time spent bootstrapping tablet: real 0.218s	user 0.068s	sys 0.043s
W20260709 13:16:59.215101 16928 leader_election.cc:343] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.221458 16928 leader_election.cc:304] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d; no voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea
I20260709 13:16:59.221791 17005 raft_consensus.cc:359] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.222520 17005 raft_consensus.cc:385] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.222901 17005 raft_consensus.cc:740] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.223876 17005 consensus_queue.cc:260] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.225847 17011 raft_consensus.cc:2749] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.187207 17039 raft_consensus.cc:2804] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.228901 17039 raft_consensus.cc:697] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Becoming Leader. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:16:59.229100 17006 tablet_bootstrap.cc:492] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea: No bootstrap required, opened a new log
I20260709 13:16:59.229683 17006 ts_tablet_manager.cc:1403] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea: Time spent bootstrapping tablet: real 0.211s	user 0.011s	sys 0.004s
I20260709 13:16:59.229805 17039 consensus_queue.cc:237] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:59.232153 16711 catalog_manager.cc:5697] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea reported cstate change: term changed from 0 to 1, leader changed from <none> to b23676daefc14e888648187016e1c7ea (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b23676daefc14e888648187016e1c7ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:59.233016 16780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:37757, user_credentials={real_user=slave}} blocked reactor thread for 57729.4us
I20260709 13:16:59.233424 16928 leader_election.cc:304] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: b23676daefc14e888648187016e1c7ea
I20260709 13:16:59.233016 17047 raft_consensus.cc:697] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Becoming Leader. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:16:59.234565 17011 raft_consensus.cc:2804] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.200210 16888 raft_consensus.cc:2468] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 1.
I20260709 13:16:59.235145 17011 raft_consensus.cc:493] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.235874 17005 ts_tablet_manager.cc:1434] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:16:59.232617 17006 raft_consensus.cc:359] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.220193 17010 raft_consensus.cc:515] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.237161 17006 raft_consensus.cc:385] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.237761 17005 tablet_bootstrap.cc:492] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a: Bootstrap starting.
I20260709 13:16:59.238515 17006 raft_consensus.cc:740] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.234483 17032 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:16:59.237128 17011 raft_consensus.cc:3060] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.241420 17006 consensus_queue.cc:260] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.246526 17006 ts_tablet_manager.cc:1434] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:16:59.239878 17047 consensus_queue.cc:237] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.251029 16962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:16:59.252449 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:16:59.253110 16888 raft_consensus.cc:3060] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.251684 17010 leader_election.cc:290] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:59.248211 16815 raft_consensus.cc:2393] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 036ccdcdf4f5452bbc801d3aa3e0250d in current term 1: Already voted for candidate 5ac85832e522403ca896409edbd19f6a in this term.
I20260709 13:16:59.254458 17006 tablet_bootstrap.cc:492] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea: Bootstrap starting.
I20260709 13:16:59.253082 16710 catalog_manager.cc:5697] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.255710 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:16:59.256313 16964 raft_consensus.cc:3060] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.256776 17004 tablet_bootstrap.cc:492] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d: No bootstrap required, opened a new log
I20260709 13:16:59.257259 17004 ts_tablet_manager.cc:1403] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent bootstrapping tablet: real 0.222s	user 0.047s	sys 0.055s
I20260709 13:16:59.266059 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:16:59.266927 16889 raft_consensus.cc:2393] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ac85832e522403ca896409edbd19f6a in current term 1: Already voted for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in this term.
I20260709 13:16:59.269881 16780 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a; no voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea
I20260709 13:16:59.271842 17004 raft_consensus.cc:359] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.272552 17004 raft_consensus.cc:385] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.272621 17010 raft_consensus.cc:2749] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.272861 17004 raft_consensus.cc:740] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.267944 17032 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 election: Requested vote from peers 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:59.274394 17004 consensus_queue.cc:260] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.267722 16888 raft_consensus.cc:2468] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 1.
I20260709 13:16:59.276248 16780 leader_election.cc:304] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:59.277136 17004 ts_tablet_manager.cc:1434] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:16:59.277036 17010 raft_consensus.cc:2804] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.277614 17010 raft_consensus.cc:697] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 1 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:16:59.278414 17010 consensus_queue.cc:237] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.279844 16710 catalog_manager.cc:5697] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.282544 16812 raft_consensus.cc:2468] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 1.
I20260709 13:16:59.283346 17005 tablet_bootstrap.cc:654] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.283385 16964 raft_consensus.cc:2468] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 1.
I20260709 13:16:59.287923 17006 tablet_bootstrap.cc:654] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.302691 16711 catalog_manager.cc:5697] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 1 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.311496 17011 raft_consensus.cc:515] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.321303 16812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:16:59.322685 16812 raft_consensus.cc:3060] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.315891 16710 catalog_manager.cc:5697] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea reported cstate change: term changed from 0 to 1, leader changed from <none> to b23676daefc14e888648187016e1c7ea (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b23676daefc14e888648187016e1c7ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.329936 17011 leader_election.cc:290] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:59.331424 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea"
W20260709 13:16:59.333195 16929 leader_election.cc:343] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b23676daefc14e888648187016e1c7ea (127.15.208.2:37757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.334618 16812 raft_consensus.cc:2468] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 1.
I20260709 13:16:59.336086 16928 leader_election.cc:304] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: b23676daefc14e888648187016e1c7ea
I20260709 13:16:59.337041 17011 raft_consensus.cc:2804] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.337616 17011 raft_consensus.cc:697] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Becoming Leader. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:16:59.339011 17005 tablet_bootstrap.cc:492] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a: No bootstrap required, opened a new log
I20260709 13:16:59.338518 17011 consensus_queue.cc:237] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.339543 17005 ts_tablet_manager.cc:1403] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a: Time spent bootstrapping tablet: real 0.102s	user 0.027s	sys 0.023s
I20260709 13:16:59.342904 17005 raft_consensus.cc:359] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.343678 17005 raft_consensus.cc:385] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.344017 17005 raft_consensus.cc:740] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.344820 17006 tablet_bootstrap.cc:492] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea: No bootstrap required, opened a new log
I20260709 13:16:59.345328 17006 ts_tablet_manager.cc:1403] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.031s
I20260709 13:16:59.345355 17005 consensus_queue.cc:260] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.348498 17005 ts_tablet_manager.cc:1434] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:16:59.350469 17006 raft_consensus.cc:359] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.351107 17006 raft_consensus.cc:385] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.351373 17006 raft_consensus.cc:740] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.352146 17006 consensus_queue.cc:260] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.352013 16710 catalog_manager.cc:5697] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.354423 17006 ts_tablet_manager.cc:1434] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:59.357095 17006 tablet_bootstrap.cc:492] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea: Bootstrap starting.
I20260709 13:16:59.363404 17006 tablet_bootstrap.cc:654] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.368710 17006 tablet_bootstrap.cc:492] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea: No bootstrap required, opened a new log
I20260709 13:16:59.369167 17006 ts_tablet_manager.cc:1403] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:16:59.370797 17010 consensus_queue.cc:1048] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.371611 17006 raft_consensus.cc:359] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.372349 17006 raft_consensus.cc:385] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.372639 17006 raft_consensus.cc:740] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.373230 17006 consensus_queue.cc:260] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.374989 17006 ts_tablet_manager.cc:1434] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:59.384739 17032 consensus_queue.cc:1048] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:59.562075 17011 raft_consensus.cc:493] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.562758 17011 raft_consensus.cc:515] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.565006 17011 leader_election.cc:290] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:59.565824 16812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:16:59.566016 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:16:59.566496 16812 raft_consensus.cc:2468] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 0.
I20260709 13:16:59.566663 16888 raft_consensus.cc:2468] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 0.
I20260709 13:16:59.567713 16928 leader_election.cc:304] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:16:59.568485 17011 raft_consensus.cc:2804] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.568938 17011 raft_consensus.cc:493] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.569295 17011 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.574293 17011 raft_consensus.cc:515] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.576261 17011 leader_election.cc:290] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:16:59.577267 16812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:16:59.577989 16812 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.577841 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:16:59.578622 16888 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.579612 17039 consensus_queue.cc:1048] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.586333 16888 raft_consensus.cc:2468] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 1.
I20260709 13:16:59.586333 16812 raft_consensus.cc:2468] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 1.
I20260709 13:16:59.588119 16929 leader_election.cc:304] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:59.589205 17053 raft_consensus.cc:2804] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.589787 17053 raft_consensus.cc:697] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Becoming Leader. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:16:59.590704 17053 consensus_queue.cc:237] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.594048 17011 consensus_queue.cc:1048] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.602629 16710 catalog_manager.cc:5697] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.616971 17047 consensus_queue.cc:1048] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.627965 17053 consensus_queue.cc:1048] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.628698 17055 consensus_queue.cc:1048] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:59.629706 17053 consensus_queue.cc:1048] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.647315 17055 consensus_queue.cc:1048] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:59.657565 17053 consensus_queue.cc:1048] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:59.657615 17039 consensus_queue.cc:1048] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.660988 17010 consensus_queue.cc:1048] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.666429 17047 consensus_queue.cc:1048] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.704623 17056 consensus_queue.cc:1048] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:59.733444 16889 raft_consensus.cc:3060] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.740661 17039 consensus_queue.cc:1048] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.745836 17055 raft_consensus.cc:493] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.746265 17055 raft_consensus.cc:515] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.748575 17055 leader_election.cc:290] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:59.751189 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:16:59.751516 17011 consensus_queue.cc:1048] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.751870 16964 raft_consensus.cc:2468] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 0.
I20260709 13:16:59.753121 16853 leader_election.cc:304] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:59.753374 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:16:59.753980 16814 raft_consensus.cc:2468] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 0.
I20260709 13:16:59.754299 17055 raft_consensus.cc:2804] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.754814 17055 raft_consensus.cc:493] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.755234 17055 raft_consensus.cc:3060] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.763527 17055 raft_consensus.cc:515] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.765545 17055 leader_election.cc:290] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:16:59.766320 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:16:59.766513 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:16:59.766911 16814 raft_consensus.cc:3060] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.767092 16964 raft_consensus.cc:3060] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.772732 16964 raft_consensus.cc:2468] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 1.
I20260709 13:16:59.773217 16814 raft_consensus.cc:2468] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 1.
I20260709 13:16:59.773859 16853 leader_election.cc:304] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:16:59.774665 17055 raft_consensus.cc:2804] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.775054 17055 raft_consensus.cc:697] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Becoming Leader. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:16:59.775718 17055 consensus_queue.cc:237] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:16:59.784020 16711 catalog_manager.cc:5697] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea reported cstate change: term changed from 0 to 1, leader changed from <none> to b23676daefc14e888648187016e1c7ea (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b23676daefc14e888648187016e1c7ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.025123 17011 consensus_queue.cc:1048] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.036162 17011 consensus_queue.cc:1048] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.064941 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a"
dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
mode: GRACEFUL
new_leader_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:48510
I20260709 13:17:00.065497 16964 raft_consensus.cc:606] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Received request to transfer leadership to TS 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:00.080251 16889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472"
dest_uuid: "b23676daefc14e888648187016e1c7ea"
mode: GRACEFUL
new_leader_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:43406
I20260709 13:17:00.080937 16889 raft_consensus.cc:606] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Received request to transfer leadership to TS 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:00.089046 16889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd"
dest_uuid: "b23676daefc14e888648187016e1c7ea"
mode: GRACEFUL
new_leader_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:43406
I20260709 13:17:00.089582 16889 raft_consensus.cc:606] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Received request to transfer leadership to TS 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:00.094982 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768"
dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
mode: GRACEFUL
new_leader_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:48510
I20260709 13:17:00.095469 16964 raft_consensus.cc:606] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Received request to transfer leadership to TS 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:00.100919 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865"
dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
mode: GRACEFUL
new_leader_uuid: "b23676daefc14e888648187016e1c7ea"
 from {username='slave'} at 127.0.0.1:48510
I20260709 13:17:00.101498 16964 raft_consensus.cc:606] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Received request to transfer leadership to TS b23676daefc14e888648187016e1c7ea
I20260709 13:17:00.111155 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638"
dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
mode: GRACEFUL
new_leader_uuid: "b23676daefc14e888648187016e1c7ea"
 from {username='slave'} at 127.0.0.1:48510
I20260709 13:17:00.111716 16964 raft_consensus.cc:606] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Received request to transfer leadership to TS b23676daefc14e888648187016e1c7ea
I20260709 13:17:00.126137 16814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d17526665334553b0669cca55028f81"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
mode: GRACEFUL
new_leader_uuid: "b23676daefc14e888648187016e1c7ea"
 from {username='slave'} at 127.0.0.1:37170
I20260709 13:17:00.126960 16814 raft_consensus.cc:606] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 1 LEADER]: Received request to transfer leadership to TS b23676daefc14e888648187016e1c7ea
I20260709 13:17:00.133070 17039 raft_consensus.cc:993] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d: : Instructing follower 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:00.133528 17011 raft_consensus.cc:1081] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Signalling peer 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:00.135241 16814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:37150
I20260709 13:17:00.135756 16814 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.136157 16814 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.140827 16814 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:00.142694 16814 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 2 election: Requested vote from peers 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:17:00.143594 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:00.143909 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:00.144160 16964 raft_consensus.cc:3055] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:00.144465 16889 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.144526 16964 raft_consensus.cc:740] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:00.145543 16964 consensus_queue.cc:260] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:00.146611 16964 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.150306 16889 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 2.
I20260709 13:17:00.151394 16780 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:00.152091 17010 raft_consensus.cc:2804] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:00.152156 16964 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 2.
I20260709 13:17:00.152652 17010 raft_consensus.cc:697] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:00.154049 17010 consensus_queue.cc:237] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:00.160279 16710 catalog_manager.cc:5697] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 1 to 2, leader changed from 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3) to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 2 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.209776 17039 raft_consensus.cc:993] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d: : Instructing follower 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:00.210232 17011 raft_consensus.cc:1081] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Signalling peer 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:00.211803 16814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:37150
I20260709 13:17:00.212291 16814 raft_consensus.cc:493] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.212618 16814 raft_consensus.cc:3060] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.218645 16814 raft_consensus.cc:515] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.220484 16814 leader_election.cc:290] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 2 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:00.221145 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:00.221729 16889 raft_consensus.cc:3060] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.224224 17055 consensus_queue.cc:1048] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.221634 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:00.225135 16964 raft_consensus.cc:3055] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:00.225894 16964 raft_consensus.cc:740] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:00.226784 16964 consensus_queue.cc:260] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.227597 16889 raft_consensus.cc:2468] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 2.
I20260709 13:17:00.228116 16964 raft_consensus.cc:3060] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.228808 16780 leader_election.cc:304] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:00.229763 17010 raft_consensus.cc:2804] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:00.230242 17010 raft_consensus.cc:697] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:00.231017 17010 consensus_queue.cc:237] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.235350 16964 raft_consensus.cc:2468] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 2.
I20260709 13:17:00.236060 17017 raft_consensus.cc:993] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea: : Instructing follower 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:00.236490 17017 raft_consensus.cc:1081] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Signalling peer 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:00.239114 16814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:37162
I20260709 13:17:00.239739 16814 raft_consensus.cc:493] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.240375 16814 raft_consensus.cc:3060] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.241631 17047 consensus_queue.cc:1048] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.245393 16711 catalog_manager.cc:5697] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 1 to 2, leader changed from 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3) to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 2 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.247519 16814 raft_consensus.cc:515] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.250876 16815 raft_consensus.cc:1240] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Rejecting Update request from peer b23676daefc14e888648187016e1c7ea for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:00.251889 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:00.252496 16889 raft_consensus.cc:3055] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:00.252856 16889 raft_consensus.cc:740] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:17:00.253729 16889 consensus_queue.cc:260] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.254149 16814 leader_election.cc:290] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 2 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:00.254652 16889 raft_consensus.cc:3060] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.258157 16962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:00.261427 16889 raft_consensus.cc:2468] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 2.
I20260709 13:17:00.262652 16780 leader_election.cc:304] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 036ccdcdf4f5452bbc801d3aa3e0250d
I20260709 13:17:00.263888 17017 raft_consensus.cc:993] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea: : Instructing follower 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:00.263824 17010 raft_consensus.cc:2804] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:00.264425 17047 raft_consensus.cc:1081] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Signalling peer 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:00.264467 17010 raft_consensus.cc:697] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:00.265595 17010 consensus_queue.cc:237] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.266345 16814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:37162
I20260709 13:17:00.266850 16814 raft_consensus.cc:493] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.267241 16814 raft_consensus.cc:3060] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.273165 16711 catalog_manager.cc:5697] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 1 to 2, leader changed from b23676daefc14e888648187016e1c7ea (127.15.208.2) to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 2 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.274044 16814 raft_consensus.cc:515] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.276561 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:00.276975 16814 leader_election.cc:290] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 2 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:00.277130 16889 raft_consensus.cc:3055] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:00.277403 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:00.277523 16889 raft_consensus.cc:740] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:17:00.278136 16964 raft_consensus.cc:3060] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.278566 16889 consensus_queue.cc:260] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.279717 16889 raft_consensus.cc:3060] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.284250 16964 raft_consensus.cc:2468] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 2.
I20260709 13:17:00.285215 16778 leader_election.cc:304] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:17:00.285650 16889 raft_consensus.cc:2468] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 2.
I20260709 13:17:00.286083 17010 raft_consensus.cc:2804] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:00.286581 17010 raft_consensus.cc:697] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:00.287251 17010 consensus_queue.cc:237] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.293813 16711 catalog_manager.cc:5697] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 1 to 2, leader changed from b23676daefc14e888648187016e1c7ea (127.15.208.2) to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 2 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.447386 17011 raft_consensus.cc:993] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d: : Instructing follower b23676daefc14e888648187016e1c7ea to start an election
I20260709 13:17:00.447821 17053 raft_consensus.cc:1081] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Signalling peer b23676daefc14e888648187016e1c7ea to start an election
I20260709 13:17:00.449410 16889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638"
dest_uuid: "b23676daefc14e888648187016e1c7ea"
 from {username='slave'} at 127.0.0.1:43398
I20260709 13:17:00.449957 16889 raft_consensus.cc:493] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.450291 16889 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.454851 16889 raft_consensus.cc:515] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.456598 16889 leader_election.cc:290] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 2 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:00.457537 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:00.457727 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:00.458209 16814 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.458288 16964 raft_consensus.cc:3055] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:00.458782 16964 raft_consensus.cc:740] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:00.459623 16964 consensus_queue.cc:260] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.460796 16964 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.465936 16814 raft_consensus.cc:2468] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 2.
I20260709 13:17:00.467404 16854 leader_election.cc:304] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:00.467981 16964 raft_consensus.cc:2468] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 2.
I20260709 13:17:00.468346 17047 raft_consensus.cc:2804] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:00.468896 17047 raft_consensus.cc:697] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Becoming Leader. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:17:00.469798 17047 consensus_queue.cc:237] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.476689 16711 catalog_manager.cc:5697] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea reported cstate change: term changed from 1 to 2, leader changed from 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3) to b23676daefc14e888648187016e1c7ea (127.15.208.2). New cstate: current_term: 2 leader_uuid: "b23676daefc14e888648187016e1c7ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.501263 17011 raft_consensus.cc:993] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d: : Instructing follower b23676daefc14e888648187016e1c7ea to start an election
I20260709 13:17:00.501767 17053 raft_consensus.cc:1081] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Signalling peer b23676daefc14e888648187016e1c7ea to start an election
I20260709 13:17:00.503372 16889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865"
dest_uuid: "b23676daefc14e888648187016e1c7ea"
 from {username='slave'} at 127.0.0.1:43398
I20260709 13:17:00.504004 16889 raft_consensus.cc:493] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.504319 16889 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.509629 16889 raft_consensus.cc:515] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.510218 17056 raft_consensus.cc:993] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a: : Instructing follower b23676daefc14e888648187016e1c7ea to start an election
I20260709 13:17:00.510684 17010 raft_consensus.cc:1081] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 1 LEADER]: Signalling peer b23676daefc14e888648187016e1c7ea to start an election
I20260709 13:17:00.511637 16889 leader_election.cc:290] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 2 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:00.512444 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:00.512506 16887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d17526665334553b0669cca55028f81"
dest_uuid: "b23676daefc14e888648187016e1c7ea"
 from {username='slave'} at 127.0.0.1:43394
I20260709 13:17:00.512823 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:00.513170 16814 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.513324 16964 raft_consensus.cc:3055] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:00.513214 16887 raft_consensus.cc:493] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.513744 16964 raft_consensus.cc:740] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:00.513852 16887 raft_consensus.cc:3060] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.514621 16964 consensus_queue.cc:260] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.515867 16964 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.518268 16814 raft_consensus.cc:2468] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 2.
I20260709 13:17:00.519387 16854 leader_election.cc:304] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:00.520195 17047 raft_consensus.cc:2804] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:00.520654 17047 raft_consensus.cc:697] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Becoming Leader. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:17:00.521492 17047 consensus_queue.cc:237] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.521957 16887 raft_consensus.cc:515] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.522693 16964 raft_consensus.cc:2468] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 2.
I20260709 13:17:00.524549 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d17526665334553b0669cca55028f81" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:00.525041 16814 raft_consensus.cc:3055] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:00.525305 16814 raft_consensus.cc:740] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:00.525740 16887 leader_election.cc:290] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 2 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:00.526105 16814 consensus_queue.cc:260] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.526947 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d17526665334553b0669cca55028f81" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:00.527352 16814 raft_consensus.cc:3060] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.527534 16964 raft_consensus.cc:3060] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.528983 16711 catalog_manager.cc:5697] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea reported cstate change: term changed from 1 to 2, leader changed from 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3) to b23676daefc14e888648187016e1c7ea (127.15.208.2). New cstate: current_term: 2 leader_uuid: "b23676daefc14e888648187016e1c7ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.534325 16964 raft_consensus.cc:2468] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 2.
I20260709 13:17:00.534334 16814 raft_consensus.cc:2468] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 2.
I20260709 13:17:00.535792 16853 leader_election.cc:304] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:00.536549 17047 raft_consensus.cc:2804] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:00.537066 17047 raft_consensus.cc:697] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Becoming Leader. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:17:00.537863 17047 consensus_queue.cc:237] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:00.544246 16711 catalog_manager.cc:5697] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea reported cstate change: term changed from 1 to 2, leader changed from 5ac85832e522403ca896409edbd19f6a (127.15.208.1) to b23676daefc14e888648187016e1c7ea (127.15.208.2). New cstate: current_term: 2 leader_uuid: "b23676daefc14e888648187016e1c7ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.659848 16964 raft_consensus.cc:1275] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.661336 17010 consensus_queue.cc:1048] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.672088 16887 raft_consensus.cc:1275] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.673447 17010 consensus_queue.cc:1048] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.676527 16889 raft_consensus.cc:1275] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.678027 17032 consensus_queue.cc:1048] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.685204 16964 raft_consensus.cc:1275] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.686789 17010 consensus_queue.cc:1048] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.691704 16962 raft_consensus.cc:1275] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.693498 17032 consensus_queue.cc:1048] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.704881 16889 raft_consensus.cc:1275] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.706235 17032 consensus_queue.cc:1048] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.746622 16962 raft_consensus.cc:3060] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:00.751376 16962 raft_consensus.cc:1275] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.752722 17032 consensus_queue.cc:1048] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.764757 16889 raft_consensus.cc:1275] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.766245 17032 consensus_queue.cc:1048] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.859843 16962 raft_consensus.cc:1275] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Refusing update from remote peer b23676daefc14e888648187016e1c7ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.861553 17047 consensus_queue.cc:1048] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.869855 16814 raft_consensus.cc:1275] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Refusing update from remote peer b23676daefc14e888648187016e1c7ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.871447 17099 consensus_queue.cc:1048] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:00.942302 16814 raft_consensus.cc:1275] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Refusing update from remote peer b23676daefc14e888648187016e1c7ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.943683 17017 consensus_queue.cc:1048] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.952991 16962 raft_consensus.cc:1275] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Refusing update from remote peer b23676daefc14e888648187016e1c7ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.954573 17047 consensus_queue.cc:1048] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.973407 16962 raft_consensus.cc:1275] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Refusing update from remote peer b23676daefc14e888648187016e1c7ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.974537 17047 consensus_queue.cc:1048] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.983348 16814 raft_consensus.cc:1275] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Refusing update from remote peer b23676daefc14e888648187016e1c7ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:00.984743 17099 consensus_queue.cc:1048] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:03.164328 16192 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:17:03.165153 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:03.185596 16814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
mode: GRACEFUL
new_leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
 from {username='slave'} at 127.0.0.1:48262
I20260709 13:17:03.186178 16814 raft_consensus.cc:606] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Received request to transfer leadership to TS 036ccdcdf4f5452bbc801d3aa3e0250d
I20260709 13:17:03.189100 16814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
mode: GRACEFUL
new_leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
 from {username='slave'} at 127.0.0.1:48262
I20260709 13:17:03.189693 16814 raft_consensus.cc:606] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 1 LEADER]: Received request to transfer leadership to TS 036ccdcdf4f5452bbc801d3aa3e0250d
I20260709 13:17:03.190915 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:03.191479 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:03.353363 17110 raft_consensus.cc:993] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a: : Instructing follower 036ccdcdf4f5452bbc801d3aa3e0250d to start an election
I20260709 13:17:03.353809 17110 raft_consensus.cc:1081] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 1 LEADER]: Signalling peer 036ccdcdf4f5452bbc801d3aa3e0250d to start an election
I20260709 13:17:03.355322 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923"
dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
 from {username='slave'} at 127.0.0.1:48492
I20260709 13:17:03.355860 16964 raft_consensus.cc:493] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.356163 16964 raft_consensus.cc:3060] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:03.360971 16964 raft_consensus.cc:515] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:03.362458 16964 leader_election.cc:290] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 2 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:17:03.363443 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:03.363613 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:03.363996 16814 raft_consensus.cc:3055] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:03.364228 16889 raft_consensus.cc:3060] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:03.364355 16814 raft_consensus.cc:740] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:03.365193 16814 consensus_queue.cc:260] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:03.366060 16814 raft_consensus.cc:3060] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:03.369254 16889 raft_consensus.cc:2468] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 2.
I20260709 13:17:03.370349 16929 leader_election.cc:304] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:03.370508 16814 raft_consensus.cc:2468] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 2.
I20260709 13:17:03.371140 17011 raft_consensus.cc:2804] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:03.372340 17011 raft_consensus.cc:697] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 LEADER]: Becoming Leader. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:03.373195 17011 consensus_queue.cc:237] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:03.382419 16713 catalog_manager.cc:5697] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d reported cstate change: term changed from 1 to 2, leader changed from 5ac85832e522403ca896409edbd19f6a (127.15.208.1) to 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3). New cstate: current_term: 2 leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:03.497538 17056 raft_consensus.cc:993] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a: : Instructing follower 036ccdcdf4f5452bbc801d3aa3e0250d to start an election
I20260709 13:17:03.498065 17110 raft_consensus.cc:1081] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Signalling peer 036ccdcdf4f5452bbc801d3aa3e0250d to start an election
I20260709 13:17:03.499500 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a"
dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
 from {username='slave'} at 127.0.0.1:48492
I20260709 13:17:03.499958 16964 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.500186 16964 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.505241 16964 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:03.506815 16964 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 3 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595)
I20260709 13:17:03.507676 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:03.507956 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:03.508227 16889 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.508538 16814 raft_consensus.cc:3055] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:03.508834 16814 raft_consensus.cc:740] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:03.509475 16814 consensus_queue.cc:260] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:03.510299 16814 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.512439 16889 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 3.
I20260709 13:17:03.513398 16929 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:03.514092 17011 raft_consensus.cc:2804] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:03.514498 16814 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 3.
I20260709 13:17:03.514508 17011 raft_consensus.cc:697] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 LEADER]: Becoming Leader. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:03.515480 17011 consensus_queue.cc:237] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:03.522742 16713 catalog_manager.cc:5697] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d reported cstate change: term changed from 2 to 3, leader changed from 5ac85832e522403ca896409edbd19f6a (127.15.208.1) to 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3). New cstate: current_term: 3 leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.757354 16889 raft_consensus.cc:1275] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Refusing update from remote peer 036ccdcdf4f5452bbc801d3aa3e0250d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:03.759085 17011 consensus_queue.cc:1048] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:03.770285 16814 raft_consensus.cc:1275] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Refusing update from remote peer 036ccdcdf4f5452bbc801d3aa3e0250d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:03.771905 17011 consensus_queue.cc:1048] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:03.931491 16889 raft_consensus.cc:1275] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Refusing update from remote peer 036ccdcdf4f5452bbc801d3aa3e0250d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.932772 17011 consensus_queue.cc:1048] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.943024 16814 raft_consensus.cc:1275] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Refusing update from remote peer 036ccdcdf4f5452bbc801d3aa3e0250d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.944574 17120 consensus_queue.cc:1048] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:04.192574 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:04.204164 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a"
dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
mode: GRACEFUL
new_leader_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:48510
I20260709 13:17:04.204797 16964 raft_consensus.cc:606] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 LEADER]: Received request to transfer leadership to TS 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:04.212399 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923"
dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
mode: GRACEFUL
new_leader_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:48510
I20260709 13:17:04.212884 16964 raft_consensus.cc:606] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 LEADER]: Received request to transfer leadership to TS 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:04.223840 16887 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865"
dest_uuid: "b23676daefc14e888648187016e1c7ea"
mode: GRACEFUL
new_leader_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:43406
I20260709 13:17:04.224433 16887 raft_consensus.cc:606] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Received request to transfer leadership to TS 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:04.229578 16887 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58676102ea6548b494330c22fcb4e02b"
dest_uuid: "b23676daefc14e888648187016e1c7ea"
mode: GRACEFUL
new_leader_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:43406
I20260709 13:17:04.230126 16887 raft_consensus.cc:606] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Received request to transfer leadership to TS 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:04.235049 16887 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638"
dest_uuid: "b23676daefc14e888648187016e1c7ea"
mode: GRACEFUL
new_leader_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:43406
I20260709 13:17:04.235600 16887 raft_consensus.cc:606] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Received request to transfer leadership to TS 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:04.236562 17124 raft_consensus.cc:993] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea: : Instructing follower 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:04.236996 17101 raft_consensus.cc:1081] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Signalling peer 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:04.238620 16814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:37162
I20260709 13:17:04.239163 16814 raft_consensus.cc:493] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:04.239513 16814 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.244583 16814 raft_consensus.cc:515] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.246073 16814 leader_election.cc:290] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 3 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:04.247043 16887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:04.247138 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:04.247717 16887 raft_consensus.cc:3055] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:04.247793 16964 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.248065 16887 raft_consensus.cc:740] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:17:04.248791 16887 consensus_queue.cc:260] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.249756 16887 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.252225 16964 raft_consensus.cc:2468] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 3.
I20260709 13:17:04.253204 16778 leader_election.cc:304] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:17:04.253881 17110 raft_consensus.cc:2804] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:04.254307 16887 raft_consensus.cc:2468] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 3.
I20260709 13:17:04.254941 17110 raft_consensus.cc:697] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:04.255702 17110 consensus_queue.cc:237] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.261886 16713 catalog_manager.cc:5697] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 2 to 3, leader changed from b23676daefc14e888648187016e1c7ea (127.15.208.2) to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 3 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:04.317512 17011 raft_consensus.cc:993] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d: : Instructing follower 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:04.318037 17120 raft_consensus.cc:1081] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 LEADER]: Signalling peer 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:04.319615 16814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:37150
I20260709 13:17:04.320111 16814 raft_consensus.cc:493] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:04.320441 16814 raft_consensus.cc:3060] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.325194 16814 raft_consensus.cc:515] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.326999 16814 leader_election.cc:290] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 3 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:04.327979 16887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:04.328187 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:04.328563 16887 raft_consensus.cc:3060] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.328749 16964 raft_consensus.cc:3055] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:04.329252 16964 raft_consensus.cc:740] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:04.329972 16964 consensus_queue.cc:260] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.330862 16964 raft_consensus.cc:3060] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.334069 16887 raft_consensus.cc:2468] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 3.
I20260709 13:17:04.335304 16780 leader_election.cc:304] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:04.335390 16964 raft_consensus.cc:2468] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 3.
I20260709 13:17:04.336181 17110 raft_consensus.cc:2804] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:04.336730 17110 raft_consensus.cc:697] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:04.337520 17110 consensus_queue.cc:237] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.343919 16713 catalog_manager.cc:5697] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 2 to 3, leader changed from 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3) to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 3 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:04.514926 17101 raft_consensus.cc:993] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea: : Instructing follower 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:04.515436 17124 raft_consensus.cc:1081] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Signalling peer 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:04.516924 16814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:37162
I20260709 13:17:04.517412 16814 raft_consensus.cc:493] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:04.517710 16814 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.521998 16814 raft_consensus.cc:515] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.523592 16814 leader_election.cc:290] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 3 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:04.524441 16887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:04.524729 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:04.525009 16887 raft_consensus.cc:3055] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:04.525341 16887 raft_consensus.cc:740] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:17:04.525334 16964 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.527724 16887 consensus_queue.cc:260] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.529011 16887 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.531405 16964 raft_consensus.cc:2468] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 3.
I20260709 13:17:04.532673 16778 leader_election.cc:304] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:17:04.533703 17110 raft_consensus.cc:2804] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:04.534317 17110 raft_consensus.cc:697] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:04.535496 16887 raft_consensus.cc:2468] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 3.
I20260709 13:17:04.535295 17110 consensus_queue.cc:237] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.542264 16713 catalog_manager.cc:5697] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 2 to 3, leader changed from b23676daefc14e888648187016e1c7ea (127.15.208.2) to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 3 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:04.559482 17101 raft_consensus.cc:993] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea: : Instructing follower 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:04.560079 17124 raft_consensus.cc:1081] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Signalling peer 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:04.561811 16815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58676102ea6548b494330c22fcb4e02b"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:37162
I20260709 13:17:04.562464 16815 raft_consensus.cc:493] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:04.562687 17011 raft_consensus.cc:993] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d: : Instructing follower 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:04.562973 16815 raft_consensus.cc:3060] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:04.563213 17120 raft_consensus.cc:1081] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 LEADER]: Signalling peer 5ac85832e522403ca896409edbd19f6a to start an election
I20260709 13:17:04.565024 16814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
 from {username='slave'} at 127.0.0.1:37150
I20260709 13:17:04.565621 16814 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:04.565956 16814 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:04.569003 16815 raft_consensus.cc:515] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.570051 16814 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:04.570971 16815 leader_election.cc:290] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 2 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:04.571645 16887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676102ea6548b494330c22fcb4e02b" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:04.572053 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58676102ea6548b494330c22fcb4e02b" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:04.572230 16887 raft_consensus.cc:3055] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:04.572515 16814 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 4 election: Requested vote from peers 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:17:04.572621 16887 raft_consensus.cc:740] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:17:04.572633 16964 raft_consensus.cc:3060] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:04.573231 16962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:04.573881 16962 raft_consensus.cc:3055] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:04.573920 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "5ac85832e522403ca896409edbd19f6a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:04.574301 16962 raft_consensus.cc:740] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:04.574565 16889 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:04.573588 16887 consensus_queue.cc:260] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.575143 16962 consensus_queue.cc:260] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:04.576144 16887 raft_consensus.cc:3060] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:04.576329 16962 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:04.580142 16964 raft_consensus.cc:2468] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 2.
I20260709 13:17:04.581070 16889 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 4.
I20260709 13:17:04.581256 16778 leader_election.cc:304] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:17:04.582195 17110 raft_consensus.cc:2804] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:04.582170 16780 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:04.582819 17110 raft_consensus.cc:697] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:04.583108 17127 raft_consensus.cc:2804] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:04.583566 17127 raft_consensus.cc:697] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 4 LEADER]: Becoming Leader. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:04.582876 16887 raft_consensus.cc:2468] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 2.
I20260709 13:17:04.584000 17110 consensus_queue.cc:237] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:04.584364 17127 consensus_queue.cc:237] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:04.586402 16962 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac85832e522403ca896409edbd19f6a in term 4.
I20260709 13:17:04.592577 16713 catalog_manager.cc:5697] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 1 to 2, leader changed from b23676daefc14e888648187016e1c7ea (127.15.208.2) to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 2 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:04.605556 16713 catalog_manager.cc:5697] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a reported cstate change: term changed from 3 to 4, leader changed from 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3) to 5ac85832e522403ca896409edbd19f6a (127.15.208.1). New cstate: current_term: 4 leader_uuid: "5ac85832e522403ca896409edbd19f6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:04.640467 16962 raft_consensus.cc:1275] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:04.641794 17110 consensus_queue.cc:1048] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.652276 16887 raft_consensus.cc:1275] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:04.655004 17127 consensus_queue.cc:1048] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:04.771154 16962 raft_consensus.cc:1275] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:04.772518 17127 consensus_queue.cc:1048] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.782018 16887 raft_consensus.cc:1275] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:04.790179 17110 consensus_queue.cc:1048] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:05.029347 16962 raft_consensus.cc:1275] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:05.030630 17141 consensus_queue.cc:1048] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:05.039274 16887 raft_consensus.cc:1275] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:05.041473 17133 consensus_queue.cc:1048] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:05.052235 16962 raft_consensus.cc:1275] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:05.053432 17133 consensus_queue.cc:1048] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:05.063266 16887 raft_consensus.cc:1275] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:05.064975 17127 consensus_queue.cc:1048] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:05.131331 16962 raft_consensus.cc:1275] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:05.132741 17127 consensus_queue.cc:1048] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:05.142136 16887 raft_consensus.cc:1275] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Refusing update from remote peer 5ac85832e522403ca896409edbd19f6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:05.144197 17110 consensus_queue.cc:1048] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.477941 17152 raft_consensus.cc:493] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 036ccdcdf4f5452bbc801d3aa3e0250d)
I20260709 13:17:07.479178 17152 raft_consensus.cc:515] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.675800 17154 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ac85832e522403ca896409edbd19f6a)
I20260709 13:17:07.676571 17154 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:07.678925 17154 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465), 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595)
I20260709 13:17:07.679555 17154 raft_consensus.cc:493] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ac85832e522403ca896409edbd19f6a)
I20260709 13:17:07.681500 17152 leader_election.cc:290] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:07.681088 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:17:07.680135 17154 raft_consensus.cc:515] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.684861 16815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dcc248549f4351853e4860659e2a88" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:17:07.686168 17154 leader_election.cc:290] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:07.694555 16962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:17:07.694885 16960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:17:07.694080 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65dcc248549f4351853e4860659e2a88" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:17:07.699085 17153 raft_consensus.cc:493] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ac85832e522403ca896409edbd19f6a)
I20260709 13:17:07.699625 17153 raft_consensus.cc:515] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.702206 17153 leader_election.cc:290] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:07.703941 16815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd59c6445024a8bbf09129996feabbd" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:17:07.704640 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:17:07.698828 17154 raft_consensus.cc:493] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ac85832e522403ca896409edbd19f6a)
I20260709 13:17:07.710886 17156 raft_consensus.cc:493] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ac85832e522403ca896409edbd19f6a)
I20260709 13:17:07.696377 16960 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 4.
I20260709 13:17:07.714658 17156 raft_consensus.cc:515] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.715634 16854 leader_election.cc:304] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b23676daefc14e888648187016e1c7ea; no voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:07.716620 17153 raft_consensus.cc:2749] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:07.717835 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:17:07.718582 16853 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:07.723248 17154 raft_consensus.cc:515] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.721029 17153 raft_consensus.cc:2804] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:07.728066 17153 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ac85832e522403ca896409edbd19f6a)
I20260709 13:17:07.728513 17153 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:07.729342 16961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f95ea5114e483f94009c0e4e4a9923" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:17:07.731571 16853 leader_election.cc:304] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b23676daefc14e888648187016e1c7ea; no voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:07.735945 17152 raft_consensus.cc:2749] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:07.720156 17156 leader_election.cc:290] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:17:07.737210 16853 leader_election.cc:304] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b23676daefc14e888648187016e1c7ea; no voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:07.741276 17152 raft_consensus.cc:2749] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:07.745368 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:17:07.745769 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" is_pre_election: true
I20260709 13:17:07.747114 17153 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:07.747469 16853 leader_election.cc:304] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b23676daefc14e888648187016e1c7ea; no voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:07.748250 16887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:17:07.748759 17152 raft_consensus.cc:2749] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:07.749593 17153 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 5 election: Requested vote from peers 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465), 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595)
I20260709 13:17:07.750223 17154 leader_election.cc:290] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:07.751194 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:07.751253 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:07.753098 16929 leader_election.cc:304] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d; no voters: 5ac85832e522403ca896409edbd19f6a, b23676daefc14e888648187016e1c7ea
I20260709 13:17:07.753255 16853 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b23676daefc14e888648187016e1c7ea; no voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a
I20260709 13:17:07.754396 17157 raft_consensus.cc:2749] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:07.754740 17154 raft_consensus.cc:2749] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:07.789566 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:07.797673 16814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
mode: GRACEFUL
new_leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
 from {username='slave'} at 127.0.0.1:48262
I20260709 13:17:07.798264 16814 raft_consensus.cc:606] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Received request to transfer leadership to TS 036ccdcdf4f5452bbc801d3aa3e0250d
I20260709 13:17:07.801179 16814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
mode: GRACEFUL
new_leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
 from {username='slave'} at 127.0.0.1:48262
I20260709 13:17:07.801679 16814 raft_consensus.cc:606] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 4 LEADER]: Received request to transfer leadership to TS 036ccdcdf4f5452bbc801d3aa3e0250d
I20260709 13:17:07.804054 16814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
mode: GRACEFUL
new_leader_uuid: "b23676daefc14e888648187016e1c7ea"
 from {username='slave'} at 127.0.0.1:48262
I20260709 13:17:07.804517 16814 raft_consensus.cc:606] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Received request to transfer leadership to TS b23676daefc14e888648187016e1c7ea
I20260709 13:17:07.806761 16814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
mode: GRACEFUL
new_leader_uuid: "b23676daefc14e888648187016e1c7ea"
 from {username='slave'} at 127.0.0.1:48262
I20260709 13:17:07.807231 16814 raft_consensus.cc:606] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Received request to transfer leadership to TS b23676daefc14e888648187016e1c7ea
I20260709 13:17:07.808460 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:07.809058 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:07.842257 17158 raft_consensus.cc:993] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a: : Instructing follower 036ccdcdf4f5452bbc801d3aa3e0250d to start an election
I20260709 13:17:07.842883 17155 raft_consensus.cc:1081] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Signalling peer 036ccdcdf4f5452bbc801d3aa3e0250d to start an election
I20260709 13:17:07.844437 16963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472"
dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
 from {username='slave'} at 127.0.0.1:48492
I20260709 13:17:07.844985 16963 raft_consensus.cc:493] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:07.845300 16963 raft_consensus.cc:3060] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:07.850629 16963 raft_consensus.cc:515] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.852432 16963 leader_election.cc:290] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 3 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:17:07.853229 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:07.853549 16887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3729478edbae48cf9c8ef2ebc7ec0472" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:07.853895 16814 raft_consensus.cc:3055] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:07.854187 16814 raft_consensus.cc:740] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:07.854179 16887 raft_consensus.cc:3060] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:07.854950 16814 consensus_queue.cc:260] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.855803 16814 raft_consensus.cc:3060] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:07.859552 16887 raft_consensus.cc:2468] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 3.
I20260709 13:17:07.860373 16814 raft_consensus.cc:2468] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 3.
I20260709 13:17:07.860591 16929 leader_election.cc:304] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:07.861486 17157 raft_consensus.cc:2804] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:07.861898 17157 raft_consensus.cc:697] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 LEADER]: Becoming Leader. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:07.862696 17157 consensus_queue.cc:237] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.871707 16711 catalog_manager.cc:5697] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d reported cstate change: term changed from 2 to 3, leader changed from 5ac85832e522403ca896409edbd19f6a (127.15.208.1) to 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3). New cstate: current_term: 3 leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:07.936161 16887 raft_consensus.cc:1240] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 5 FOLLOWER]: Rejecting Update request from peer 5ac85832e522403ca896409edbd19f6a for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:07.937377 17155 consensus_queue.cc:1059] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:07.938264 17158 raft_consensus.cc:3055] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:07.938524 17158 raft_consensus.cc:740] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:07.939200 17158 consensus_queue.cc:260] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:07.940459 17158 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:07.965042 17155 raft_consensus.cc:993] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a: : Instructing follower b23676daefc14e888648187016e1c7ea to start an election
I20260709 13:17:07.965545 17155 raft_consensus.cc:1081] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Signalling peer b23676daefc14e888648187016e1c7ea to start an election
I20260709 13:17:07.966971 16887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768"
dest_uuid: "b23676daefc14e888648187016e1c7ea"
 from {username='slave'} at 127.0.0.1:43394
I20260709 13:17:07.967463 16887 raft_consensus.cc:493] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:07.967775 16887 raft_consensus.cc:3060] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:07.972636 16887 raft_consensus.cc:515] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.974503 16887 leader_election.cc:290] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 3 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:07.975374 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:07.975697 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e347d100d23f43a3a831de5163ad9768" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:07.975982 16814 raft_consensus.cc:3055] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:07.976281 16963 raft_consensus.cc:3060] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:07.976311 16814 raft_consensus.cc:740] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:07.977100 16814 consensus_queue.cc:260] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.977939 16814 raft_consensus.cc:3060] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:07.981490 16963 raft_consensus.cc:2468] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 3.
I20260709 13:17:07.982570 16853 leader_election.cc:304] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:07.983273 17154 raft_consensus.cc:2804] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:07.983556 16814 raft_consensus.cc:2468] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 3.
I20260709 13:17:07.983762 17154 raft_consensus.cc:697] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 3 LEADER]: Becoming Leader. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:17:07.984728 17154 consensus_queue.cc:237] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:07.991803 16711 catalog_manager.cc:5697] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea reported cstate change: term changed from 2 to 3, leader changed from 5ac85832e522403ca896409edbd19f6a (127.15.208.1) to b23676daefc14e888648187016e1c7ea (127.15.208.2). New cstate: current_term: 3 leader_uuid: "b23676daefc14e888648187016e1c7ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:08.256878 17158 raft_consensus.cc:993] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a: : Instructing follower b23676daefc14e888648187016e1c7ea to start an election
I20260709 13:17:08.257378 17155 raft_consensus.cc:1081] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Signalling peer b23676daefc14e888648187016e1c7ea to start an election
I20260709 13:17:08.258895 16887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638"
dest_uuid: "b23676daefc14e888648187016e1c7ea"
 from {username='slave'} at 127.0.0.1:43394
I20260709 13:17:08.259380 16887 raft_consensus.cc:493] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:08.259690 16887 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:08.264256 16887 raft_consensus.cc:515] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:08.265820 16887 leader_election.cc:290] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 4 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3:33465)
I20260709 13:17:08.266723 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:08.266894 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec93e87d659a42029e7032ccc0fb7638" candidate_uuid: "b23676daefc14e888648187016e1c7ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
I20260709 13:17:08.267251 16814 raft_consensus.cc:3055] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:08.267431 16963 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:08.267555 16814 raft_consensus.cc:740] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:08.268388 16814 consensus_queue.cc:260] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:08.269253 16814 raft_consensus.cc:3060] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:08.272310 16963 raft_consensus.cc:2468] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 4.
I20260709 13:17:08.273293 16853 leader_election.cc:304] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:08.273422 16814 raft_consensus.cc:2468] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23676daefc14e888648187016e1c7ea in term 4.
I20260709 13:17:08.274143 17154 raft_consensus.cc:2804] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:08.274614 17154 raft_consensus.cc:697] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 4 LEADER]: Becoming Leader. State: Replica: b23676daefc14e888648187016e1c7ea, State: Running, Role: LEADER
I20260709 13:17:08.275416 17154 consensus_queue.cc:237] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:08.281960 16711 catalog_manager.cc:5697] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea reported cstate change: term changed from 3 to 4, leader changed from 5ac85832e522403ca896409edbd19f6a (127.15.208.1) to b23676daefc14e888648187016e1c7ea (127.15.208.2). New cstate: current_term: 4 leader_uuid: "b23676daefc14e888648187016e1c7ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:08.291641 16814 raft_consensus.cc:1275] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Refusing update from remote peer 036ccdcdf4f5452bbc801d3aa3e0250d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:08.293000 17157 consensus_queue.cc:1048] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:08.303347 16887 raft_consensus.cc:1275] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Refusing update from remote peer 036ccdcdf4f5452bbc801d3aa3e0250d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:08.305084 17169 consensus_queue.cc:1048] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:08.466928 16814 raft_consensus.cc:1275] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Refusing update from remote peer b23676daefc14e888648187016e1c7ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:08.468340 17154 consensus_queue.cc:1048] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:08.477962 16963 raft_consensus.cc:1275] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Refusing update from remote peer b23676daefc14e888648187016e1c7ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:08.479738 17154 consensus_queue.cc:1048] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:08.673455 16985 debug-util.cc:398] Leaking SignalData structure 0x7b08000be5e0 after lost signal to thread 16195
W20260709 13:17:08.674489 16985 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8880 after lost signal to thread 16747
W20260709 13:17:08.675545 16985 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6500 after lost signal to thread 16839
W20260709 13:17:08.676272 16985 debug-util.cc:398] Leaking SignalData structure 0x7b08000dfe80 after lost signal to thread 16914
W20260709 13:17:08.677013 16985 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8520 after lost signal to thread 16988
I20260709 13:17:08.727126 16963 raft_consensus.cc:1275] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Refusing update from remote peer b23676daefc14e888648187016e1c7ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:08.728736 17153 consensus_queue.cc:1048] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:08.743010 16814 raft_consensus.cc:1275] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Refusing update from remote peer b23676daefc14e888648187016e1c7ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:08.744611 17173 consensus_queue.cc:1048] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:08.810024 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:08.818305 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:08.827039 16814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865"
dest_uuid: "5ac85832e522403ca896409edbd19f6a"
mode: GRACEFUL
new_leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
 from {username='slave'} at 127.0.0.1:48262
I20260709 13:17:08.827598 16814 raft_consensus.cc:606] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Received request to transfer leadership to TS 036ccdcdf4f5452bbc801d3aa3e0250d
I20260709 13:17:08.828752 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:17:08.829497 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:09.218688 17177 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ac85832e522403ca896409edbd19f6a)
I20260709 13:17:09.219364 17177 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:09.222187 17177 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595)
I20260709 13:17:09.222658 16887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea" is_pre_election: true
I20260709 13:17:09.223459 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a" is_pre_election: true
I20260709 13:17:09.223466 16887 raft_consensus.cc:2393] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 036ccdcdf4f5452bbc801d3aa3e0250d in current term 5: Already voted for candidate b23676daefc14e888648187016e1c7ea in this term.
I20260709 13:17:09.224013 16814 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 5.
I20260709 13:17:09.225219 16928 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: 
I20260709 13:17:09.226027 17177 raft_consensus.cc:2804] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:09.226454 17177 raft_consensus.cc:493] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ac85832e522403ca896409edbd19f6a)
I20260709 13:17:09.226900 17177 raft_consensus.cc:3060] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:09.231912 17177 raft_consensus.cc:515] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:09.233806 17177 leader_election.cc:290] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 5 election: Requested vote from peers b23676daefc14e888648187016e1c7ea (127.15.208.2:37757), 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595)
I20260709 13:17:09.234918 16814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:09.234871 16887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "942dd7457dbc44f298607013b6b8b66a" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:09.235822 16887 raft_consensus.cc:2393] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 036ccdcdf4f5452bbc801d3aa3e0250d in current term 5: Already voted for candidate b23676daefc14e888648187016e1c7ea in this term.
I20260709 13:17:09.240641 16814 raft_consensus.cc:2468] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 5.
I20260709 13:17:09.241742 16928 leader_election.cc:304] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, 5ac85832e522403ca896409edbd19f6a; no voters: b23676daefc14e888648187016e1c7ea
I20260709 13:17:09.242596 17177 raft_consensus.cc:2804] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:09.243111 17177 raft_consensus.cc:697] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 5 LEADER]: Becoming Leader. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:09.243901 17177 consensus_queue.cc:237] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } }
I20260709 13:17:09.254230 16713 catalog_manager.cc:5697] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d reported cstate change: term changed from 4 to 5, leader changed from 5ac85832e522403ca896409edbd19f6a (127.15.208.1) to 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3). New cstate: current_term: 5 leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:09.339941 17179 raft_consensus.cc:993] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a: : Instructing follower 036ccdcdf4f5452bbc801d3aa3e0250d to start an election
I20260709 13:17:09.340538 17179 raft_consensus.cc:1081] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Signalling peer 036ccdcdf4f5452bbc801d3aa3e0250d to start an election
I20260709 13:17:09.342412 16963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865"
dest_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d"
 from {username='slave'} at 127.0.0.1:48492
I20260709 13:17:09.342944 16963 raft_consensus.cc:493] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:09.343292 16963 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:09.349022 16963 raft_consensus.cc:515] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:09.350841 16963 leader_election.cc:290] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 4 election: Requested vote from peers 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595), b23676daefc14e888648187016e1c7ea (127.15.208.2:37757)
I20260709 13:17:09.351706 16815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5ac85832e522403ca896409edbd19f6a"
I20260709 13:17:09.351974 16887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5501a9f97842f6b5bd72b23d4d5865" candidate_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b23676daefc14e888648187016e1c7ea"
I20260709 13:17:09.352381 16815 raft_consensus.cc:3055] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:09.352507 16887 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:09.352829 16815 raft_consensus.cc:740] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ac85832e522403ca896409edbd19f6a, State: Running, Role: LEADER
I20260709 13:17:09.353785 16815 consensus_queue.cc:260] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:09.355229 16815 raft_consensus.cc:3060] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:09.358804 16887 raft_consensus.cc:2468] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 4.
I20260709 13:17:09.360076 16929 leader_election.cc:304] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036ccdcdf4f5452bbc801d3aa3e0250d, b23676daefc14e888648187016e1c7ea; no voters: 
I20260709 13:17:09.361020 17178 raft_consensus.cc:2804] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:09.361670 17178 raft_consensus.cc:697] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 LEADER]: Becoming Leader. State: Replica: 036ccdcdf4f5452bbc801d3aa3e0250d, State: Running, Role: LEADER
I20260709 13:17:09.363204 17178 consensus_queue.cc:237] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } }
I20260709 13:17:09.363987 16815 raft_consensus.cc:2468] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036ccdcdf4f5452bbc801d3aa3e0250d in term 4.
I20260709 13:17:09.371935 16713 catalog_manager.cc:5697] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d reported cstate change: term changed from 3 to 4, leader changed from 5ac85832e522403ca896409edbd19f6a (127.15.208.1) to 036ccdcdf4f5452bbc801d3aa3e0250d (127.15.208.3). New cstate: current_term: 4 leader_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "036ccdcdf4f5452bbc801d3aa3e0250d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33465 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:09.697412 16815 raft_consensus.cc:1275] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 5 FOLLOWER]: Refusing update from remote peer 036ccdcdf4f5452bbc801d3aa3e0250d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:09.698670 17178 consensus_queue.cc:1048] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:09.709352 16887 raft_consensus.cc:1275] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 5 FOLLOWER]: Refusing update from remote peer 036ccdcdf4f5452bbc801d3aa3e0250d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:09.710922 17177 consensus_queue.cc:1048] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:09.764066 16887 raft_consensus.cc:1275] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Refusing update from remote peer 036ccdcdf4f5452bbc801d3aa3e0250d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:09.765261 17187 consensus_queue.cc:1048] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b23676daefc14e888648187016e1c7ea" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 37757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:09.774652 16815 raft_consensus.cc:1275] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Refusing update from remote peer 036ccdcdf4f5452bbc801d3aa3e0250d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:09.776382 17177 consensus_queue.cc:1048] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac85832e522403ca896409edbd19f6a" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:09.830459 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:09.840078 16192 tablet_server.cc:179] TabletServer@127.15.208.1:0 shutting down...
I20260709 13:17:09.875052 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:09.875922 16192 tablet_replica.cc:333] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a: stopping tablet replica
I20260709 13:17:09.876768 16192 raft_consensus.cc:2243] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.878945 16192 raft_consensus.cc:2272] T 3729478edbae48cf9c8ef2ebc7ec0472 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.881237 16192 tablet_replica.cc:333] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a: stopping tablet replica
I20260709 13:17:09.881791 16192 raft_consensus.cc:2243] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.882458 16192 raft_consensus.cc:2272] T f8f95ea5114e483f94009c0e4e4a9923 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.884240 16192 tablet_replica.cc:333] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a: stopping tablet replica
I20260709 13:17:09.884722 16192 raft_consensus.cc:2243] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.885157 16192 raft_consensus.cc:2272] T ec93e87d659a42029e7032ccc0fb7638 P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.886739 16192 tablet_replica.cc:333] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a: stopping tablet replica
I20260709 13:17:09.887362 16192 raft_consensus.cc:2243] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.887743 16192 raft_consensus.cc:2272] T 942dd7457dbc44f298607013b6b8b66a P 5ac85832e522403ca896409edbd19f6a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.889899 16192 tablet_replica.cc:333] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a: stopping tablet replica
I20260709 13:17:09.890411 16192 raft_consensus.cc:2243] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.891112 16192 raft_consensus.cc:2272] T 8fd59c6445024a8bbf09129996feabbd P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.892920 16192 tablet_replica.cc:333] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a: stopping tablet replica
I20260709 13:17:09.893385 16192 raft_consensus.cc:2243] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.893769 16192 raft_consensus.cc:2272] T e347d100d23f43a3a831de5163ad9768 P 5ac85832e522403ca896409edbd19f6a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.895412 16192 tablet_replica.cc:333] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a: stopping tablet replica
I20260709 13:17:09.896096 16192 raft_consensus.cc:2243] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:09.897136 16192 raft_consensus.cc:2272] T 58676102ea6548b494330c22fcb4e02b P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.899727 16192 tablet_replica.cc:333] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a: stopping tablet replica
I20260709 13:17:09.900242 16192 raft_consensus.cc:2243] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.900682 16192 raft_consensus.cc:2272] T 0d17526665334553b0669cca55028f81 P 5ac85832e522403ca896409edbd19f6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.902663 16192 tablet_replica.cc:333] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a: stopping tablet replica
I20260709 13:17:09.903127 16192 raft_consensus.cc:2243] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.903530 16192 raft_consensus.cc:2272] T 65dcc248549f4351853e4860659e2a88 P 5ac85832e522403ca896409edbd19f6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.905336 16192 tablet_replica.cc:333] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a: stopping tablet replica
I20260709 13:17:09.905808 16192 raft_consensus.cc:2243] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.906189 16192 raft_consensus.cc:2272] T 8b5501a9f97842f6b5bd72b23d4d5865 P 5ac85832e522403ca896409edbd19f6a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.929576 16192 tablet_server.cc:196] TabletServer@127.15.208.1:0 shutdown complete.
I20260709 13:17:09.960698 16192 tablet_server.cc:179] TabletServer@127.15.208.2:0 shutting down...
I20260709 13:17:10.004050 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:10.005102 16192 tablet_replica.cc:333] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea: stopping tablet replica
I20260709 13:17:10.005717 16192 raft_consensus.cc:2243] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:10.006211 16854 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.208.1:41595: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260709 13:17:10.006399 16192 raft_consensus.cc:2272] T f8f95ea5114e483f94009c0e4e4a9923 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.009202 16192 tablet_replica.cc:333] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea: stopping tablet replica
I20260709 13:17:10.009989 16192 raft_consensus.cc:2243] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.010550 16192 raft_consensus.cc:2272] T 3729478edbae48cf9c8ef2ebc7ec0472 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:10.010665 16854 consensus_peers.cc:597] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea -> Peer 5ac85832e522403ca896409edbd19f6a (127.15.208.1:41595): Couldn't send request to peer 5ac85832e522403ca896409edbd19f6a. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:41595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:10.012413 16192 tablet_replica.cc:333] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea: stopping tablet replica
I20260709 13:17:10.013017 16192 raft_consensus.cc:2243] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.013410 16192 raft_consensus.cc:2272] T 65dcc248549f4351853e4860659e2a88 P b23676daefc14e888648187016e1c7ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.015254 16192 tablet_replica.cc:333] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea: stopping tablet replica
I20260709 13:17:10.015774 16192 raft_consensus.cc:2243] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.016253 16192 raft_consensus.cc:2272] T 8fd59c6445024a8bbf09129996feabbd P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.018038 16192 tablet_replica.cc:333] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea: stopping tablet replica
I20260709 13:17:10.018522 16192 raft_consensus.cc:2243] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.019313 16192 raft_consensus.cc:2272] T e347d100d23f43a3a831de5163ad9768 P b23676daefc14e888648187016e1c7ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.021070 16192 tablet_replica.cc:333] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea: stopping tablet replica
I20260709 13:17:10.021559 16192 raft_consensus.cc:2243] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.022347 16192 raft_consensus.cc:2272] T 0d17526665334553b0669cca55028f81 P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.024118 16192 tablet_replica.cc:333] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea: stopping tablet replica
I20260709 13:17:10.024614 16192 raft_consensus.cc:2243] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.025197 16192 raft_consensus.cc:2272] T 58676102ea6548b494330c22fcb4e02b P b23676daefc14e888648187016e1c7ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.026927 16192 tablet_replica.cc:333] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea: stopping tablet replica
I20260709 13:17:10.027516 16192 raft_consensus.cc:2243] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.027948 16192 raft_consensus.cc:2272] T 8b5501a9f97842f6b5bd72b23d4d5865 P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.030418 16192 tablet_replica.cc:333] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea: stopping tablet replica
I20260709 13:17:10.030980 16192 raft_consensus.cc:2243] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.031677 16192 raft_consensus.cc:2272] T ec93e87d659a42029e7032ccc0fb7638 P b23676daefc14e888648187016e1c7ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.033385 16192 tablet_replica.cc:333] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea: stopping tablet replica
I20260709 13:17:10.033828 16192 raft_consensus.cc:2243] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.034219 16192 raft_consensus.cc:2272] T 942dd7457dbc44f298607013b6b8b66a P b23676daefc14e888648187016e1c7ea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.070580 16192 tablet_server.cc:196] TabletServer@127.15.208.2:0 shutdown complete.
I20260709 13:17:10.102809 16192 tablet_server.cc:179] TabletServer@127.15.208.3:0 shutting down...
I20260709 13:17:10.135252 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:10.136142 16192 tablet_replica.cc:333] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d: stopping tablet replica
I20260709 13:17:10.137135 16192 raft_consensus.cc:2243] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.138204 16192 raft_consensus.cc:2272] T 8b5501a9f97842f6b5bd72b23d4d5865 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.140413 16192 tablet_replica.cc:333] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d: stopping tablet replica
I20260709 13:17:10.141024 16192 raft_consensus.cc:2243] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.141851 16192 raft_consensus.cc:2272] T 65dcc248549f4351853e4860659e2a88 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.143664 16192 tablet_replica.cc:333] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d: stopping tablet replica
I20260709 13:17:10.144205 16192 raft_consensus.cc:2243] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.145009 16192 raft_consensus.cc:2272] T 3729478edbae48cf9c8ef2ebc7ec0472 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.146790 16192 tablet_replica.cc:333] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d: stopping tablet replica
I20260709 13:17:10.147493 16192 raft_consensus.cc:2243] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.147985 16192 raft_consensus.cc:2272] T e347d100d23f43a3a831de5163ad9768 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.149816 16192 tablet_replica.cc:333] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d: stopping tablet replica
I20260709 13:17:10.150357 16192 raft_consensus.cc:2243] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.150803 16192 raft_consensus.cc:2272] T 58676102ea6548b494330c22fcb4e02b P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.152597 16192 tablet_replica.cc:333] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d: stopping tablet replica
I20260709 13:17:10.153139 16192 raft_consensus.cc:2243] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.153589 16192 raft_consensus.cc:2272] T 8fd59c6445024a8bbf09129996feabbd P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.155915 16192 tablet_replica.cc:333] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d: stopping tablet replica
I20260709 13:17:10.156417 16192 raft_consensus.cc:2243] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.156956 16192 raft_consensus.cc:2272] T 0d17526665334553b0669cca55028f81 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.158778 16192 tablet_replica.cc:333] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d: stopping tablet replica
I20260709 13:17:10.159322 16192 raft_consensus.cc:2243] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.159749 16192 raft_consensus.cc:2272] T f8f95ea5114e483f94009c0e4e4a9923 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.161692 16192 tablet_replica.cc:333] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d: stopping tablet replica
I20260709 13:17:10.162201 16192 raft_consensus.cc:2243] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.162665 16192 raft_consensus.cc:2272] T ec93e87d659a42029e7032ccc0fb7638 P 036ccdcdf4f5452bbc801d3aa3e0250d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.164337 16192 tablet_replica.cc:333] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d: stopping tablet replica
I20260709 13:17:10.164795 16192 raft_consensus.cc:2243] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:17:10.165589 16192 raft_consensus.cc:2272] T 942dd7457dbc44f298607013b6b8b66a P 036ccdcdf4f5452bbc801d3aa3e0250d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:11.131906 16192 tablet_server.cc:196] TabletServer@127.15.208.3:0 shutdown complete.
I20260709 13:17:11.151346 16192 master.cc:562] Master@127.15.208.62:38783 shutting down...
I20260709 13:17:11.174904 16192 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:11.175501 16192 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:11.175832 16192 tablet_replica.cc:333] T 00000000000000000000000000000000 P d153b16f62f54c169f1cddaceeb153b7: stopping tablet replica
I20260709 13:17:11.197206 16192 master.cc:584] Master@127.15.208.62:38783 shutdown complete.
036ccdcdf4f5452bbc801d3aa3e0250d  1
5ac85832e522403ca896409edbd19f6a  5
b23676daefc14e888648187016e1c7ea  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (13584 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:17:11.242287 16192 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.208.62:46299
I20260709 13:17:11.243515 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:11.251081 17195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:11.251309 17198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:11.252254 16192 server_base.cc:1061] running on GCE node
W20260709 13:17:11.252226 17196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:11.254264 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:11.254484 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:11.254673 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603031254658 us; error 0 us; skew 500 ppm
I20260709 13:17:11.255249 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:11.257932 16192 webserver.cc:533] Webserver started at http://127.15.208.62:36365/ using document root <none> and password file <none>
I20260709 13:17:11.258437 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:11.258598 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:11.258946 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:11.260144 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/master-0-root/instance:
uuid: "6a4082b2c6894817acb2d2a07603a4d6"
format_stamp: "Formatted at 2026-07-09 13:17:11 on dist-test-slave-w3b1"
I20260709 13:17:11.264822 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:11.268626 17203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:11.269660 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:11.270012 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/master-0-root
uuid: "6a4082b2c6894817acb2d2a07603a4d6"
format_stamp: "Formatted at 2026-07-09 13:17:11 on dist-test-slave-w3b1"
I20260709 13:17:11.270300 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:11.287341 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:11.288741 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:11.331856 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.62:46299
I20260709 13:17:11.331971 17254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.62:46299 every 8 connection(s)
I20260709 13:17:11.336265 17255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.346446 17255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Bootstrap starting.
I20260709 13:17:11.351377 17255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.356148 17255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: No bootstrap required, opened a new log
I20260709 13:17:11.358512 17255 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4082b2c6894817acb2d2a07603a4d6" member_type: VOTER }
I20260709 13:17:11.358975 17255 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.359216 17255 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a4082b2c6894817acb2d2a07603a4d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.359905 17255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4082b2c6894817acb2d2a07603a4d6" member_type: VOTER }
I20260709 13:17:11.360392 17255 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:11.360654 17255 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:11.361016 17255 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.365844 17255 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4082b2c6894817acb2d2a07603a4d6" member_type: VOTER }
I20260709 13:17:11.366418 17255 leader_election.cc:304] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a4082b2c6894817acb2d2a07603a4d6; no voters: 
I20260709 13:17:11.367676 17255 leader_election.cc:290] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:11.368067 17258 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:11.369663 17258 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 1 LEADER]: Becoming Leader. State: Replica: 6a4082b2c6894817acb2d2a07603a4d6, State: Running, Role: LEADER
I20260709 13:17:11.370419 17258 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4082b2c6894817acb2d2a07603a4d6" member_type: VOTER }
I20260709 13:17:11.370615 17255 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:11.376786 17260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a4082b2c6894817acb2d2a07603a4d6. Latest consensus state: current_term: 1 leader_uuid: "6a4082b2c6894817acb2d2a07603a4d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4082b2c6894817acb2d2a07603a4d6" member_type: VOTER } }
I20260709 13:17:11.376691 17259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a4082b2c6894817acb2d2a07603a4d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4082b2c6894817acb2d2a07603a4d6" member_type: VOTER } }
I20260709 13:17:11.377785 17260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:11.378029 17259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:11.381260 17266 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:11.386708 17266 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:11.390718 16192 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:11.396150 17266 catalog_manager.cc:1383] Generated new cluster ID: 52ae280bb42a4db0965d728deb73fe6e
I20260709 13:17:11.396442 17266 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:11.418021 17266 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:11.419394 17266 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:11.432014 17266 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Generated new TSK 0
I20260709 13:17:11.432682 17266 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:11.457661 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:11.464610 17276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:11.465559 17277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:11.467998 16192 server_base.cc:1061] running on GCE node
W20260709 13:17:11.468611 17279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:11.469830 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:11.470152 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:11.470351 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603031470334 us; error 0 us; skew 500 ppm
I20260709 13:17:11.471014 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:11.473721 16192 webserver.cc:533] Webserver started at http://127.15.208.1:32981/ using document root <none> and password file <none>
I20260709 13:17:11.474213 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:11.474421 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:11.474711 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:11.475797 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/instance:
uuid: "7241e45fbfca4b46b6df9be8cebcd863"
format_stamp: "Formatted at 2026-07-09 13:17:11 on dist-test-slave-w3b1"
I20260709 13:17:11.480351 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:17:11.484123 17284 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:11.485029 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:11.485352 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root
uuid: "7241e45fbfca4b46b6df9be8cebcd863"
format_stamp: "Formatted at 2026-07-09 13:17:11 on dist-test-slave-w3b1"
I20260709 13:17:11.485649 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:11.503211 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:11.504508 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:11.506156 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:11.508549 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:11.508778 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:11.509151 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:11.509344 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:11.552685 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.1:40163
I20260709 13:17:11.552788 17346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.1:40163 every 8 connection(s)
I20260709 13:17:11.557602 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:11.565171 17351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:11.567189 17352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:11.571125 17354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:11.574183 16192 server_base.cc:1061] running on GCE node
I20260709 13:17:11.575337 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:11.575649 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:11.575827 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603031575814 us; error 0 us; skew 500 ppm
I20260709 13:17:11.575712 17347 heartbeater.cc:344] Connected to a master server at 127.15.208.62:46299
I20260709 13:17:11.576179 17347 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:11.576360 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:11.577036 17347 heartbeater.cc:507] Master 127.15.208.62:46299 requested a full tablet report, sending...
I20260709 13:17:11.579474 17220 ts_manager.cc:194] Registered new tserver with Master: 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:11.580288 16192 webserver.cc:533] Webserver started at http://127.15.208.2:39479/ using document root <none> and password file <none>
I20260709 13:17:11.580819 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:11.581084 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:11.581383 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:11.581796 17220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49270
I20260709 13:17:11.582705 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/instance:
uuid: "c23a664ebf3347a4934dee377c8b5101"
format_stamp: "Formatted at 2026-07-09 13:17:11 on dist-test-slave-w3b1"
I20260709 13:17:11.587898 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:17:11.591714 17359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:11.592555 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:17:11.592968 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root
uuid: "c23a664ebf3347a4934dee377c8b5101"
format_stamp: "Formatted at 2026-07-09 13:17:11 on dist-test-slave-w3b1"
I20260709 13:17:11.593238 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:11.630847 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:11.632023 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:11.633467 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:11.635668 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:11.635842 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:11.636147 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:11.636282 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:11.679234 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.2:33079
I20260709 13:17:11.679363 17421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.2:33079 every 8 connection(s)
I20260709 13:17:11.683943 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:11.690992 17425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:11.693887 17426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:11.697781 17428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:11.698045 17422 heartbeater.cc:344] Connected to a master server at 127.15.208.62:46299
I20260709 13:17:11.698488 17422 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:11.699383 16192 server_base.cc:1061] running on GCE node
I20260709 13:17:11.699509 17422 heartbeater.cc:507] Master 127.15.208.62:46299 requested a full tablet report, sending...
I20260709 13:17:11.700326 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:11.700590 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:11.700882 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603031700813 us; error 0 us; skew 500 ppm
I20260709 13:17:11.701647 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:11.701829 17220 ts_manager.cc:194] Registered new tserver with Master: c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:11.703701 17220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49282
I20260709 13:17:11.704420 16192 webserver.cc:533] Webserver started at http://127.15.208.3:46221/ using document root <none> and password file <none>
I20260709 13:17:11.705108 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:11.705309 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:11.705605 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:11.706738 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/instance:
uuid: "b7108577e5754060b7e468a43dfdcdeb"
format_stamp: "Formatted at 2026-07-09 13:17:11 on dist-test-slave-w3b1"
I20260709 13:17:11.711179 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:17:11.714519 17433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:11.715312 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:17:11.715626 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root
uuid: "b7108577e5754060b7e468a43dfdcdeb"
format_stamp: "Formatted at 2026-07-09 13:17:11 on dist-test-slave-w3b1"
I20260709 13:17:11.715881 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:11.734470 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:11.735716 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:11.737278 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:11.739519 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:11.739699 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:11.739998 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:11.740150 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:11.781563 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.3:33147
I20260709 13:17:11.781703 17495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.3:33147 every 8 connection(s)
I20260709 13:17:11.796101 17496 heartbeater.cc:344] Connected to a master server at 127.15.208.62:46299
I20260709 13:17:11.796499 17496 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:11.797333 17496 heartbeater.cc:507] Master 127.15.208.62:46299 requested a full tablet report, sending...
I20260709 13:17:11.799477 17220 ts_manager.cc:194] Registered new tserver with Master: b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:11.800591 16192 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015691051s
I20260709 13:17:11.800993 17220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49294
I20260709 13:17:11.827590 17220 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49306:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:11.833554 17220 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:12.063174 17460 tablet_service.cc:1511] Processing CreateTablet for tablet 213e74ac16bb4f19b434bdd25b7bd3af (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:12.063851 17461 tablet_service.cc:1511] Processing CreateTablet for tablet 2566406852d04693963f9fa3f001ff8c (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:12.064608 17312 tablet_service.cc:1511] Processing CreateTablet for tablet 2566406852d04693963f9fa3f001ff8c (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:12.065987 17312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2566406852d04693963f9fa3f001ff8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.066069 17459 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4c351b74b044eab8a6561b3eb27a1b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:12.067516 17307 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3c6f4045794af59b877ad412ae6450 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:12.067917 17308 tablet_service.cc:1511] Processing CreateTablet for tablet 452dfe9db12345ae88b3dbbd163f480e (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:12.069070 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3c6f4045794af59b877ad412ae6450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.068682 17458 tablet_service.cc:1511] Processing CreateTablet for tablet af5b45fab0a7463d90e9b2fec8241e1a (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:12.070580 17309 tablet_service.cc:1511] Processing CreateTablet for tablet af5b45fab0a7463d90e9b2fec8241e1a (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:12.071976 17309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5b45fab0a7463d90e9b2fec8241e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.072571 17457 tablet_service.cc:1511] Processing CreateTablet for tablet 452dfe9db12345ae88b3dbbd163f480e (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:12.074501 17460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213e74ac16bb4f19b434bdd25b7bd3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.075059 17311 tablet_service.cc:1511] Processing CreateTablet for tablet 213e74ac16bb4f19b434bdd25b7bd3af (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:12.076045 17459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4c351b74b044eab8a6561b3eb27a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.076352 17311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213e74ac16bb4f19b434bdd25b7bd3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.081321 17458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5b45fab0a7463d90e9b2fec8241e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.082394 17308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452dfe9db12345ae88b3dbbd163f480e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.081318 17310 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4c351b74b044eab8a6561b3eb27a1b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:12.084877 17461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2566406852d04693963f9fa3f001ff8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.085471 17310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4c351b74b044eab8a6561b3eb27a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.090531 17456 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3c6f4045794af59b877ad412ae6450 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:12.092212 17456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3c6f4045794af59b877ad412ae6450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.091939 17306 tablet_service.cc:1511] Processing CreateTablet for tablet b59d252a868a4ba8bc72588a2ae450b2 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:12.093439 17306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59d252a868a4ba8bc72588a2ae450b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.094084 17457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452dfe9db12345ae88b3dbbd163f480e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.094551 17511 tablet_bootstrap.cc:492] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:12.102507 17511 tablet_bootstrap.cc:654] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.109926 17312 tablet_service.cc:1511] Processing CreateTablet for tablet 1b85187304c149c58d33a53cb3005a02 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:12.110733 17455 tablet_service.cc:1511] Processing CreateTablet for tablet b59d252a868a4ba8bc72588a2ae450b2 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:12.111321 17312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b85187304c149c58d33a53cb3005a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.112229 17455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59d252a868a4ba8bc72588a2ae450b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.118211 17305 tablet_service.cc:1511] Processing CreateTablet for tablet 96090377e5474346a1e4fdadd3c4c7ab (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:12.119829 17305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96090377e5474346a1e4fdadd3c4c7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.122804 17454 tablet_service.cc:1511] Processing CreateTablet for tablet 1b85187304c149c58d33a53cb3005a02 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:12.124366 17454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b85187304c149c58d33a53cb3005a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.150306 17453 tablet_service.cc:1511] Processing CreateTablet for tablet 96090377e5474346a1e4fdadd3c4c7ab (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:12.151432 17307 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0241098ae744cbae27ac900424b754 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:12.151933 17453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96090377e5474346a1e4fdadd3c4c7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.152694 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0241098ae744cbae27ac900424b754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.163388 17452 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0241098ae744cbae27ac900424b754 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:12.165086 17452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0241098ae744cbae27ac900424b754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.186067 17511 tablet_bootstrap.cc:492] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:12.186132 17387 tablet_service.cc:1511] Processing CreateTablet for tablet 2566406852d04693963f9fa3f001ff8c (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:12.187817 17387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2566406852d04693963f9fa3f001ff8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.190223 17386 tablet_service.cc:1511] Processing CreateTablet for tablet 213e74ac16bb4f19b434bdd25b7bd3af (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:12.192871 17385 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4c351b74b044eab8a6561b3eb27a1b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:12.195626 17384 tablet_service.cc:1511] Processing CreateTablet for tablet af5b45fab0a7463d90e9b2fec8241e1a (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:12.186690 17511 ts_tablet_manager.cc:1403] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.031s
I20260709 13:17:12.199435 17383 tablet_service.cc:1511] Processing CreateTablet for tablet 452dfe9db12345ae88b3dbbd163f480e (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:12.199579 17381 tablet_service.cc:1511] Processing CreateTablet for tablet b59d252a868a4ba8bc72588a2ae450b2 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:12.199787 17382 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3c6f4045794af59b877ad412ae6450 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:12.202476 17380 tablet_service.cc:1511] Processing CreateTablet for tablet 1b85187304c149c58d33a53cb3005a02 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:12.203176 17308 tablet_service.cc:1511] Processing CreateTablet for tablet 58b200038e814f72ae96c61b0e1dd286 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:12.204674 17386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213e74ac16bb4f19b434bdd25b7bd3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.205454 17385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4c351b74b044eab8a6561b3eb27a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.206125 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452dfe9db12345ae88b3dbbd163f480e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.205046 17379 tablet_service.cc:1511] Processing CreateTablet for tablet 96090377e5474346a1e4fdadd3c4c7ab (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:12.206800 17384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5b45fab0a7463d90e9b2fec8241e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.206914 17378 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0241098ae744cbae27ac900424b754 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:12.208339 17378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0241098ae744cbae27ac900424b754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.209545 17382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3c6f4045794af59b877ad412ae6450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.204677 17308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b200038e814f72ae96c61b0e1dd286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.213347 17381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59d252a868a4ba8bc72588a2ae450b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.221195 17379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96090377e5474346a1e4fdadd3c4c7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.223325 17455 tablet_service.cc:1511] Processing CreateTablet for tablet 58b200038e814f72ae96c61b0e1dd286 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:12.224870 17455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b200038e814f72ae96c61b0e1dd286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.221215 17511 raft_consensus.cc:359] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.226374 17511 raft_consensus.cc:385] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.226722 17511 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.226814 17380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b85187304c149c58d33a53cb3005a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.227876 17511 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.233973 17460 tablet_service.cc:1511] Processing CreateTablet for tablet c824a7378ba243ca96d57d97c47847c9 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:12.235606 17460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c824a7378ba243ca96d57d97c47847c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.236188 17307 tablet_service.cc:1511] Processing CreateTablet for tablet bf42e0c75aa14899935b39a4a7437626 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:12.236461 17310 tablet_service.cc:1511] Processing CreateTablet for tablet c824a7378ba243ca96d57d97c47847c9 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:12.241016 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf42e0c75aa14899935b39a4a7437626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.241302 17456 tablet_service.cc:1511] Processing CreateTablet for tablet bf42e0c75aa14899935b39a4a7437626 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:12.241833 17310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c824a7378ba243ca96d57d97c47847c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.242707 17456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf42e0c75aa14899935b39a4a7437626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.257583 17305 tablet_service.cc:1511] Processing CreateTablet for tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:12.258183 17513 tablet_bootstrap.cc:492] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:12.259063 17305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.264410 17513 tablet_bootstrap.cc:654] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.273480 17459 tablet_service.cc:1511] Processing CreateTablet for tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:12.275002 17459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.283738 17306 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1a5ebc1019411290bc16a4e1cab89b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:12.285112 17306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1a5ebc1019411290bc16a4e1cab89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.291793 17386 tablet_service.cc:1511] Processing CreateTablet for tablet 58b200038e814f72ae96c61b0e1dd286 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:12.294158 17311 tablet_service.cc:1511] Processing CreateTablet for tablet aaa77e48390f407cb43bb16febfe2e8d (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:12.295533 17383 tablet_service.cc:1511] Processing CreateTablet for tablet c824a7378ba243ca96d57d97c47847c9 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:12.297363 17347 heartbeater.cc:499] Master 127.15.208.62:46299 was elected leader, sending a full tablet report...
I20260709 13:17:12.297523 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c824a7378ba243ca96d57d97c47847c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.297704 17511 ts_tablet_manager.cc:1434] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 13:17:12.298909 17311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa77e48390f407cb43bb16febfe2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.301858 17455 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1a5ebc1019411290bc16a4e1cab89b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:12.303205 17455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1a5ebc1019411290bc16a4e1cab89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.305583 17452 tablet_service.cc:1511] Processing CreateTablet for tablet aaa77e48390f407cb43bb16febfe2e8d (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:12.307046 17452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa77e48390f407cb43bb16febfe2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.308010 17511 tablet_bootstrap.cc:492] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:12.312103 17312 tablet_service.cc:1511] Processing CreateTablet for tablet a7e1f8f7b0e44cc38e154e294927d7ff (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:12.313618 17312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e1f8f7b0e44cc38e154e294927d7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.341254 17382 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1a5ebc1019411290bc16a4e1cab89b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:12.348122 17515 tablet_bootstrap.cc:492] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:12.347879 17378 tablet_service.cc:1511] Processing CreateTablet for tablet aaa77e48390f407cb43bb16febfe2e8d (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:12.349526 17307 tablet_service.cc:1511] Processing CreateTablet for tablet 128956e308c048a2af21fae67c6683ef (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:12.350972 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128956e308c048a2af21fae67c6683ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.351183 17511 tablet_bootstrap.cc:654] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.352913 17386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b200038e814f72ae96c61b0e1dd286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.358712 17461 tablet_service.cc:1511] Processing CreateTablet for tablet 128956e308c048a2af21fae67c6683ef (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:12.362138 17461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128956e308c048a2af21fae67c6683ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.364030 17310 tablet_service.cc:1511] Processing CreateTablet for tablet b0bff337c6c8418e8fe0872b92f3bd6f (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:12.365398 17310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bff337c6c8418e8fe0872b92f3bd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.373083 17385 tablet_service.cc:1511] Processing CreateTablet for tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:12.379853 17384 tablet_service.cc:1511] Processing CreateTablet for tablet b0bff337c6c8418e8fe0872b92f3bd6f (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:12.384038 17379 tablet_service.cc:1511] Processing CreateTablet for tablet 128956e308c048a2af21fae67c6683ef (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:12.385097 17456 tablet_service.cc:1511] Processing CreateTablet for tablet a7e1f8f7b0e44cc38e154e294927d7ff (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:12.386457 17456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e1f8f7b0e44cc38e154e294927d7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.359686 17382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1a5ebc1019411290bc16a4e1cab89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.358750 17380 tablet_service.cc:1511] Processing CreateTablet for tablet a7e1f8f7b0e44cc38e154e294927d7ff (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:12.359364 17515 tablet_bootstrap.cc:654] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.340605 17381 tablet_service.cc:1511] Processing CreateTablet for tablet bf42e0c75aa14899935b39a4a7437626 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:12.393780 17384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bff337c6c8418e8fe0872b92f3bd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.395009 17378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa77e48390f407cb43bb16febfe2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.396008 17460 tablet_service.cc:1511] Processing CreateTablet for tablet b0bff337c6c8418e8fe0872b92f3bd6f (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
W20260709 13:17:12.396813 17268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:12.397308 17460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bff337c6c8418e8fe0872b92f3bd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.396970 17455 tablet_service.cc:1511] Processing CreateTablet for tablet 7601a632a565453b83b93c1020924101 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:12.398236 17455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7601a632a565453b83b93c1020924101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.399338 17305 tablet_service.cc:1511] Processing CreateTablet for tablet a5d6271327d4457ea6b522d9188f4f84 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:12.400530 17305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d6271327d4457ea6b522d9188f4f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.356758 17513 tablet_bootstrap.cc:492] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:12.401324 17513 ts_tablet_manager.cc:1403] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.143s	user 0.015s	sys 0.014s
I20260709 13:17:12.402848 17457 tablet_service.cc:1511] Processing CreateTablet for tablet a5d6271327d4457ea6b522d9188f4f84 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:12.404106 17457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d6271327d4457ea6b522d9188f4f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.403789 17308 tablet_service.cc:1511] Processing CreateTablet for tablet 24bd9827b3204adba8158c0366088793 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:12.405128 17308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bd9827b3204adba8158c0366088793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.405654 17385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.414040 17307 tablet_service.cc:1511] Processing CreateTablet for tablet 7601a632a565453b83b93c1020924101 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:12.415382 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7601a632a565453b83b93c1020924101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.417404 17380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e1f8f7b0e44cc38e154e294927d7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.421128 17453 tablet_service.cc:1511] Processing CreateTablet for tablet 24bd9827b3204adba8158c0366088793 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:12.422484 17453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bd9827b3204adba8158c0366088793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.422263 17306 tablet_service.cc:1511] Processing CreateTablet for tablet 622554a5186d4910b8476a653411c85d (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:12.423569 17306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622554a5186d4910b8476a653411c85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.435320 17387 tablet_service.cc:1511] Processing CreateTablet for tablet 7601a632a565453b83b93c1020924101 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:12.436753 17387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7601a632a565453b83b93c1020924101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.440932 17514 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.404474 17513 raft_consensus.cc:359] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.441457 17513 raft_consensus.cc:385] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.441427 17514 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.441875 17513 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.442644 17513 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.461318 17379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128956e308c048a2af21fae67c6683ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.480607 17511 tablet_bootstrap.cc:492] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:12.482517 17511 ts_tablet_manager.cc:1403] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.002s
I20260709 13:17:12.482677 17461 tablet_service.cc:1511] Processing CreateTablet for tablet 622554a5186d4910b8476a653411c85d (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:12.473526 17514 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:12.483990 17461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622554a5186d4910b8476a653411c85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.485841 17511 raft_consensus.cc:359] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.486532 17511 raft_consensus.cc:385] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.486809 17511 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.488524 17515 tablet_bootstrap.cc:492] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:12.489013 17515 ts_tablet_manager.cc:1403] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.010s
I20260709 13:17:12.490823 17452 tablet_service.cc:1511] Processing CreateTablet for tablet 34cf7d4eca6445628c0af4ea7b65f11b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:12.492136 17452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cf7d4eca6445628c0af4ea7b65f11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.491797 17515 raft_consensus.cc:359] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.492538 17515 raft_consensus.cc:385] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.494113 17511 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.495997 17383 tablet_service.cc:1511] Processing CreateTablet for tablet a5d6271327d4457ea6b522d9188f4f84 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:12.501595 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d6271327d4457ea6b522d9188f4f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.503305 17511 ts_tablet_manager.cc:1434] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:17:12.504534 17513 ts_tablet_manager.cc:1434] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.008s
I20260709 13:17:12.504750 17515 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.508505 17456 tablet_service.cc:1511] Processing CreateTablet for tablet 132676f9343f4733b4f07f4587384a56 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:12.514585 17453 tablet_service.cc:1511] Processing CreateTablet for tablet 457e80c2d06f4623a397b7b3d6190f05 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:12.533191 17386 tablet_service.cc:1511] Processing CreateTablet for tablet 24bd9827b3204adba8158c0366088793 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:12.534305 17455 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed6b0a2fcf5476ab0f8dffeb3536922 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:12.534904 17511 tablet_bootstrap.cc:492] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:12.534669 17459 tablet_service.cc:1511] Processing CreateTablet for tablet a4c1e66c4a684159ae427b3705522c26 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:12.537420 17519 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.537931 17519 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.538259 17378 tablet_service.cc:1511] Processing CreateTablet for tablet 622554a5186d4910b8476a653411c85d (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:12.543455 17455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed6b0a2fcf5476ab0f8dffeb3536922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.544054 17519 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:12.539235 17381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf42e0c75aa14899935b39a4a7437626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.541649 17496 heartbeater.cc:499] Master 127.15.208.62:46299 was elected leader, sending a full tablet report...
I20260709 13:17:12.567317 17514 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.567924 17514 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.570367 17514 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:12.551108 17515 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.565182 17513 tablet_bootstrap.cc:492] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:12.594358 17459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c1e66c4a684159ae427b3705522c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.590158 17310 tablet_service.cc:1511] Processing CreateTablet for tablet 34cf7d4eca6445628c0af4ea7b65f11b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:12.590737 17378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622554a5186d4910b8476a653411c85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.597514 17380 tablet_service.cc:1511] Processing CreateTablet for tablet 34cf7d4eca6445628c0af4ea7b65f11b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:12.599185 17380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cf7d4eca6445628c0af4ea7b65f11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.597363 17310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cf7d4eca6445628c0af4ea7b65f11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.606343 17515 ts_tablet_manager.cc:1434] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.000s
I20260709 13:17:12.621129 17386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bd9827b3204adba8158c0366088793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.622699 17457 tablet_service.cc:1511] Processing CreateTablet for tablet 15143e49c9844f47911ff4266f078b54 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:12.626288 17515 tablet_bootstrap.cc:492] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:12.626765 17422 heartbeater.cc:499] Master 127.15.208.62:46299 was elected leader, sending a full tablet report...
I20260709 13:17:12.627758 17458 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3278087b524fbab2103bd52cc56710 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:12.624913 17460 tablet_service.cc:1511] Processing CreateTablet for tablet 72154b87dcf145b2aeae9bf915b34ce0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:12.635962 17382 tablet_service.cc:1511] Processing CreateTablet for tablet 132676f9343f4733b4f07f4587384a56 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:12.637389 17382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132676f9343f4733b4f07f4587384a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.641233 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:12.641969 17471 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:12.643267 17515 tablet_bootstrap.cc:654] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.643877 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:12.644693 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:12.651957 17511 tablet_bootstrap.cc:654] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.651808 17461 tablet_service.cc:1511] Processing CreateTablet for tablet 96a5582b6bfb4ac592225b49ce6df9be (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:12.654248 17456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132676f9343f4733b4f07f4587384a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.652215 17384 tablet_service.cc:1511] Processing CreateTablet for tablet 457e80c2d06f4623a397b7b3d6190f05 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:12.658347 17305 tablet_service.cc:1511] Processing CreateTablet for tablet 457e80c2d06f4623a397b7b3d6190f05 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:12.659279 17311 tablet_service.cc:1511] Processing CreateTablet for tablet 15143e49c9844f47911ff4266f078b54 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:12.659861 17306 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed6b0a2fcf5476ab0f8dffeb3536922 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:12.661374 17308 tablet_service.cc:1511] Processing CreateTablet for tablet a4c1e66c4a684159ae427b3705522c26 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:12.661618 17309 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3278087b524fbab2103bd52cc56710 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:12.662914 17312 tablet_service.cc:1511] Processing CreateTablet for tablet 72154b87dcf145b2aeae9bf915b34ce0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:12.664584 17304 tablet_service.cc:1511] Processing CreateTablet for tablet 96a5582b6bfb4ac592225b49ce6df9be (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:12.666332 17303 tablet_service.cc:1511] Processing CreateTablet for tablet a20d82b49da74027abe144db7281b7b0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:12.667383 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:12.676489 17514 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.692139 17514 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.692665 17514 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.693502 17307 tablet_service.cc:1511] Processing CreateTablet for tablet 132676f9343f4733b4f07f4587384a56 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:12.696509 17305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457e80c2d06f4623a397b7b3d6190f05. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:12.678761 17287 leader_election.cc:343] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.690742 17461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a5582b6bfb4ac592225b49ce6df9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.697592 17457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15143e49c9844f47911ff4266f078b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.699002 17452 tablet_service.cc:1511] Processing CreateTablet for tablet a20d82b49da74027abe144db7281b7b0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:12.699855 17460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72154b87dcf145b2aeae9bf915b34ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.700563 17452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d82b49da74027abe144db7281b7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.700865 17309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3278087b524fbab2103bd52cc56710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.701179 17458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3278087b524fbab2103bd52cc56710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.704468 17312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72154b87dcf145b2aeae9bf915b34ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.709733 17384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457e80c2d06f4623a397b7b3d6190f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.710626 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:12.713167 17453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457e80c2d06f4623a397b7b3d6190f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.714305 17308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c1e66c4a684159ae427b3705522c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.717618 17306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed6b0a2fcf5476ab0f8dffeb3536922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.718523 17513 tablet_bootstrap.cc:654] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.721509 17311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15143e49c9844f47911ff4266f078b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.725509 17304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a5582b6bfb4ac592225b49ce6df9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.726217 17303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d82b49da74027abe144db7281b7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.729758 17379 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed6b0a2fcf5476ab0f8dffeb3536922 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:12.731073 17379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed6b0a2fcf5476ab0f8dffeb3536922. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:12.735599 17286 leader_election.cc:343] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.716487 17514 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.735567 17385 tablet_service.cc:1511] Processing CreateTablet for tablet 72154b87dcf145b2aeae9bf915b34ce0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:12.750782 17385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72154b87dcf145b2aeae9bf915b34ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.759495 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132676f9343f4733b4f07f4587384a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.744311 17381 tablet_service.cc:1511] Processing CreateTablet for tablet a4c1e66c4a684159ae427b3705522c26 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:12.767705 17381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c1e66c4a684159ae427b3705522c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.769778 17526 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.770422 17526 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.794160 17526 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:17:12.805158 17286 leader_election.cc:343] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.807276 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:12.821336 17471 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.808446 17514 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:12.826084 17383 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3278087b524fbab2103bd52cc56710 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:12.822559 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:12.838133 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:17:12.839530 17435 leader_election.cc:343] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.845755 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3278087b524fbab2103bd52cc56710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.816817 17457 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0cd72466fe4edf8e126347432dbccb (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:12.850142 17457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0cd72466fe4edf8e126347432dbccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.821668 17387 tablet_service.cc:1511] Processing CreateTablet for tablet 15143e49c9844f47911ff4266f078b54 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:12.859174 17514 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:12.861721 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 56612.7us
I20260709 13:17:12.873265 17461 tablet_service.cc:1511] Processing CreateTablet for tablet bd3f7b090266450da9f53ec675edc8f0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:12.876967 17304 tablet_service.cc:1511] Processing CreateTablet for tablet bd3f7b090266450da9f53ec675edc8f0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:12.875730 17455 tablet_service.cc:1511] Processing CreateTablet for tablet 5d53d8e9fcbb4d1b901628952a056ffb (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:12.878238 17304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3f7b090266450da9f53ec675edc8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.878388 17461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3f7b090266450da9f53ec675edc8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.878553 17515 tablet_bootstrap.cc:492] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:12.879163 17515 ts_tablet_manager.cc:1403] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.253s	user 0.007s	sys 0.013s
I20260709 13:17:12.881434 17455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d53d8e9fcbb4d1b901628952a056ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.881887 17310 tablet_service.cc:1511] Processing CreateTablet for tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:12.883097 17310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.888666 17513 tablet_bootstrap.cc:492] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:12.889164 17513 ts_tablet_manager.cc:1403] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.336s	user 0.018s	sys 0.003s
I20260709 13:17:12.889464 17460 tablet_service.cc:1511] Processing CreateTablet for tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:12.890723 17460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.892017 17513 raft_consensus.cc:359] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.893790 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:12.894637 17322 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 1: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:17:12.895947 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:12.898136 17382 tablet_service.cc:1511] Processing CreateTablet for tablet 96a5582b6bfb4ac592225b49ce6df9be (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:12.899353 17471 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:12.892741 17513 raft_consensus.cc:385] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.900055 17520 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.900105 17513 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.903689 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:12.848712 17311 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0cd72466fe4edf8e126347432dbccb (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:12.904547 17513 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.905553 17311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0cd72466fe4edf8e126347432dbccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.912786 17511 tablet_bootstrap.cc:492] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:12.913846 17511 ts_tablet_manager.cc:1403] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.379s	user 0.015s	sys 0.011s
I20260709 13:17:12.911713 17387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15143e49c9844f47911ff4266f078b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.912987 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:12.916788 17511 raft_consensus.cc:359] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.905977 17514 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:12.926005 17286 leader_election.cc:343] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.922065 17515 raft_consensus.cc:359] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.926728 17515 raft_consensus.cc:385] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.927044 17515 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.927948 17515 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.928794 17514 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:12.929746 17514 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.930236 17380 tablet_service.cc:1511] Processing CreateTablet for tablet a20d82b49da74027abe144db7281b7b0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:12.946635 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:12.934031 17378 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0cd72466fe4edf8e126347432dbccb (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:12.946686 17513 ts_tablet_manager.cc:1434] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
W20260709 13:17:12.948259 17360 leader_election.cc:343] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.936997 17382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a5582b6bfb4ac592225b49ce6df9be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.924304 17511 raft_consensus.cc:385] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.949301 17511 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.950095 17511 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:12.954888 17380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d82b49da74027abe144db7281b7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.962498 17384 tablet_service.cc:1511] Processing CreateTablet for tablet bd3f7b090266450da9f53ec675edc8f0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:12.962699 17453 tablet_service.cc:1511] Processing CreateTablet for tablet 984feea4e2564e57923c946b7572e2a0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:12.964876 17453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984feea4e2564e57923c946b7572e2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.940980 17386 tablet_service.cc:1511] Processing CreateTablet for tablet 5d53d8e9fcbb4d1b901628952a056ffb (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:12.969301 17378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0cd72466fe4edf8e126347432dbccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.974191 17303 tablet_service.cc:1511] Processing CreateTablet for tablet b19033ecd72e4ba188910445b70c84d5 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:12.975725 17303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19033ecd72e4ba188910445b70c84d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.972550 17515 ts_tablet_manager.cc:1434] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 13:17:12.989194 17458 tablet_service.cc:1511] Processing CreateTablet for tablet b19033ecd72e4ba188910445b70c84d5 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:12.989810 17307 tablet_service.cc:1511] Processing CreateTablet for tablet 984feea4e2564e57923c946b7572e2a0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:12.992969 17384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3f7b090266450da9f53ec675edc8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.993309 17513 tablet_bootstrap.cc:492] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:13.006263 17458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19033ecd72e4ba188910445b70c84d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.006297 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984feea4e2564e57923c946b7572e2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.984896 17312 tablet_service.cc:1511] Processing CreateTablet for tablet 5d53d8e9fcbb4d1b901628952a056ffb (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:13.020282 17312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d53d8e9fcbb4d1b901628952a056ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.031677 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:13.033386 17362 leader_election.cc:343] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.033900 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:13.035079 17526 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.042737 17515 tablet_bootstrap.cc:492] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:13.049942 17383 tablet_service.cc:1511] Processing CreateTablet for tablet 984feea4e2564e57923c946b7572e2a0 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:13.052464 17309 tablet_service.cc:1511] Processing CreateTablet for tablet ef8ac3d116f3443db6462f3a86ce1432 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:13.053788 17309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8ac3d116f3443db6462f3a86ce1432. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:13.016006 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 112399us
I20260709 13:17:13.045508 17386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d53d8e9fcbb4d1b901628952a056ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.056684 17307 tablet_service.cc:1511] Processing CreateTablet for tablet 036c02de798949eeb02d27e9dd520825 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:13.058035 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036c02de798949eeb02d27e9dd520825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.063737 17219 catalog_manager.cc:5697] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.065256 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984feea4e2564e57923c946b7572e2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.067194 17380 tablet_service.cc:1511] Processing CreateTablet for tablet b19033ecd72e4ba188910445b70c84d5 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:13.068471 17380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19033ecd72e4ba188910445b70c84d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.069854 17379 tablet_service.cc:1511] Processing CreateTablet for tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:13.054208 17460 tablet_service.cc:1511] Processing CreateTablet for tablet ef8ac3d116f3443db6462f3a86ce1432 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:13.073390 17460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8ac3d116f3443db6462f3a86ce1432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.077982 17513 tablet_bootstrap.cc:654] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.082578 17385 tablet_service.cc:1511] Processing CreateTablet for tablet 036c02de798949eeb02d27e9dd520825 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:13.094462 17511 ts_tablet_manager.cc:1434] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.180s	user 0.012s	sys 0.004s
I20260709 13:17:13.077704 17381 tablet_service.cc:1511] Processing CreateTablet for tablet ef8ac3d116f3443db6462f3a86ce1432 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:13.097035 17511 tablet_bootstrap.cc:492] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:13.115049 17514 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.115571 17514 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.116175 17453 tablet_service.cc:1511] Processing CreateTablet for tablet 036c02de798949eeb02d27e9dd520825 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:13.117609 17453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036c02de798949eeb02d27e9dd520825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.081259 17379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.127792 17381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8ac3d116f3443db6462f3a86ce1432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.129632 17385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036c02de798949eeb02d27e9dd520825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.146544 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:17:13.148130 17286 leader_election.cc:343] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.149668 17514 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:13.150269 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:13.151633 17287 leader_election.cc:343] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.152066 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:17:13.153216 17205 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 57019us
I20260709 13:17:13.153236 17514 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.158509 17457 tablet_service.cc:1511] Processing CreateTablet for tablet 6758d139882843e5bddc827c260b81a9 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:13.160023 17457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6758d139882843e5bddc827c260b81a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.161900 17303 tablet_service.cc:1511] Processing CreateTablet for tablet 6758d139882843e5bddc827c260b81a9 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:13.163252 17303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6758d139882843e5bddc827c260b81a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.164464 17526 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.165015 17526 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.165693 17515 tablet_bootstrap.cc:654] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.167426 17526 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:13.173918 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:13.175208 17307 tablet_service.cc:1511] Processing CreateTablet for tablet ff6cbb1194424d7fb250bdb904d367ab (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 13:17:13.175464 17360 leader_election.cc:343] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.176342 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6cbb1194424d7fb250bdb904d367ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.182780 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:13.183951 17460 tablet_service.cc:1511] Processing CreateTablet for tablet ff6cbb1194424d7fb250bdb904d367ab (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:13.184684 17515 tablet_bootstrap.cc:492] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
W20260709 13:17:13.184521 17362 leader_election.cc:343] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.185218 17515 ts_tablet_manager.cc:1403] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.157s	user 0.009s	sys 0.013s
I20260709 13:17:13.185185 17362 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:13.186517 17526 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.188560 17511 tablet_bootstrap.cc:654] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.188624 17387 tablet_service.cc:1511] Processing CreateTablet for tablet 6758d139882843e5bddc827c260b81a9 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:13.190153 17387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6758d139882843e5bddc827c260b81a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.195307 17382 tablet_service.cc:1511] Processing CreateTablet for tablet ff6cbb1194424d7fb250bdb904d367ab (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:13.196815 17382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6cbb1194424d7fb250bdb904d367ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.198212 17513 tablet_bootstrap.cc:492] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:13.198040 17515 raft_consensus.cc:359] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.198716 17513 ts_tablet_manager.cc:1403] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.221s	user 0.021s	sys 0.020s
I20260709 13:17:13.198899 17515 raft_consensus.cc:385] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.199273 17515 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.200047 17515 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.204942 17311 tablet_service.cc:1511] Processing CreateTablet for tablet 7bb3b6f88d9b4423a689bae4e9e59333 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:13.206275 17311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bb3b6f88d9b4423a689bae4e9e59333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.206653 17458 tablet_service.cc:1511] Processing CreateTablet for tablet 7bb3b6f88d9b4423a689bae4e9e59333 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:13.185302 17460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6cbb1194424d7fb250bdb904d367ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.217407 17458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bb3b6f88d9b4423a689bae4e9e59333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.226263 17513 raft_consensus.cc:359] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.227015 17513 raft_consensus.cc:385] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.227314 17513 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.237483 17515 ts_tablet_manager.cc:1434] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:17:13.239960 17461 tablet_service.cc:1511] Processing CreateTablet for tablet 4295303b785442b287bf068dfd2e160c (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:13.240581 17513 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.241292 17461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4295303b785442b287bf068dfd2e160c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.243026 17513 ts_tablet_manager.cc:1434] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:17:13.244087 17513 tablet_bootstrap.cc:492] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:13.249213 17520 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.249708 17520 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.250149 17383 tablet_service.cc:1511] Processing CreateTablet for tablet 7bb3b6f88d9b4423a689bae4e9e59333 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:13.251664 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bb3b6f88d9b4423a689bae4e9e59333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.251793 17520 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:13.253387 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:13.253628 17515 tablet_bootstrap.cc:492] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:13.255323 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:13.255947 17322 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
W20260709 13:17:13.257920 17435 leader_election.cc:343] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.259406 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:13.260210 17309 tablet_service.cc:1511] Processing CreateTablet for tablet 4295303b785442b287bf068dfd2e160c (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:13.261034 17520 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.264442 17312 tablet_service.cc:1511] Processing CreateTablet for tablet 16a281c8bb174a28b9e029139de7e00b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:13.267333 17312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a281c8bb174a28b9e029139de7e00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.268688 17511 tablet_bootstrap.cc:492] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:13.266345 17520 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.269183 17511 ts_tablet_manager.cc:1403] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.172s	user 0.013s	sys 0.003s
I20260709 13:17:13.269220 17520 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.272498 17511 raft_consensus.cc:359] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.273314 17511 raft_consensus.cc:385] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.273622 17511 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.274104 17515 tablet_bootstrap.cc:654] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.274343 17511 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.276585 17511 ts_tablet_manager.cc:1434] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:13.276662 17379 tablet_service.cc:1511] Processing CreateTablet for tablet 4295303b785442b287bf068dfd2e160c (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:13.277483 17309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4295303b785442b287bf068dfd2e160c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.296277 17307 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc026cf7a3b43b3a05aca657efbaecd (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:13.298028 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc026cf7a3b43b3a05aca657efbaecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.289384 17453 tablet_service.cc:1511] Processing CreateTablet for tablet 16a281c8bb174a28b9e029139de7e00b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:13.307703 17453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a281c8bb174a28b9e029139de7e00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.307801 17513 tablet_bootstrap.cc:654] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.308631 17457 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc026cf7a3b43b3a05aca657efbaecd (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:13.310590 17457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc026cf7a3b43b3a05aca657efbaecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.315352 17305 tablet_service.cc:1511] Processing CreateTablet for tablet 2679735faeb64bcf9031060956c1e1b9 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:13.316273 17379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4295303b785442b287bf068dfd2e160c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.316797 17305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2679735faeb64bcf9031060956c1e1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.293097 17520 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.318284 17455 tablet_service.cc:1511] Processing CreateTablet for tablet 2679735faeb64bcf9031060956c1e1b9 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:13.319617 17455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2679735faeb64bcf9031060956c1e1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.319559 17383 tablet_service.cc:1511] Processing CreateTablet for tablet 2679735faeb64bcf9031060956c1e1b9 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:13.321087 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2679735faeb64bcf9031060956c1e1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.318645 17520 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:13.322183 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:17:13.324398 17435 leader_election.cc:343] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.326010 17511 tablet_bootstrap.cc:492] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:13.325953 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:13.326673 17322 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.334702 17515 tablet_bootstrap.cc:492] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:13.335227 17515 ts_tablet_manager.cc:1403] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.014s
I20260709 13:17:13.338038 17515 raft_consensus.cc:359] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.338580 17322 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:13.338793 17515 raft_consensus.cc:385] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.339099 17515 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.339567 17386 tablet_service.cc:1511] Processing CreateTablet for tablet 16a281c8bb174a28b9e029139de7e00b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:13.339900 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:13.341147 17386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a281c8bb174a28b9e029139de7e00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.321954 17381 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc026cf7a3b43b3a05aca657efbaecd (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:13.344651 17515 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.346144 17381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc026cf7a3b43b3a05aca657efbaecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.345036 17520 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.350629 17515 ts_tablet_manager.cc:1434] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:17:13.351688 17515 tablet_bootstrap.cc:492] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:13.355100 17307 tablet_service.cc:1511] Processing CreateTablet for tablet 4df43493289c4586a02bce2e14a38202 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:13.356393 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df43493289c4586a02bce2e14a38202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.368530 17511 tablet_bootstrap.cc:654] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.382686 17515 tablet_bootstrap.cc:654] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.394089 17379 tablet_service.cc:1511] Processing CreateTablet for tablet 4df43493289c4586a02bce2e14a38202 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:13.395819 17379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df43493289c4586a02bce2e14a38202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.398538 17520 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:13.399860 17520 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:13.410531 17268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:13.416465 17458 tablet_service.cc:1511] Processing CreateTablet for tablet 4df43493289c4586a02bce2e14a38202 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:13.420751 17458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df43493289c4586a02bce2e14a38202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.420828 17526 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.421429 17526 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.423729 17526 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:13.425369 17547 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.425854 17547 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.426491 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:13.427085 17471 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:13.427834 17547 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:13.429224 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:13.430655 17511 tablet_bootstrap.cc:492] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:13.430648 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:13.432042 17397 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:13.438019 17526 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.439082 17387 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3bd226d2e04278bed4c50c89f1f5bd (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:13.439703 17526 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.440155 17526 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.433883 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:13.437925 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:13.431196 17511 ts_tablet_manager.cc:1403] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.010s
I20260709 13:17:13.440810 17387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3bd226d2e04278bed4c50c89f1f5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.441244 17322 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:13.448419 17513 tablet_bootstrap.cc:492] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:13.448976 17513 ts_tablet_manager.cc:1403] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.205s	user 0.017s	sys 0.009s
I20260709 13:17:13.441829 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:13.450883 17547 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.451377 17547 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.451814 17547 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.452350 17513 raft_consensus.cc:359] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.453223 17513 raft_consensus.cc:385] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.453569 17513 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.454428 17513 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.444622 17305 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3bd226d2e04278bed4c50c89f1f5bd (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:13.457427 17305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3bd226d2e04278bed4c50c89f1f5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.458148 17513 ts_tablet_manager.cc:1434] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:17:13.459290 17513 tablet_bootstrap.cc:492] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:13.460322 17515 tablet_bootstrap.cc:492] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:13.460973 17515 ts_tablet_manager.cc:1403] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.016s
I20260709 13:17:13.466394 17513 tablet_bootstrap.cc:654] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:13.467350 17286 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:13.469501 17511 raft_consensus.cc:359] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.470515 17511 raft_consensus.cc:385] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.470858 17511 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.477514 17514 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:13.483739 17515 raft_consensus.cc:359] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.491585 17307 tablet_service.cc:1511] Processing CreateTablet for tablet ff504a0c820741ecb08279a255054a6c (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:13.500070 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff504a0c820741ecb08279a255054a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.501618 17383 tablet_service.cc:1511] Processing CreateTablet for tablet ff504a0c820741ecb08279a255054a6c (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:13.503196 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff504a0c820741ecb08279a255054a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.494359 17457 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3bd226d2e04278bed4c50c89f1f5bd (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:13.471807 17511 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.505754 17457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3bd226d2e04278bed4c50c89f1f5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.519665 17511 ts_tablet_manager.cc:1434] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:17:13.520258 17515 raft_consensus.cc:385] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.532236 17515 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.535610 17515 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.554719 17514 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.555508 17514 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.566741 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:13.567677 17397 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:13.569502 17286 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:13.579689 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:13.584617 17287 leader_election.cc:343] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.589933 17514 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:13.590500 17514 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.590835 17514 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.591151 17514 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.594157 17547 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.596344 17547 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:13.597316 17511 tablet_bootstrap.cc:492] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:13.596678 17218 catalog_manager.cc:5697] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:13.598719 17526 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.618575 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:13.619499 17511 tablet_bootstrap.cc:654] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.607738 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:13.620638 17526 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:13.610136 17554 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.609197 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:13.622467 17397 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 1: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:17:13.621788 17554 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.619395 17321 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.625541 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:13.626300 17554 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:13.614933 17515 ts_tablet_manager.cc:1434] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.154s	user 0.009s	sys 0.002s
I20260709 13:17:13.626844 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:13.628240 17515 tablet_bootstrap.cc:492] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:13.630362 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:13.631117 17470 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
W20260709 13:17:13.632298 17360 leader_election.cc:343] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.632565 17547 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:17:13.605062 17205 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 77689.3us
I20260709 13:17:13.633045 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:13.634480 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:13.634863 17321 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:13.635262 17471 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 1: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:17:13.636004 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:13.641578 17514 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.642285 17513 tablet_bootstrap.cc:492] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:13.642769 17513 ts_tablet_manager.cc:1403] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.184s	user 0.062s	sys 0.064s
I20260709 13:17:13.643748 17514 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:13.645192 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:13.645784 17397 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.648792 17312 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecbe40a17fe40b69ac2ecffb5e51786 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:13.650148 17312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecbe40a17fe40b69ac2ecffb5e51786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.645794 17513 raft_consensus.cc:359] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.651695 17453 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecbe40a17fe40b69ac2ecffb5e51786 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:13.653059 17453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecbe40a17fe40b69ac2ecffb5e51786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.654599 17383 tablet_service.cc:1511] Processing CreateTablet for tablet f2018cf7711d4001a8a9fae2f46d00f4 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:13.655592 17309 tablet_service.cc:1511] Processing CreateTablet for tablet f2018cf7711d4001a8a9fae2f46d00f4 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:13.657287 17309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2018cf7711d4001a8a9fae2f46d00f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.659226 17455 tablet_service.cc:1511] Processing CreateTablet for tablet f2018cf7711d4001a8a9fae2f46d00f4 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:13.660574 17455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2018cf7711d4001a8a9fae2f46d00f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.655776 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2018cf7711d4001a8a9fae2f46d00f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.662230 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:13.663625 17526 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.664093 17526 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.664522 17526 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.670558 17381 tablet_service.cc:1511] Processing CreateTablet for tablet 060ed925d51948b7b415b005543f7a9f (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:13.672024 17381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ed925d51948b7b415b005543f7a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.650516 17513 raft_consensus.cc:385] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.672248 17554 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.675561 17397 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:13.673137 17513 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.683071 17460 tablet_service.cc:1511] Processing CreateTablet for tablet 060ed925d51948b7b415b005543f7a9f (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:13.685743 17554 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:13.687072 17286 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:13.687861 17460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ed925d51948b7b415b005543f7a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.687973 17514 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.688454 17514 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:13.688156 17554 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.689272 17514 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.694522 17461 tablet_service.cc:1511] Processing CreateTablet for tablet cd74e04425094277971ef1f372f80d50 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:13.694909 17386 tablet_service.cc:1511] Processing CreateTablet for tablet cd74e04425094277971ef1f372f80d50 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:13.695861 17461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd74e04425094277971ef1f372f80d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.696179 17386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd74e04425094277971ef1f372f80d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.698455 17303 tablet_service.cc:1511] Processing CreateTablet for tablet 060ed925d51948b7b415b005543f7a9f (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:13.699147 17311 tablet_service.cc:1511] Processing CreateTablet for tablet cd74e04425094277971ef1f372f80d50 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:13.699723 17303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ed925d51948b7b415b005543f7a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.700414 17311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd74e04425094277971ef1f372f80d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.693761 17513 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.707212 17513 ts_tablet_manager.cc:1434] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:17:13.708241 17513 tablet_bootstrap.cc:492] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:13.709677 17385 tablet_service.cc:1511] Processing CreateTablet for tablet 77bea333b0644080b6a74f153a5f03c5 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:13.710929 17385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77bea333b0644080b6a74f153a5f03c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.713943 17456 tablet_service.cc:1511] Processing CreateTablet for tablet 77bea333b0644080b6a74f153a5f03c5 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:13.714331 17310 tablet_service.cc:1511] Processing CreateTablet for tablet b5bcc05e009f492a9e252332680b738b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:13.715391 17456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77bea333b0644080b6a74f153a5f03c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.715554 17310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bcc05e009f492a9e252332680b738b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.717973 17304 tablet_service.cc:1511] Processing CreateTablet for tablet 77bea333b0644080b6a74f153a5f03c5 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:13.719385 17304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77bea333b0644080b6a74f153a5f03c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.720999 17471 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.705845 17387 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecbe40a17fe40b69ac2ecffb5e51786 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:13.727629 17382 tablet_service.cc:1511] Processing CreateTablet for tablet b5bcc05e009f492a9e252332680b738b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:13.729001 17382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bcc05e009f492a9e252332680b738b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.737165 17526 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.738891 17387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecbe40a17fe40b69ac2ecffb5e51786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.740172 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:17:13.749933 17360 leader_election.cc:343] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.756780 17526 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:13.758328 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:13.759052 17469 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.760092 17307 tablet_service.cc:1511] Processing CreateTablet for tablet 96336e4c5eb64d4d967c671c9a221e69 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:13.761441 17307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96336e4c5eb64d4d967c671c9a221e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.761842 17453 tablet_service.cc:1511] Processing CreateTablet for tablet b5bcc05e009f492a9e252332680b738b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:13.763139 17453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bcc05e009f492a9e252332680b738b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.767274 17469 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:13.768271 17383 tablet_service.cc:1511] Processing CreateTablet for tablet 96336e4c5eb64d4d967c671c9a221e69 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:13.769508 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96336e4c5eb64d4d967c671c9a221e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.745834 17458 tablet_service.cc:1511] Processing CreateTablet for tablet ff504a0c820741ecb08279a255054a6c (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:13.769114 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:13.756670 17513 tablet_bootstrap.cc:654] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.782230 17458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff504a0c820741ecb08279a255054a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.788762 17554 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.797602 17554 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:13.798416 17554 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.798607 17380 tablet_service.cc:1511] Processing CreateTablet for tablet 1e69b6a14a654bac9e2288b25123fc4b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:13.800019 17380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e69b6a14a654bac9e2288b25123fc4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.802536 17308 tablet_service.cc:1511] Processing CreateTablet for tablet 1e69b6a14a654bac9e2288b25123fc4b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:13.804028 17308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e69b6a14a654bac9e2288b25123fc4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.808920 17218 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.815889 17547 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.816243 17471 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:13.820344 17460 tablet_service.cc:1511] Processing CreateTablet for tablet 1e69b6a14a654bac9e2288b25123fc4b (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:13.821494 17460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e69b6a14a654bac9e2288b25123fc4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.845031 17218 catalog_manager.cc:5697] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.850844 17455 tablet_service.cc:1511] Processing CreateTablet for tablet 96336e4c5eb64d4d967c671c9a221e69 (DEFAULT_TABLE table=test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:13.855015 17455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96336e4c5eb64d4d967c671c9a221e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.873561 17515 tablet_bootstrap.cc:654] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.891191 17513 tablet_bootstrap.cc:492] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:13.891767 17513 ts_tablet_manager.cc:1403] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.184s	user 0.016s	sys 0.000s
I20260709 13:17:13.895056 17513 raft_consensus.cc:359] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.896625 17513 raft_consensus.cc:385] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.896974 17513 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.898000 17513 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.900540 17513 ts_tablet_manager.cc:1434] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:13.901566 17513 tablet_bootstrap.cc:492] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:13.907390 17513 tablet_bootstrap.cc:654] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.909104 17218 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:13.917124 17435 consensus_peers.cc:597] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:13.930428 17511 tablet_bootstrap.cc:492] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:13.933477 17511 ts_tablet_manager.cc:1403] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.413s	user 0.034s	sys 0.026s
I20260709 13:17:13.935577 17511 raft_consensus.cc:359] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.936302 17511 raft_consensus.cc:385] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.936578 17511 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.938736 17513 tablet_bootstrap.cc:492] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:13.939216 17513 ts_tablet_manager.cc:1403] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.003s
I20260709 13:17:13.941627 17513 raft_consensus.cc:359] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.942370 17513 raft_consensus.cc:385] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.942682 17513 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.943490 17513 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.943728 17511 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.945122 17515 tablet_bootstrap.cc:492] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:13.945612 17515 ts_tablet_manager.cc:1403] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.318s	user 0.010s	sys 0.014s
I20260709 13:17:13.945858 17511 ts_tablet_manager.cc:1434] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.003s
I20260709 13:17:13.947589 17513 ts_tablet_manager.cc:1434] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:17:13.948539 17513 tablet_bootstrap.cc:492] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:13.948777 17511 tablet_bootstrap.cc:492] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:13.950484 17515 raft_consensus.cc:359] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.950999 17514 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.951226 17515 raft_consensus.cc:385] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.951542 17515 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.951442 17514 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.952369 17515 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.953543 17514 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:13.954712 17515 ts_tablet_manager.cc:1434] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:13.954864 17513 tablet_bootstrap.cc:654] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.955195 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:13.955687 17515 tablet_bootstrap.cc:492] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:13.960222 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:13.961362 17470 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 1: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:17:13.962244 17515 tablet_bootstrap.cc:654] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.962244 17511 tablet_bootstrap.cc:654] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.968544 17287 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:13.970184 17514 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.974536 17515 tablet_bootstrap.cc:492] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:13.974536 17511 tablet_bootstrap.cc:492] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:13.975229 17511 ts_tablet_manager.cc:1403] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.002s
I20260709 13:17:13.975229 17515 ts_tablet_manager.cc:1403] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:17:13.978438 17511 raft_consensus.cc:359] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.979157 17511 raft_consensus.cc:385] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.979508 17511 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.980268 17511 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.978349 17515 raft_consensus.cc:359] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.981288 17515 raft_consensus.cc:385] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.981612 17515 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.982321 17515 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:13.985028 17511 ts_tablet_manager.cc:1434] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:13.986636 17515 ts_tablet_manager.cc:1434] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:17:13.987882 17515 tablet_bootstrap.cc:492] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:13.994251 17515 tablet_bootstrap.cc:654] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.004266 17511 tablet_bootstrap.cc:492] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.009563 17514 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.014719 17511 tablet_bootstrap.cc:654] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.021549 17515 tablet_bootstrap.cc:492] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.022047 17515 ts_tablet_manager.cc:1403] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.020s
I20260709 13:17:14.022492 17513 tablet_bootstrap.cc:492] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:14.022876 17513 ts_tablet_manager.cc:1403] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.075s	user 0.036s	sys 0.036s
I20260709 13:17:14.023077 17511 tablet_bootstrap.cc:492] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.023547 17511 ts_tablet_manager.cc:1403] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:17:14.024744 17513 raft_consensus.cc:359] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.024682 17515 raft_consensus.cc:359] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.025563 17513 raft_consensus.cc:385] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.025624 17515 raft_consensus.cc:385] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.025853 17513 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.025961 17515 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.026196 17511 raft_consensus.cc:359] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.026942 17511 raft_consensus.cc:385] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.026629 17513 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.026775 17515 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.027230 17511 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.028064 17511 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.028756 17513 ts_tablet_manager.cc:1434] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:17:14.030349 17511 ts_tablet_manager.cc:1434] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:14.031756 17515 ts_tablet_manager.cc:1434] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:14.032644 17515 tablet_bootstrap.cc:492] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.034426 17513 tablet_bootstrap.cc:492] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:14.034644 17554 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.035112 17554 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.036691 17511 tablet_bootstrap.cc:492] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.037196 17554 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.037993 17515 tablet_bootstrap.cc:654] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.038782 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.040112 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:14.042039 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:14.049665 17513 tablet_bootstrap.cc:654] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.050339 17511 tablet_bootstrap.cc:654] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.055018 17515 tablet_bootstrap.cc:492] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.055393 17526 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.055603 17515 ts_tablet_manager.cc:1403] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.003s
I20260709 13:17:14.055438 17554 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.056458 17554 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.058846 17554 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.059257 17513 tablet_bootstrap.cc:492] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:14.059103 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.058924 17515 raft_consensus.cc:359] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.059830 17513 ts_tablet_manager.cc:1403] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.004s
I20260709 13:17:14.059878 17515 raft_consensus.cc:385] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.060212 17515 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.060505 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:14.060789 17360 leader_election.cc:343] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.060904 17515 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:14.061831 17362 leader_election.cc:343] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.062197 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:14.063066 17515 ts_tablet_manager.cc:1434] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:14.063090 17526 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.064222 17515 tablet_bootstrap.cc:492] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.063385 17513 raft_consensus.cc:359] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.065282 17513 raft_consensus.cc:385] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.065905 17513 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.066075 17520 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.066552 17520 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.066542 17513 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.068888 17520 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.069720 17513 ts_tablet_manager.cc:1434] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:14.070658 17515 tablet_bootstrap.cc:654] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.070941 17513 tablet_bootstrap.cc:492] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:14.071811 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.072460 17397 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.075372 17511 tablet_bootstrap.cc:492] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.075817 17511 ts_tablet_manager.cc:1403] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.005s
I20260709 13:17:14.076980 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.077970 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.078121 17513 tablet_bootstrap.cc:654] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.078590 17321 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.078387 17511 raft_consensus.cc:359] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.079061 17511 raft_consensus.cc:385] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.079485 17511 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.080188 17511 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.082456 17511 ts_tablet_manager.cc:1434] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:14.083027 17520 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.083441 17520 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.083815 17520 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.090837 17520 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.093276 17511 tablet_bootstrap.cc:492] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.096462 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:14.097074 17397 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.097710 17513 tablet_bootstrap.cc:492] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:14.098410 17513 ts_tablet_manager.cc:1403] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.004s
I20260709 13:17:14.101156 17511 tablet_bootstrap.cc:654] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.102035 17513 raft_consensus.cc:359] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.094918 17520 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.103166 17513 raft_consensus.cc:385] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.103646 17513 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.104027 17397 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.104741 17513 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.105428 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.106806 17513 ts_tablet_manager.cc:1434] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:14.107215 17515 tablet_bootstrap.cc:492] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.107657 17515 ts_tablet_manager.cc:1403] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.044s	user 0.026s	sys 0.014s
I20260709 13:17:14.107797 17513 tablet_bootstrap.cc:492] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:14.109109 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:14.109906 17321 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.110407 17515 raft_consensus.cc:359] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.110741 17514 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.111116 17515 raft_consensus.cc:385] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.111449 17515 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.112231 17515 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.113085 17520 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.113989 17520 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:14.115127 17520 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.118916 17515 ts_tablet_manager.cc:1434] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 13:17:14.119478 17544 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.120198 17515 tablet_bootstrap.cc:492] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.120113 17544 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.123106 17544 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.125308 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.126077 17395 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.126420 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.127195 17515 tablet_bootstrap.cc:654] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.127247 17322 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.129434 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:14.130795 17554 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.131579 17544 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.131395 17554 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.132160 17544 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.132699 17544 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.135033 17554 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.137038 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.137524 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:14.138803 17362 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:14.139218 17515 tablet_bootstrap.cc:492] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.139639 17515 ts_tablet_manager.cc:1403] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:17:14.139871 17554 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.140062 17526 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.137889 17513 tablet_bootstrap.cc:654] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.140712 17526 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.142345 17515 raft_consensus.cc:359] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.142952 17515 raft_consensus.cc:385] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.143297 17515 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.143405 17526 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.144153 17515 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.146328 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:14.146960 17470 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:14.148032 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.150059 17552 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.150446 17552 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.150283 17554 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.150910 17515 ts_tablet_manager.cc:1434] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:14.150812 17552 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.150288 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.154397 17322 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:14.156939 17556 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.159160 17552 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.160713 17515 tablet_bootstrap.cc:492] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.168753 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:14.169507 17320 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.170042 17554 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.172590 17554 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.175354 17554 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.178655 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.169577 17552 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.179669 17513 tablet_bootstrap.cc:492] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:14.180141 17513 ts_tablet_manager.cc:1403] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.000s
W20260709 13:17:14.180135 17360 leader_election.cc:343] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.183266 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:14.183894 17469 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.185825 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:14.186661 17515 tablet_bootstrap.cc:654] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:14.187785 17362 leader_election.cc:343] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.188249 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:14.189447 17513 raft_consensus.cc:359] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.189960 17321 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.190160 17513 raft_consensus.cc:385] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.214978 17513 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.168751 17544 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.215988 17513 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.217582 17544 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.218394 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:14.218803 17513 ts_tablet_manager.cc:1434] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 13:17:14.190513 17554 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.219182 17321 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.219843 17513 tablet_bootstrap.cc:492] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:14.220446 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:14.221127 17396 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.226404 17513 tablet_bootstrap.cc:654] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.227633 17321 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.228093 17396 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.195185 17320 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:14.196702 17526 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.229142 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:14.202827 17469 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:14.230304 17511 tablet_bootstrap.cc:492] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.211949 17515 tablet_bootstrap.cc:492] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.230803 17511 ts_tablet_manager.cc:1403] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.138s	user 0.024s	sys 0.061s
I20260709 13:17:14.231151 17515 ts_tablet_manager.cc:1403] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.012s
I20260709 13:17:14.231521 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.232519 17587 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.233042 17587 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:14.233603 17511 raft_consensus.cc:359] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.233816 17515 raft_consensus.cc:359] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.234310 17511 raft_consensus.cc:385] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.233846 17587 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.234548 17515 raft_consensus.cc:385] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.234730 17511 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.234861 17515 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.235535 17511 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.236153 17515 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.237514 17511 ts_tablet_manager.cc:1434] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:17:14.237717 17515 ts_tablet_manager.cc:1434] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:14.211263 17219 catalog_manager.cc:5697] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.238940 17515 tablet_bootstrap.cc:492] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.239420 17520 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.239915 17520 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:14.241227 17511 tablet_bootstrap.cc:492] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.240674 17520 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.248657 17515 tablet_bootstrap.cc:654] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.249185 17511 tablet_bootstrap.cc:654] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.267693 17526 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.290948 17554 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.314656 17556 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.315469 17556 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.316291 17513 tablet_bootstrap.cc:492] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:14.316782 17513 ts_tablet_manager.cc:1403] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.097s	user 0.026s	sys 0.009s
I20260709 13:17:14.318836 17556 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.319653 17513 raft_consensus.cc:359] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.320380 17513 raft_consensus.cc:385] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.320647 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.321863 17396 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:14.323156 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:14.323770 17469 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:14.323551 17220 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.325569 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.327023 17556 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.327374 17556 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.327710 17556 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.320650 17513 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.331038 17513 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.333498 17513 ts_tablet_manager.cc:1434] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:17:14.334385 17513 tablet_bootstrap.cc:492] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:14.335516 17515 tablet_bootstrap.cc:492] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.335979 17515 ts_tablet_manager.cc:1403] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.097s	user 0.027s	sys 0.005s
I20260709 13:17:14.338601 17515 raft_consensus.cc:359] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.339118 17515 raft_consensus.cc:385] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.339378 17515 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.340045 17515 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.342375 17515 ts_tablet_manager.cc:1434] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:17:14.343305 17515 tablet_bootstrap.cc:492] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.343781 17218 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.344733 17513 tablet_bootstrap.cc:654] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.352546 17511 tablet_bootstrap.cc:492] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.353048 17511 ts_tablet_manager.cc:1403] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.023s
I20260709 13:17:14.354096 17515 tablet_bootstrap.cc:654] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.356462 17556 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.357306 17513 tablet_bootstrap.cc:492] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:14.357066 17511 raft_consensus.cc:359] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.357746 17511 raft_consensus.cc:385] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.357782 17513 ts_tablet_manager.cc:1403] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 13:17:14.358160 17511 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.358801 17511 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.360512 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:14.360728 17511 ts_tablet_manager.cc:1434] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:17:14.361119 17396 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.361279 17513 raft_consensus.cc:359] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.361701 17511 tablet_bootstrap.cc:492] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.361972 17513 raft_consensus.cc:385] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.362277 17513 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.363291 17556 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.363961 17513 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.366171 17513 ts_tablet_manager.cc:1434] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:17:14.366389 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:14.366932 17469 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.367065 17513 tablet_bootstrap.cc:492] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:14.374136 17513 tablet_bootstrap.cc:654] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.375752 17511 tablet_bootstrap.cc:654] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.377869 17469 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:14.381112 17287 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:14.382303 17556 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.382925 17556 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:14.384014 17556 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.379467 17396 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:14.407109 17515 tablet_bootstrap.cc:492] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.407575 17515 ts_tablet_manager.cc:1403] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.015s
I20260709 13:17:14.409878 17515 raft_consensus.cc:359] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.410399 17515 raft_consensus.cc:385] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.410621 17515 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.412161 17218 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.414477 17511 tablet_bootstrap.cc:492] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.415028 17511 ts_tablet_manager.cc:1403] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.014s
W20260709 13:17:14.416134 17268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:14.417080 17515 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.417909 17511 raft_consensus.cc:359] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.418680 17511 raft_consensus.cc:385] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.418954 17511 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.419339 17513 tablet_bootstrap.cc:492] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:14.419797 17513 ts_tablet_manager.cc:1403] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.027s
I20260709 13:17:14.420042 17515 ts_tablet_manager.cc:1434] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:17:14.419734 17511 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.421098 17515 tablet_bootstrap.cc:492] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.421991 17511 ts_tablet_manager.cc:1434] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:17:14.422490 17513 raft_consensus.cc:359] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.422914 17511 tablet_bootstrap.cc:492] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.423128 17513 raft_consensus.cc:385] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.423439 17513 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.428260 17515 tablet_bootstrap.cc:654] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.430260 17396 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.424237 17513 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.432859 17513 ts_tablet_manager.cc:1434] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:14.434355 17556 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.434832 17513 tablet_bootstrap.cc:492] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:14.435032 17556 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.438647 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:17:14.440129 17286 leader_election.cc:343] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.440053 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:14.440363 17515 tablet_bootstrap.cc:492] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.441041 17469 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:14.441272 17515 ts_tablet_manager.cc:1403] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.011s
I20260709 13:17:14.442384 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:14.443380 17553 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.443746 17553 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.444082 17553 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.444487 17515 raft_consensus.cc:359] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.445261 17515 raft_consensus.cc:385] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.445583 17515 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.446475 17515 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.448632 17515 ts_tablet_manager.cc:1434] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:14.448949 17556 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.450017 17515 tablet_bootstrap.cc:492] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.450489 17513 tablet_bootstrap.cc:654] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.452325 17553 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.455521 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:14.456163 17397 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.457333 17515 tablet_bootstrap.cc:654] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.468724 17515 tablet_bootstrap.cc:492] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.469307 17515 ts_tablet_manager.cc:1403] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:17:14.471581 17397 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:14.472290 17515 raft_consensus.cc:359] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.473268 17515 raft_consensus.cc:385] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.473618 17515 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.473498 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.474562 17556 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.475142 17556 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:14.476253 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:14.476130 17556 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.476945 17469 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.480142 17515 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.482432 17515 ts_tablet_manager.cc:1434] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:17:14.484316 17515 tablet_bootstrap.cc:492] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.485124 17469 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:14.487491 17553 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.488976 17511 tablet_bootstrap.cc:654] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.491716 17397 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.491046 17220 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.492698 17515 tablet_bootstrap.cc:654] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.496472 17587 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.497313 17587 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.500072 17587 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.504317 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.505784 17515 tablet_bootstrap.cc:492] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
W20260709 13:17:14.505967 17360 leader_election.cc:343] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.506374 17515 ts_tablet_manager.cc:1403] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 13:17:14.508183 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:14.509603 17515 raft_consensus.cc:359] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:14.510116 17362 leader_election.cc:343] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.510401 17515 raft_consensus.cc:385] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.510854 17515 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.510807 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:14.512233 17515 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.513335 17526 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.514513 17515 ts_tablet_manager.cc:1434] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:17:14.515561 17515 tablet_bootstrap.cc:492] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.519186 17511 tablet_bootstrap.cc:492] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.519716 17511 ts_tablet_manager.cc:1403] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.097s	user 0.007s	sys 0.003s
I20260709 13:17:14.521948 17515 tablet_bootstrap.cc:654] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.523541 17511 raft_consensus.cc:359] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.524233 17511 raft_consensus.cc:385] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.524521 17511 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.524572 17513 tablet_bootstrap.cc:492] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:14.525255 17513 ts_tablet_manager.cc:1403] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.091s	user 0.037s	sys 0.036s
I20260709 13:17:14.528937 17513 raft_consensus.cc:359] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.529874 17513 raft_consensus.cc:385] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.530222 17513 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.531141 17513 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.534047 17513 ts_tablet_manager.cc:1434] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:14.525281 17511 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.538076 17515 tablet_bootstrap.cc:492] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.538663 17515 ts_tablet_manager.cc:1403] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 13:17:14.541651 17511 ts_tablet_manager.cc:1434] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:17:14.542455 17511 tablet_bootstrap.cc:492] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.546954 17515 raft_consensus.cc:359] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.547730 17515 raft_consensus.cc:385] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.548067 17511 tablet_bootstrap.cc:654] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.548768 17513 tablet_bootstrap.cc:492] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:14.548096 17515 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.551430 17515 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.554145 17515 ts_tablet_manager.cc:1434] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:17:14.555048 17515 tablet_bootstrap.cc:492] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.560994 17515 tablet_bootstrap.cc:654] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.561187 17513 tablet_bootstrap.cc:654] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.563656 17511 tablet_bootstrap.cc:492] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.564145 17511 ts_tablet_manager.cc:1403] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.004s
I20260709 13:17:14.564978 17587 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.565442 17587 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.566722 17511 raft_consensus.cc:359] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.567384 17511 raft_consensus.cc:385] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.567503 17587 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.567745 17511 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.568411 17511 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.569278 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.571171 17511 ts_tablet_manager.cc:1434] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
W20260709 13:17:14.571182 17360 leader_election.cc:343] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.572225 17511 tablet_bootstrap.cc:492] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.578135 17511 tablet_bootstrap.cc:654] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.581413 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:14.583047 17362 leader_election.cc:343] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.584002 17520 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.584573 17520 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.583503 17362 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:14.585614 17587 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.586615 17520 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.589630 17544 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.590265 17544 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.590875 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.591747 17321 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.592963 17544 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.595650 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.596194 17511 tablet_bootstrap.cc:492] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.596292 17320 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.596817 17511 ts_tablet_manager.cc:1403] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.007s
I20260709 13:17:14.598816 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.599126 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:14.599529 17396 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.599829 17511 raft_consensus.cc:359] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.600440 17544 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.600602 17511 raft_consensus.cc:385] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.601050 17544 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.601123 17511 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.601646 17544 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.602155 17511 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.603030 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.603888 17547 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.604242 17547 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.604431 17511 ts_tablet_manager.cc:1434] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:17:14.604609 17547 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.598846 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.605695 17397 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.608556 17511 tablet_bootstrap.cc:492] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.613626 17544 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.616735 17511 tablet_bootstrap.cc:654] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.616575 17544 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.626647 17587 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.627609 17544 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.628892 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:14.629479 17511 tablet_bootstrap.cc:492] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.629451 17397 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.630033 17511 ts_tablet_manager.cc:1403] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:17:14.632700 17511 raft_consensus.cc:359] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.633380 17511 raft_consensus.cc:385] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.633647 17511 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.634270 17511 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.634881 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:14.635555 17321 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.636296 17511 ts_tablet_manager.cc:1434] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:14.636231 17397 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.638015 17520 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.637917 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.638672 17520 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.639793 17587 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.640235 17587 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.628218 17544 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.642144 17511 tablet_bootstrap.cc:492] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.642225 17587 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.642481 17544 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.642992 17544 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.644651 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.645602 17520 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.646142 17520 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:14.646279 17360 leader_election.cc:343] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.646615 17520 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:14.647440 17515 tablet_bootstrap.cc:492] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.647899 17515 ts_tablet_manager.cc:1403] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.039s
I20260709 13:17:14.649413 17511 tablet_bootstrap.cc:654] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.616760 17547 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.650823 17513 tablet_bootstrap.cc:492] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:14.650578 17515 raft_consensus.cc:359] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.651233 17513 ts_tablet_manager.cc:1403] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.103s	user 0.023s	sys 0.047s
I20260709 13:17:14.651250 17515 raft_consensus.cc:385] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.651623 17547 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.651684 17515 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.652781 17515 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.654377 17513 raft_consensus.cc:359] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.655071 17513 raft_consensus.cc:385] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.655380 17513 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.656020 17513 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.657018 17515 ts_tablet_manager.cc:1434] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:14.658160 17515 tablet_bootstrap.cc:492] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.658434 17513 ts_tablet_manager.cc:1434] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:14.660441 17511 tablet_bootstrap.cc:492] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.660953 17511 ts_tablet_manager.cc:1403] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 13:17:14.647567 17520 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.664615 17511 raft_consensus.cc:359] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.665306 17511 raft_consensus.cc:385] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.665567 17511 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.669100 17321 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.671676 17511 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.674155 17511 ts_tablet_manager.cc:1434] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:14.674234 17515 tablet_bootstrap.cc:654] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.675271 17511 tablet_bootstrap.cc:492] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.677505 17513 tablet_bootstrap.cc:492] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:14.681242 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.681972 17397 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.682432 17556 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.682893 17556 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.684020 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.684710 17397 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.685417 17513 tablet_bootstrap.cc:654] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.685712 17556 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.687207 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.687614 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:14.687868 17396 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:14.686836 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:17:14.689029 17287 leader_election.cc:343] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.689424 17397 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.690337 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:14.691430 17514 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.691860 17514 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.692292 17514 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.693475 17511 tablet_bootstrap.cc:654] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.703572 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.705430 17397 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.704627 17435 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.706663 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:14.706796 17514 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.707995 17554 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.710217 17514 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.711603 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:14.711189 17218 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.712440 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.713253 17520 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.713639 17520 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:14.713724 17362 leader_election.cc:343] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.714110 17520 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.714226 17362 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:14.715008 17554 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.712756 17547 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.718411 17547 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.720358 17513 tablet_bootstrap.cc:492] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:14.720827 17513 ts_tablet_manager.cc:1403] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.012s
I20260709 13:17:14.720961 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:14.722431 17617 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:14.723562 17287 leader_election.cc:343] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.720304 17616 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.724325 17513 raft_consensus.cc:359] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.726131 17513 raft_consensus.cc:385] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.726462 17513 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.724339 17616 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.727372 17616 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.727396 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.728156 17396 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.729409 17435 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:17:14.733273 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 95755.4us
I20260709 13:17:14.712329 17397 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.735945 17544 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.736116 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.736356 17544 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.725718 17547 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.736729 17544 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.736824 17322 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.742573 17513 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.738010 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.751240 17318 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.737231 17617 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:14.738489 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.762708 17513 ts_tablet_manager.cc:1434] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:17:14.738054 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:14.764523 17319 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.759804 17617 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.758553 17320 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.777071 17556 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.777410 17397 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:14.777683 17556 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.778910 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:14.781181 17514 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.781255 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:14.781749 17514 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:14.782104 17471 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:14.782608 17514 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.783006 17556 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.783057 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.783942 17397 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:14.784610 17287 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:14.785751 17553 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.786152 17553 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.786517 17553 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.789033 17513 tablet_bootstrap.cc:492] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:14.794337 17515 tablet_bootstrap.cc:492] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:14.794878 17515 ts_tablet_manager.cc:1403] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.137s	user 0.020s	sys 0.008s
I20260709 13:17:14.796454 17319 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.796245 17544 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.797745 17553 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.799008 17511 tablet_bootstrap.cc:492] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:14.802409 17511 ts_tablet_manager.cc:1403] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.127s	user 0.014s	sys 0.041s
I20260709 13:17:14.808992 17511 raft_consensus.cc:359] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.809584 17511 raft_consensus.cc:385] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.809824 17511 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.810405 17511 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.814147 17511 ts_tablet_manager.cc:1434] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:14.818234 17544 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.819329 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:14.821098 17397 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.821825 17616 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.819393 17520 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.824522 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:14.825465 17396 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.825806 17616 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.827028 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:14.827590 17395 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.832104 17513 tablet_bootstrap.cc:654] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.831779 17556 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.832366 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:14.830371 17520 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.828759 17511 tablet_bootstrap.cc:492] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:14.833489 17394 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.828802 17397 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.837527 17435 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.841593 17520 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.843509 17520 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:14.847741 17396 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:14.855140 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:14.849361 17286 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:14.857177 17319 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.868080 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:14.868733 17321 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.869980 17616 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.872154 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:14.872735 17469 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.873041 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:14.873624 17322 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.873801 17556 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.874322 17556 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:14.880923 17515 raft_consensus.cc:359] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.881886 17515 raft_consensus.cc:385] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.882306 17515 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.853402 17553 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:14.852363 17520 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.885522 17515 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.903910 17515 ts_tablet_manager.cc:1434] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.001s
I20260709 13:17:14.903702 17321 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.905987 17624 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.911341 17515 tablet_bootstrap.cc:492] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:14.908574 17623 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:14.914404 17469 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:14.909111 17616 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.913347 17319 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.875149 17556 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.915494 17616 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.918198 17395 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.921865 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:14.922570 17322 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.908748 17553 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:17:14.923750 17623 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.925642 17623 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:14.926677 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:14.949925 17511 tablet_bootstrap.cc:654] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.926517 17623 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.960393 17624 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.965312 17624 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:14.966208 17624 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:14.967680 17616 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:14.964179 17394 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:14.970701 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:14.971318 17319 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.975054 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:14.975982 17392 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:14.979686 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:14.980912 17616 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.981421 17616 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.981827 17616 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.992234 17515 tablet_bootstrap.cc:654] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:15.023445 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 139188us
I20260709 13:17:15.026144 17616 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.035586 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:15.023833 17633 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.037123 17633 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.039525 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:15.039755 17633 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.040228 17397 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.040774 17319 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.044503 17616 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:15.051851 17319 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:15.055130 17397 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:15.056629 17435 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:15.057623 17520 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.058236 17520 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:15.059326 17520 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.062552 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:15.073278 17219 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.091382 17218 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.105183 17511 tablet_bootstrap.cc:492] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:15.105671 17511 ts_tablet_manager.cc:1403] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.277s	user 0.014s	sys 0.006s
I20260709 13:17:15.107762 17515 tablet_bootstrap.cc:492] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:15.108263 17515 ts_tablet_manager.cc:1403] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.197s	user 0.010s	sys 0.021s
I20260709 13:17:15.111750 17511 raft_consensus.cc:359] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.112565 17511 raft_consensus.cc:385] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.112946 17511 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.113756 17511 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.116762 17511 ts_tablet_manager.cc:1434] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:15.117348 17513 tablet_bootstrap.cc:492] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:15.117467 17515 raft_consensus.cc:359] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.118005 17511 tablet_bootstrap.cc:492] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:15.118204 17515 raft_consensus.cc:385] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.118064 17513 ts_tablet_manager.cc:1403] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.329s	user 0.016s	sys 0.014s
I20260709 13:17:15.118597 17515 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.119427 17515 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.121484 17515 ts_tablet_manager.cc:1434] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:17:15.121255 17513 raft_consensus.cc:359] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.121938 17513 raft_consensus.cc:385] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.122203 17513 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.122491 17515 tablet_bootstrap.cc:492] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:15.122916 17513 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.125172 17513 ts_tablet_manager.cc:1434] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:15.125612 17511 tablet_bootstrap.cc:654] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.126055 17513 tablet_bootstrap.cc:492] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:15.129040 17515 tablet_bootstrap.cc:654] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.134235 17513 tablet_bootstrap.cc:654] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.133826 17219 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:15.143563 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 294260us
I20260709 13:17:15.157883 17633 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.158517 17633 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.159996 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:15.161120 17395 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 1: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:17:15.162611 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:15.164358 17287 leader_election.cc:343] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.164940 17511 tablet_bootstrap.cc:492] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:15.165694 17511 ts_tablet_manager.cc:1403] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.012s
I20260709 13:17:15.168397 17511 raft_consensus.cc:359] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.168520 17586 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.169314 17586 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.169555 17286 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:15.170329 17553 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.171525 17586 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.164949 17633 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.172770 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:15.173561 17511 raft_consensus.cc:385] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.173909 17511 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.174175 17633 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:15.174666 17360 leader_election.cc:343] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.174588 17511 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.177299 17511 ts_tablet_manager.cc:1434] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:15.178246 17511 tablet_bootstrap.cc:492] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:15.183531 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:17:15.187777 17286 leader_election.cc:343] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.188354 17286 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:15.186137 17511 tablet_bootstrap.cc:654] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.188670 17520 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.191872 17633 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.193238 17520 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.194373 17633 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.199185 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:15.199960 17469 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:15.202620 17520 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.208163 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:15.210449 17586 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.211051 17586 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.211529 17586 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.238320 17219 catalog_manager.cc:5697] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.241554 17219 catalog_manager.cc:5697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.243424 17554 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.244104 17554 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.244730 17219 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.247201 17219 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.248124 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:15.250240 17554 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:17:15.251601 17360 leader_election.cc:343] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.260411 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:15.270951 17511 tablet_bootstrap.cc:492] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:15.271611 17511 ts_tablet_manager.cc:1403] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.017s
I20260709 13:17:15.272710 17515 tablet_bootstrap.cc:492] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:15.273180 17515 ts_tablet_manager.cc:1403] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.151s	user 0.019s	sys 0.029s
W20260709 13:17:15.275225 17362 leader_election.cc:343] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.275694 17362 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:15.278069 17513 tablet_bootstrap.cc:492] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:15.278518 17513 ts_tablet_manager.cc:1403] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.153s	user 0.019s	sys 0.024s
I20260709 13:17:15.281109 17511 raft_consensus.cc:359] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.282176 17511 raft_consensus.cc:385] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.281924 17513 raft_consensus.cc:359] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.283469 17513 raft_consensus.cc:385] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.283878 17513 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.284022 17520 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.284895 17513 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.286919 17554 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.269152 17586 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.290879 17586 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.286688 17515 raft_consensus.cc:359] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.291656 17515 raft_consensus.cc:385] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.291828 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:15.294646 17515 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.295686 17515 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:15.296330 17360 leader_election.cc:343] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.282570 17511 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.301323 17511 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.300045 17513 ts_tablet_manager.cc:1434] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:17:15.304700 17513 tablet_bootstrap.cc:492] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:15.305665 17511 ts_tablet_manager.cc:1434] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:17:15.307240 17511 tablet_bootstrap.cc:492] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:15.306241 17515 ts_tablet_manager.cc:1434] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 13:17:15.310424 17515 tablet_bootstrap.cc:492] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:15.310470 17513 tablet_bootstrap.cc:654] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:15.349536 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 74632.8us
I20260709 13:17:15.365044 17511 tablet_bootstrap.cc:654] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.364961 17520 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.378240 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:15.378908 17514 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.379451 17471 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.388875 17513 tablet_bootstrap.cc:492] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
W20260709 13:17:15.389241 17287 consensus_peers.cc:597] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.389986 17513 ts_tablet_manager.cc:1403] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.007s
I20260709 13:17:15.418416 17544 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.421411 17553 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.423904 17553 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.429970 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:15.430884 17392 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:15.432745 17286 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:15.433838 17514 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.434201 17514 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.434536 17514 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.445215 17515 tablet_bootstrap.cc:654] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:15.449582 17268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:15.451047 17513 raft_consensus.cc:359] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.451776 17513 raft_consensus.cc:385] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.452137 17513 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.451793 17624 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.453342 17471 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:15.462251 17553 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.464440 17513 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.468364 17513 ts_tablet_manager.cc:1434] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:17:15.470148 17513 tablet_bootstrap.cc:492] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:15.470235 17622 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.473841 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:15.475883 17657 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.478374 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:15.478488 17657 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:15.479828 17657 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.481381 17514 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.576638 17514 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.577167 17511 tablet_bootstrap.cc:492] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:15.578076 17511 ts_tablet_manager.cc:1403] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.271s	user 0.015s	sys 0.030s
I20260709 13:17:15.578523 17544 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.580170 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:15.580819 17397 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.580591 17544 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.581888 17511 raft_consensus.cc:359] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.582749 17511 raft_consensus.cc:385] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.583057 17511 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.583765 17511 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.590620 17511 ts_tablet_manager.cc:1434] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:15.596928 17622 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:15.589987 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 116287us
I20260709 13:17:15.607214 17632 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.621361 17513 tablet_bootstrap.cc:654] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.635100 17511 tablet_bootstrap.cc:492] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:15.632669 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:15.638160 17322 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:15.639089 17544 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:15.640370 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:15.620723 17623 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:17:15.641367 17622 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.641767 17622 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.642119 17622 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.617285 17397 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:15.618901 17657 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.650724 17617 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.654630 17515 tablet_bootstrap.cc:492] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:15.658689 17553 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.659370 17553 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.662072 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:15.663218 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:17:15.664973 17286 leader_election.cc:343] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.667462 17553 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.668922 17617 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:15.668944 17435 leader_election.cc:343] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.673576 17286 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:15.674587 17632 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.675539 17632 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:15.676664 17632 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.651978 17657 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:15.666666 17287 leader_election.cc:343] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.682875 17515 ts_tablet_manager.cc:1403] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.373s	user 0.004s	sys 0.012s
I20260709 13:17:15.694288 17514 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.709148 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:15.715572 17220 catalog_manager.cc:5697] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.692730 17622 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.732450 17515 raft_consensus.cc:359] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.733184 17515 raft_consensus.cc:385] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:15.733479 17287 leader_election.cc:343] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.734148 17287 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:15.718425 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:15.733456 17515 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.738374 17553 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:15.742872 17287 leader_election.cc:343] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.735469 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:15.745926 17513 tablet_bootstrap.cc:492] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:15.746500 17513 ts_tablet_manager.cc:1403] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.277s	user 0.017s	sys 0.003s
I20260709 13:17:15.748186 17515 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.751075 17515 ts_tablet_manager.cc:1434] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:17:15.751942 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:15.752435 17515 tablet_bootstrap.cc:492] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:15.752609 17318 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:15.759572 17360 leader_election.cc:343] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.769529 17513 raft_consensus.cc:359] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.777501 17513 raft_consensus.cc:385] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.777918 17513 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.781867 17511 tablet_bootstrap.cc:654] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.784380 17513 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.777156 17622 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:17:15.787040 17669 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:17:15.784205 17657 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.773452 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:15.791033 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:15.792657 17362 leader_election.cc:343] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.793119 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:15.797688 17513 ts_tablet_manager.cc:1434] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:17:15.811470 17515 tablet_bootstrap.cc:654] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.797318 17657 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.813125 17513 tablet_bootstrap.cc:492] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:15.815191 17470 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.823421 17656 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.823962 17656 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.814245 17318 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
W20260709 13:17:15.831149 17435 leader_election.cc:343] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.841549 17656 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.842844 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:15.843689 17319 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:15.845819 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:15.847011 17656 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.848235 17656 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.849277 17656 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.853188 17513 tablet_bootstrap.cc:654] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.853586 17515 tablet_bootstrap.cc:492] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:15.854079 17515 ts_tablet_manager.cc:1403] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.016s
I20260709 13:17:15.856805 17511 tablet_bootstrap.cc:492] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:15.857391 17511 ts_tablet_manager.cc:1403] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.233s	user 0.016s	sys 0.005s
I20260709 13:17:15.860965 17656 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.863111 17511 raft_consensus.cc:359] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.865919 17515 raft_consensus.cc:359] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.866375 17511 raft_consensus.cc:385] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.866583 17515 raft_consensus.cc:385] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.866674 17511 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.866925 17515 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.867491 17511 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.869625 17511 ts_tablet_manager.cc:1434] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.006s
I20260709 13:17:15.870872 17511 tablet_bootstrap.cc:492] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:15.872727 17515 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.872045 17656 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.864995 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:15.876107 17319 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.877628 17515 ts_tablet_manager.cc:1434] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 13:17:15.878957 17515 tablet_bootstrap.cc:492] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
W20260709 13:17:15.881965 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46223.9us
I20260709 13:17:15.885982 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:15.887807 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:15.894753 17547 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.895325 17547 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:15.900614 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:15.896409 17547 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:15.905333 17362 leader_election.cc:343] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:15.905992 17362 leader_election.cc:343] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.915010 17515 tablet_bootstrap.cc:654] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.908987 17218 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.920997 17511 tablet_bootstrap.cc:654] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.927819 17319 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:15.931066 17513 tablet_bootstrap.cc:492] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:15.931432 17513 ts_tablet_manager.cc:1403] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.017s
I20260709 13:17:15.929173 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:15.933310 17656 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.933871 17656 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:15.934775 17656 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.937208 17513 raft_consensus.cc:359] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.938024 17513 raft_consensus.cc:385] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.938342 17513 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.939074 17513 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.941529 17513 ts_tablet_manager.cc:1434] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:17:15.942643 17513 tablet_bootstrap.cc:492] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:15.948269 17547 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.948781 17547 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.954871 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:15.957770 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:15.967787 17395 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:15.963454 17657 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.968756 17657 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.969403 17435 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:15.970407 17623 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.970777 17623 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.970865 17657 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:15.971169 17623 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.971328 17511 tablet_bootstrap.cc:492] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:15.971815 17511 ts_tablet_manager.cc:1403] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.007s
I20260709 13:17:15.972173 17219 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.974246 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:15.975098 17319 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:15.967144 17547 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:15.975047 17511 raft_consensus.cc:359] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.965044 17515 tablet_bootstrap.cc:492] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:15.978542 17511 raft_consensus.cc:385] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:15.975922 17360 leader_election.cc:343] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.978899 17511 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.978807 17515 ts_tablet_manager.cc:1403] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.003s
I20260709 13:17:15.980559 17511 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.976344 17513 tablet_bootstrap.cc:654] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.982553 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:15.986166 17362 leader_election.cc:343] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.986989 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:15.988652 17319 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.990476 17515 raft_consensus.cc:359] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.991218 17515 raft_consensus.cc:385] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.991530 17515 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.991605 17218 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.992291 17515 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.995688 17656 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.994220 17623 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:15.995858 17511 ts_tablet_manager.cc:1434] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 13:17:16.004272 17511 tablet_bootstrap.cc:492] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:16.004619 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:16.005299 17320 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.998164 17515 ts_tablet_manager.cc:1434] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:17:16.009964 17515 tablet_bootstrap.cc:492] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:16.012735 17320 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:16.014137 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:16.015089 17547 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.015782 17515 tablet_bootstrap.cc:654] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.016294 17623 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:16.019062 17511 tablet_bootstrap.cc:654] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.020360 17547 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:16.021339 17547 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.023989 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:16.025315 17397 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.036738 17397 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:16.043906 17656 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.050830 17513 tablet_bootstrap.cc:492] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:16.051551 17513 ts_tablet_manager.cc:1403] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.109s	user 0.022s	sys 0.015s
I20260709 13:17:16.056573 17513 raft_consensus.cc:359] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.057504 17513 raft_consensus.cc:385] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.057886 17513 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.061769 17513 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.062858 17511 tablet_bootstrap.cc:492] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:16.063383 17511 ts_tablet_manager.cc:1403] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.009s
I20260709 13:17:16.064229 17513 ts_tablet_manager.cc:1434] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:16.065441 17513 tablet_bootstrap.cc:492] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:16.073266 17515 tablet_bootstrap.cc:492] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:16.073756 17515 ts_tablet_manager.cc:1403] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.064s	user 0.004s	sys 0.023s
I20260709 13:17:16.075829 17511 raft_consensus.cc:359] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.076994 17511 raft_consensus.cc:385] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.077298 17511 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.077708 17657 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.077989 17511 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.079264 17513 tablet_bootstrap.cc:654] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.086449 17515 raft_consensus.cc:359] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.087234 17515 raft_consensus.cc:385] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.087531 17515 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.088251 17515 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.095394 17511 ts_tablet_manager.cc:1434] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:17:16.096580 17511 tablet_bootstrap.cc:492] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:16.097216 17218 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.103488 17515 ts_tablet_manager.cc:1434] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:17:16.105540 17470 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.107689 17513 tablet_bootstrap.cc:492] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:16.108350 17513 ts_tablet_manager.cc:1403] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.005s
I20260709 13:17:16.111464 17513 raft_consensus.cc:359] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.112385 17513 raft_consensus.cc:385] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.112761 17513 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.116166 17631 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.113624 17513 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.125087 17513 ts_tablet_manager.cc:1434] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:17:16.126226 17513 tablet_bootstrap.cc:492] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:16.133596 17513 tablet_bootstrap.cc:654] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.141587 17515 tablet_bootstrap.cc:492] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:16.149312 17511 tablet_bootstrap.cc:654] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.156579 17515 tablet_bootstrap.cc:654] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.160374 17632 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.171944 17657 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.172526 17657 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.174779 17657 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.176517 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.185045 17515 tablet_bootstrap.cc:492] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:16.185702 17515 ts_tablet_manager.cc:1403] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.011s
I20260709 13:17:16.189170 17515 raft_consensus.cc:359] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.190078 17515 raft_consensus.cc:385] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.190409 17515 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.191231 17515 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.194335 17515 ts_tablet_manager.cc:1434] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:16.208576 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.211664 17319 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 1: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:17:16.206032 17515 tablet_bootstrap.cc:492] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:16.221786 17360 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:16.222383 17515 tablet_bootstrap.cc:654] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.223258 17657 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.236882 17657 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.251470 17515 tablet_bootstrap.cc:492] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:16.253991 17515 ts_tablet_manager.cc:1403] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.004s
I20260709 13:17:16.254990 17511 tablet_bootstrap.cc:492] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:16.255458 17511 ts_tablet_manager.cc:1403] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.159s	user 0.043s	sys 0.020s
I20260709 13:17:16.257229 17515 raft_consensus.cc:359] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.258132 17515 raft_consensus.cc:385] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.258028 17511 raft_consensus.cc:359] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.258754 17511 raft_consensus.cc:385] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.258584 17515 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.259105 17511 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.259896 17632 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.259866 17511 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.259812 17515 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.262106 17511 ts_tablet_manager.cc:1434] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:16.260473 17632 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.263244 17511 tablet_bootstrap.cc:492] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:16.263273 17515 ts_tablet_manager.cc:1434] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:17:16.264654 17515 tablet_bootstrap.cc:492] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:16.264978 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:16.265602 17395 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:16.267019 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:16.267899 17514 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.268237 17514 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.268587 17514 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.270277 17656 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.270756 17656 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.271946 17515 tablet_bootstrap.cc:654] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.274194 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:17:16.275681 17360 leader_election.cc:343] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.277145 17513 tablet_bootstrap.cc:492] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:16.277557 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.277823 17513 ts_tablet_manager.cc:1403] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.152s	user 0.068s	sys 0.043s
I20260709 13:17:16.272789 17656 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:17:16.279045 17362 leader_election.cc:343] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.279493 17362 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:16.280452 17656 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.281725 17513 raft_consensus.cc:359] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.282900 17513 raft_consensus.cc:385] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.283301 17513 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.284734 17632 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.284269 17513 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.286055 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.286659 17470 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:16.291457 17514 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.293390 17511 tablet_bootstrap.cc:654] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.294093 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:16.294729 17395 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.302696 17515 tablet_bootstrap.cc:492] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:16.303335 17515 ts_tablet_manager.cc:1403] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.026s
I20260709 13:17:16.306409 17515 raft_consensus.cc:359] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.307279 17515 raft_consensus.cc:385] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.307669 17515 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.308455 17515 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.309616 17513 ts_tablet_manager.cc:1434] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:17:16.311241 17515 ts_tablet_manager.cc:1434] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:16.313014 17515 tablet_bootstrap.cc:492] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:16.314512 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:16.315323 17470 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.320120 17515 tablet_bootstrap.cc:654] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.320979 17513 tablet_bootstrap.cc:492] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:16.329061 17395 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:16.330304 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:16.330660 17511 tablet_bootstrap.cc:492] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:16.331105 17511 ts_tablet_manager.cc:1403] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.022s
I20260709 13:17:16.331156 17632 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.331887 17632 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:16.332686 17632 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.333312 17513 tablet_bootstrap.cc:654] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.334542 17511 raft_consensus.cc:359] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.335434 17511 raft_consensus.cc:385] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.335738 17511 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.336493 17511 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.333532 17514 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.337821 17515 tablet_bootstrap.cc:492] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:16.338246 17470 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:16.338554 17515 ts_tablet_manager.cc:1403] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.006s
I20260709 13:17:16.338622 17511 ts_tablet_manager.cc:1434] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:16.340905 17511 tablet_bootstrap.cc:492] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:16.342535 17515 raft_consensus.cc:359] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.343346 17515 raft_consensus.cc:385] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.343782 17515 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.344700 17515 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.347316 17515 ts_tablet_manager.cc:1434] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:16.348585 17515 tablet_bootstrap.cc:492] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:16.350502 17623 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.350780 17220 catalog_manager.cc:5697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.354293 17656 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.355490 17515 tablet_bootstrap.cc:654] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.363562 17656 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.364459 17656 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.368245 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.369256 17511 tablet_bootstrap.cc:654] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:16.370739 17360 leader_election.cc:343] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.371455 17623 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.371842 17515 tablet_bootstrap.cc:492] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:16.372453 17515 ts_tablet_manager.cc:1403] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.001s
I20260709 13:17:16.375933 17515 raft_consensus.cc:359] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.376813 17515 raft_consensus.cc:385] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.377218 17515 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.377897 17656 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.378626 17511 tablet_bootstrap.cc:492] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:16.378069 17515 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.379067 17511 ts_tablet_manager.cc:1403] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.001s
I20260709 13:17:16.380214 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.381319 17515 ts_tablet_manager.cc:1434] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
W20260709 13:17:16.381520 17362 leader_election.cc:343] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.381996 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:16.382629 17515 tablet_bootstrap.cc:492] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:16.383368 17656 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.383718 17511 raft_consensus.cc:359] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.384567 17511 raft_consensus.cc:385] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.384850 17511 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.385442 17511 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.350452 17514 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.388465 17511 ts_tablet_manager.cc:1434] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:16.390843 17511 tablet_bootstrap.cc:492] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:16.388253 17514 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.391683 17515 tablet_bootstrap.cc:654] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.394078 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:16.396780 17511 tablet_bootstrap.cc:654] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:16.396739 17286 leader_election.cc:343] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.406961 17468 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.413736 17511 tablet_bootstrap.cc:492] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:16.414363 17511 ts_tablet_manager.cc:1403] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:17:16.416929 17511 raft_consensus.cc:359] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.417572 17511 raft_consensus.cc:385] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.417841 17511 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.418473 17511 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.420976 17511 ts_tablet_manager.cc:1434] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:16.421919 17511 tablet_bootstrap.cc:492] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:16.422397 17711 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.427729 17511 tablet_bootstrap.cc:654] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.438405 17511 tablet_bootstrap.cc:492] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:16.438730 17511 ts_tablet_manager.cc:1403] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:17:16.440336 17511 raft_consensus.cc:359] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.440819 17511 raft_consensus.cc:385] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.441253 17511 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.441766 17511 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.443961 17511 ts_tablet_manager.cc:1434] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:17:16.444909 17511 tablet_bootstrap.cc:492] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:16.446959 17623 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.450357 17511 tablet_bootstrap.cc:654] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.454825 17657 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.455552 17657 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.459403 17657 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.460389 17553 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.461349 17553 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.466045 17553 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.466974 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.468230 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:16.469193 17392 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
W20260709 13:17:16.471145 17287 leader_election.cc:343] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.469202 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.474285 17286 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:17:16.475041 17360 leader_election.cc:343] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.476476 17553 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.477128 17553 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.477630 17553 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.479362 17511 tablet_bootstrap.cc:492] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:16.479832 17511 ts_tablet_manager.cc:1403] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.011s
I20260709 13:17:16.480286 17623 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.485293 17544 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.487392 17511 raft_consensus.cc:359] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.487507 17544 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.490685 17544 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:16.484686 17657 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.491360 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.492133 17319 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:16.491891 17657 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.493613 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:16.488225 17511 raft_consensus.cc:385] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.496520 17511 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.501622 17544 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.502156 17544 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.502528 17544 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.501327 17511 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.510452 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.511184 17319 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:16.512758 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:16.514686 17657 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.515990 17656 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.516428 17656 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.516822 17656 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.517575 17511 ts_tablet_manager.cc:1434] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260709 13:17:16.524441 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:16.525295 17268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:16.525197 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:17:16.533915 17362 leader_election.cc:343] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.534622 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:16.535682 17711 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.536614 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.537159 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:16.538757 17287 leader_election.cc:343] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.539446 17287 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:16.540789 17511 tablet_bootstrap.cc:492] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:16.531554 17544 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.549105 17556 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.552543 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:16.553248 17321 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.551281 17553 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.543031 17514 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:17:16.536641 17435 leader_election.cc:343] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.561892 17513 tablet_bootstrap.cc:492] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:16.562292 17513 ts_tablet_manager.cc:1403] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.242s	user 0.025s	sys 0.010s
I20260709 13:17:16.578955 17656 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.580152 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:16.581344 17656 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.575147 17553 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.581976 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:16.582544 17322 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:16.582576 17287 leader_election.cc:343] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.570122 17321 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:16.585069 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:16.585988 17617 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.586441 17617 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:16.586970 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:16.587042 17513 raft_consensus.cc:359] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.587278 17617 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.587872 17513 raft_consensus.cc:385] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.587693 17395 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.588178 17513 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.588827 17513 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.590935 17513 ts_tablet_manager.cc:1434] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:17:16.591950 17513 tablet_bootstrap.cc:492] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
W20260709 13:17:16.593343 17362 leader_election.cc:343] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.573076 17544 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:16.597591 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:16.601280 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:16.610414 17515 tablet_bootstrap.cc:492] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:16.610906 17515 ts_tablet_manager.cc:1403] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.229s	user 0.032s	sys 0.104s
I20260709 13:17:16.606667 17322 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:16.614725 17515 raft_consensus.cc:359] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.615532 17515 raft_consensus.cc:385] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.616214 17515 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.620167 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:16.621429 17711 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.621965 17711 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:17:16.623049 17362 leader_election.cc:343] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.622880 17711 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.616971 17515 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.625329 17511 tablet_bootstrap.cc:654] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.625871 17513 tablet_bootstrap.cc:654] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:16.627449 17435 leader_election.cc:343] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.636735 17515 ts_tablet_manager.cc:1434] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:17:16.640419 17514 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.641007 17514 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.645498 17515 tablet_bootstrap.cc:492] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:16.646996 17395 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:16.647073 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:16.652956 17397 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:16.639322 17218 catalog_manager.cc:5697] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.654824 17286 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:16.655047 17515 tablet_bootstrap.cc:654] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.655742 17553 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.656124 17553 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.656493 17553 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.650484 17514 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.661688 17656 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.662200 17656 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.663457 17286 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:16.664233 17656 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.665141 17513 tablet_bootstrap.cc:492] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:16.665194 17514 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.665663 17513 ts_tablet_manager.cc:1403] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.008s
I20260709 13:17:16.665807 17514 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:16.666739 17514 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.668092 17513 raft_consensus.cc:359] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.668640 17513 raft_consensus.cc:385] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.668805 17513 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.669369 17513 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.671222 17513 ts_tablet_manager.cc:1434] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:16.653251 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.671722 17468 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:16.665840 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.667277 17553 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.673576 17321 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:16.674993 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:16.675547 17513 tablet_bootstrap.cc:492] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:16.676242 17656 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.676759 17656 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.677259 17656 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.681576 17513 tablet_bootstrap.cc:654] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.691534 17515 tablet_bootstrap.cc:492] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:16.692220 17515 ts_tablet_manager.cc:1403] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.002s
I20260709 13:17:16.652350 17511 tablet_bootstrap.cc:492] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:16.693205 17511 ts_tablet_manager.cc:1403] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.001s
I20260709 13:17:16.695694 17513 tablet_bootstrap.cc:492] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:16.695305 17515 raft_consensus.cc:359] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.696130 17513 ts_tablet_manager.cc:1403] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.003s
I20260709 13:17:16.696089 17515 raft_consensus.cc:385] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.696564 17515 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.696623 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:16.697444 17515 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.697777 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.698876 17513 raft_consensus.cc:359] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.699290 17395 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.699569 17513 raft_consensus.cc:385] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.699916 17513 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.700094 17515 ts_tablet_manager.cc:1434] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:16.701205 17515 tablet_bootstrap.cc:492] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:16.700794 17513 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.702849 17513 ts_tablet_manager.cc:1434] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:17:16.703913 17513 tablet_bootstrap.cc:492] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:16.709833 17513 tablet_bootstrap.cc:654] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.712177 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:16.712827 17470 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.703692 17511 raft_consensus.cc:359] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.717067 17511 raft_consensus.cc:385] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.717413 17511 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.718133 17511 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.721184 17553 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.721841 17513 tablet_bootstrap.cc:492] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:16.722358 17513 ts_tablet_manager.cc:1403] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:17:16.725193 17513 raft_consensus.cc:359] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.725993 17513 raft_consensus.cc:385] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.726284 17513 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.727533 17515 tablet_bootstrap.cc:654] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.728768 17513 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:16.730986 17362 leader_election.cc:343] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.731169 17513 ts_tablet_manager.cc:1434] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:16.732337 17513 tablet_bootstrap.cc:492] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:16.720455 17470 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:16.733254 17395 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:16.734285 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:16.727705 17218 catalog_manager.cc:5697] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.742535 17553 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.743513 17553 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:16.745530 17726 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.739832 17511 ts_tablet_manager.cc:1434] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.003s
I20260709 13:17:16.741168 17513 tablet_bootstrap.cc:654] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.746886 17511 tablet_bootstrap.cc:492] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:16.747192 17515 tablet_bootstrap.cc:492] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:16.747713 17515 ts_tablet_manager.cc:1403] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.006s
I20260709 13:17:16.745030 17553 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.751379 17657 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.751119 17515 raft_consensus.cc:359] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.751971 17515 raft_consensus.cc:385] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.752256 17515 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.737032 17656 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.764967 17515 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.774606 17656 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.753188 17726 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.796912 17556 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.797646 17556 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.752815 17657 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.800393 17657 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.809383 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:16.818715 17623 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.819967 17623 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.850232 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.850692 17322 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.856627 17515 ts_tablet_manager.cc:1434] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.109s	user 0.028s	sys 0.020s
I20260709 13:17:16.857064 17556 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.857826 17515 tablet_bootstrap.cc:492] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:16.857878 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:16.858822 17470 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.858865 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.859647 17468 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:16.860713 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:16.860986 17514 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.863189 17632 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.860610 17623 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:16.854333 17726 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.863570 17632 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.864425 17632 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.863667 17514 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.866345 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.867131 17318 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 1: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:17:16.868181 17514 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.869252 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.869376 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:16.871806 17287 leader_election.cc:343] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.874647 17514 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.879696 17511 tablet_bootstrap.cc:654] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.887599 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:16.888500 17392 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 1: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:17:16.894379 17435 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:16.894943 17515 tablet_bootstrap.cc:654] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.875288 17632 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.891215 17623 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.902545 17623 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.903442 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:16.904160 17392 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:16.904779 17623 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:16.906711 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.906916 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:16.914601 17468 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:16.913429 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.918097 17321 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 1: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:17:16.909837 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.930433 17726 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:16.933324 17286 leader_election.cc:343] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.933856 17286 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:16.935220 17553 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.930930 17726 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.936507 17322 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:16.929183 17470 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:16.937410 17726 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:16.937906 17616 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.938350 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:16.939821 17726 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.940536 17731 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.946470 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:16.946621 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:16.947324 17397 raft_consensus.cc:2393] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 1: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:17:16.944721 17726 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:17:16.948277 17360 leader_election.cc:343] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.949461 17726 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.957289 17362 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:16.958329 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:16.958586 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:16.959846 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:16.960386 17468 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.963712 17727 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.964121 17727 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.964427 17727 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.967316 17468 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:16.970786 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:16.971645 17731 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.972090 17731 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:16.973104 17729 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.972986 17731 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.977823 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:16.980031 17511 tablet_bootstrap.cc:492] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:16.980666 17511 ts_tablet_manager.cc:1403] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.234s	user 0.013s	sys 0.024s
I20260709 13:17:16.973908 17632 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:17:16.982416 17362 leader_election.cc:343] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.986442 17727 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:16.988721 17513 tablet_bootstrap.cc:492] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:17.003075 17513 ts_tablet_manager.cc:1403] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.271s	user 0.031s	sys 0.029s
I20260709 13:17:17.001065 17553 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.001703 17362 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:17.014910 17435 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:17.014783 17553 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.016182 17623 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.017373 17553 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.018085 17724 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.019026 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:17.019555 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:17.019804 17395 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:17.022922 17511 raft_consensus.cc:359] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.023550 17511 raft_consensus.cc:385] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.025038 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:17.025936 17632 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.026297 17632 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.026620 17632 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.027738 17513 raft_consensus.cc:359] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.028430 17513 raft_consensus.cc:385] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:17.029012 17287 leader_election.cc:343] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.029649 17623 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.034730 17657 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:17.028730 17513 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.038512 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:17.039057 17513 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.036669 17727 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.037145 17397 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 1: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:17:17.038280 17515 tablet_bootstrap.cc:492] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:17.023880 17511 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.043622 17511 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.045146 17515 ts_tablet_manager.cc:1403] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.188s	user 0.010s	sys 0.018s
I20260709 13:17:17.045899 17511 ts_tablet_manager.cc:1434] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 13:17:17.042358 17513 ts_tablet_manager.cc:1434] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
W20260709 13:17:17.045671 17362 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.047758 17513 tablet_bootstrap.cc:492] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:17.050034 17515 raft_consensus.cc:359] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.050806 17515 raft_consensus.cc:385] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.051141 17515 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.051627 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:17.051477 17511 tablet_bootstrap.cc:492] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:17.052386 17471 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 1: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:17:17.042785 17729 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.064391 17515 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.042022 17217 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.075927 17362 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:17.076509 17515 ts_tablet_manager.cc:1434] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:17:17.077026 17729 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.077596 17515 tablet_bootstrap.cc:492] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:17.081911 17217 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.090654 17513 tablet_bootstrap.cc:654] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.093230 17218 catalog_manager.cc:5697] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.100312 17632 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.116171 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:17.116789 17395 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.119656 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:17.125110 17395 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:17.104640 17632 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.131934 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:17:17.132794 17287 leader_election.cc:343] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.133481 17632 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.134124 17632 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:17.135001 17632 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.128314 17515 tablet_bootstrap.cc:654] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.129791 17624 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.130669 17511 tablet_bootstrap.cc:654] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.148476 17731 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.155130 17616 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.175450 17513 tablet_bootstrap.cc:492] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:17.175935 17513 ts_tablet_manager.cc:1403] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.128s	user 0.026s	sys 0.036s
I20260709 13:17:17.187784 17513 raft_consensus.cc:359] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.188452 17513 raft_consensus.cc:385] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.188711 17513 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.189366 17513 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.191540 17513 ts_tablet_manager.cc:1434] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:17:17.191649 17220 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.195050 17511 tablet_bootstrap.cc:492] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:17.195647 17511 ts_tablet_manager.cc:1403] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.007s
I20260709 13:17:17.197413 17513 tablet_bootstrap.cc:492] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:17.216476 17511 raft_consensus.cc:359] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.217214 17511 raft_consensus.cc:385] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.217497 17511 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.218209 17511 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.225309 17511 ts_tablet_manager.cc:1434] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:17:17.229122 17511 tablet_bootstrap.cc:492] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:17.235766 17623 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.239199 17623 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.243287 17623 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:17.243667 17511 tablet_bootstrap.cc:654] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.246654 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:17.247416 17321 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:17.248960 17434 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:17.253017 17617 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.254664 17617 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.255183 17617 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.256947 17513 tablet_bootstrap.cc:654] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.254009 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:17.258594 17392 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:17.266932 17515 tablet_bootstrap.cc:492] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:17.274995 17515 ts_tablet_manager.cc:1403] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.198s	user 0.028s	sys 0.014s
I20260709 13:17:17.264544 17617 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.256078 17217 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.271988 17632 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:17:17.271692 17556 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:17:17.279516 17514 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.299283 17617 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:17.300096 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:17.300820 17322 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.300973 17515 raft_consensus.cc:359] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.304411 17515 raft_consensus.cc:385] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.309001 17515 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.299407 17511 tablet_bootstrap.cc:492] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:17.306094 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:17.309878 17397 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.304070 17513 tablet_bootstrap.cc:492] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:17.309881 17511 ts_tablet_manager.cc:1403] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.019s
I20260709 13:17:17.310765 17513 ts_tablet_manager.cc:1403] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.114s	user 0.016s	sys 0.001s
I20260709 13:17:17.313495 17511 raft_consensus.cc:359] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.314497 17511 raft_consensus.cc:385] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.314819 17511 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.315514 17511 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.310256 17515 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.313724 17513 raft_consensus.cc:359] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.316994 17513 raft_consensus.cc:385] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.317287 17513 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.319448 17397 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:17.319589 17515 ts_tablet_manager.cc:1434] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:17:17.320698 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:17.321859 17616 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.322383 17616 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:17.308918 17322 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:17.323285 17616 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.317287 17511 ts_tablet_manager.cc:1434] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:17.326300 17513 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.329403 17515 tablet_bootstrap.cc:492] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:17.335892 17515 tablet_bootstrap.cc:654] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.337332 17513 ts_tablet_manager.cc:1434] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:17:17.338739 17513 tablet_bootstrap.cc:492] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:17.340711 17511 tablet_bootstrap.cc:492] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:17.359459 17515 tablet_bootstrap.cc:492] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:17.360039 17515 ts_tablet_manager.cc:1403] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.015s
I20260709 13:17:17.362507 17544 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.362855 17515 raft_consensus.cc:359] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.363042 17544 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.363698 17515 raft_consensus.cc:385] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.364085 17515 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.363395 17513 tablet_bootstrap.cc:654] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.365017 17515 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.364209 17511 tablet_bootstrap.cc:654] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.365711 17544 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:17.367208 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:17.369180 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:17.371352 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:17.371754 17515 ts_tablet_manager.cc:1434] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:17.372584 17511 tablet_bootstrap.cc:492] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:17.372587 17544 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.373041 17515 tablet_bootstrap.cc:492] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:17.373214 17511 ts_tablet_manager.cc:1403] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.003s
I20260709 13:17:17.378103 17724 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.378578 17724 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.378458 17511 raft_consensus.cc:359] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.380492 17511 raft_consensus.cc:385] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.380810 17511 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.381131 17515 tablet_bootstrap.cc:654] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.381592 17511 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.382050 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:17.382709 17322 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:17.387177 17511 ts_tablet_manager.cc:1434] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:17:17.387549 17360 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:17.388535 17726 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.388947 17726 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.389348 17726 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.392570 17511 tablet_bootstrap.cc:492] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:17.380622 17724 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.396314 17724 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.413820 17726 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.423300 17724 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:17.426275 17726 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.419447 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:17.427809 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:17:17.428030 17362 leader_election.cc:343] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.429150 17511 tablet_bootstrap.cc:654] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:17.431806 17362 leader_election.cc:343] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.432791 17218 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.435384 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:17.435912 17322 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.446074 17322 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:17.453971 17556 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.454216 17360 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:17.455106 17726 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.455580 17726 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:17.460031 17515 tablet_bootstrap.cc:492] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:17.460533 17515 ts_tablet_manager.cc:1403] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.010s
I20260709 13:17:17.456377 17726 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.461256 17632 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.463152 17515 raft_consensus.cc:359] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.463891 17515 raft_consensus.cc:385] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.464226 17515 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.465066 17515 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.467679 17515 ts_tablet_manager.cc:1434] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:17.470876 17515 tablet_bootstrap.cc:492] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:17.471480 17513 tablet_bootstrap.cc:492] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:17.478204 17513 ts_tablet_manager.cc:1403] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.140s	user 0.025s	sys 0.013s
I20260709 13:17:17.478535 17515 tablet_bootstrap.cc:654] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.490473 17513 raft_consensus.cc:359] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.497283 17513 raft_consensus.cc:385] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.497591 17513 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.507207 17632 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.507804 17632 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.510735 17514 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.510979 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:17.511427 17514 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.511794 17392 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:17.513788 17514 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.514480 17217 catalog_manager.cc:5697] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.514930 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:17.516192 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:17.517623 17514 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.518044 17514 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.518455 17514 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.522363 17632 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.522555 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:17.523090 17470 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.523193 17471 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:17.533305 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:17.533982 17392 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:17.535192 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:17.536053 17632 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.536588 17632 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.537097 17632 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.539036 17515 tablet_bootstrap.cc:492] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:17.539594 17515 ts_tablet_manager.cc:1403] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.004s
I20260709 13:17:17.541168 17726 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.541745 17726 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.542511 17515 raft_consensus.cc:359] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.543298 17515 raft_consensus.cc:385] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.543670 17515 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.544981 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:17.545663 17726 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.545899 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:17.546346 17360 leader_election.cc:343] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:17.547479 17362 leader_election.cc:343] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.547885 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:17.548959 17726 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:17.550570 17287 leader_election.cc:343] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.551196 17632 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.552395 17514 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.498262 17513 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.557013 17515 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.558838 17511 tablet_bootstrap.cc:492] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:17.563130 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:17.563864 17511 ts_tablet_manager.cc:1403] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.009s
I20260709 13:17:17.562191 17632 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.565623 17514 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.566825 17515 ts_tablet_manager.cc:1434] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:17:17.565729 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:17.567967 17515 tablet_bootstrap.cc:492] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:17.568285 17397 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.568349 17513 ts_tablet_manager.cc:1434] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.001s
I20260709 13:17:17.569397 17513 tablet_bootstrap.cc:492] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:17.564018 17392 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.574923 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:17.575846 17511 raft_consensus.cc:359] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.576617 17511 raft_consensus.cc:385] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.576956 17511 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.577891 17511 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.576985 17469 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.579747 17511 ts_tablet_manager.cc:1434] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:17:17.580885 17511 tablet_bootstrap.cc:492] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:17.587915 17469 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:17.590305 17515 tablet_bootstrap.cc:654] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.593091 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:17.591739 17392 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:17.595072 17511 tablet_bootstrap.cc:654] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.597244 17726 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.575389 17397 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:17.597827 17726 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.599624 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:17.601616 17731 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.602114 17731 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.604784 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:17.606163 17556 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.604292 17632 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.612699 17726 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.613926 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:17.614995 17556 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:17.615204 17322 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:17.615942 17556 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.617223 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:17:17.617460 17287 leader_election.cc:343] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.617637 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:17.606513 17731 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.618172 17657 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.621476 17657 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.625552 17657 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.626464 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:17.628399 17362 leader_election.cc:343] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.611346 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:17.631034 17287 leader_election.cc:343] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.635988 17515 tablet_bootstrap.cc:492] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:17.636651 17515 ts_tablet_manager.cc:1403] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.004s
W20260709 13:17:17.642257 17268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:17.643332 17515 raft_consensus.cc:359] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.644213 17515 raft_consensus.cc:385] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.645004 17515 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.646000 17515 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.652138 17657 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.653527 17396 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 1: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:17:17.655043 17731 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.655452 17726 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.656432 17726 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.657282 17515 ts_tablet_manager.cc:1434] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:17:17.658339 17515 tablet_bootstrap.cc:492] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:17.658131 17286 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:17.659463 17726 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.665572 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:17.663863 17556 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:17.667613 17362 leader_election.cc:343] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.668431 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:17.672297 17632 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:17.694438 17632 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.700433 17556 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:17.702996 17360 leader_election.cc:343] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.703496 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:17.704577 17726 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.707240 17469 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.709805 17513 tablet_bootstrap.cc:654] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.713912 17511 tablet_bootstrap.cc:492] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:17.714263 17657 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.714458 17511 ts_tablet_manager.cc:1403] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.004s
I20260709 13:17:17.716089 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:17.716194 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:17:17.717885 17362 leader_election.cc:343] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.725342 17322 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:17.726580 17511 raft_consensus.cc:359] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.727305 17511 raft_consensus.cc:385] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.727563 17511 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.728104 17767 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:17.728330 17511 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.729908 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:17.731231 17511 ts_tablet_manager.cc:1434] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:17:17.732205 17511 tablet_bootstrap.cc:492] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:17.732659 17726 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.733188 17726 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:17.734536 17726 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.736102 17515 tablet_bootstrap.cc:654] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.734309 17220 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.740300 17220 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.743723 17513 tablet_bootstrap.cc:492] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:17.744226 17513 ts_tablet_manager.cc:1403] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.175s	user 0.006s	sys 0.005s
I20260709 13:17:17.764014 17511 tablet_bootstrap.cc:654] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.761750 17513 raft_consensus.cc:359] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.768865 17513 raft_consensus.cc:385] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.769304 17513 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.780804 17513 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.782986 17513 ts_tablet_manager.cc:1434] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 13:17:17.786824 17513 tablet_bootstrap.cc:492] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:17.793601 17515 tablet_bootstrap.cc:492] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:17.794102 17515 ts_tablet_manager.cc:1403] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.004s
I20260709 13:17:17.794216 17513 tablet_bootstrap.cc:654] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.796638 17515 raft_consensus.cc:359] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.797397 17515 raft_consensus.cc:385] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.797739 17515 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.798419 17515 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.799896 17515 ts_tablet_manager.cc:1434] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:17.801592 17515 tablet_bootstrap.cc:492] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:17.807469 17515 tablet_bootstrap.cc:654] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.835163 17511 tablet_bootstrap.cc:492] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:17.835659 17511 ts_tablet_manager.cc:1403] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.104s	user 0.018s	sys 0.001s
I20260709 13:17:17.836436 17513 tablet_bootstrap.cc:492] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:17.837033 17513 ts_tablet_manager.cc:1403] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.051s	user 0.031s	sys 0.012s
I20260709 13:17:17.838343 17511 raft_consensus.cc:359] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.839039 17511 raft_consensus.cc:385] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.839303 17511 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.839803 17729 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.839972 17511 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.840286 17729 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.840827 17513 raft_consensus.cc:359] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.841523 17513 raft_consensus.cc:385] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.841809 17513 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.842281 17729 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.842629 17513 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.843442 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:17.846072 17511 ts_tablet_manager.cc:1434] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:17.846201 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:17.847129 17511 tablet_bootstrap.cc:492] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
W20260709 13:17:17.847566 17360 leader_election.cc:343] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:17.850134 17362 leader_election.cc:343] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.850564 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:17.851300 17513 ts_tablet_manager.cc:1434] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:17.851713 17729 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:17.857710 17220 catalog_manager.cc:5697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.861140 17515 tablet_bootstrap.cc:492] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:17.861629 17515 ts_tablet_manager.cc:1403] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.014s
I20260709 13:17:17.862515 17513 tablet_bootstrap.cc:492] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:17.864228 17515 raft_consensus.cc:359] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.864925 17515 raft_consensus.cc:385] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.865188 17515 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.865823 17515 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.868095 17515 ts_tablet_manager.cc:1434] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
W20260709 13:17:17.868455 17362 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:17.868867 17513 tablet_bootstrap.cc:654] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.869123 17515 tablet_bootstrap.cc:492] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:17.870008 17766 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.870500 17766 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.853653 17511 tablet_bootstrap.cc:654] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.874603 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:17.875329 17396 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:17.876029 17632 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.876425 17515 tablet_bootstrap.cc:654] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.876523 17632 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.879175 17632 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.881907 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:17.885218 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:17.886080 17395 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
W20260709 13:17:17.889192 17287 leader_election.cc:343] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.891044 17286 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:17.894284 17767 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.894785 17767 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.895110 17767 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.899593 17766 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.902457 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:17.903101 17515 tablet_bootstrap.cc:492] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:17.903839 17515 ts_tablet_manager.cc:1403] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:17:17.907701 17515 raft_consensus.cc:359] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.908717 17515 raft_consensus.cc:385] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.910416 17515 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
W20260709 13:17:17.911018 17287 leader_election.cc:343] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.911056 17515 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.911517 17511 tablet_bootstrap.cc:492] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:17.912357 17511 ts_tablet_manager.cc:1403] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.015s
I20260709 13:17:17.915114 17511 raft_consensus.cc:359] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.915827 17511 raft_consensus.cc:385] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.915951 17544 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.916158 17511 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.916481 17544 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.917176 17511 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.919432 17511 ts_tablet_manager.cc:1434] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:17:17.920378 17511 tablet_bootstrap.cc:492] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:17.920717 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:17.921351 17322 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:17.920722 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:17.922031 17395 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 0.
I20260709 13:17:17.922334 17515 ts_tablet_manager.cc:1434] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 13:17:17.922629 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:17.923377 17515 tablet_bootstrap.cc:492] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:17.923555 17616 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.923931 17616 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.924230 17616 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.926154 17511 tablet_bootstrap.cc:654] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.919365 17544 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:17.929528 17515 tablet_bootstrap.cc:654] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.931252 17616 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.936420 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:17.937053 17322 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.937186 17286 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:17.938004 17766 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:17.938349 17766 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.938692 17766 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.944716 17322 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:17.945562 17544 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.946553 17616 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:17.948009 17766 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.948570 17617 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:17.950099 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:17.951414 17616 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:17.952374 17616 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:17.954239 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:17.954962 17396 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.953994 17616 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.955302 17766 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:17.957759 17515 tablet_bootstrap.cc:492] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:17.957777 17511 tablet_bootstrap.cc:492] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:17.958289 17515 ts_tablet_manager.cc:1403] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.007s
I20260709 13:17:17.958279 17511 ts_tablet_manager.cc:1403] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.010s
I20260709 13:17:17.959651 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:17:17.961054 17287 leader_election.cc:343] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:17.961746 17511 raft_consensus.cc:359] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.962411 17511 raft_consensus.cc:385] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.962680 17511 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.962735 17515 raft_consensus.cc:359] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.963470 17515 raft_consensus.cc:385] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.963860 17515 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.963436 17511 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.964672 17515 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.966260 17511 ts_tablet_manager.cc:1434] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:17.967209 17511 tablet_bootstrap.cc:492] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:17.968354 17515 ts_tablet_manager.cc:1434] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:17:17.969345 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:17.970150 17395 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:17.980108 17511 tablet_bootstrap.cc:654] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:17.987926 17511 tablet_bootstrap.cc:492] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:17.988372 17511 ts_tablet_manager.cc:1403] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 13:17:17.969338 17515 tablet_bootstrap.cc:492] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:17.990615 17511 raft_consensus.cc:359] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.991151 17511 raft_consensus.cc:385] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:17.991429 17511 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:17.992233 17511 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:17.992237 17220 catalog_manager.cc:5697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.994509 17511 ts_tablet_manager.cc:1434] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:17:17.995642 17511 tablet_bootstrap.cc:492] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:17.996162 17515 tablet_bootstrap.cc:654] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.002596 17511 tablet_bootstrap.cc:654] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.000561 17396 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:17.944790 17767 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.011157 17286 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.016907 17766 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.021883 17766 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:18.022995 17766 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.051281 17556 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:18.062958 17515 tablet_bootstrap.cc:492] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
W20260709 13:17:18.063478 17287 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.063751 17767 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.063572 17515 ts_tablet_manager.cc:1403] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.006s
I20260709 13:17:18.065207 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:18.073135 17657 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.073920 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:17:18.074093 17287 leader_election.cc:343] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.074501 17397 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.066903 17511 tablet_bootstrap.cc:492] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:18.077615 17511 ts_tablet_manager.cc:1403] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.012s
W20260709 13:17:18.080199 17497 tablet.cc:2406] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:18.081524 17766 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.081854 17556 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.082018 17766 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.082543 17556 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.083559 17511 raft_consensus.cc:359] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.084836 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:18.085476 17393 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:18.086187 17511 raft_consensus.cc:385] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.086505 17511 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.086534 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:18.087872 17287 leader_election.cc:343] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.089473 17766 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.090339 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:18.091656 17632 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.092063 17632 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.092428 17632 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.077844 17395 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:18.097711 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:18.098875 17287 leader_election.cc:343] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.087230 17511 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.101969 17632 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.104198 17632 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.105250 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:18.105151 17511 ts_tablet_manager.cc:1434] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
W20260709 13:17:18.130345 17287 leader_election.cc:343] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.130549 17511 tablet_bootstrap.cc:492] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:18.109226 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:18.133121 17392 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.136139 17657 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.137014 17513 tablet_bootstrap.cc:492] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:18.136746 17657 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.137503 17513 ts_tablet_manager.cc:1403] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.285s	user 0.054s	sys 0.107s
I20260709 13:17:18.109764 17556 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.139802 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:18.095481 17515 raft_consensus.cc:359] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.121822 17794 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.140481 17515 raft_consensus.cc:385] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.140801 17515 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.140640 17794 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.141605 17657 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.142218 17515 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.142812 17794 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:18.143023 17726 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.143523 17726 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.112607 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:18.145809 17395 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:18.147289 17726 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.147751 17397 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:18.148604 17515 ts_tablet_manager.cc:1434] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.001s
I20260709 13:17:18.151305 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:18.151654 17515 tablet_bootstrap.cc:492] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:18.152144 17321 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 1: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:17:18.148895 17360 leader_election.cc:343] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.154286 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:18.155714 17511 tablet_bootstrap.cc:654] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:18.155632 17360 leader_election.cc:343] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.140077 17513 raft_consensus.cc:359] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.157106 17513 raft_consensus.cc:385] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.157414 17513 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.158059 17513 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.159844 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.160131 17513 ts_tablet_manager.cc:1434] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:17:18.164324 17515 tablet_bootstrap.cc:654] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.161068 17513 tablet_bootstrap.cc:492] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:18.140108 17392 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:18.173194 17513 tablet_bootstrap.cc:654] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.179226 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:18.184434 17556 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.184983 17556 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.185010 17513 tablet_bootstrap.cc:492] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:18.185539 17556 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.185866 17513 ts_tablet_manager.cc:1403] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.001s
I20260709 13:17:18.189815 17767 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.190335 17767 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.190901 17513 raft_consensus.cc:359] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.192013 17513 raft_consensus.cc:385] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.192137 17286 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.192390 17513 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.193040 17766 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.193557 17766 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:18.193414 17513 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.194533 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:18.194388 17766 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.195174 17470 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:18.202117 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:18.203800 17513 ts_tablet_manager.cc:1434] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:17:18.205116 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:18.203810 17553 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.205789 17553 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.206104 17513 tablet_bootstrap.cc:492] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:18.207690 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:18.206144 17553 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.210125 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.213464 17513 tablet_bootstrap.cc:654] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.213822 17470 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.192269 17767 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.216509 17218 catalog_manager.cc:5697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.225340 17513 tablet_bootstrap.cc:492] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:18.225832 17513 ts_tablet_manager.cc:1403] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:17:18.230245 17553 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.231623 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:18.232451 17553 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.240984 17514 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.245175 17511 tablet_bootstrap.cc:492] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:18.245713 17511 ts_tablet_manager.cc:1403] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.005s
I20260709 13:17:18.232244 17513 raft_consensus.cc:359] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.247401 17513 raft_consensus.cc:385] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.247709 17513 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.235821 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:18.236400 17731 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.248726 17731 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:18.248524 17513 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.249619 17731 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.239527 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:18.247553 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:18.232275 17397 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:18.254295 17217 catalog_manager.cc:5697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.255741 17470 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.256341 17513 ts_tablet_manager.cc:1434] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:17:18.256353 17785 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:18.259140 17362 leader_election.cc:343] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.262056 17362 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:17:18.263055 17362 leader_election.cc:343] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.263732 17657 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.265151 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.266425 17726 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.266705 17513 tablet_bootstrap.cc:492] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:18.268069 17657 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.270713 17724 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.274391 17513 tablet_bootstrap.cc:654] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.277349 17514 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.278555 17515 tablet_bootstrap.cc:492] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:18.279086 17515 ts_tablet_manager.cc:1403] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.128s	user 0.031s	sys 0.032s
I20260709 13:17:18.282375 17515 raft_consensus.cc:359] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.291604 17515 raft_consensus.cc:385] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.293267 17515 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.294088 17515 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.296382 17515 ts_tablet_manager.cc:1434] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:17:18.297415 17515 tablet_bootstrap.cc:492] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:18.285904 17513 tablet_bootstrap.cc:492] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:18.304051 17513 ts_tablet_manager.cc:1403] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.003s
I20260709 13:17:18.306531 17515 tablet_bootstrap.cc:654] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.307551 17513 raft_consensus.cc:359] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.308277 17513 raft_consensus.cc:385] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.308569 17513 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.228304 17556 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.309214 17513 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.283089 17511 raft_consensus.cc:359] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.310611 17511 raft_consensus.cc:385] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.310902 17511 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.313560 17217 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.314664 17513 ts_tablet_manager.cc:1434] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:17:18.318470 17515 tablet_bootstrap.cc:492] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:18.318951 17515 ts_tablet_manager.cc:1403] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.006s
I20260709 13:17:18.319305 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:18.319972 17397 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.320029 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:18.320619 17469 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.321353 17513 tablet_bootstrap.cc:492] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:18.321520 17515 raft_consensus.cc:359] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.322152 17515 raft_consensus.cc:385] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.322404 17515 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.323218 17515 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.324956 17556 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.314774 17511 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.333555 17515 ts_tablet_manager.cc:1434] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:17:18.334852 17515 tablet_bootstrap.cc:492] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:18.337920 17470 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:18.342299 17515 tablet_bootstrap.cc:654] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.333479 17511 ts_tablet_manager.cc:1434] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.002s
I20260709 13:17:18.345619 17511 tablet_bootstrap.cc:492] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:18.355329 17724 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.356063 17724 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.382524 17469 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
W20260709 13:17:18.455652 17807 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.062s	user 0.005s	sys 0.000s
I20260709 13:17:18.457376 17724 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.461719 17657 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.462417 17397 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:18.462216 17657 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.478598 17657 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.463726 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:18.470618 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:18.471917 17470 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.480327 17287 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:18.476521 17511 tablet_bootstrap.cc:654] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.482213 17514 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.482661 17514 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:18.483367 17514 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.484208 17767 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.484673 17767 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:18.485396 17515 tablet_bootstrap.cc:492] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:18.485939 17515 ts_tablet_manager.cc:1403] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.151s	user 0.036s	sys 0.028s
I20260709 13:17:18.485498 17767 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.493589 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:18.475337 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:18.494884 17322 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:18.493443 17632 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.495910 17632 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.498063 17796 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:18.498104 17632 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.499588 17785 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.499850 17515 raft_consensus.cc:359] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.500286 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:18.500552 17515 raft_consensus.cc:385] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.500828 17515 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
W20260709 13:17:18.502115 17362 leader_election.cc:343] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.502518 17515 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:18.503433 17287 leader_election.cc:343] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.505544 17515 ts_tablet_manager.cc:1434] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:17:18.505463 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:18.506155 17396 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:18.506613 17515 tablet_bootstrap.cc:492] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:18.507383 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:18.510584 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.511351 17766 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.511724 17766 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.512058 17766 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.513269 17515 tablet_bootstrap.cc:654] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.519407 17766 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.522774 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:17:18.524343 17362 leader_election.cc:343] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.460687 17513 tablet_bootstrap.cc:654] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:18.526587 17287 leader_election.cc:343] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.529008 17471 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.533942 17632 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:18.537091 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:18.537699 17397 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.551574 17511 tablet_bootstrap.cc:492] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:18.552446 17511 ts_tablet_manager.cc:1403] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.207s	user 0.011s	sys 0.004s
I20260709 13:17:18.556608 17515 tablet_bootstrap.cc:492] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:18.557137 17515 ts_tablet_manager.cc:1403] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.001s
W20260709 13:17:18.537554 17360 leader_election.cc:343] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.559271 17360 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.559993 17515 raft_consensus.cc:359] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.560683 17657 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.562542 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.560716 17515 raft_consensus.cc:385] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.575810 17515 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.576534 17515 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.579488 17515 ts_tablet_manager.cc:1434] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:17:18.580457 17515 tablet_bootstrap.cc:492] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:18.557017 17766 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.573575 17397 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:18.564620 17511 raft_consensus.cc:359] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.585642 17511 raft_consensus.cc:385] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.586081 17511 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.586792 17511 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.589835 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.586833 17515 tablet_bootstrap.cc:654] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.590512 17657 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.599115 17287 consensus_peers.cc:597] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.608045 17657 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.610278 17657 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.592692 17513 tablet_bootstrap.cc:492] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:18.591940 17724 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.611228 17513 ts_tablet_manager.cc:1403] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.290s	user 0.012s	sys 0.004s
I20260709 13:17:18.611402 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:18.598917 17218 catalog_manager.cc:5697] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.611152 17724 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.612408 17724 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.613090 17218 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.600375 17766 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:18.613667 17360 leader_election.cc:343] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.621052 17766 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:18.589876 17511 ts_tablet_manager.cc:1434] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:17:18.621987 17766 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.622879 17511 tablet_bootstrap.cc:492] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:18.628728 17724 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.611788 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:18.637233 17362 leader_election.cc:343] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.637678 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.643539 17729 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.647020 17513 raft_consensus.cc:359] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.647764 17513 raft_consensus.cc:385] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.648036 17513 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.648723 17513 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.649535 17724 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.648653 17511 tablet_bootstrap.cc:654] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.649164 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:17:18.653847 17362 leader_election.cc:343] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.656476 17513 ts_tablet_manager.cc:1434] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 13:17:18.658851 17511 tablet_bootstrap.cc:492] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:18.659582 17511 ts_tablet_manager.cc:1403] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:17:18.660946 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:18.661844 17318 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.662976 17511 raft_consensus.cc:359] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.664319 17515 tablet_bootstrap.cc:492] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:18.665081 17515 ts_tablet_manager.cc:1403] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.085s	user 0.024s	sys 0.044s
I20260709 13:17:18.667666 17515 raft_consensus.cc:359] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.664309 17511 raft_consensus.cc:385] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.668463 17511 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.669238 17511 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.673434 17511 ts_tablet_manager.cc:1434] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:18.673489 17470 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.673985 17724 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.674145 17318 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:18.674767 17511 tablet_bootstrap.cc:492] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:18.674460 17724 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.674964 17515 raft_consensus.cc:385] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.675266 17515 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.675912 17515 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.677723 17724 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.677969 17515 ts_tablet_manager.cc:1434] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:17:18.678592 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:18.679073 17513 tablet_bootstrap.cc:492] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:18.676637 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.680989 17632 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:18.683171 17362 leader_election.cc:343] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.689817 17724 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.691520 17724 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:18.692360 17724 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.695150 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:18.695813 17318 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:18.702605 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.704063 17729 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:18.704547 17729 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.705060 17729 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.706362 17657 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.706835 17657 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.727432 17513 tablet_bootstrap.cc:654] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.728372 17657 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.733206 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:18.735528 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:17:18.737416 17362 leader_election.cc:343] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:18.739588 17360 leader_election.cc:343] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.740121 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.741142 17729 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.741518 17726 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.742483 17220 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.747766 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:18.748364 17318 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:18.755133 17515 tablet_bootstrap.cc:492] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:18.759019 17811 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:17:18.762012 17318 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:18.774564 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:17:18.776818 17362 leader_election.cc:343] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:18.777086 17287 consensus_peers.cc:597] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.779978 17511 tablet_bootstrap.cc:654] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.774834 17729 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.785050 17515 tablet_bootstrap.cc:654] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.785392 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.789973 17513 tablet_bootstrap.cc:492] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:18.790422 17513 ts_tablet_manager.cc:1403] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.005s
I20260709 13:17:18.787762 17729 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:18.794252 17729 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:18.795055 17729 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.798362 17218 catalog_manager.cc:5697] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:18.801458 17268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:18.807349 17511 tablet_bootstrap.cc:492] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:18.811085 17511 ts_tablet_manager.cc:1403] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.017s
I20260709 13:17:18.814329 17511 raft_consensus.cc:359] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.810074 17513 raft_consensus.cc:359] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.815207 17513 raft_consensus.cc:385] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.815549 17513 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.816262 17513 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.819103 17515 tablet_bootstrap.cc:492] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:18.819588 17515 ts_tablet_manager.cc:1403] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.008s
I20260709 13:17:18.821452 17513 ts_tablet_manager.cc:1434] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:17:18.822418 17513 tablet_bootstrap.cc:492] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:18.827683 17515 raft_consensus.cc:359] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.828243 17513 tablet_bootstrap.cc:654] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.828428 17515 raft_consensus.cc:385] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.828050 17217 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.828701 17515 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.829517 17515 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.830700 17511 raft_consensus.cc:385] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.831516 17511 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.832144 17515 ts_tablet_manager.cc:1434] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:18.832257 17511 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.834633 17511 ts_tablet_manager.cc:1434] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:17:18.833187 17515 tablet_bootstrap.cc:492] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:18.845996 17515 tablet_bootstrap.cc:654] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.851822 17811 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:18.857924 17515 tablet_bootstrap.cc:492] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:18.858450 17515 ts_tablet_manager.cc:1403] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.009s
I20260709 13:17:18.861898 17513 tablet_bootstrap.cc:492] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:18.862399 17513 ts_tablet_manager.cc:1403] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.012s
I20260709 13:17:18.865015 17513 raft_consensus.cc:359] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.865700 17513 raft_consensus.cc:385] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.866056 17513 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.867245 17513 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.869536 17513 ts_tablet_manager.cc:1434] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:18.870572 17513 tablet_bootstrap.cc:492] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:18.871073 17515 raft_consensus.cc:359] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.872053 17515 raft_consensus.cc:385] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.872386 17515 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.873202 17515 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.875007 17515 ts_tablet_manager.cc:1434] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:17:18.876096 17515 tablet_bootstrap.cc:492] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:18.877941 17513 tablet_bootstrap.cc:654] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.883195 17515 tablet_bootstrap.cc:654] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.893421 17511 tablet_bootstrap.cc:492] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:18.898262 17515 tablet_bootstrap.cc:492] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:18.898957 17515 ts_tablet_manager.cc:1403] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:17:18.905570 17511 tablet_bootstrap.cc:654] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.908967 17515 raft_consensus.cc:359] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.913659 17515 raft_consensus.cc:385] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.914096 17515 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.915165 17515 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.917584 17515 ts_tablet_manager.cc:1434] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:17:18.918561 17515 tablet_bootstrap.cc:492] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:18.919410 17513 tablet_bootstrap.cc:492] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:18.919889 17513 ts_tablet_manager.cc:1403] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.019s
I20260709 13:17:18.922221 17729 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.922732 17729 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.924520 17515 tablet_bootstrap.cc:654] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.924791 17729 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.925601 17513 raft_consensus.cc:359] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.926409 17513 raft_consensus.cc:385] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.926417 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:18.927646 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:18.927884 17360 leader_election.cc:343] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.926945 17513 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
W20260709 13:17:18.929296 17362 leader_election.cc:343] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.929697 17362 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.930650 17729 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.930121 17513 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.933269 17513 ts_tablet_manager.cc:1434] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:17:18.934468 17511 tablet_bootstrap.cc:492] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:18.935081 17511 ts_tablet_manager.cc:1403] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.005s
I20260709 13:17:18.937124 17515 tablet_bootstrap.cc:492] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:18.937559 17515 ts_tablet_manager.cc:1403] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:17:18.939137 17513 tablet_bootstrap.cc:492] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:18.940647 17515 raft_consensus.cc:359] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.941277 17515 raft_consensus.cc:385] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.941541 17515 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.942157 17515 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.944262 17515 ts_tablet_manager.cc:1434] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:17:18.937583 17511 raft_consensus.cc:359] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.944623 17511 raft_consensus.cc:385] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.944924 17511 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.945649 17513 tablet_bootstrap.cc:654] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.945516 17511 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.947649 17511 ts_tablet_manager.cc:1434] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:17:18.948571 17511 tablet_bootstrap.cc:492] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:18.950135 17729 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.951597 17515 tablet_bootstrap.cc:492] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:18.957630 17513 tablet_bootstrap.cc:492] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:18.958230 17513 ts_tablet_manager.cc:1403] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:17:18.960879 17515 tablet_bootstrap.cc:654] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.960760 17513 raft_consensus.cc:359] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.960919 17729 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.963088 17511 tablet_bootstrap.cc:654] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:18.965674 17729 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.966828 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:18.966311 17513 raft_consensus.cc:385] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:18.967581 17513 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:18.968422 17513 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.970887 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:17:18.972239 17360 leader_election.cc:343] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.973210 17514 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.973661 17514 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:18.974118 17632 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:18.975049 17513 ts_tablet_manager.cc:1434] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:17:18.975514 17514 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:18.976219 17513 tablet_bootstrap.cc:492] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:18.979197 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:18.981352 17287 leader_election.cc:343] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.981612 17766 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:18.984740 17362 leader_election.cc:343] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:18.985170 17362 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:18.986274 17724 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:18.992568 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:18.993299 17395 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:19.015090 17286 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.018069 17514 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.018489 17514 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.018932 17514 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.022639 17511 tablet_bootstrap.cc:492] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:19.023154 17511 ts_tablet_manager.cc:1403] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.007s
I20260709 13:17:19.032478 17513 tablet_bootstrap.cc:654] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.033008 17511 raft_consensus.cc:359] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.033850 17511 raft_consensus.cc:385] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.034219 17511 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.035626 17514 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.037420 17785 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.038928 17515 tablet_bootstrap.cc:492] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:19.039470 17515 ts_tablet_manager.cc:1403] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.088s	user 0.032s	sys 0.020s
I20260709 13:17:19.037909 17785 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.042177 17511 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.041253 17794 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.046557 17729 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.047055 17729 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.049060 17511 ts_tablet_manager.cc:1434] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:17:19.053270 17794 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.056157 17794 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:19.056172 17515 raft_consensus.cc:359] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.057024 17515 raft_consensus.cc:385] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.057291 17515 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.047931 17785 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:19.057832 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:19.058845 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:19.059132 17767 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.057874 17515 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.059715 17767 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.060108 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:19.061306 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:19.068740 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:19.069198 17767 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.070508 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:19.071892 17434 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:19.073520 17511 tablet_bootstrap.cc:492] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:19.073998 17515 ts_tablet_manager.cc:1434] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:17:19.073401 17785 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.074990 17616 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:19.075680 17360 leader_election.cc:343] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.075704 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:19.077644 17362 leader_election.cc:343] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.078467 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.079351 17514 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.081538 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:19.073096 17729 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.082249 17394 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:19.080224 17724 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.085104 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:19.085732 17393 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.088577 17394 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.108462 17632 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.142720 17515 tablet_bootstrap.cc:492] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:19.143395 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:19.144412 17513 tablet_bootstrap.cc:492] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:19.144928 17470 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:19.145088 17513 ts_tablet_manager.cc:1403] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.169s	user 0.013s	sys 0.006s
I20260709 13:17:19.150697 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:19.152158 17511 tablet_bootstrap.cc:654] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.154464 17766 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.154873 17766 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.155198 17766 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.158231 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:19.160763 17724 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.163264 17513 raft_consensus.cc:359] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.163762 17513 raft_consensus.cc:385] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.164047 17513 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.164542 17513 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.170583 17726 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.172216 17726 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.177701 17513 ts_tablet_manager.cc:1434] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
I20260709 13:17:19.179602 17726 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.183772 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:19.190685 17513 tablet_bootstrap.cc:492] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:19.183462 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:19.192575 17362 leader_election.cc:343] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:19.193547 17360 leader_election.cc:343] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.190308 17766 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.194036 17360 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.196342 17726 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.199752 17393 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:19.203972 17766 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:17:19.204784 17287 leader_election.cc:343] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.211733 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:19.212473 17471 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.209607 17811 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:17:19.221664 17362 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.209277 17726 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.245159 17467 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.252744 17471 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:19.266966 17513 tablet_bootstrap.cc:654] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.262645 17468 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.253479 17794 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.268203 17794 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.269887 17811 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.270578 17794 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:19.270418 17811 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.229027 17726 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.287145 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:19.288148 17393 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 1: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:17:19.287233 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:19.272693 17811 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.294055 17435 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:19.296804 17845 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.301388 17515 tablet_bootstrap.cc:654] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.329684 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:19.333746 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:19.339113 17811 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.362360 17511 tablet_bootstrap.cc:492] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:19.363127 17511 ts_tablet_manager.cc:1403] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.291s	user 0.066s	sys 0.052s
I20260709 13:17:19.339896 17724 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:17:19.373353 17463 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.390599 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:19.379999 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:19.379472 17845 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.399051 17726 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.402070 17511 raft_consensus.cc:359] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.402833 17511 raft_consensus.cc:385] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.403098 17511 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.403676 17511 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:19.405532 17360 leader_election.cc:343] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:19.396456 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 58372.3us
W20260709 13:17:19.413187 17287 leader_election.cc:343] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.420157 17513 tablet_bootstrap.cc:492] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:19.420910 17513 ts_tablet_manager.cc:1403] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.230s	user 0.028s	sys 0.021s
I20260709 13:17:19.427460 17511 ts_tablet_manager.cc:1434] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.064s	user 0.000s	sys 0.008s
I20260709 13:17:19.429051 17511 tablet_bootstrap.cc:492] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:19.407560 17394 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.437678 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:19.412424 17811 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:17:19.442684 17362 leader_election.cc:343] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.443202 17362 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.445489 17513 raft_consensus.cc:359] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.446070 17513 raft_consensus.cc:385] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.446281 17513 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.447965 17513 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.447139 17848 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.456341 17513 ts_tablet_manager.cc:1434] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:17:19.458904 17767 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.461930 17767 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.463348 17766 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.464244 17767 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.467226 17511 tablet_bootstrap.cc:654] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.467969 17513 tablet_bootstrap.cc:492] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:19.482707 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:19.483448 17396 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:19.461547 17811 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.491027 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:19.507508 17515 tablet_bootstrap.cc:492] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
W20260709 13:17:19.499524 17287 leader_election.cc:343] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.508025 17515 ts_tablet_manager.cc:1403] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.366s	user 0.015s	sys 0.025s
I20260709 13:17:19.532269 17515 raft_consensus.cc:359] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.533022 17515 raft_consensus.cc:385] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.533318 17515 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.534514 17515 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.573233 17218 catalog_manager.cc:5697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.581032 17394 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:19.582427 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:19.583233 17396 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:19.592571 17515 ts_tablet_manager.cc:1434] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 13:17:19.599092 17513 tablet_bootstrap.cc:654] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.604900 17515 tablet_bootstrap.cc:492] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:19.609176 17286 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.611300 17855 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.611927 17855 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:19.612782 17855 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.608209 17811 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:17:19.615765 17511 tablet_bootstrap.cc:492] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:19.616279 17511 ts_tablet_manager.cc:1403] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.188s	user 0.036s	sys 0.026s
I20260709 13:17:19.625183 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.626075 17859 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.626515 17859 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.626622 17848 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.626926 17859 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.627048 17511 raft_consensus.cc:359] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.627135 17848 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.627928 17511 raft_consensus.cc:385] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.628234 17511 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.632663 17724 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:19.634459 17511 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.635365 17848 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.636296 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:17:19.643774 17360 leader_election.cc:343] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.648892 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.650269 17511 ts_tablet_manager.cc:1434] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.003s
I20260709 13:17:19.650461 17811 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.650974 17811 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.651374 17811 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.651558 17511 tablet_bootstrap.cc:492] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:19.653157 17515 tablet_bootstrap.cc:654] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.669742 17811 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.670315 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:19.676236 17362 leader_election.cc:343] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.676681 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.678414 17853 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.680668 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:19.671497 17859 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:19.682827 17287 leader_election.cc:343] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.683671 17811 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.685098 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:19.685714 17395 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.685807 17811 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.687573 17811 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.693477 17811 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.690040 17511 tablet_bootstrap.cc:654] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.691401 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:19.698877 17465 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.699631 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:19.700196 17396 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.690248 17859 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.696372 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:19.702767 17287 leader_election.cc:343] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.704005 17515 tablet_bootstrap.cc:492] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:19.694895 17395 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:19.708096 17465 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:19.708678 17515 ts_tablet_manager.cc:1403] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.104s	user 0.018s	sys 0.000s
I20260709 13:17:19.709559 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:19.709710 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:19.710191 17394 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:19.710614 17859 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.711324 17859 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:19.712459 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.713490 17632 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.714051 17632 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:19.716439 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.714941 17632 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.718677 17856 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.719166 17856 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.719600 17856 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.711403 17515 raft_consensus.cc:359] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.721654 17515 raft_consensus.cc:385] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.721951 17515 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.722591 17515 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.724689 17515 ts_tablet_manager.cc:1434] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.000s
I20260709 13:17:19.729311 17515 tablet_bootstrap.cc:492] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:19.734691 17859 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.740804 17856 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.760092 17511 tablet_bootstrap.cc:492] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:19.760615 17511 ts_tablet_manager.cc:1403] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.001s
I20260709 13:17:19.762070 17513 tablet_bootstrap.cc:492] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:19.762579 17513 ts_tablet_manager.cc:1403] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.295s	user 0.019s	sys 0.023s
I20260709 13:17:19.764020 17511 raft_consensus.cc:359] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.765091 17511 raft_consensus.cc:385] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.765520 17511 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.766817 17511 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.770879 17856 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.770666 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:19.773403 17392 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.773576 17396 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:19.776643 17511 ts_tablet_manager.cc:1434] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:17:19.775182 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:19.777721 17511 tablet_bootstrap.cc:492] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:19.779110 17515 tablet_bootstrap.cc:654] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:19.779361 17287 leader_election.cc:343] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.780386 17513 raft_consensus.cc:359] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.781198 17513 raft_consensus.cc:385] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.781515 17513 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.782256 17513 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.785856 17513 ts_tablet_manager.cc:1434] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:17:19.789003 17513 tablet_bootstrap.cc:492] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:19.790699 17392 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:19.792999 17632 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.794519 17632 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.797036 17848 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.797526 17848 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.799511 17848 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.804361 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:19.805985 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.806773 17767 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.807181 17511 tablet_bootstrap.cc:654] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.807236 17767 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:19.808243 17767 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:19.812076 17360 leader_election.cc:343] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.814352 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:19.817482 17362 leader_election.cc:343] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.818539 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.820130 17513 tablet_bootstrap.cc:654] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.820461 17848 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.822101 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:19.822999 17392 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:19.824177 17286 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:19.824913 17811 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.825268 17811 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.825568 17632 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.825645 17811 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.826581 17511 tablet_bootstrap.cc:492] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:19.827399 17511 ts_tablet_manager.cc:1403] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.003s
I20260709 13:17:19.826653 17220 catalog_manager.cc:5697] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.830066 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:19.831131 17511 raft_consensus.cc:359] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.831868 17511 raft_consensus.cc:385] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.832185 17511 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.832566 17513 tablet_bootstrap.cc:492] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:19.828554 17220 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.833645 17513 ts_tablet_manager.cc:1403] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.007s
I20260709 13:17:19.832964 17511 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.834144 17220 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.835525 17511 ts_tablet_manager.cc:1434] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:19.836473 17511 tablet_bootstrap.cc:492] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:19.836138 17513 raft_consensus.cc:359] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.836937 17513 raft_consensus.cc:385] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.837200 17513 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.837815 17513 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.839226 17513 ts_tablet_manager.cc:1434] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:19.840188 17513 tablet_bootstrap.cc:492] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:19.841151 17811 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.842919 17511 tablet_bootstrap.cc:654] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:19.831418 17287 leader_election.cc:343] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.844998 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:19.845585 17392 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.853498 17513 tablet_bootstrap.cc:654] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.854063 17392 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:19.856082 17632 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.856432 17511 tablet_bootstrap.cc:492] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:19.857026 17511 ts_tablet_manager.cc:1403] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.002s
I20260709 13:17:19.856644 17632 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.857323 17286 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:19.858136 17856 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:19.858625 17856 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:19.858898 17632 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.859536 17856 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.860638 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:19.862561 17287 leader_election.cc:343] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.859913 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:19.864444 17392 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:19.865908 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:19.867260 17856 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:19.867677 17785 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.868193 17511 raft_consensus.cc:359] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.867671 17856 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.868527 17785 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.869431 17511 raft_consensus.cc:385] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.874306 17511 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.875242 17511 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.878613 17511 ts_tablet_manager.cc:1434] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:17:19.879771 17511 tablet_bootstrap.cc:492] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:19.874550 17856 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.915110 17511 tablet_bootstrap.cc:654] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.918749 17785 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:19.907963 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:19.917361 17811 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.923414 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:19.947549 17435 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:19.949162 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:17:19.951355 17287 leader_election.cc:343] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.951970 17515 tablet_bootstrap.cc:492] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:19.954980 17766 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:19.952225 17785 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:19.955400 17515 ts_tablet_manager.cc:1403] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.228s	user 0.037s	sys 0.037s
I20260709 13:17:19.954815 17513 tablet_bootstrap.cc:492] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:19.956635 17513 ts_tablet_manager.cc:1403] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.117s	user 0.031s	sys 0.014s
I20260709 13:17:19.959610 17515 raft_consensus.cc:359] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.960304 17515 raft_consensus.cc:385] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.960577 17515 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.951164 17218 catalog_manager.cc:5697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.963043 17218 catalog_manager.cc:5697] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.965164 17513 raft_consensus.cc:359] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.966485 17515 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.965801 17513 raft_consensus.cc:385] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:19.967609 17513 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:19.968729 17513 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.972675 17513 ts_tablet_manager.cc:1434] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:17:19.973398 17856 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:19.973974 17513 tablet_bootstrap.cc:492] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:19.975610 17856 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:19.976876 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:17:19.978220 17287 leader_election.cc:343] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:19.980741 17515 ts_tablet_manager.cc:1434] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:17:19.982658 17515 tablet_bootstrap.cc:492] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Bootstrap starting.
I20260709 13:17:19.990764 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:19.991444 17396 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:19.995631 17853 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.003137 17268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:20.006505 17515 tablet_bootstrap.cc:654] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:19.996556 17853 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.014704 17396 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:20.015580 17853 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:20.016108 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:20.017329 17856 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.017800 17856 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:20.018953 17767 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.018694 17856 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.020349 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:20.023888 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:20.028534 17362 leader_election.cc:343] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:20.032436 17360 leader_election.cc:343] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.033790 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:20.034551 17724 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:20.035878 17794 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.036656 17511 tablet_bootstrap.cc:492] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:20.036350 17794 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.037103 17511 ts_tablet_manager.cc:1403] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.158s	user 0.023s	sys 0.034s
I20260709 13:17:20.040544 17794 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:20.043203 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:20.041843 17511 raft_consensus.cc:359] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.050908 17767 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.055060 17511 raft_consensus.cc:385] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.055194 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:20.055413 17511 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.056023 17511 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.057132 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:20.060029 17794 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:20.063647 17513 tablet_bootstrap.cc:654] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.088330 17511 ts_tablet_manager.cc:1434] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.001s
I20260709 13:17:20.089599 17511 tablet_bootstrap.cc:492] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:20.090809 17515 tablet_bootstrap.cc:492] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: No bootstrap required, opened a new log
I20260709 13:17:20.091266 17515 ts_tablet_manager.cc:1403] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.009s
I20260709 13:17:20.096097 17515 raft_consensus.cc:359] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.097071 17515 raft_consensus.cc:385] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.097363 17515 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.098747 17511 tablet_bootstrap.cc:654] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.098328 17515 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.103358 17632 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.104089 17632 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.108651 17466 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.110870 17515 ts_tablet_manager.cc:1434] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:17:20.119935 17632 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:20.140056 17855 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.145386 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:20.146678 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:20.147244 17396 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:20.151039 17632 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.151448 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:20.153524 17632 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.153846 17632 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.154126 17632 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.160720 17632 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.162770 17632 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:20.169646 17218 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.171712 17513 tablet_bootstrap.cc:492] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:20.172601 17513 ts_tablet_manager.cc:1403] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.199s	user 0.023s	sys 0.024s
I20260709 13:17:20.180205 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:17:20.180781 17287 leader_election.cc:343] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.181028 17395 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.196085 17395 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:20.198081 17463 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.203586 17855 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.204396 17855 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.210551 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:17:20.214984 17287 leader_election.cc:343] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:20.216475 17287 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.218859 17855 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:20.220827 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:20.223515 17287 leader_election.cc:343] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.233186 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:20.233934 17393 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:20.233815 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:20.235610 17632 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.236229 17632 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:20.237196 17632 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.254065 17466 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.241539 17513 raft_consensus.cc:359] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.261458 17513 raft_consensus.cc:385] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.261970 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:20.261986 17513 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.264808 17513 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.268769 17513 ts_tablet_manager.cc:1434] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.096s	user 0.000s	sys 0.008s
I20260709 13:17:20.270807 17859 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.279449 17513 tablet_bootstrap.cc:492] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:20.269367 17767 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.279978 17859 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.286374 17511 tablet_bootstrap.cc:492] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:20.286902 17511 ts_tablet_manager.cc:1403] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.198s	user 0.025s	sys 0.047s
I20260709 13:17:20.288311 17859 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:20.282459 17767 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.290632 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:17:20.292364 17287 leader_election.cc:343] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.289728 17767 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.294814 17511 raft_consensus.cc:359] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.295580 17511 raft_consensus.cc:385] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.295914 17511 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.296664 17511 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.299098 17511 ts_tablet_manager.cc:1434] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:17:20.300444 17856 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:20.302379 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:20.303056 17396 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:20.304175 17767 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.304745 17856 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:20.305734 17287 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.307813 17859 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:20.349121 17511 tablet_bootstrap.cc:492] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:20.354167 17513 tablet_bootstrap.cc:654] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.356073 17767 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:20.365315 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:20.365706 17513 tablet_bootstrap.cc:492] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:20.365841 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:20.366178 17513 ts_tablet_manager.cc:1403] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.003s
I20260709 13:17:20.367054 17859 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:20.368811 17513 raft_consensus.cc:359] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.369531 17513 raft_consensus.cc:385] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.369789 17513 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.370612 17513 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.365970 17393 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.368870 17859 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.385043 17859 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.385419 17859 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.388090 17632 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.388728 17632 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.395467 17220 catalog_manager.cc:5697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.396394 17632 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:20.399614 17393 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:20.400959 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:20.405483 17463 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.416057 17724 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.416829 17724 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.430591 17514 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:20.439811 17463 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:20.486655 17513 ts_tablet_manager.cc:1434] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.000s
I20260709 13:17:20.487902 17513 tablet_bootstrap.cc:492] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
W20260709 13:17:20.478140 17895 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:20.497180 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:20.501044 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:20.502224 17514 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.502650 17514 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:20.503324 17514 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:20.505267 17287 leader_election.cc:343] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.453207 17785 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.517778 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:17:20.520612 17360 leader_election.cc:343] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.526891 17511 tablet_bootstrap.cc:654] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.519709 17785 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.559864 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:20.560534 17395 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:20.571846 17785 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:20.569384 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:20.572557 17464 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 0.
I20260709 13:17:20.564043 17724 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:20.575887 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:20.581390 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:20.582104 17391 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:20.586699 17286 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:20.587719 17632 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.588055 17632 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.588363 17632 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.574272 17859 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.593523 17901 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:20.591671 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:20.597718 17513 tablet_bootstrap.cc:654] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.602468 17901 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.605785 17901 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.611934 17632 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.603628 17903 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:20.626219 17903 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.642313 17903 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.652349 17859 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:17:20.688544 17287 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.687187 17901 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.689483 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:20.703490 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:20.712657 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:20.713342 17393 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.709393 17903 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:17:20.727551 17287 leader_election.cc:343] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.738376 17511 tablet_bootstrap.cc:492] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:20.739302 17511 ts_tablet_manager.cc:1403] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.391s	user 0.017s	sys 0.021s
I20260709 13:17:20.746626 17632 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:20.753520 17511 raft_consensus.cc:359] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.754341 17511 raft_consensus.cc:385] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.765885 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:20.771472 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:20.772111 17396 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.754745 17511 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.754621 17393 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:20.789115 17903 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:20.793462 17511 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.800576 17396 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:20.801534 17217 catalog_manager.cc:5697] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.806758 17511 ts_tablet_manager.cc:1434] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.067s	user 0.011s	sys 0.010s
I20260709 13:17:20.807057 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:20.807641 17468 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:20.807701 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:17:20.809563 17287 leader_election.cc:343] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.813346 17511 tablet_bootstrap.cc:492] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:20.793649 17901 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:20.812420 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:20.823462 17468 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:20.826494 17513 tablet_bootstrap.cc:492] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:20.826979 17513 ts_tablet_manager.cc:1403] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.339s	user 0.029s	sys 0.033s
I20260709 13:17:20.829718 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:20.830528 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:20.831079 17395 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:20.832021 17360 leader_election.cc:343] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:20.833278 17901 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.833796 17901 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:20.838721 17901 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.839772 17513 raft_consensus.cc:359] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.840476 17513 raft_consensus.cc:385] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.840730 17513 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.841339 17513 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.843395 17513 ts_tablet_manager.cc:1434] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:17:20.844357 17513 tablet_bootstrap.cc:492] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:20.847241 17395 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:20.848933 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:20.850790 17511 tablet_bootstrap.cc:654] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.851701 17899 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.862175 17899 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:20.863399 17899 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.869372 17286 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:20.870543 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:20.873979 17906 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:20.874320 17767 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.874908 17767 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:20.873437 17855 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:20.886530 17855 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:20.887425 17855 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.889554 17767 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.889729 17220 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 0 to 1, leader changed from <none> to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.922075 17766 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:20.923306 17287 consensus_peers.cc:597] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.940814 17218 catalog_manager.cc:5697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.948556 17220 catalog_manager.cc:5697] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.951496 17511 tablet_bootstrap.cc:492] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:20.952049 17511 ts_tablet_manager.cc:1403] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.139s	user 0.037s	sys 0.013s
I20260709 13:17:20.958541 17511 raft_consensus.cc:359] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.959286 17511 raft_consensus.cc:385] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:20.959573 17511 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:20.960219 17511 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:20.973412 17511 ts_tablet_manager.cc:1434] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.006s
I20260709 13:17:20.974489 17511 tablet_bootstrap.cc:492] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Bootstrap starting.
I20260709 13:17:20.976296 17217 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.980180 17513 tablet_bootstrap.cc:654] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:20.991065 17511 tablet_bootstrap.cc:654] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.007086 17513 tablet_bootstrap.cc:492] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:21.007609 17513 ts_tablet_manager.cc:1403] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.007s
I20260709 13:17:21.011556 17511 tablet_bootstrap.cc:492] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: No bootstrap required, opened a new log
I20260709 13:17:21.012079 17511 ts_tablet_manager.cc:1403] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 13:17:21.013183 17513 raft_consensus.cc:359] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.013862 17513 raft_consensus.cc:385] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.014101 17513 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.014752 17899 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.015023 17513 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.015224 17899 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.015065 17511 raft_consensus.cc:359] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.016036 17511 raft_consensus.cc:385] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.016355 17511 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.017273 17513 ts_tablet_manager.cc:1434] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:21.017109 17511 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.018226 17513 tablet_bootstrap.cc:492] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:21.020475 17511 ts_tablet_manager.cc:1434] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:21.023905 17513 tablet_bootstrap.cc:654] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.024884 17394 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:21.026520 17514 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.027418 17514 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:21.027705 17514 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:21.029820 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:21.030584 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:21.032169 17899 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:21.032598 17435 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:21.028537 17514 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.033787 17514 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:21.036192 17785 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:21.057907 17513 tablet_bootstrap.cc:492] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:21.058548 17513 ts_tablet_manager.cc:1403] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.020s
I20260709 13:17:21.061858 17513 raft_consensus.cc:359] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.062670 17513 raft_consensus.cc:385] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.063030 17513 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.063809 17513 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.068126 17513 ts_tablet_manager.cc:1434] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:17:21.106487 17513 tablet_bootstrap.cc:492] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:21.113134 17513 tablet_bootstrap.cc:654] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.123538 17513 tablet_bootstrap.cc:492] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:21.124186 17513 ts_tablet_manager.cc:1403] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.010s
W20260709 13:17:21.125103 17268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:21.126612 17513 raft_consensus.cc:359] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.127214 17513 raft_consensus.cc:385] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.127437 17513 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.127942 17513 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.129725 17513 ts_tablet_manager.cc:1434] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:21.131243 17513 tablet_bootstrap.cc:492] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:21.136482 17513 tablet_bootstrap.cc:654] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.142768 17513 tablet_bootstrap.cc:492] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:21.143214 17513 ts_tablet_manager.cc:1403] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:17:21.145548 17513 raft_consensus.cc:359] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.146078 17513 raft_consensus.cc:385] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.146324 17513 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.146860 17513 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.148240 17513 ts_tablet_manager.cc:1434] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:17:21.149173 17513 tablet_bootstrap.cc:492] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:21.154671 17513 tablet_bootstrap.cc:654] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.160043 17513 tablet_bootstrap.cc:492] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:21.160480 17513 ts_tablet_manager.cc:1403] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:17:21.162392 17513 raft_consensus.cc:359] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.162899 17513 raft_consensus.cc:385] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.163182 17513 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.163785 17513 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.165504 17513 ts_tablet_manager.cc:1434] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:17:21.166344 17513 tablet_bootstrap.cc:492] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:21.171058 17513 tablet_bootstrap.cc:654] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.177129 17513 tablet_bootstrap.cc:492] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:21.177006 17903 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.177655 17513 ts_tablet_manager.cc:1403] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 13:17:21.177591 17903 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.180231 17513 raft_consensus.cc:359] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.180913 17513 raft_consensus.cc:385] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.180800 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:21.181170 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:21.181305 17513 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.181831 17395 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 1: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:17:21.182003 17513 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.183179 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:21.183889 17899 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.184096 17513 ts_tablet_manager.cc:1434] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:21.185443 17513 tablet_bootstrap.cc:492] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb: Bootstrap starting.
I20260709 13:17:21.191057 17513 tablet_bootstrap.cc:654] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.194387 17464 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.197041 17899 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:21.183867 17903 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:21.198881 17514 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.199303 17514 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.199530 17766 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.200141 17766 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.200881 17514 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:21.201838 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:21.202292 17766 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:21.202675 17395 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:21.203588 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:21.204121 17463 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:21.205199 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:21.206308 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:21.206462 17766 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:21.206990 17463 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:21.207223 17766 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.207705 17766 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.206296 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:21.208451 17395 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 0.
I20260709 13:17:21.209857 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:21.217360 17514 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:21.217916 17514 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.218340 17514 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.219195 17766 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.220664 17766 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:21.227749 17320 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.230065 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:21.230698 17463 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.231938 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:21.232685 17395 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.237437 17463 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:21.237779 17901 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.238538 17468 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.245405 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:21.247638 17859 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:21.248160 17859 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:21.249010 17859 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.263549 17395 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:21.270442 17903 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:21.271001 17903 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.273296 17514 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.275945 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:21.276225 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:21.277187 17389 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.277211 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:21.279245 17434 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:21.279946 17899 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:21.281158 17903 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:21.288195 17514 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:21.289446 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:21.290392 17468 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.295600 17859 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.298806 17389 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:21.308957 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:21.310283 17514 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:21.311180 17468 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:21.317106 17514 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:21.318070 17514 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.321832 17766 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.324096 17513 tablet_bootstrap.cc:492] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb: No bootstrap required, opened a new log
I20260709 13:17:21.324633 17513 ts_tablet_manager.cc:1403] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb: Time spent bootstrapping tablet: real 0.139s	user 0.048s	sys 0.076s
I20260709 13:17:21.327595 17901 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.327788 17513 raft_consensus.cc:359] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.328395 17513 raft_consensus.cc:385] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.328677 17513 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.329418 17513 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.331817 17513 ts_tablet_manager.cc:1434] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:21.334151 17463 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.342003 17220 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:21.343875 17766 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.391788 17320 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:17:21.392230 17320 pending_rounds.cc:85] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 0
I20260709 13:17:21.392514 17320 pending_rounds.cc:107] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:17:21.392832 17320 raft_consensus.cc:2889] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.407109 17766 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.416193 17785 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:21.473640 17937 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.075s	user 0.004s	sys 0.000s
I20260709 13:17:21.476653 17395 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:21.479159 17220 catalog_manager.cc:5697] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:21.485733 17466 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.486320 17468 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.488766 17899 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:21.548655 17944 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.052s	user 0.010s	sys 0.005s
W20260709 13:17:21.592887 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 95951.5us
I20260709 13:17:21.599083 17785 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:21.599754 17785 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.602684 17785 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:21.605909 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:21.612942 17903 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:21.613507 17903 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:21.613766 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:21.616705 17903 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:21.619243 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:21.622814 17434 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:21.624089 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:21.625385 17785 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:21.629789 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:21.634968 17903 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:21.704339 17948 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:21.719667 17947 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:21.741411 17947 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:21.752462 17766 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:22.255108 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:22.291236 17953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:22.291369 17954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:22.292325 17956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:22.294688 16192 server_base.cc:1061] running on GCE node
I20260709 13:17:22.296609 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:22.296887 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:22.297101 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603042297081 us; error 0 us; skew 500 ppm
I20260709 13:17:22.297945 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:22.302178 16192 webserver.cc:533] Webserver started at http://127.15.208.4:35019/ using document root <none> and password file <none>
I20260709 13:17:22.302708 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:22.302987 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:22.303269 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:22.304540 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-3-root/instance:
uuid: "3747096bb5074ea2bf86037fd17c1160"
format_stamp: "Formatted at 2026-07-09 13:17:22 on dist-test-slave-w3b1"
I20260709 13:17:22.317871 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:17:22.322640 17961 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.323429 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.001s
I20260709 13:17:22.323781 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-3-root
uuid: "3747096bb5074ea2bf86037fd17c1160"
format_stamp: "Formatted at 2026-07-09 13:17:22 on dist-test-slave-w3b1"
I20260709 13:17:22.324056 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:22.349151 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:22.350581 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:22.352064 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:22.354533 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:22.354871 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.355268 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:22.355541 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.430794 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.4:34493
I20260709 13:17:22.430887 18023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.4:34493 every 8 connection(s)
I20260709 13:17:22.438265 16192 auto_leader_rebalancer-test.cc:384] add a tserver: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:22.474756 18024 heartbeater.cc:344] Connected to a master server at 127.15.208.62:46299
I20260709 13:17:22.475220 18024 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:22.476284 18024 heartbeater.cc:507] Master 127.15.208.62:46299 requested a full tablet report, sending...
I20260709 13:17:22.478780 17217 ts_manager.cc:194] Registered new tserver with Master: 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:22.480906 17217 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50174
I20260709 13:17:23.279238 17317 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:23.289283 17466 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:23.292752 17395 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:23.293254 17767 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.295646 18030 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:23.321601 18030 raft_consensus.cc:2955] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
W20260709 13:17:23.324077 17285 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96336e4c5eb64d4d967c671c9a221e69. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:23.325124 17395 raft_consensus.cc:2955] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.329113 17467 raft_consensus.cc:2955] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.349848 17217 catalog_manager.cc:5697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.360992 17395 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:23.373812 17467 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:23.374243 17319 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:23.376703 17901 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.378314 17900 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.391638 17901 raft_consensus.cc:2955] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.393759 17467 raft_consensus.cc:2955] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
W20260709 13:17:23.401626 17360 consensus_peers.cc:597] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96090377e5474346a1e4fdadd3c4c7ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:23.405032 17319 raft_consensus.cc:2955] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.413843 17218 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.454460 17467 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:23.466269 17395 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:23.468081 18029 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:23.468773 17319 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:23.470312 18029 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.484182 18024 heartbeater.cc:499] Master 127.15.208.62:46299 was elected leader, sending a full tablet report...
W20260709 13:17:23.497191 17434 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e42c2b9c0d646f1a18c2f8ea4f1a259. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:23.499588 17899 raft_consensus.cc:2955] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.501107 17317 raft_consensus.cc:2955] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.506686 17395 raft_consensus.cc:2955] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.517674 17389 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:23.522475 17217 catalog_manager.cc:5697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
W20260709 13:17:23.547446 17360 consensus_peers.cc:597] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b59d252a868a4ba8bc72588a2ae450b2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:23.549937 17317 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:23.551462 18049 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.555728 17467 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:23.559259 18048 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.578502 18049 raft_consensus.cc:2955] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.581840 17319 raft_consensus.cc:2955] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.585018 17467 raft_consensus.cc:2955] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.611095 17218 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:23.686812 18062 ts_tablet_manager.cc:933] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:23.690526 18062 tablet_copy_client.cc:323] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:23.711388 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet 96336e4c5eb64d4d967c671c9a221e69 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:23.711961 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet 96336e4c5eb64d4d967c671c9a221e69 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-96336e4c5eb64d4d967c671c9a221e69
I20260709 13:17:23.718592 17332 tablet_copy_source_session.cc:215] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:23.730420 18062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96336e4c5eb64d4d967c671c9a221e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.750885 18062 tablet_copy_client.cc:806] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:23.751664 18062 tablet_copy_client.cc:670] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:23.756474 18062 tablet_copy_client.cc:538] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:23.764289 18062 tablet_bootstrap.cc:492] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:23.782958 18062 tablet_bootstrap.cc:492] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.783969 18062 tablet_bootstrap.cc:492] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:23.791128 18062 ts_tablet_manager.cc:1403] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.009s
I20260709 13:17:23.794230 18062 raft_consensus.cc:359] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:23.795101 18062 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:23.795755 18062 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:23.802809 18066 ts_tablet_manager.cc:933] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:23.810036 18062 ts_tablet_manager.cc:1434] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.009s
I20260709 13:17:23.811187 18066 tablet_copy_client.cc:323] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:17:23.815565 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-96336e4c5eb64d4d967c671c9a221e69 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:23.816174 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-96336e4c5eb64d4d967c671c9a221e69 on tablet 96336e4c5eb64d4d967c671c9a221e69 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:23.832625 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet 96090377e5474346a1e4fdadd3c4c7ab from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:17:23.833293 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet 96090377e5474346a1e4fdadd3c4c7ab from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-96090377e5474346a1e4fdadd3c4c7ab
I20260709 13:17:23.839989 17407 tablet_copy_source_session.cc:215] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:23.846256 18066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96090377e5474346a1e4fdadd3c4c7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.862146 18062 ts_tablet_manager.cc:933] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:23.863787 18066 tablet_copy_client.cc:806] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:23.863787 18062 tablet_copy_client.cc:323] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:17:23.864529 18066 tablet_copy_client.cc:670] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:23.870004 18066 tablet_copy_client.cc:538] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:23.877405 17481 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:17:23.878073 17481 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-4e42c2b9c0d646f1a18c2f8ea4f1a259
I20260709 13:17:23.880647 18066 tablet_bootstrap.cc:492] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:23.886806 17481 tablet_copy_source_session.cc:215] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:23.890453 18062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.905931 18062 tablet_copy_client.cc:806] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:23.906508 18062 tablet_copy_client.cc:670] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:23.909154 18066 tablet_bootstrap.cc:492] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.909988 18062 tablet_copy_client.cc:538] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:23.910097 18066 tablet_bootstrap.cc:492] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:23.910838 18066 ts_tablet_manager.cc:1403] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.009s
I20260709 13:17:23.913825 18066 raft_consensus.cc:359] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:23.914672 18066 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:23.915292 18066 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:23.918761 18062 tablet_bootstrap.cc:492] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:23.923033 18066 ts_tablet_manager.cc:1434] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:17:23.950912 17407 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-96090377e5474346a1e4fdadd3c4c7ab received from {username='slave'} at 127.0.0.1:59472
I20260709 13:17:23.951486 17407 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-96090377e5474346a1e4fdadd3c4c7ab on tablet 96090377e5474346a1e4fdadd3c4c7ab with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:23.963963 18062 tablet_bootstrap.cc:492] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.965233 18062 tablet_bootstrap.cc:492] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:23.965893 18062 ts_tablet_manager.cc:1403] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.012s
I20260709 13:17:23.968779 18062 raft_consensus.cc:359] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:23.970043 18062 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:23.971110 18062 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:23.973781 18062 ts_tablet_manager.cc:1434] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:23.975589 17481 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-4e42c2b9c0d646f1a18c2f8ea4f1a259 received from {username='slave'} at 127.0.0.1:59988
I20260709 13:17:23.976001 17481 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-4e42c2b9c0d646f1a18c2f8ea4f1a259 on tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:24.134989 18062 ts_tablet_manager.cc:933] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:24.136631 18062 tablet_copy_client.cc:323] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:17:24.138545 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet b59d252a868a4ba8bc72588a2ae450b2 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:17:24.139166 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet b59d252a868a4ba8bc72588a2ae450b2 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-b59d252a868a4ba8bc72588a2ae450b2
I20260709 13:17:24.147307 17407 tablet_copy_source_session.cc:215] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:24.150643 18062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b59d252a868a4ba8bc72588a2ae450b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.167304 18062 tablet_copy_client.cc:806] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:24.167899 18062 tablet_copy_client.cc:670] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:24.171571 18062 tablet_copy_client.cc:538] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:24.177199 18062 tablet_bootstrap.cc:492] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:24.192402 18062 tablet_bootstrap.cc:492] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:24.193248 18062 tablet_bootstrap.cc:492] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:24.193836 18062 ts_tablet_manager.cc:1403] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:17:24.195771 18062 raft_consensus.cc:359] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:24.196475 18062 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:24.196988 18062 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:24.203377 18062 ts_tablet_manager.cc:1434] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:24.205509 17407 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-b59d252a868a4ba8bc72588a2ae450b2 received from {username='slave'} at 127.0.0.1:59472
I20260709 13:17:24.205957 17407 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-b59d252a868a4ba8bc72588a2ae450b2 on tablet b59d252a868a4ba8bc72588a2ae450b2 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:24.247134 17999 raft_consensus.cc:1217] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:24.355752 17999 raft_consensus.cc:1217] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:24.466641 17999 raft_consensus.cc:1217] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:24.646260 17999 raft_consensus.cc:1217] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:24.706806 18071 raft_consensus.cc:1064] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:24.709610 18071 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:24.726482 17999 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.726996 17468 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.728955 17767 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.733130 17392 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.735134 18030 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.739957 17767 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.746874 18049 raft_consensus.cc:1064] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:24.749672 18049 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:24.776700 17466 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.776778 17999 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.778828 18048 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.780350 18075 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:24.791628 17317 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.804509 18049 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:24.806267 17767 raft_consensus.cc:2955] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.809172 17466 raft_consensus.cc:2955] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.814349 18048 raft_consensus.cc:2955] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.819155 17999 raft_consensus.cc:2955] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.833160 17220 catalog_manager.cc:5697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.838364 17392 raft_consensus.cc:2955] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.838225 17998 raft_consensus.cc:2955] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.856592 17466 raft_consensus.cc:2955] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.875608 17219 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.908324 17392 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:24.914870 17319 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:24.927752 17468 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.929716 18075 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:24.930341 17998 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.932433 18075 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:24.930606 17317 raft_consensus.cc:2955] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.941897 18087 raft_consensus.cc:2955] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.947700 17392 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.949285 17998 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.951320 18038 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.954880 18030 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.958819 17205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96090377e5474346a1e4fdadd3c4c7ab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:24.962817 17767 raft_consensus.cc:2955] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.964058 17998 raft_consensus.cc:2955] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.968518 17999 raft_consensus.cc:2955] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.973306 17392 raft_consensus.cc:2955] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:24.977166 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96336e4c5eb64d4d967c671c9a221e69 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:24.984220 17220 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.987733 17466 raft_consensus.cc:2955] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.015774 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet 96090377e5474346a1e4fdadd3c4c7ab with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:25.022284 17216 catalog_manager.cc:5697] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.031199 18092 tablet_replica.cc:333] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:25.032932 18092 raft_consensus.cc:2243] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:25.033738 18092 raft_consensus.cc:2272] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:25.036886 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet 96336e4c5eb64d4d967c671c9a221e69 with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:25.037933 18092 ts_tablet_manager.cc:1916] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:25.055563 18092 ts_tablet_manager.cc:1929] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:25.056073 18092 log.cc:1199] T 96090377e5474346a1e4fdadd3c4c7ab P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/96090377e5474346a1e4fdadd3c4c7ab
I20260709 13:17:25.057811 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet 96090377e5474346a1e4fdadd3c4c7ab (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:25.065410 18093 tablet_replica.cc:333] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:25.066687 18093 raft_consensus.cc:2243] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:25.067453 18093 raft_consensus.cc:2272] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:25.078516 18093 ts_tablet_manager.cc:1916] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:25.101887 18093 ts_tablet_manager.cc:1929] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:25.102311 18093 log.cc:1199] T 96336e4c5eb64d4d967c671c9a221e69 P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/96336e4c5eb64d4d967c671c9a221e69
I20260709 13:17:25.107342 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet 96336e4c5eb64d4d967c671c9a221e69 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:25.111328 18058 raft_consensus.cc:1064] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:25.127332 18058 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:25.141115 17392 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:25.141253 17999 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:25.143066 18094 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:25.143528 17317 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:25.145116 18094 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:25.146076 18095 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:25.177680 18094 raft_consensus.cc:2955] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.179605 17395 raft_consensus.cc:2955] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.204509 17218 catalog_manager.cc:5697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.204701 17999 raft_consensus.cc:2955] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.209674 17317 raft_consensus.cc:2955] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.227993 18087 raft_consensus.cc:1064] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:25.230461 18087 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:25.242015 17999 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:25.244293 17468 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:25.244379 17317 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:25.245249 18085 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:25.246487 18075 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:25.258359 18075 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:25.256683 17468 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:25.274694 17316 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:25.276008 18058 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:25.279949 18087 raft_consensus.cc:2955] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.284221 17466 raft_consensus.cc:2955] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.288719 17999 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:25.290576 18094 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:25.292625 18094 raft_consensus.cc:2955] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.300797 17320 raft_consensus.cc:2955] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.305397 17316 raft_consensus.cc:2955] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.317095 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:25.324270 17998 raft_consensus.cc:2955] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.338230 17999 raft_consensus.cc:2955] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.339676 17219 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.340638 17217 catalog_manager.cc:5697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.362222 17389 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:25.367748 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259 with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:25.373786 17466 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:25.375262 18087 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:25.384097 18075 raft_consensus.cc:2955] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.387988 17467 raft_consensus.cc:2955] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.390555 17999 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:25.378674 18105 tablet_replica.cc:333] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:25.392238 18085 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:25.405354 17205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b59d252a868a4ba8bc72588a2ae450b2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:25.413830 18105 raft_consensus.cc:2243] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:25.414645 18105 raft_consensus.cc:2272] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:25.416201 17216 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.418486 17999 raft_consensus.cc:2955] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:25.421200 18105 ts_tablet_manager.cc:1916] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:25.428828 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet b59d252a868a4ba8bc72588a2ae450b2 with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:25.429916 18092 tablet_replica.cc:333] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:25.430959 18092 raft_consensus.cc:2243] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:25.431619 18092 raft_consensus.cc:2272] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:25.438647 18092 ts_tablet_manager.cc:1916] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:25.447640 18105 ts_tablet_manager.cc:1929] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:25.448138 18105 log.cc:1199] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/4e42c2b9c0d646f1a18c2f8ea4f1a259
I20260709 13:17:25.457504 18092 ts_tablet_manager.cc:1929] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:25.458051 18092 log.cc:1199] T b59d252a868a4ba8bc72588a2ae450b2 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/b59d252a868a4ba8bc72588a2ae450b2
I20260709 13:17:25.488615 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet 4e42c2b9c0d646f1a18c2f8ea4f1a259 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:25.528113 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet b59d252a868a4ba8bc72588a2ae450b2 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:26.522289 17317 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:17:26.537072 17285 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5d6271327d4457ea6b522d9188f4f84. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:26.537617 17394 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:26.539641 17466 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:26.539696 18109 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:26.541774 18030 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:26.550253 18030 raft_consensus.cc:2955] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.553000 17394 raft_consensus.cc:2955] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.554647 17467 raft_consensus.cc:2955] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.569754 17317 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:26.575786 17219 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.585423 17467 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:26.587538 17395 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:26.588932 18038 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:26.592546 17285 consensus_peers.cc:597] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6758d139882843e5bddc827c260b81a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:26.593030 18030 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:26.603363 18117 raft_consensus.cc:2955] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.604782 17394 raft_consensus.cc:2955] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.624298 17467 raft_consensus.cc:2955] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.626637 17466 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:26.637197 17216 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
W20260709 13:17:26.643213 17434 consensus_peers.cc:597] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58b200038e814f72ae96c61b0e1dd286. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:26.644722 17394 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:26.644722 17317 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:26.647042 18094 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:26.648013 18029 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:26.659247 18029 raft_consensus.cc:2955] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.677392 17317 raft_consensus.cc:2955] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.678984 17316 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:26.686290 17392 raft_consensus.cc:2955] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.688001 17217 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.719003 17466 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:26.721447 18038 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:26.724373 17285 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 452dfe9db12345ae88b3dbbd163f480e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:26.727936 17392 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:26.729367 18038 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:26.744469 18117 raft_consensus.cc:2955] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.745970 17392 raft_consensus.cc:2955] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.755718 17466 raft_consensus.cc:2955] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.771906 17219 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:26.973217 18131 ts_tablet_manager.cc:933] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:26.981489 18131 tablet_copy_client.cc:323] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:26.983547 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet a5d6271327d4457ea6b522d9188f4f84 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:26.984303 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet a5d6271327d4457ea6b522d9188f4f84 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-a5d6271327d4457ea6b522d9188f4f84
I20260709 13:17:26.993795 17332 tablet_copy_source_session.cc:215] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:27.000087 18131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d6271327d4457ea6b522d9188f4f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:27.044512 18131 tablet_copy_client.cc:806] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:27.045266 18131 tablet_copy_client.cc:670] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:27.049824 18131 tablet_copy_client.cc:538] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:27.057858 18131 tablet_bootstrap.cc:492] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:27.076958 18131 tablet_bootstrap.cc:492] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:27.078117 18131 tablet_bootstrap.cc:492] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:27.078912 18131 ts_tablet_manager.cc:1403] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:17:27.081874 18131 raft_consensus.cc:359] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:27.082530 18131 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:27.083177 18131 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:27.086580 18131 ts_tablet_manager.cc:1434] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:17:27.088667 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-a5d6271327d4457ea6b522d9188f4f84 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:27.089164 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-a5d6271327d4457ea6b522d9188f4f84 on tablet a5d6271327d4457ea6b522d9188f4f84 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:27.132212 18131 ts_tablet_manager.cc:933] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:27.134285 18131 tablet_copy_client.cc:323] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:17:27.136319 17481 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet 58b200038e814f72ae96c61b0e1dd286 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:17:27.136930 17481 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet 58b200038e814f72ae96c61b0e1dd286 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-58b200038e814f72ae96c61b0e1dd286
I20260709 13:17:27.145323 17481 tablet_copy_source_session.cc:215] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:27.150698 18137 ts_tablet_manager.cc:933] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:27.153124 18137 tablet_copy_client.cc:323] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:27.153298 18131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b200038e814f72ae96c61b0e1dd286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:27.155045 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet 452dfe9db12345ae88b3dbbd163f480e from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:27.155642 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet 452dfe9db12345ae88b3dbbd163f480e from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-452dfe9db12345ae88b3dbbd163f480e
I20260709 13:17:27.163928 17332 tablet_copy_source_session.cc:215] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:27.168545 18137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452dfe9db12345ae88b3dbbd163f480e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:27.195269 18139 ts_tablet_manager.cc:933] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:27.196569 18131 tablet_copy_client.cc:806] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:27.197165 18131 tablet_copy_client.cc:670] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:27.198885 18139 tablet_copy_client.cc:323] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:27.201313 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet 6758d139882843e5bddc827c260b81a9 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:27.201874 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet 6758d139882843e5bddc827c260b81a9 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-6758d139882843e5bddc827c260b81a9
I20260709 13:17:27.201915 18131 tablet_copy_client.cc:538] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:27.211412 18131 tablet_bootstrap.cc:492] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:27.221800 17332 tablet_copy_source_session.cc:215] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:27.223626 18137 tablet_copy_client.cc:806] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:27.224277 18137 tablet_copy_client.cc:670] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:27.225458 18139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6758d139882843e5bddc827c260b81a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:27.228505 18137 tablet_copy_client.cc:538] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:27.238183 18137 tablet_bootstrap.cc:492] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:27.250031 18139 tablet_copy_client.cc:806] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:27.250656 18139 tablet_copy_client.cc:670] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:27.252487 18131 tablet_bootstrap.cc:492] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:27.254213 18131 tablet_bootstrap.cc:492] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:27.254263 18139 tablet_copy_client.cc:538] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:27.255410 18131 ts_tablet_manager.cc:1403] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.004s
I20260709 13:17:27.262108 18131 raft_consensus.cc:359] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:27.264896 18131 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:27.265856 18131 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:27.268361 18139 tablet_bootstrap.cc:492] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:27.268922 18131 ts_tablet_manager.cc:1434] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:27.271100 17481 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-58b200038e814f72ae96c61b0e1dd286 received from {username='slave'} at 127.0.0.1:59988
I20260709 13:17:27.271553 17481 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-58b200038e814f72ae96c61b0e1dd286 on tablet 58b200038e814f72ae96c61b0e1dd286 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:27.276355 18137 tablet_bootstrap.cc:492] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:27.283605 18137 tablet_bootstrap.cc:492] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:27.284319 18137 ts_tablet_manager.cc:1403] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.004s
I20260709 13:17:27.287298 18137 raft_consensus.cc:359] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:27.288447 18137 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:27.289418 18137 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:27.299067 18137 ts_tablet_manager.cc:1434] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:17:27.309100 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-452dfe9db12345ae88b3dbbd163f480e received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:27.309557 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-452dfe9db12345ae88b3dbbd163f480e on tablet 452dfe9db12345ae88b3dbbd163f480e with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:27.320263 18139 tablet_bootstrap.cc:492] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:27.323143 18139 tablet_bootstrap.cc:492] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:27.323844 18139 ts_tablet_manager.cc:1403] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.009s
I20260709 13:17:27.330669 18139 raft_consensus.cc:359] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:27.331539 18139 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:27.332422 18139 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:27.337280 18139 ts_tablet_manager.cc:1434] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:17:27.338843 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-6758d139882843e5bddc827c260b81a9 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:27.339242 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-6758d139882843e5bddc827c260b81a9 on tablet 6758d139882843e5bddc827c260b81a9 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:27.483520 17998 raft_consensus.cc:1217] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:27.535281 17998 raft_consensus.cc:1217] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:27.596149 17998 raft_consensus.cc:1217] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:27.767390 17998 raft_consensus.cc:1217] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:27.913259 18038 raft_consensus.cc:1064] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:27.915585 18038 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:27.922914 17466 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.924122 18113 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.924381 17998 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.925968 18113 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.926879 17394 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.943763 18117 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:27.943802 18030 raft_consensus.cc:2955] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:27.947605 17466 raft_consensus.cc:2955] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:27.956933 17998 raft_consensus.cc:2955] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:27.968237 17217 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.982583 17394 raft_consensus.cc:2955] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:17:28.048300 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 63206.9us
I20260709 13:17:28.071898 18030 raft_consensus.cc:1064] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:28.076557 18030 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:28.086728 17466 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.088145 18113 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:28.093155 17998 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.095216 18113 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:28.115355 18029 raft_consensus.cc:1064] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:28.119534 18029 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:28.135424 17317 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:28.142568 17394 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.185976 17468 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:28.187626 18117 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.187914 17999 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:28.190553 18117 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.195569 18038 raft_consensus.cc:2955] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.202968 17468 raft_consensus.cc:2955] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.210350 18030 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:28.208719 17999 raft_consensus.cc:2955] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.235446 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5d6271327d4457ea6b522d9188f4f84 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:28.240803 17219 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.253234 18113 raft_consensus.cc:1064] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:28.255026 18113 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:28.279989 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet a5d6271327d4457ea6b522d9188f4f84 with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:28.301913 17999 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.306102 18127 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:28.332404 17392 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.334990 17317 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.349668 18161 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:28.353051 18029 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:28.388084 18162 tablet_replica.cc:333] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:28.389362 18162 raft_consensus.cc:2243] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.406872 18038 raft_consensus.cc:2955] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.413800 17466 raft_consensus.cc:2955] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.421307 17463 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.390228 18162 raft_consensus.cc:2272] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.441877 18162 ts_tablet_manager.cc:1916] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:28.450047 17998 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.452800 18030 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:28.455117 17998 raft_consensus.cc:2955] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.470799 18113 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:28.473217 17392 raft_consensus.cc:2955] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.474699 18029 raft_consensus.cc:2955] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.505542 17997 raft_consensus.cc:2955] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.508957 17217 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.516081 17219 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.540825 17392 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.542871 18117 raft_consensus.cc:2955] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.546499 17392 raft_consensus.cc:2955] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.547148 17999 raft_consensus.cc:2955] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.566337 18162 ts_tablet_manager.cc:1929] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:28.566844 18162 log.cc:1199] T a5d6271327d4457ea6b522d9188f4f84 P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/a5d6271327d4457ea6b522d9188f4f84
I20260709 13:17:28.572135 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet a5d6271327d4457ea6b522d9188f4f84 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:28.585456 17466 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:28.590456 17997 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:28.590072 17317 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:28.592134 18029 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.600064 17463 raft_consensus.cc:2955] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.603250 18166 raft_consensus.cc:2955] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.614948 17997 raft_consensus.cc:2955] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.616226 17999 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:28.618305 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58b200038e814f72ae96c61b0e1dd286 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:28.618572 18171 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:28.621101 18174 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:28.629114 18171 raft_consensus.cc:2955] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.629729 17997 raft_consensus.cc:2955] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.639241 17394 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:28.639262 17217 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:28.650559 18161 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.652180 17394 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:28.658694 17394 raft_consensus.cc:2955] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.662024 17216 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.667582 18030 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.674366 17389 raft_consensus.cc:2955] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.700227 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet 58b200038e814f72ae96c61b0e1dd286 with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:28.701102 17216 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:17:28.710876 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 73062.8us
W20260709 13:17:28.711207 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 75220.1us
W20260709 13:17:28.721751 17206 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 58b200038e814f72ae96c61b0e1dd286 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:17:28.724611 18178 tablet_replica.cc:333] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:28.728108 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet 6758d139882843e5bddc827c260b81a9 with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:28.731791 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6758d139882843e5bddc827c260b81a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:28.733953 18178 raft_consensus.cc:2243] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.734521 18178 pending_rounds.cc:70] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: Trying to abort 1 pending ops.
I20260709 13:17:28.734809 18178 pending_rounds.cc:77] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305638085086961664 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "58b200038e814f72ae96c61b0e1dd286" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } } }
I20260709 13:17:28.736284 18178 raft_consensus.cc:2917] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:17:28.736738 18178 raft_consensus.cc:2889] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:17:28.737242 18178 raft_consensus.cc:2272] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.725433 17392 raft_consensus.cc:2955] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:28.766284 18179 tablet_replica.cc:333] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:28.769591 18178 ts_tablet_manager.cc:1916] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:28.802872 18179 raft_consensus.cc:2243] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.803871 18179 raft_consensus.cc:2272] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.802963 18178 ts_tablet_manager.cc:1929] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:28.804769 18178 log.cc:1199] T 58b200038e814f72ae96c61b0e1dd286 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/58b200038e814f72ae96c61b0e1dd286
I20260709 13:17:28.810778 18179 ts_tablet_manager.cc:1916] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:28.828456 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet 58b200038e814f72ae96c61b0e1dd286 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:28.829798 18179 ts_tablet_manager.cc:1929] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:28.830310 18179 log.cc:1199] T 6758d139882843e5bddc827c260b81a9 P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/6758d139882843e5bddc827c260b81a9
I20260709 13:17:28.832108 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet 6758d139882843e5bddc827c260b81a9 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:29.120189 17322 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:29.126106 17997 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:29.126564 17392 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:29.127619 18030 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:29.128437 18173 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:29.134635 18173 raft_consensus.cc:2955] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:29.138605 17997 raft_consensus.cc:2955] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:29.146731 17392 raft_consensus.cc:2955] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:29.171798 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 452dfe9db12345ae88b3dbbd163f480e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:29.171939 17216 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:29.186954 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet 452dfe9db12345ae88b3dbbd163f480e with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:29.187938 18179 tablet_replica.cc:333] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:29.189105 18179 raft_consensus.cc:2243] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:29.189906 18179 raft_consensus.cc:2272] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:29.196681 18179 ts_tablet_manager.cc:1916] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:29.217214 18179 ts_tablet_manager.cc:1929] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:29.217724 18179 log.cc:1199] T 452dfe9db12345ae88b3dbbd163f480e P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/452dfe9db12345ae88b3dbbd163f480e
I20260709 13:17:29.219285 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet 452dfe9db12345ae88b3dbbd163f480e (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:30.270475 17317 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:17:30.279830 17285 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 060ed925d51948b7b415b005543f7a9f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.280997 17389 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:30.282389 17466 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:30.282687 18030 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.283687 18173 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.291713 18181 raft_consensus.cc:2955] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.293399 17389 raft_consensus.cc:2955] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.293896 17466 raft_consensus.cc:2955] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.308032 17317 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:30.316813 17217 catalog_manager.cc:5697] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
W20260709 13:17:30.319278 17285 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2566406852d04693963f9fa3f001ff8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.323916 17389 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:30.325700 18173 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.327587 17466 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:30.329170 18182 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.340128 18030 raft_consensus.cc:2955] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.344040 17463 raft_consensus.cc:2955] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.344337 17394 raft_consensus.cc:2955] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.363299 17219 catalog_manager.cc:5697] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.364526 17317 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:17:30.372490 17285 consensus_peers.cc:597] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4df43493289c4586a02bce2e14a38202. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.374454 17394 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:30.374714 17466 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:30.376169 18173 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.378328 18173 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.396227 18181 raft_consensus.cc:2955] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.397862 17466 raft_consensus.cc:2955] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.411152 17394 raft_consensus.cc:2955] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.415635 17389 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:30.420382 17217 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:30.425132 17360 consensus_peers.cc:597] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ecbe40a17fe40b69ac2ecffb5e51786. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.426291 17317 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:30.426419 17466 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:30.428158 18175 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.429121 18180 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.444586 18175 raft_consensus.cc:2955] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.448330 17466 raft_consensus.cc:2955] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.451705 17317 raft_consensus.cc:2955] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.468037 17217 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:30.780508 18200 ts_tablet_manager.cc:933] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:30.782676 18200 tablet_copy_client.cc:323] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:30.784622 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet 4df43493289c4586a02bce2e14a38202 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:30.785219 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet 4df43493289c4586a02bce2e14a38202 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-4df43493289c4586a02bce2e14a38202
I20260709 13:17:30.796679 18202 ts_tablet_manager.cc:933] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:30.799721 17332 tablet_copy_source_session.cc:215] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:30.801921 18202 tablet_copy_client.cc:323] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:30.806727 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet 2566406852d04693963f9fa3f001ff8c from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:30.807276 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet 2566406852d04693963f9fa3f001ff8c from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-2566406852d04693963f9fa3f001ff8c
I20260709 13:17:30.809850 18200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df43493289c4586a02bce2e14a38202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.819355 17332 tablet_copy_source_session.cc:215] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:30.829609 18202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2566406852d04693963f9fa3f001ff8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.834528 18200 tablet_copy_client.cc:806] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:30.835148 18200 tablet_copy_client.cc:670] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:30.842917 18200 tablet_copy_client.cc:538] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:30.847301 18202 tablet_copy_client.cc:806] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:30.847934 18202 tablet_copy_client.cc:670] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:30.852147 18204 ts_tablet_manager.cc:933] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:30.855800 18204 tablet_copy_client.cc:323] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:30.856159 18202 tablet_copy_client.cc:538] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:30.857699 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet 060ed925d51948b7b415b005543f7a9f from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:30.858296 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet 060ed925d51948b7b415b005543f7a9f from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-060ed925d51948b7b415b005543f7a9f
I20260709 13:17:30.865969 17332 tablet_copy_source_session.cc:215] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:30.869102 18204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060ed925d51948b7b415b005543f7a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:30.885536 18200 tablet_bootstrap.cc:492] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:30.896412 18202 tablet_bootstrap.cc:492] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:30.899835 18204 tablet_copy_client.cc:806] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:30.900489 18204 tablet_copy_client.cc:670] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:30.904748 18204 tablet_copy_client.cc:538] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:30.916251 18204 tablet_bootstrap.cc:492] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:30.928105 18200 tablet_bootstrap.cc:492] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:30.929139 18200 tablet_bootstrap.cc:492] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:30.929883 18200 ts_tablet_manager.cc:1403] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.009s
I20260709 13:17:30.932983 18200 raft_consensus.cc:359] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:30.933831 18200 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:30.934484 18200 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:30.940439 18202 tablet_bootstrap.cc:492] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:30.953352 18200 ts_tablet_manager.cc:1434] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.023s	user 0.013s	sys 0.009s
I20260709 13:17:30.957226 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-4df43493289c4586a02bce2e14a38202 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:30.957648 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-4df43493289c4586a02bce2e14a38202 on tablet 4df43493289c4586a02bce2e14a38202 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:30.958482 18202 tablet_bootstrap.cc:492] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:30.959667 18202 ts_tablet_manager.cc:1403] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.011s
I20260709 13:17:30.964689 18204 tablet_bootstrap.cc:492] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:30.965687 18204 tablet_bootstrap.cc:492] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:30.966408 18204 ts_tablet_manager.cc:1403] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.011s
I20260709 13:17:30.966974 18202 raft_consensus.cc:359] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:30.967854 18202 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:30.968381 18202 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:30.969569 18204 raft_consensus.cc:359] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:30.970399 18204 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:30.970477 18202 ts_tablet_manager.cc:1434] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:17:30.975675 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-2566406852d04693963f9fa3f001ff8c received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:30.976141 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-2566406852d04693963f9fa3f001ff8c on tablet 2566406852d04693963f9fa3f001ff8c with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:30.971012 18204 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:30.985806 18204 ts_tablet_manager.cc:1434] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:17:30.987576 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-060ed925d51948b7b415b005543f7a9f received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:30.988103 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-060ed925d51948b7b415b005543f7a9f on tablet 060ed925d51948b7b415b005543f7a9f with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:31.041317 18204 ts_tablet_manager.cc:933] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:31.044751 18204 tablet_copy_client.cc:323] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:17:31.046769 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet 9ecbe40a17fe40b69ac2ecffb5e51786 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:17:31.047333 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet 9ecbe40a17fe40b69ac2ecffb5e51786 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-9ecbe40a17fe40b69ac2ecffb5e51786
I20260709 13:17:31.055107 17407 tablet_copy_source_session.cc:215] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:31.059312 18204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecbe40a17fe40b69ac2ecffb5e51786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:31.077998 18204 tablet_copy_client.cc:806] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:31.078692 18204 tablet_copy_client.cc:670] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:31.082955 18204 tablet_copy_client.cc:538] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:31.092643 18204 tablet_bootstrap.cc:492] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:31.114382 18204 tablet_bootstrap.cc:492] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:31.116112 18204 tablet_bootstrap.cc:492] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:31.116775 18204 ts_tablet_manager.cc:1403] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.001s
I20260709 13:17:31.119374 18204 raft_consensus.cc:359] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:31.120107 18204 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:31.120711 18204 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:31.122900 18204 ts_tablet_manager.cc:1434] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:31.125418 17407 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-9ecbe40a17fe40b69ac2ecffb5e51786 received from {username='slave'} at 127.0.0.1:59472
I20260709 13:17:31.125917 17407 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-9ecbe40a17fe40b69ac2ecffb5e51786 on tablet 9ecbe40a17fe40b69ac2ecffb5e51786 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:31.213733 17997 raft_consensus.cc:1217] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:31.265723 17997 raft_consensus.cc:1217] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:31.318475 17997 raft_consensus.cc:1217] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:31.579180 17997 raft_consensus.cc:1217] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:31.765450 18182 raft_consensus.cc:1064] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:31.767480 18182 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:31.774055 17463 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.777138 17394 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.778591 18030 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.780386 18181 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.795171 17997 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.795672 18173 raft_consensus.cc:1064] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:31.798256 18173 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:31.799954 18182 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.810539 18030 raft_consensus.cc:1064] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:31.817381 17467 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.818173 17999 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.815546 18030 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:31.820591 17389 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:31.821417 18173 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.829842 18182 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:17:31.878628 18181 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:31.913075 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 73240.7us
I20260709 13:17:32.007483 17466 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:32.014096 17396 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:32.043172 18030 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:32.029640 18182 raft_consensus.cc:2955] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.032389 17997 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:32.036243 17395 raft_consensus.cc:2955] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.022951 18219 raft_consensus.cc:2955] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.107455 17219 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.116657 17397 raft_consensus.cc:2955] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.121644 18181 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:32.121608 17467 raft_consensus.cc:2955] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.129544 17999 raft_consensus.cc:2955] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:17:32.133597 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 57411.3us
I20260709 13:17:32.133826 17997 raft_consensus.cc:2955] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.146332 18223 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:32.300320 17468 raft_consensus.cc:2955] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.372241 18216 raft_consensus.cc:2955] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.388542 17464 raft_consensus.cc:2955] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.390398 17998 raft_consensus.cc:2955] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.391337 17217 catalog_manager.cc:5697] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.419132 18213 raft_consensus.cc:1064] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:32.422856 18213 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:32.424551 17389 raft_consensus.cc:2955] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.473897 17219 catalog_manager.cc:5697] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.491791 17315 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:32.495635 17321 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:32.507920 17998 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.508102 17389 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.509603 18224 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:32.510565 18239 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:32.513427 17467 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.513603 17998 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.514926 17999 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:32.515349 18216 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:32.517086 18223 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:32.521871 17321 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:32.522392 17471 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:32.522897 18175 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:32.525254 18223 raft_consensus.cc:2955] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.527244 18240 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:32.527019 17467 raft_consensus.cc:2955] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.547365 18175 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:32.538535 17999 raft_consensus.cc:2955] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.547982 18173 raft_consensus.cc:2955] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.586169 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4df43493289c4586a02bce2e14a38202 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:17:32.597656 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 63380.2us
I20260709 13:17:32.598543 17219 catalog_manager.cc:5697] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.611897 17321 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:32.623890 17389 raft_consensus.cc:2955] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.633262 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2566406852d04693963f9fa3f001ff8c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:32.660000 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet 2566406852d04693963f9fa3f001ff8c with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:32.660779 17217 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.663010 17998 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.697906 17998 raft_consensus.cc:2955] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.707787 18181 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:32.709165 18252 tablet_replica.cc:333] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:32.718915 18252 raft_consensus.cc:2243] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.719885 18252 raft_consensus.cc:2272] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.730861 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df43493289c4586a02bce2e14a38202 with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:32.742770 17315 raft_consensus.cc:2955] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.727312 18180 raft_consensus.cc:2955] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.753701 17997 raft_consensus.cc:2955] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.755386 18252 ts_tablet_manager.cc:1916] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:32.747684 18181 raft_consensus.cc:2955] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:17:32.795760 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 186802us
W20260709 13:17:32.806524 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 150551us
I20260709 13:17:32.817713 17998 raft_consensus.cc:2955] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.834061 17467 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.840299 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 060ed925d51948b7b415b005543f7a9f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:32.847138 18254 tablet_replica.cc:333] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:32.850044 18254 raft_consensus.cc:2243] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.829914 17466 raft_consensus.cc:2955] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.855952 18254 raft_consensus.cc:2272] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.856349 17217 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.860991 18254 ts_tablet_manager.cc:1916] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:32.880559 17389 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:32.882905 17217 catalog_manager.cc:5697] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.898530 18250 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:32.893054 18252 ts_tablet_manager.cc:1929] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:32.900007 18252 log.cc:1199] T 2566406852d04693963f9fa3f001ff8c P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/2566406852d04693963f9fa3f001ff8c
I20260709 13:17:32.901937 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet 2566406852d04693963f9fa3f001ff8c (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:32.904192 17998 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.905889 18240 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:32.909332 17466 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.913208 18213 raft_consensus.cc:2955] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.916569 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet 060ed925d51948b7b415b005543f7a9f with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:32.917364 17997 raft_consensus.cc:2955] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.919778 18252 tablet_replica.cc:333] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:32.921072 18252 raft_consensus.cc:2243] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.921790 18252 raft_consensus.cc:2272] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.925748 18252 ts_tablet_manager.cc:1916] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:32.933259 17205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ecbe40a17fe40b69ac2ecffb5e51786 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:32.928601 18180 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:17:32.944195 18252 ts_tablet_manager.cc:1929] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:32.944773 18252 log.cc:1199] T 060ed925d51948b7b415b005543f7a9f P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/060ed925d51948b7b415b005543f7a9f
I20260709 13:17:32.939975 17466 raft_consensus.cc:2955] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.946257 18254 ts_tablet_manager.cc:1929] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:32.946844 18254 log.cc:1199] T 4df43493289c4586a02bce2e14a38202 P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/4df43493289c4586a02bce2e14a38202
I20260709 13:17:32.947033 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet 060ed925d51948b7b415b005543f7a9f (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:32.949123 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet 4df43493289c4586a02bce2e14a38202 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:32.957486 17467 raft_consensus.cc:2955] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.960527 17219 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:32.976405 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ecbe40a17fe40b69ac2ecffb5e51786 with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:32.987248 18255 tablet_replica.cc:333] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:33.014952 18255 raft_consensus.cc:2243] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:33.015755 18255 raft_consensus.cc:2272] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:33.019568 18255 ts_tablet_manager.cc:1916] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:33.042834 18255 ts_tablet_manager.cc:1929] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:33.045172 18255 log.cc:1199] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/9ecbe40a17fe40b69ac2ecffb5e51786
I20260709 13:17:33.047350 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet 9ecbe40a17fe40b69ac2ecffb5e51786 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
W20260709 13:17:33.191087 17343 debug-util.cc:398] Leaking SignalData structure 0x7b08000cdc00 after lost signal to thread 16195
W20260709 13:17:33.192039 17343 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef160 after lost signal to thread 17254
W20260709 13:17:33.193269 17343 debug-util.cc:398] Leaking SignalData structure 0x7b080029dbe0 after lost signal to thread 17346
W20260709 13:17:33.194274 17343 debug-util.cc:398] Leaking SignalData structure 0x7b0800261dc0 after lost signal to thread 17421
W20260709 13:17:33.195580 17343 debug-util.cc:398] Leaking SignalData structure 0x7b08002854c0 after lost signal to thread 17495
W20260709 13:17:33.197075 17343 debug-util.cc:398] Leaking SignalData structure 0x7b08002cf520 after lost signal to thread 18023
I20260709 13:17:34.068095 17467 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:17:34.135520 17434 consensus_peers.cc:597] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c824a7378ba243ca96d57d97c47847c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:34.135780 17389 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:34.137761 18231 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.142432 17316 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:34.144445 18231 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.163877 18231 raft_consensus.cc:2955] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.178157 17316 raft_consensus.cc:2955] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.183943 17397 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:34.193008 17395 raft_consensus.cc:2955] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.188831 17219 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:34.209800 17360 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fc026cf7a3b43b3a05aca657efbaecd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:34.210470 17467 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:34.211221 17316 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:34.213615 18213 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.215754 18213 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.238005 18180 raft_consensus.cc:2955] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.241852 17316 raft_consensus.cc:2955] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.242183 17462 raft_consensus.cc:2955] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.264747 17316 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:34.273375 17467 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:34.274305 17217 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.275406 18260 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:34.276304 17285 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ed6b0a2fcf5476ab0f8dffeb3536922. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:34.278401 17395 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:34.282805 18260 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.317834 18224 raft_consensus.cc:2955] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.323388 17467 raft_consensus.cc:2955] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.337598 17389 raft_consensus.cc:2955] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.357091 17316 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:34.358294 17216 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.391842 17462 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:34.391906 17397 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:34.395785 17285 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd3f7b090266450da9f53ec675edc8f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:34.396961 18259 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.399345 18224 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.410758 18224 raft_consensus.cc:2955] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.412369 17462 raft_consensus.cc:2955] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.413775 17389 raft_consensus.cc:2955] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.433012 17219 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:34.556330 18279 ts_tablet_manager.cc:933] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:34.558439 18279 tablet_copy_client.cc:323] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:17:34.560293 17481 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet c824a7378ba243ca96d57d97c47847c9 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:17:34.560935 17481 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet c824a7378ba243ca96d57d97c47847c9 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-c824a7378ba243ca96d57d97c47847c9
I20260709 13:17:34.572706 17481 tablet_copy_source_session.cc:215] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:34.576387 18279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c824a7378ba243ca96d57d97c47847c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.593060 18279 tablet_copy_client.cc:806] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:34.593739 18279 tablet_copy_client.cc:670] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:34.598209 18279 tablet_copy_client.cc:538] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:34.612720 18279 tablet_bootstrap.cc:492] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:34.650483 18279 tablet_bootstrap.cc:492] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.652024 18279 tablet_bootstrap.cc:492] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:34.667672 18279 ts_tablet_manager.cc:1403] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.009s
I20260709 13:17:34.669018 18282 ts_tablet_manager.cc:933] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:34.672082 18279 raft_consensus.cc:359] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:34.675490 18279 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:34.677773 18279 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:34.684819 18282 tablet_copy_client.cc:323] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:17:34.686815 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet 5fc026cf7a3b43b3a05aca657efbaecd from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:17:34.687381 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet 5fc026cf7a3b43b3a05aca657efbaecd from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-5fc026cf7a3b43b3a05aca657efbaecd
I20260709 13:17:34.689055 18279 ts_tablet_manager.cc:1434] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 13:17:34.690723 17481 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-c824a7378ba243ca96d57d97c47847c9 received from {username='slave'} at 127.0.0.1:59988
I20260709 13:17:34.691148 17481 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-c824a7378ba243ca96d57d97c47847c9 on tablet c824a7378ba243ca96d57d97c47847c9 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:34.703555 17407 tablet_copy_source_session.cc:215] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:34.707062 18282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc026cf7a3b43b3a05aca657efbaecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.726591 18282 tablet_copy_client.cc:806] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:34.730057 18282 tablet_copy_client.cc:670] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:34.737799 18282 tablet_copy_client.cc:538] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:34.754667 18282 tablet_bootstrap.cc:492] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:34.812219 18282 tablet_bootstrap.cc:492] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.813511 18282 tablet_bootstrap.cc:492] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:34.814415 18282 ts_tablet_manager.cc:1403] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.010s
I20260709 13:17:34.819460 18282 raft_consensus.cc:359] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:34.820629 18282 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:34.821579 18282 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:34.841005 18282 ts_tablet_manager.cc:1434] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:17:34.847124 17407 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-5fc026cf7a3b43b3a05aca657efbaecd received from {username='slave'} at 127.0.0.1:59472
I20260709 13:17:34.847582 17407 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-5fc026cf7a3b43b3a05aca657efbaecd on tablet 5fc026cf7a3b43b3a05aca657efbaecd with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:34.852222 18279 ts_tablet_manager.cc:933] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:34.878747 18279 tablet_copy_client.cc:323] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:34.880677 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet 6ed6b0a2fcf5476ab0f8dffeb3536922 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:34.881278 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet 6ed6b0a2fcf5476ab0f8dffeb3536922 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-6ed6b0a2fcf5476ab0f8dffeb3536922
I20260709 13:17:34.893218 17332 tablet_copy_source_session.cc:215] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:34.896768 18279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed6b0a2fcf5476ab0f8dffeb3536922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.913272 18279 tablet_copy_client.cc:806] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:34.913939 18279 tablet_copy_client.cc:670] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:34.932655 18279 tablet_copy_client.cc:538] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:34.948050 18279 tablet_bootstrap.cc:492] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:34.974014 18279 tablet_bootstrap.cc:492] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.975010 18279 tablet_bootstrap.cc:492] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:34.975734 18279 ts_tablet_manager.cc:1403] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.000s
I20260709 13:17:34.992347 18279 raft_consensus.cc:359] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:34.993358 18279 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:34.994061 18279 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:34.997365 18279 ts_tablet_manager.cc:1434] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:17:35.001674 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-6ed6b0a2fcf5476ab0f8dffeb3536922 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:35.002182 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-6ed6b0a2fcf5476ab0f8dffeb3536922 on tablet 6ed6b0a2fcf5476ab0f8dffeb3536922 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:35.014580 17998 raft_consensus.cc:1217] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:35.018486 18279 ts_tablet_manager.cc:933] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:35.021879 18279 tablet_copy_client.cc:323] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:35.023530 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet bd3f7b090266450da9f53ec675edc8f0 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:35.024123 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet bd3f7b090266450da9f53ec675edc8f0 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-bd3f7b090266450da9f53ec675edc8f0
I20260709 13:17:35.033738 17332 tablet_copy_source_session.cc:215] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:35.039204 18279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3f7b090266450da9f53ec675edc8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.068920 18279 tablet_copy_client.cc:806] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:35.069656 18279 tablet_copy_client.cc:670] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:35.074343 18279 tablet_copy_client.cc:538] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:35.083915 18279 tablet_bootstrap.cc:492] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:35.085929 17998 raft_consensus.cc:1217] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:35.139464 18279 tablet_bootstrap.cc:492] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.140492 18279 tablet_bootstrap.cc:492] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:35.141284 18279 ts_tablet_manager.cc:1403] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.012s
I20260709 13:17:35.148425 18279 raft_consensus.cc:359] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:35.149237 18279 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:35.149863 18279 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:35.155016 18279 ts_tablet_manager.cc:1434] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:17:35.158684 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-bd3f7b090266450da9f53ec675edc8f0 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:35.159114 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-bd3f7b090266450da9f53ec675edc8f0 on tablet bd3f7b090266450da9f53ec675edc8f0 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:35.432107 18288 raft_consensus.cc:1064] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:35.434993 18288 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:35.442421 17998 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:35.444882 18231 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:35.452179 17997 raft_consensus.cc:1217] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:17:35.609755 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 104430us
I20260709 13:17:35.639066 17395 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:35.655723 17316 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:35.667181 18180 raft_consensus.cc:1064] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:35.678159 18296 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:35.699105 18180 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:35.703382 18295 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:35.730945 17997 raft_consensus.cc:1217] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:35.775435 18295 raft_consensus.cc:2955] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:35.776741 17321 raft_consensus.cc:2955] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:17:35.789319 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 71399.1us
I20260709 13:17:35.795173 17998 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:35.798599 18302 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:35.805250 17466 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:35.859791 18304 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:17:35.875620 17219 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:35.882213 17321 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:35.889880 17998 raft_consensus.cc:2955] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:35.946547 17397 raft_consensus.cc:2955] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:35.964148 18224 raft_consensus.cc:1064] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:35.967262 18224 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:35.987336 18304 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:35.980645 18308 raft_consensus.cc:2955] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.004801 17998 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.004984 17462 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.006383 18224 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.007541 18260 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:36.007894 17389 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.009439 18259 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:36.036084 18260 raft_consensus.cc:2955] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.041172 17321 raft_consensus.cc:2955] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.048882 17462 raft_consensus.cc:2955] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:35.999199 17466 raft_consensus.cc:2955] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.078969 17394 raft_consensus.cc:2955] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.093271 17997 raft_consensus.cc:2955] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.118217 17998 raft_consensus.cc:2955] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.164538 17216 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.170039 17216 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.191133 17462 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:36.199267 17321 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:36.214398 17394 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:36.219544 17998 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.221771 18257 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:36.222149 17392 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.223558 17998 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.224865 18308 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.228209 18296 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.233352 18309 raft_consensus.cc:2955] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.240739 17997 raft_consensus.cc:2955] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.247105 17999 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.249431 18260 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.255043 18231 raft_consensus.cc:2955] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.305677 17389 raft_consensus.cc:2955] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.307327 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c824a7378ba243ca96d57d97c47847c9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:36.318531 17999 raft_consensus.cc:2955] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.326045 18260 raft_consensus.cc:2955] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.323832 17462 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.334060 17205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5fc026cf7a3b43b3a05aca657efbaecd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:36.347251 17321 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.356313 17218 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.367376 18320 raft_consensus.cc:1064] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:36.351611 17999 raft_consensus.cc:2955] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.320873 17219 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.394982 18320 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:17:36.408748 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 53366.1us
I20260709 13:17:36.414239 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet c824a7378ba243ca96d57d97c47847c9 with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:36.417035 18321 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:36.425087 17466 raft_consensus.cc:2955] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.429064 18304 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.430647 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fc026cf7a3b43b3a05aca657efbaecd with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:36.445421 17321 raft_consensus.cc:2955] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.449611 18325 tablet_replica.cc:333] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:36.450675 18325 raft_consensus.cc:2243] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.451463 18325 raft_consensus.cc:2272] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.458088 17217 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.474545 17471 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.476135 17999 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.476683 18320 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.476114 18325 ts_tablet_manager.cc:1916] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:36.483083 17394 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.485841 18290 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:36.499296 18290 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.515921 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ed6b0a2fcf5476ab0f8dffeb3536922 with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:36.523064 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ed6b0a2fcf5476ab0f8dffeb3536922 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:17:36.530122 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 86987.2us
I20260709 13:17:36.544576 17389 raft_consensus.cc:2955] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.547359 18332 tablet_replica.cc:333] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:36.548532 18332 raft_consensus.cc:2243] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.549139 18332 raft_consensus.cc:2272] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.553117 17997 raft_consensus.cc:2955] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.542256 18324 raft_consensus.cc:2955] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.568342 18327 tablet_replica.cc:333] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:36.569784 18327 raft_consensus.cc:2243] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.570617 18327 raft_consensus.cc:2272] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.584445 18327 ts_tablet_manager.cc:1916] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:36.591121 18332 ts_tablet_manager.cc:1916] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:36.591256 17217 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.596104 18325 ts_tablet_manager.cc:1929] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:36.618552 18325 log.cc:1199] T c824a7378ba243ca96d57d97c47847c9 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/c824a7378ba243ca96d57d97c47847c9
I20260709 13:17:36.600888 17471 raft_consensus.cc:2955] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.623857 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet c824a7378ba243ca96d57d97c47847c9 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:36.641834 17321 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:36.664031 17997 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.665134 17397 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.665803 18324 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.666806 18320 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:36.676533 18298 raft_consensus.cc:2955] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.679857 17997 raft_consensus.cc:2955] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.680991 17394 raft_consensus.cc:2955] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.690729 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd3f7b090266450da9f53ec675edc8f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:36.703826 17216 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:36.716583 18332 ts_tablet_manager.cc:1929] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:36.718525 18332 log.cc:1199] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/6ed6b0a2fcf5476ab0f8dffeb3536922
I20260709 13:17:36.723031 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet 6ed6b0a2fcf5476ab0f8dffeb3536922 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:36.732059 18327 ts_tablet_manager.cc:1929] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:36.734503 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet bd3f7b090266450da9f53ec675edc8f0 with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:36.737974 18327 log.cc:1199] T 5fc026cf7a3b43b3a05aca657efbaecd P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/5fc026cf7a3b43b3a05aca657efbaecd
I20260709 13:17:36.740022 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet 5fc026cf7a3b43b3a05aca657efbaecd (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:36.740172 18327 tablet_replica.cc:333] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:36.741483 18327 raft_consensus.cc:2243] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.742367 18327 raft_consensus.cc:2272] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.745730 18327 ts_tablet_manager.cc:1916] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:36.763917 18327 ts_tablet_manager.cc:1929] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:36.764344 18327 log.cc:1199] T bd3f7b090266450da9f53ec675edc8f0 P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/bd3f7b090266450da9f53ec675edc8f0
I20260709 13:17:36.766001 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet bd3f7b090266450da9f53ec675edc8f0 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:37.836334 17471 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:37.846866 17389 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:37.848941 18231 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:37.854146 17434 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 579bc2ff6fcd49d8bc55557aa9b1bc3d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.854995 17321 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:37.856628 18257 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:37.864817 18231 raft_consensus.cc:2955] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:37.871199 17394 raft_consensus.cc:2955] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:37.873586 17321 raft_consensus.cc:2955] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:37.885663 17216 catalog_manager.cc:5697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.886703 17389 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:17:37.937314 17360 consensus_peers.cc:597] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bb3b6f88d9b4423a689bae4e9e59333. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.940160 17471 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:37.945065 17315 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:37.945173 18308 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:37.949577 18304 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:37.964326 18308 raft_consensus.cc:2955] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:37.976940 17315 raft_consensus.cc:2955] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:37.985745 17471 raft_consensus.cc:2955] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:37.996129 17217 catalog_manager.cc:5697] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:38.017637 17462 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:17:38.044122 17434 consensus_peers.cc:597] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c4c351b74b044eab8a6561b3eb27a1b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.044445 17389 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:38.046331 18257 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.053166 17321 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:38.055055 18336 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:38.084388 18336 raft_consensus.cc:2955] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:38.091710 17315 raft_consensus.cc:2955] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:38.099558 17321 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:38.110936 17462 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:38.112243 18324 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:38.113238 17285 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff504a0c820741ecb08279a255054a6c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.119798 17217 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:38.123067 17389 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:38.132187 18324 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:38.137773 17394 raft_consensus.cc:2955] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:38.153092 18320 raft_consensus.cc:2955] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:38.182828 17467 raft_consensus.cc:2955] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:38.188262 17389 raft_consensus.cc:2955] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:38.192296 17217 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.233032 18355 ts_tablet_manager.cc:933] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:38.235459 18355 tablet_copy_client.cc:323] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:17:38.237596 17481 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:17:38.238263 17481 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-579bc2ff6fcd49d8bc55557aa9b1bc3d
I20260709 13:17:38.249817 17481 tablet_copy_source_session.cc:215] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:38.257433 18355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:38.278007 18355 tablet_copy_client.cc:806] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:38.278535 18355 tablet_copy_client.cc:670] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:38.283463 18355 tablet_copy_client.cc:538] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:38.296938 18355 tablet_bootstrap.cc:492] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:38.333880 18355 tablet_bootstrap.cc:492] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:38.334649 18355 tablet_bootstrap.cc:492] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:38.335246 18355 ts_tablet_manager.cc:1403] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.010s
I20260709 13:17:38.338104 18355 raft_consensus.cc:359] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:38.338954 18355 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:38.339696 18355 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:38.359551 18355 ts_tablet_manager.cc:1434] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.004s
I20260709 13:17:38.364748 17481 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-579bc2ff6fcd49d8bc55557aa9b1bc3d received from {username='slave'} at 127.0.0.1:59988
I20260709 13:17:38.365271 17481 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-579bc2ff6fcd49d8bc55557aa9b1bc3d on tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:38.404204 18355 ts_tablet_manager.cc:933] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:38.430190 18355 tablet_copy_client.cc:323] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:17:38.432240 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet 7bb3b6f88d9b4423a689bae4e9e59333 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:17:38.432876 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet 7bb3b6f88d9b4423a689bae4e9e59333 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-7bb3b6f88d9b4423a689bae4e9e59333
I20260709 13:17:38.461202 17407 tablet_copy_source_session.cc:215] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:38.464172 18360 ts_tablet_manager.cc:933] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:38.465301 18355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bb3b6f88d9b4423a689bae4e9e59333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:38.481304 18355 tablet_copy_client.cc:806] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:38.482016 18355 tablet_copy_client.cc:670] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:38.485762 18360 tablet_copy_client.cc:323] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:17:38.485903 18355 tablet_copy_client.cc:538] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:38.497490 17481 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet 8c4c351b74b044eab8a6561b3eb27a1b from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:17:38.498157 17481 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet 8c4c351b74b044eab8a6561b3eb27a1b from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-8c4c351b74b044eab8a6561b3eb27a1b
I20260709 13:17:38.500931 18355 tablet_bootstrap.cc:492] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:38.544080 18355 tablet_bootstrap.cc:492] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:38.545130 18355 tablet_bootstrap.cc:492] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:38.545857 18355 ts_tablet_manager.cc:1403] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.045s	user 0.032s	sys 0.007s
I20260709 13:17:38.548808 18355 raft_consensus.cc:359] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:38.549757 18355 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:38.550451 18355 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:38.553334 18355 ts_tablet_manager.cc:1434] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:17:38.555160 17407 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-7bb3b6f88d9b4423a689bae4e9e59333 received from {username='slave'} at 127.0.0.1:59472
I20260709 13:17:38.555598 17407 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-7bb3b6f88d9b4423a689bae4e9e59333 on tablet 7bb3b6f88d9b4423a689bae4e9e59333 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:38.578508 17481 tablet_copy_source_session.cc:215] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:38.583963 18360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4c351b74b044eab8a6561b3eb27a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:38.646847 18355 ts_tablet_manager.cc:933] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:38.667400 18355 tablet_copy_client.cc:323] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:38.670310 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet ff504a0c820741ecb08279a255054a6c from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:38.671013 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet ff504a0c820741ecb08279a255054a6c from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-ff504a0c820741ecb08279a255054a6c
I20260709 13:17:38.686255 17332 tablet_copy_source_session.cc:215] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:38.693583 18355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff504a0c820741ecb08279a255054a6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:38.696466 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 122982us
I20260709 13:17:38.719007 18355 tablet_copy_client.cc:806] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:38.719915 18355 tablet_copy_client.cc:670] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
W20260709 13:17:38.721300 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 64326.7us
I20260709 13:17:38.727471 18355 tablet_copy_client.cc:538] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:38.730443 18360 tablet_copy_client.cc:806] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:38.731168 18360 tablet_copy_client.cc:670] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:38.736192 18355 tablet_bootstrap.cc:492] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:38.736397 17997 raft_consensus.cc:1217] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:38.769364 18360 tablet_copy_client.cc:538] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:38.775408 18355 tablet_bootstrap.cc:492] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:38.776444 18355 tablet_bootstrap.cc:492] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:38.777175 18355 ts_tablet_manager.cc:1403] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.003s
I20260709 13:17:38.780014 18355 raft_consensus.cc:359] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:38.780872 18355 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:38.781507 18355 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:38.786091 18355 ts_tablet_manager.cc:1434] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:17:38.787670 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-ff504a0c820741ecb08279a255054a6c received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:38.788101 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-ff504a0c820741ecb08279a255054a6c on tablet ff504a0c820741ecb08279a255054a6c with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:38.796736 18360 tablet_bootstrap.cc:492] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:38.824332 18360 tablet_bootstrap.cc:492] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:38.825341 18360 tablet_bootstrap.cc:492] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:38.826113 18360 ts_tablet_manager.cc:1403] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.012s
I20260709 13:17:38.829272 18360 raft_consensus.cc:359] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:38.830257 18360 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:38.831004 18360 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:38.833734 18360 ts_tablet_manager.cc:1434] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:38.836037 17481 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-8c4c351b74b044eab8a6561b3eb27a1b received from {username='slave'} at 127.0.0.1:59988
I20260709 13:17:38.836519 17481 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-8c4c351b74b044eab8a6561b3eb27a1b on tablet 8c4c351b74b044eab8a6561b3eb27a1b with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:38.900357 17997 raft_consensus.cc:1217] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:38.933421 17997 raft_consensus.cc:1217] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:39.084983 17997 raft_consensus.cc:1217] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:39.297855 18336 raft_consensus.cc:1064] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:39.300221 18336 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:39.335899 17999 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.336203 17389 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.338189 18369 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:39.341675 18365 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:39.351291 17315 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.352874 18365 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:39.394636 18369 raft_consensus.cc:2955] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.405465 17997 raft_consensus.cc:2955] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.422403 17389 raft_consensus.cc:2955] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.427261 17217 catalog_manager.cc:5697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.457036 18344 raft_consensus.cc:1064] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:39.460307 18365 raft_consensus.cc:1064] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:39.487665 18365 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:39.508347 17997 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.508378 17389 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.510512 18336 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:39.513903 18365 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:39.503451 18344 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:39.529050 17321 raft_consensus.cc:2955] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.533423 17315 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.540055 18365 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:39.555521 18336 raft_consensus.cc:2955] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.561569 17997 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.561966 17471 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.566131 17471 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:39.569053 18363 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:39.571161 18379 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:39.572190 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 101371us
I20260709 13:17:39.585427 17396 raft_consensus.cc:2955] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.587412 17998 raft_consensus.cc:2955] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.604254 17999 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:39.607053 18374 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:39.613948 17216 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.630398 17319 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:39.634320 18369 raft_consensus.cc:2955] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.638187 17996 raft_consensus.cc:2955] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.660275 17319 raft_consensus.cc:2955] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.664566 18320 raft_consensus.cc:1064] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:39.668663 18320 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:39.692155 17471 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.692209 17998 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.699869 17219 catalog_manager.cc:5697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.709002 18383 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:39.680759 17467 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:39.710532 18384 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:39.718860 18374 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:39.725438 17315 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.725454 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:39.730108 17316 raft_consensus.cc:2955] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.699059 17389 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:39.740938 18320 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:39.741518 17996 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:39.744496 18365 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:39.755815 17397 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:39.760138 18363 raft_consensus.cc:2955] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.762249 17999 raft_consensus.cc:2955] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.777295 18382 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:39.741704 18396 tablet_replica.cc:333] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:39.792101 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:39.793304 18396 raft_consensus.cc:2243] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.794288 18396 raft_consensus.cc:2272] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.798022 18396 ts_tablet_manager.cc:1916] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:39.800532 18298 raft_consensus.cc:2955] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.842825 17319 raft_consensus.cc:2955] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:17:39.808250 18397 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:17:39.819559 18365 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:39.850368 18374 raft_consensus.cc:2955] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.852473 17998 raft_consensus.cc:2955] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.858896 17997 raft_consensus.cc:2955] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.860793 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8c4c351b74b044eab8a6561b3eb27a1b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:39.826069 17467 raft_consensus.cc:2955] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.841743 17389 raft_consensus.cc:2955] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.886009 17216 catalog_manager.cc:5697] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:39.894487 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 50499us
I20260709 13:17:39.932588 17471 raft_consensus.cc:2955] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.935880 17396 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:39.941632 17389 raft_consensus.cc:2955] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.943647 17219 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.955982 17219 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:39.970468 17997 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:39.972230 18363 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:39.974300 18396 ts_tablet_manager.cc:1929] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:39.974821 18396 log.cc:1199] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/579bc2ff6fcd49d8bc55557aa9b1bc3d
I20260709 13:17:39.976581 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet 579bc2ff6fcd49d8bc55557aa9b1bc3d (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:39.993742 18344 raft_consensus.cc:2955] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:40.005429 17997 raft_consensus.cc:2955] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:40.020638 17205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7bb3b6f88d9b4423a689bae4e9e59333 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:40.026916 17471 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:40.029666 18363 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:40.035560 17471 raft_consensus.cc:2955] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:40.041690 17219 catalog_manager.cc:5697] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:17:40.086930 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 73584.5us
I20260709 13:17:40.100443 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c4c351b74b044eab8a6561b3eb27a1b with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:40.109520 18400 tablet_replica.cc:333] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:40.143514 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bb3b6f88d9b4423a689bae4e9e59333 with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:40.144814 17315 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:40.152807 17997 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:40.155478 18384 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:40.165839 17396 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:40.167351 18400 raft_consensus.cc:2243] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.168203 18400 raft_consensus.cc:2272] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.168737 18290 raft_consensus.cc:2955] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:40.170218 17996 raft_consensus.cc:2955] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:40.172775 18400 ts_tablet_manager.cc:1916] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:40.201258 17215 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:17:40.214567 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45496.6us
I20260709 13:17:40.216432 18298 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:40.221779 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff504a0c820741ecb08279a255054a6c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:40.222874 18400 ts_tablet_manager.cc:1929] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:40.223434 18400 log.cc:1199] T 8c4c351b74b044eab8a6561b3eb27a1b P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/8c4c351b74b044eab8a6561b3eb27a1b
I20260709 13:17:40.224692 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet ff504a0c820741ecb08279a255054a6c with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:40.225467 18400 tablet_replica.cc:333] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:40.226666 18400 raft_consensus.cc:2243] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.227448 18400 raft_consensus.cc:2272] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.227015 17396 raft_consensus.cc:2955] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:40.234025 18400 ts_tablet_manager.cc:1916] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:40.243139 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet 8c4c351b74b044eab8a6561b3eb27a1b (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:40.258347 18400 ts_tablet_manager.cc:1929] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:40.258997 18400 log.cc:1199] T 7bb3b6f88d9b4423a689bae4e9e59333 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/7bb3b6f88d9b4423a689bae4e9e59333
I20260709 13:17:40.261891 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet 7bb3b6f88d9b4423a689bae4e9e59333 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:40.263742 18402 tablet_replica.cc:333] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:40.264993 18402 raft_consensus.cc:2243] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:40.265827 18402 raft_consensus.cc:2272] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:40.269598 18402 ts_tablet_manager.cc:1916] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:40.284582 18402 ts_tablet_manager.cc:1929] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:40.285035 18402 log.cc:1199] T ff504a0c820741ecb08279a255054a6c P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/ff504a0c820741ecb08279a255054a6c
I20260709 13:17:40.286986 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet ff504a0c820741ecb08279a255054a6c (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:41.295373 17321 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:17:41.301793 17285 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a20d82b49da74027abe144db7281b7b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:41.301887 17467 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:41.302793 17392 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:41.303392 18290 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.305042 18354 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.317068 18354 raft_consensus.cc:2955] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.325280 17462 raft_consensus.cc:2955] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.326943 17396 raft_consensus.cc:2955] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.336627 17392 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:41.346566 17215 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:41.365955 17360 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 622554a5186d4910b8476a653411c85d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:41.366163 17321 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:41.368647 17462 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:41.368443 18410 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:41.372740 18410 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:41.385835 18379 raft_consensus.cc:2955] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.390612 17321 raft_consensus.cc:2955] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.393558 17462 raft_consensus.cc:2955] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.401541 17321 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:41.407980 17467 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:41.410971 18405 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.412513 17392 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:41.411931 17285 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4c1e66c4a684159ae427b3705522c26. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:41.414094 18405 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.405095 17220 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.422703 18290 raft_consensus.cc:2955] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.430665 17392 raft_consensus.cc:2955] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.435119 17467 raft_consensus.cc:2955] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.440241 17396 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:17:41.447638 17360 consensus_peers.cc:597] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 984feea4e2564e57923c946b7572e2a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:41.452752 17215 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.454488 17462 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:41.456091 17321 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:41.459087 18410 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.460322 18363 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.481812 18410 raft_consensus.cc:2955] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.484575 17466 raft_consensus.cc:2955] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.485098 17321 raft_consensus.cc:2955] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.502235 17216 catalog_manager.cc:5697] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:41.715410 18423 ts_tablet_manager.cc:933] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:41.727553 18423 tablet_copy_client.cc:323] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:41.729518 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet a20d82b49da74027abe144db7281b7b0 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:41.730074 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet a20d82b49da74027abe144db7281b7b0 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-a20d82b49da74027abe144db7281b7b0
I20260709 13:17:41.736783 17332 tablet_copy_source_session.cc:215] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:41.741418 18423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d82b49da74027abe144db7281b7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.754310 18423 tablet_copy_client.cc:806] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:41.754967 18423 tablet_copy_client.cc:670] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:41.759333 18423 tablet_copy_client.cc:538] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:41.766665 18425 ts_tablet_manager.cc:933] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:41.777211 18425 tablet_copy_client.cc:323] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:17:41.777354 18423 tablet_bootstrap.cc:492] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:41.779003 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet 622554a5186d4910b8476a653411c85d from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:17:41.779577 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet 622554a5186d4910b8476a653411c85d from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-622554a5186d4910b8476a653411c85d
I20260709 13:17:41.795253 17407 tablet_copy_source_session.cc:215] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:41.800001 18425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622554a5186d4910b8476a653411c85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.831524 18425 tablet_copy_client.cc:806] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:41.832147 18425 tablet_copy_client.cc:670] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:41.832455 18423 tablet_bootstrap.cc:492] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:41.833441 18423 tablet_bootstrap.cc:492] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:41.834182 18423 ts_tablet_manager.cc:1403] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.012s
I20260709 13:17:41.835927 18425 tablet_copy_client.cc:538] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:41.837141 18423 raft_consensus.cc:359] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:41.838020 18423 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:41.838703 18423 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:41.844666 18423 ts_tablet_manager.cc:1434] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:17:41.845468 18425 tablet_bootstrap.cc:492] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:41.846990 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-a20d82b49da74027abe144db7281b7b0 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:41.847460 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-a20d82b49da74027abe144db7281b7b0 on tablet a20d82b49da74027abe144db7281b7b0 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:41.870452 18425 tablet_bootstrap.cc:492] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:41.871579 18425 tablet_bootstrap.cc:492] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:41.872366 18425 ts_tablet_manager.cc:1403] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.005s
I20260709 13:17:41.875285 18425 raft_consensus.cc:359] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:41.876116 18425 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:41.876722 18425 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:41.879210 18425 ts_tablet_manager.cc:1434] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:41.881956 17407 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-622554a5186d4910b8476a653411c85d received from {username='slave'} at 127.0.0.1:59472
I20260709 13:17:41.882382 17407 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-622554a5186d4910b8476a653411c85d on tablet 622554a5186d4910b8476a653411c85d with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:41.903862 18425 ts_tablet_manager.cc:933] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:41.905589 18425 tablet_copy_client.cc:323] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:41.909107 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet a4c1e66c4a684159ae427b3705522c26 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:41.909621 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet a4c1e66c4a684159ae427b3705522c26 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-a4c1e66c4a684159ae427b3705522c26
I20260709 13:17:41.916712 17332 tablet_copy_source_session.cc:215] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:41.921108 18425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c1e66c4a684159ae427b3705522c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.938953 18425 tablet_copy_client.cc:806] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:41.939546 18425 tablet_copy_client.cc:670] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:41.943329 18425 tablet_copy_client.cc:538] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:41.951387 18425 tablet_bootstrap.cc:492] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:41.971968 18425 tablet_bootstrap.cc:492] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:41.972466 18423 ts_tablet_manager.cc:933] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:41.972987 18425 tablet_bootstrap.cc:492] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:41.973780 18425 ts_tablet_manager.cc:1403] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.008s
I20260709 13:17:41.976878 18425 raft_consensus.cc:359] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:41.977813 18425 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:41.978546 18425 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:41.980405 18425 ts_tablet_manager.cc:1434] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:41.985841 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-a4c1e66c4a684159ae427b3705522c26 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:41.986299 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-a4c1e66c4a684159ae427b3705522c26 on tablet a4c1e66c4a684159ae427b3705522c26 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:41.986835 18423 tablet_copy_client.cc:323] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:17:41.988590 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet 984feea4e2564e57923c946b7572e2a0 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:17:41.989104 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet 984feea4e2564e57923c946b7572e2a0 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-984feea4e2564e57923c946b7572e2a0
I20260709 13:17:41.996989 17407 tablet_copy_source_session.cc:215] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:42.003881 18423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984feea4e2564e57923c946b7572e2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:42.023222 18423 tablet_copy_client.cc:806] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:42.023881 18423 tablet_copy_client.cc:670] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:42.029137 18423 tablet_copy_client.cc:538] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:42.038519 18423 tablet_bootstrap.cc:492] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:42.065080 18423 tablet_bootstrap.cc:492] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:42.066023 18423 tablet_bootstrap.cc:492] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:42.066718 18423 ts_tablet_manager.cc:1403] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.002s
I20260709 13:17:42.069918 18423 raft_consensus.cc:359] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:42.070792 18423 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:42.071491 18423 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:42.074664 18423 ts_tablet_manager.cc:1434] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:42.078387 17407 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-984feea4e2564e57923c946b7572e2a0 received from {username='slave'} at 127.0.0.1:59472
I20260709 13:17:42.078830 17407 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-984feea4e2564e57923c946b7572e2a0 on tablet 984feea4e2564e57923c946b7572e2a0 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:42.183413 17997 raft_consensus.cc:1217] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:42.350929 17997 raft_consensus.cc:1217] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:42.375473 17997 raft_consensus.cc:1217] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:42.378572 17997 raft_consensus.cc:1217] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:42.455740 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:42.540643 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "128956e308c048a2af21fae67c6683ef"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:42.541426 17321 raft_consensus.cc:606] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:42.544070 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:42.544626 17321 raft_consensus.cc:606] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:42.547405 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:42.547888 17321 raft_consensus.cc:606] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:42.550410 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:42.550843 17321 raft_consensus.cc:606] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:42.553076 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:42.553507 17321 raft_consensus.cc:606] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:42.554435 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:42.556026 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:42.579958 18405 raft_consensus.cc:1064] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:42.582190 18405 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:42.591818 17997 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.592211 17466 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.594035 17392 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.593858 18290 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.595486 18405 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:42.605057 18290 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.621171 18435 raft_consensus.cc:2955] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:42.623386 17996 raft_consensus.cc:2955] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:42.631629 17467 raft_consensus.cc:2955] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:42.639283 17396 raft_consensus.cc:2955] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:42.642445 17220 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:42.653398 18403 raft_consensus.cc:993] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:42.654134 18403 raft_consensus.cc:1081] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:42.656875 17471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:17:42.657676 17471 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:42.658110 17471 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.665949 17471 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.670173 17471 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:42.670864 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:42.671594 17321 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.671931 17321 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:42.672636 17321 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.672783 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:42.673434 17396 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.678218 17321 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.682195 17396 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:42.683629 18435 raft_consensus.cc:993] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:42.692132 18435 raft_consensus.cc:1081] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:42.693068 18405 raft_consensus.cc:993] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:42.693647 18405 raft_consensus.cc:1081] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:42.693986 17435 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:42.694845 18393 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.695310 18393 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:42.696138 18393 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.696652 17321 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:42.700763 17396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:42.701491 17396 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:42.701937 17396 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.702702 17392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "128956e308c048a2af21fae67c6683ef"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:42.703373 17392 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:42.703729 17392 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.710984 17396 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.714214 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:42.714818 17471 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.716859 17315 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:42.718703 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:42.719281 17321 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.719599 17321 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:42.720263 17321 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.721272 17321 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.730594 17467 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:42.734277 17996 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:42.738118 17471 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:42.738188 18446 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:42.739194 17396 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:42.739606 17362 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:42.740175 18403 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:42.740635 18434 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.741166 18434 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:42.743227 18435 raft_consensus.cc:993] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:42.735857 17216 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.743094 17392 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.743741 18435 raft_consensus.cc:1081] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:42.746050 17392 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:42.742013 18434 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.747598 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:42.748188 17466 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.752118 17392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:42.752959 17321 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:42.752676 18447 raft_consensus.cc:2955] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:42.752719 17392 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:42.754889 17392 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.766806 17392 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.770833 17392 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:42.773236 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:42.773877 17462 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.760142 17997 raft_consensus.cc:2955] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:42.784395 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:42.785116 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:42.785451 17316 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.785667 17321 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.785784 17316 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:42.786058 17321 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:42.786545 17316 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.786756 17321 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.787742 17316 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.787773 17321 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.788520 17467 raft_consensus.cc:2955] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:42.794509 17321 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:42.794798 17466 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:42.796242 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:42.797423 18420 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.799779 18420 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:42.802120 18420 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.804502 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:42.784014 17462 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:42.811043 17468 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:42.813488 18410 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.813009 17316 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:42.828644 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a20d82b49da74027abe144db7281b7b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:42.838524 17216 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.843747 17215 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:42.846472 18410 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:42.847636 18410 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.858938 18403 raft_consensus.cc:1064] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:42.862066 18403 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:42.893201 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet a20d82b49da74027abe144db7281b7b0 with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:42.895640 18447 raft_consensus.cc:993] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:42.896310 18446 raft_consensus.cc:1081] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:42.898134 17392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:42.898877 17392 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:42.899276 17392 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.908243 18434 raft_consensus.cc:1064] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:42.914281 17467 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.917557 17997 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.918660 17396 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.919548 18446 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.920709 18435 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.912176 18434 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:42.921670 18290 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:42.934230 17392 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.936460 17392 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:42.938597 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:42.939263 17467 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.943621 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:42.944278 17315 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.944605 17315 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:42.945412 17315 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.946538 17315 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.949360 17467 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:42.951023 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:42.951897 18420 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.952582 18420 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:42.953495 18420 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:42.966562 17315 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:42.990777 18455 tablet_replica.cc:333] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:42.994243 18447 raft_consensus.cc:2955] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:42.995539 17468 raft_consensus.cc:2955] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.007059 17396 raft_consensus.cc:2955] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.014789 17997 raft_consensus.cc:2955] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.028496 18410 raft_consensus.cc:1064] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:43.003683 18455 raft_consensus.cc:2243] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.031071 18455 raft_consensus.cc:2272] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.033838 18410 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:43.049160 17216 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.051348 17996 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:43.060173 17315 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:43.062276 18463 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:43.064116 18420 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:43.076045 17316 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:43.077404 17467 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:43.077874 18420 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:43.082420 18420 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:43.105027 17997 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:43.116299 17319 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:43.053819 17466 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:43.123696 17215 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.129669 17215 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.125645 18410 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:43.130445 18452 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:43.133623 17466 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.142115 18456 raft_consensus.cc:2955] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.143678 17315 raft_consensus.cc:2955] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.051777 18455 ts_tablet_manager.cc:1916] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:43.163501 17997 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:43.163735 18420 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.169853 18434 raft_consensus.cc:2955] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.174224 18290 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:43.179771 17471 raft_consensus.cc:2955] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.186259 17392 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.187446 17215 catalog_manager.cc:5697] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.192816 18450 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:43.195016 17468 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:43.198464 18290 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:43.205412 17468 raft_consensus.cc:2955] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.211774 17997 raft_consensus.cc:2955] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.215873 17217 catalog_manager.cc:5697] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.218061 18446 raft_consensus.cc:2955] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.229285 17998 raft_consensus.cc:2955] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.230798 17466 raft_consensus.cc:2955] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.238732 17315 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.238608 17999 raft_consensus.cc:2955] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.240811 18455 ts_tablet_manager.cc:1929] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:43.241285 18455 log.cc:1199] T a20d82b49da74027abe144db7281b7b0 P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/a20d82b49da74027abe144db7281b7b0
I20260709 13:17:43.245524 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet a20d82b49da74027abe144db7281b7b0 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:43.254279 18393 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.254719 17316 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.259660 18410 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.265197 17215 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.284801 17321 raft_consensus.cc:2955] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.286897 17466 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.288255 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a4c1e66c4a684159ae427b3705522c26 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:43.306130 17217 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.315570 18434 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:43.324182 17468 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.324638 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c1e66c4a684159ae427b3705522c26 with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:43.325670 18455 tablet_replica.cc:333] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:43.326658 18455 raft_consensus.cc:2243] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.327319 18455 raft_consensus.cc:2272] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.331173 17392 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:43.333124 18455 ts_tablet_manager.cc:1916] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:43.355679 18420 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.356760 17999 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:43.358820 18463 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:43.364791 17319 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.368317 18452 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.369488 17468 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:43.372822 18452 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:43.374994 18455 ts_tablet_manager.cc:1929] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:43.375453 18455 log.cc:1199] T a4c1e66c4a684159ae427b3705522c26 P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/a4c1e66c4a684159ae427b3705522c26
I20260709 13:17:43.377177 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet a4c1e66c4a684159ae427b3705522c26 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:43.380511 18464 raft_consensus.cc:2955] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.387756 17997 raft_consensus.cc:2955] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.392204 17471 raft_consensus.cc:2955] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.395609 17468 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.397671 17205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 984feea4e2564e57923c946b7572e2a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:43.405337 17316 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.405437 17321 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.408489 18452 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.410230 18452 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.417501 18463 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.409835 17215 catalog_manager.cc:5697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.408360 17392 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:43.441953 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet 984feea4e2564e57923c946b7572e2a0 with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:43.455287 18486 tablet_replica.cc:333] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:43.456384 18486 raft_consensus.cc:2243] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.457193 18486 raft_consensus.cc:2272] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.472121 18486 ts_tablet_manager.cc:1916] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:43.473620 17999 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:43.476588 17316 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:43.485663 18463 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:43.486840 18464 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:43.498417 18452 raft_consensus.cc:2955] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.500597 17997 raft_consensus.cc:2955] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.502765 18486 ts_tablet_manager.cc:1929] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:43.503374 18486 log.cc:1199] T 984feea4e2564e57923c946b7572e2a0 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/984feea4e2564e57923c946b7572e2a0
I20260709 13:17:43.505329 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet 984feea4e2564e57923c946b7572e2a0 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:43.512005 17205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 622554a5186d4910b8476a653411c85d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:43.507984 17316 raft_consensus.cc:2955] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.526489 17215 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:43.542215 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet 622554a5186d4910b8476a653411c85d with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:43.557181 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:43.559129 18487 tablet_replica.cc:333] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:43.560274 18487 raft_consensus.cc:2243] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.561067 18487 raft_consensus.cc:2272] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.565462 18487 ts_tablet_manager.cc:1916] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:43.587260 18487 ts_tablet_manager.cc:1929] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:43.587759 18487 log.cc:1199] T 622554a5186d4910b8476a653411c85d P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/622554a5186d4910b8476a653411c85d
I20260709 13:17:43.589610 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet 622554a5186d4910b8476a653411c85d (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:43.614975 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:43.653153 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:43.653713 17316 raft_consensus.cc:606] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:43.667768 17392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:17:43.668442 17392 raft_consensus.cc:606] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:43.671108 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:43.671672 17316 raft_consensus.cc:606] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:43.674256 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4df43493289c4586a02bce2e14a38202"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:43.674872 17316 raft_consensus.cc:606] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:43.677675 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:43.678346 17316 raft_consensus.cc:606] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:43.682184 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:43.682754 17316 raft_consensus.cc:606] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:43.695848 17467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:43.696506 17467 raft_consensus.cc:606] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:43.697746 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:17:43.699038 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:43.812410 18450 raft_consensus.cc:993] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:43.813156 18450 raft_consensus.cc:1081] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:43.815300 17396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:51620
I20260709 13:17:43.815842 17396 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.816211 17396 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.822628 17396 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.825109 17396 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:43.825866 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:43.826433 17316 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.827369 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:43.827968 17471 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.828284 17471 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:43.829157 17471 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.830430 17471 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.835809 17316 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:43.836019 17471 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:43.837178 17360 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:43.838047 18420 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.838539 18420 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:43.839455 18420 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.850814 17215 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 2, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.872922 18435 raft_consensus.cc:993] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:43.873481 18446 raft_consensus.cc:1081] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:43.874956 17471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:17:43.875381 17471 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.875627 17471 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.880034 17471 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.882040 17471 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:43.882769 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:43.883021 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:43.883420 17316 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.883514 17396 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.883811 17316 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:43.884533 17316 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.885675 17316 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.891052 17396 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:43.892928 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:43.893791 18450 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.893934 17316 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:43.894320 18450 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:43.895232 18450 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.904395 17215 catalog_manager.cc:5697] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.912518 18446 raft_consensus.cc:993] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:43.913085 18290 raft_consensus.cc:1081] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:43.914595 17467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:17:43.915046 17467 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.915330 17467 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.920208 17467 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.921828 17467 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:43.922854 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:43.923238 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:43.923444 17396 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.923894 17316 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.924312 17316 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:43.925071 17316 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.927194 17316 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.930177 17396 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:43.932556 17316 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:43.932870 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:43.933790 18365 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.934227 18365 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:43.934944 18365 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.944514 17215 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.949402 18290 raft_consensus.cc:993] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:43.949923 18446 raft_consensus.cc:1081] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:43.951354 17396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:43.951829 17396 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.952694 17396 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.958432 17396 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.959831 17396 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:43.960651 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:43.960651 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:43.961372 17316 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.961486 17467 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.961673 17316 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:43.962441 17316 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.963671 17316 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.971400 17316 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:43.972507 17467 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:43.975710 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:43.976792 18463 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.977353 18463 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:43.978171 18463 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:43.993376 17215 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.012149 18420 raft_consensus.cc:993] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:44.012714 18463 raft_consensus.cc:1081] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:44.014387 17467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:32812
I20260709 13:17:44.014957 17467 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.015292 17467 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.019953 17467 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:44.021433 17467 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:44.022331 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:44.022634 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:44.023064 17315 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.023175 17396 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:44.023576 17396 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:44.024145 17396 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:44.025131 17396 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.028194 17315 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:44.029469 17434 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:44.029711 17396 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:44.030416 18393 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:44.031020 18393 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:44.032245 18393 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:44.044044 17215 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 2, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.055785 18290 raft_consensus.cc:993] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:44.056373 18435 raft_consensus.cc:1081] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:44.057854 17389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:44.058338 17389 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.058616 17389 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.062880 17389 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:44.064395 17389 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:44.064989 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:44.065599 17315 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:44.065589 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:44.066167 17315 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:44.066356 17467 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.066915 17315 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:44.067950 17315 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.072392 17467 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:44.075067 17315 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:44.076169 17360 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:44.076876 18463 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:44.077417 18463 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:44.078315 18463 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:44.090577 17215 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.171427 18290 raft_consensus.cc:993] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:44.172021 18403 raft_consensus.cc:1081] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:44.173961 17997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4df43493289c4586a02bce2e14a38202"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:17:44.174425 17997 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.174835 17997 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.180049 17997 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:44.183393 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:44.184082 17315 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:44.184413 17315 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:44.182693 17997 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:44.185220 17315 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:44.186555 17315 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.186944 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:44.187508 17396 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.192137 17396 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:44.192176 17315 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:44.193261 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:44.195264 18497 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:44.196708 18497 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:44.197822 18497 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:44.206061 17215 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.249668 17321 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.251132 18463 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.268633 17467 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.271469 18452 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:44.294615 17321 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.295923 18365 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.313072 17389 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.314548 18365 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.450035 17321 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.451282 18365 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.460685 17389 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.463476 18365 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.489048 17321 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.490721 18365 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.500100 17389 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.501497 18450 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.533159 17321 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.534468 18452 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.549726 17467 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.551249 18463 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.555732 17321 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.559374 18464 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.562332 17471 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.563810 18463 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.645200 17467 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:17:44.651075 17434 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf42e0c75aa14899935b39a4a7437626. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:44.651096 17396 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:44.652537 18393 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.652973 17315 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:44.655871 18393 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.660856 18393 raft_consensus.cc:2955] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.662492 17396 raft_consensus.cc:2955] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.665132 17315 raft_consensus.cc:2955] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.675364 17467 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:44.680881 17217 catalog_manager.cc:5697] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
W20260709 13:17:44.693643 17434 consensus_peers.cc:597] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c0241098ae744cbae27ac900424b754. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:44.696226 17396 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:44.696498 17315 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:44.698158 18519 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.699074 18365 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.699887 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:44.708457 18365 raft_consensus.cc:2955] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.717063 17315 raft_consensus.cc:2955] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.728616 17389 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:44.738838 17215 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.739916 17392 raft_consensus.cc:2955] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
W20260709 13:17:44.751637 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef8ac3d116f3443db6462f3a86ce1432. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:44.751081 17315 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:44.754153 17467 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:44.759395 18452 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:44.778218 18452 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:44.781363 18463 raft_consensus.cc:2955] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.790140 17316 raft_consensus.cc:2955] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.795826 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:44.814795 17315 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:44.817281 17392 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:44.818781 18526 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:44.820235 18526 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:44.847043 17316 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:44.856045 17471 raft_consensus.cc:2955] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.882272 17216 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.942561 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:44.943241 17321 raft_consensus.cc:606] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
W20260709 13:17:44.950641 17285 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c3c6f4045794af59b877ad412ae6450. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:44.951043 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:44.951644 17321 raft_consensus.cc:606] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:44.952752 17392 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:44.953899 17462 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:44.954200 18435 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.955395 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6758d139882843e5bddc827c260b81a9"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:44.955900 17316 raft_consensus.cc:606] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:44.957445 18435 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.963364 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:44.963894 17316 raft_consensus.cc:606] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:44.967975 17467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd74e04425094277971ef1f372f80d50"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:44.968571 17467 raft_consensus.cc:606] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:44.975625 17392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:17:44.976353 17392 raft_consensus.cc:606] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:44.980060 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:44.980611 17321 raft_consensus.cc:606] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:44.981737 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:17:44.983341 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:44.985805 18403 raft_consensus.cc:2955] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.988618 17467 raft_consensus.cc:2955] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:44.996603 17396 raft_consensus.cc:2955] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:45.017640 18290 raft_consensus.cc:993] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:45.018878 18446 raft_consensus.cc:1081] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:45.019009 17220 catalog_manager.cc:5697] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:45.020618 17462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:17:45.021242 17462 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.021617 17462 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.029071 17462 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:45.031721 17462 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:45.033922 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:45.034222 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:45.034509 17316 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.034825 17316 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:45.035094 17396 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.035518 17316 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:45.036710 17316 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.042441 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:45.043071 17316 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:45.043262 18446 raft_consensus.cc:993] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:45.043799 18446 raft_consensus.cc:1081] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:45.044262 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:45.045518 18450 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.046033 18450 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:45.046955 18450 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:45.053083 17396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:45.053723 17396 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.054113 17396 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.061040 17396 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:45.063035 17396 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:45.063767 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:45.064505 17316 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.064833 17316 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:45.065588 17316 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:45.065971 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:45.066597 17467 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.066876 17316 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.067833 17217 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.076689 17316 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:45.078339 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:45.079269 18464 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.079826 18464 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:45.080864 18464 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:45.094888 17467 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:45.097187 18534 ts_tablet_manager.cc:933] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:45.122112 17216 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.124176 18534 tablet_copy_client.cc:323] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:17:45.126062 17481 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet 6c0241098ae744cbae27ac900424b754 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:17:45.126684 17481 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet 6c0241098ae744cbae27ac900424b754 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-6c0241098ae744cbae27ac900424b754
I20260709 13:17:45.136463 17481 tablet_copy_source_session.cc:215] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:45.140192 18435 raft_consensus.cc:993] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:45.143502 18435 raft_consensus.cc:1081] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:45.145411 17998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:17:45.145985 17998 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.146373 17998 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.148576 18534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0241098ae744cbae27ac900424b754. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:45.156031 17998 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:45.159431 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:45.160070 17321 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.160193 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:45.160449 17321 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:45.160917 17462 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.161401 17321 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:45.162575 17321 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.166070 18534 tablet_copy_client.cc:806] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:45.166688 18534 tablet_copy_client.cc:670] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:45.170186 18464 raft_consensus.cc:993] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:45.170833 18452 raft_consensus.cc:1081] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:45.170107 17998 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:45.172371 18534 tablet_copy_client.cc:538] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:45.173221 17316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35788
I20260709 13:17:45.173818 17316 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.174165 17316 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.181713 17316 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:45.183120 18534 tablet_bootstrap.cc:492] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:45.196632 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:45.197384 17396 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:45.197373 17321 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:45.197923 17396 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:45.198629 17462 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:45.198791 17396 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:45.200289 17396 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.200419 17316 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:45.203743 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:45.204380 17462 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.202100 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:45.206362 18523 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.206868 18523 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:45.207806 18523 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:45.213102 17462 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:45.214505 17287 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:45.217744 18446 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:45.224538 17396 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:45.218466 18446 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:45.229730 18537 ts_tablet_manager.cc:933] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:45.232653 18446 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:45.251812 17216 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.255151 18435 raft_consensus.cc:993] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:45.255692 18435 raft_consensus.cc:1081] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:45.260449 18519 raft_consensus.cc:993] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:45.260927 18519 raft_consensus.cc:1081] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:45.262888 17316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd74e04425094277971ef1f372f80d50"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35772
I20260709 13:17:45.263363 17998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6758d139882843e5bddc827c260b81a9"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:17:45.263473 17316 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.263970 17316 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.265936 17217 catalog_manager.cc:5697] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.269145 18534 tablet_bootstrap.cc:492] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.270155 18534 tablet_bootstrap.cc:492] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:45.270890 18534 ts_tablet_manager.cc:1403] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.007s
I20260709 13:17:45.263994 17998 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.272532 17998 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.278136 18534 raft_consensus.cc:359] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:45.279140 18534 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:45.279886 18534 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:45.285094 17316 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:45.286060 18534 ts_tablet_manager.cc:1434] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:17:45.260914 18537 tablet_copy_client.cc:323] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:17:45.288120 17481 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-6c0241098ae744cbae27ac900424b754 received from {username='slave'} at 127.0.0.1:59988
I20260709 13:17:45.288566 17481 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-6c0241098ae744cbae27ac900424b754 on tablet 6c0241098ae744cbae27ac900424b754 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:45.288702 17480 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet bf42e0c75aa14899935b39a4a7437626 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:17:45.289268 17480 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet bf42e0c75aa14899935b39a4a7437626 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-bf42e0c75aa14899935b39a4a7437626
I20260709 13:17:45.289372 17998 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:45.291343 17316 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:45.292229 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:45.295033 17396 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.293015 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:45.295667 17389 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.293170 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:45.301124 17321 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.301437 17321 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:45.302137 17321 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:45.303134 17321 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.306535 17389 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:45.293481 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:45.309100 17462 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:45.309403 17462 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:45.310190 17462 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:45.311307 17480 tablet_copy_source_session.cc:215] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:45.294307 17998 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:45.313153 17462 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.315915 18537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf42e0c75aa14899935b39a4a7437626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:45.315828 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:45.316387 17396 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:45.317488 17321 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:45.319058 18523 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.319591 18523 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:45.320444 18523 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:45.322762 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:45.323642 18290 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:45.324100 18290 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:45.324944 18290 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:45.322341 17462 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:45.335192 18537 tablet_copy_client.cc:806] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:45.335800 18537 tablet_copy_client.cc:670] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:45.343067 17216 catalog_manager.cc:5697] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.360745 18537 tablet_copy_client.cc:538] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:45.375700 18537 tablet_bootstrap.cc:492] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:45.381814 17216 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.420914 18435 raft_consensus.cc:993] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:45.421545 18435 raft_consensus.cc:1081] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:45.427346 17997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:17:45.427910 17997 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.428324 17997 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.434794 18537 tablet_bootstrap.cc:492] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.435797 18537 tablet_bootstrap.cc:492] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:45.436476 18537 ts_tablet_manager.cc:1403] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.034s
I20260709 13:17:45.439373 18537 raft_consensus.cc:359] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:45.440186 18537 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:45.440856 18537 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:45.441566 18534 ts_tablet_manager.cc:933] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:45.443389 18534 tablet_copy_client.cc:323] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:45.443617 18537 ts_tablet_manager.cc:1434] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:17:45.443574 17997 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:45.445132 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet 7c3c6f4045794af59b877ad412ae6450 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:45.445751 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet 7c3c6f4045794af59b877ad412ae6450 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-7c3c6f4045794af59b877ad412ae6450
I20260709 13:17:45.446484 17480 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-bf42e0c75aa14899935b39a4a7437626 received from {username='slave'} at 127.0.0.1:59988
I20260709 13:17:45.446911 17480 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-bf42e0c75aa14899935b39a4a7437626 on tablet bf42e0c75aa14899935b39a4a7437626 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:45.453964 17332 tablet_copy_source_session.cc:215] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:45.455621 17997 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:45.456065 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:45.456677 17471 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.458264 18534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3c6f4045794af59b877ad412ae6450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:45.458923 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:45.459481 17316 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.459764 17316 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:45.460412 17316 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:45.461673 17316 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.469988 17316 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:45.471264 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:17:45.472952 18523 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.473440 18523 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:45.474224 18523 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:45.474601 17997 raft_consensus.cc:1217] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:45.502637 17471 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:45.503041 18534 tablet_copy_client.cc:806] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:45.504911 18534 tablet_copy_client.cc:670] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:45.510666 18534 tablet_copy_client.cc:538] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:45.519164 17216 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.520382 18534 tablet_bootstrap.cc:492] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:45.545426 17471 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.549007 18420 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.556043 18534 tablet_bootstrap.cc:492] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:45.556970 18534 tablet_bootstrap.cc:492] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:45.557641 18534 ts_tablet_manager.cc:1403] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.016s
I20260709 13:17:45.560186 18534 raft_consensus.cc:359] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:45.560825 18534 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:45.561544 18534 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:45.570566 18534 ts_tablet_manager.cc:1434] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:45.572419 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-7c3c6f4045794af59b877ad412ae6450 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:45.572942 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-7c3c6f4045794af59b877ad412ae6450 on tablet 7c3c6f4045794af59b877ad412ae6450 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:45.575644 17392 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.582227 18393 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.598348 17321 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.600395 18450 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:45.624940 17316 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.626744 18464 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:45.666937 17285 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef8ac3d116f3443db6462f3a86ce1432. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:45.736402 17321 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:45.743095 18523 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:17:45.754330 17998 raft_consensus.cc:1217] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:45.776487 17316 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:45.795763 18545 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:17:45.809901 17471 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:45.813665 17389 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:45.822955 17471 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:45.822788 18435 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:45.832031 18523 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:45.834560 17396 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:45.840624 18435 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:45.841684 17462 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:45.873374 18446 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:17:45.875119 18403 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:45.905227 17389 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:45.909942 18526 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:45.926875 17466 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:45.935971 18523 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:45.987646 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.002625 17997 raft_consensus.cc:1217] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:46.034022 18519 raft_consensus.cc:1064] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:46.037849 18519 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:17:46.077435 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 61760.6us
W20260709 13:17:46.090950 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 92035us
I20260709 13:17:46.109596 17317 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:46.195792 18570 ts_tablet_manager.cc:933] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
W20260709 13:17:46.201416 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 61800.6us
I20260709 13:17:46.222604 18545 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:46.227155 18556 raft_consensus.cc:1064] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:46.234046 17998 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:46.244166 18556 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:46.247362 17392 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:46.246155 18570 tablet_copy_client.cc:323] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:46.275075 18577 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:46.277388 17997 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:46.277882 17317 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:46.279982 17317 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:46.281384 18577 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.282608 18575 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:46.286036 18365 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:46.296736 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet ef8ac3d116f3443db6462f3a86ce1432 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:46.297487 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet ef8ac3d116f3443db6462f3a86ce1432 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-ef8ac3d116f3443db6462f3a86ce1432
I20260709 13:17:46.311538 18365 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.314419 17389 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:46.334550 18365 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.355736 18575 raft_consensus.cc:2955] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.365226 17332 tablet_copy_source_session.cc:215] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:46.368950 18570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8ac3d116f3443db6462f3a86ce1432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.362191 17389 raft_consensus.cc:2955] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.376946 18578 raft_consensus.cc:2955] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.383800 17392 raft_consensus.cc:2955] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.385725 17316 raft_consensus.cc:2955] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.409479 17997 raft_consensus.cc:2955] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.417167 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.415115 17216 catalog_manager.cc:5697] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.441150 17220 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.471698 17997 raft_consensus.cc:2955] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.474139 18570 tablet_copy_client.cc:806] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:46.474888 18570 tablet_copy_client.cc:670] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:46.479812 17316 raft_consensus.cc:2955] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.492249 18570 tablet_copy_client.cc:538] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:46.503516 18570 tablet_bootstrap.cc:492] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:46.533255 17467 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:46.571484 17997 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:46.571038 17466 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:46.587096 17316 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:46.588207 17998 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:46.589527 18575 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:46.595427 17392 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:46.596386 18556 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:46.598022 18393 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:46.600210 18578 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:46.608669 18572 raft_consensus.cc:1064] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:46.610172 18575 raft_consensus.cc:2955] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.614787 17389 raft_consensus.cc:2955] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.616966 18572 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:46.618664 18556 raft_consensus.cc:2955] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.620198 17997 raft_consensus.cc:2955] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.632360 17316 raft_consensus.cc:2955] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.635046 17999 raft_consensus.cc:2955] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.642751 18570 tablet_bootstrap.cc:492] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:46.652169 18570 tablet_bootstrap.cc:492] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:46.652969 18570 ts_tablet_manager.cc:1403] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.150s	user 0.037s	sys 0.035s
I20260709 13:17:46.666973 17466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:46.673239 17466 raft_consensus.cc:606] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:46.702627 17396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:17:46.703284 17396 raft_consensus.cc:606] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:46.711712 17997 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:46.716183 18403 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:46.718429 17396 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:46.721588 17217 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.729386 17318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:46.731876 17318 raft_consensus.cc:606] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:46.732825 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c0241098ae744cbae27ac900424b754 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:46.734349 17467 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:46.737779 18435 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.732403 18570 raft_consensus.cc:359] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:46.741058 18570 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:46.744279 17215 catalog_manager.cc:5697] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 3 to 4, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.755712 17315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:46.756364 17315 raft_consensus.cc:606] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:46.761169 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c0241098ae744cbae27ac900424b754 with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:46.761540 17315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:46.762200 17315 raft_consensus.cc:606] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:46.767151 17318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:46.767652 17318 raft_consensus.cc:606] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:46.772094 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:46.774286 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:46.781970 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf42e0c75aa14899935b39a4a7437626 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:46.741884 18570 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:46.784206 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet bf42e0c75aa14899935b39a4a7437626 with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:46.794360 18570 ts_tablet_manager.cc:1434] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.141s	user 0.009s	sys 0.000s
I20260709 13:17:46.796949 18598 tablet_replica.cc:333] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:46.805112 18598 raft_consensus.cc:2243] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:46.806180 18598 raft_consensus.cc:2272] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:46.811244 18599 tablet_replica.cc:333] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:46.812752 18599 raft_consensus.cc:2243] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:46.813714 18599 raft_consensus.cc:2272] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:46.813665 18598 ts_tablet_manager.cc:1916] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:46.816376 18572 raft_consensus.cc:2955] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.821635 18599 ts_tablet_manager.cc:1916] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:46.824322 17389 raft_consensus.cc:2955] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.834187 17998 raft_consensus.cc:2955] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:17:46.842880 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 104116us
I20260709 13:17:46.843137 17216 catalog_manager.cc:5697] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.844626 18572 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.861770 18573 raft_consensus.cc:993] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:46.862229 18573 raft_consensus.cc:1081] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:46.863293 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-ef8ac3d116f3443db6462f3a86ce1432 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:46.863940 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-ef8ac3d116f3443db6462f3a86ce1432 on tablet ef8ac3d116f3443db6462f3a86ce1432 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:46.864023 17318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35788
I20260709 13:17:46.864634 17318 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.864997 17318 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.872365 17318 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:46.874675 17318 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:46.875703 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:46.876341 17396 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:46.876662 17396 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:46.877825 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:46.879493 17466 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.882264 18598 ts_tablet_manager.cc:1929] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:46.885717 18598 log.cc:1199] T 6c0241098ae744cbae27ac900424b754 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/6c0241098ae744cbae27ac900424b754
I20260709 13:17:46.894562 17396 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:46.897266 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet 6c0241098ae744cbae27ac900424b754 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:46.897518 18290 raft_consensus.cc:993] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:46.898128 18290 raft_consensus.cc:1081] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:46.901491 17318 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:46.903225 17997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:17:46.903771 17997 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.904111 17997 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.897519 17396 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.910485 18599 ts_tablet_manager.cc:1929] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:46.915227 18599 log.cc:1199] T bf42e0c75aa14899935b39a4a7437626 P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/bf42e0c75aa14899935b39a4a7437626
I20260709 13:17:46.913431 17999 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:46.917861 17389 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:46.918802 18595 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:46.919831 18594 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:46.920522 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet bf42e0c75aa14899935b39a4a7437626 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:46.929643 17466 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:46.931391 18572 raft_consensus.cc:993] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:46.931900 18572 raft_consensus.cc:1081] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:46.934604 17998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:17:46.935125 17998 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.935465 17998 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.935918 17396 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:46.936565 18450 raft_consensus.cc:993] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:46.937271 18576 raft_consensus.cc:1081] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:46.938170 17997 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:46.940248 17997 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:46.943289 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:46.944582 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:46.945181 17471 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.947050 17318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35772
I20260709 13:17:46.947098 17997 raft_consensus.cc:2955] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.948217 17318 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.948668 17318 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.949359 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:46.950937 17315 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.951915 17998 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:46.953240 18564 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.953747 18564 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:46.954067 17471 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:46.954679 18564 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:46.955173 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:46.951210 17315 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:46.956818 18523 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.957331 18523 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:46.949698 18290 raft_consensus.cc:2955] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.941514 17467 raft_consensus.cc:2955] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.965830 17998 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:46.965700 18523 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:46.967319 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:46.967990 17396 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.970721 17315 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:46.976176 17315 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.976928 17396 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:46.978312 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:46.982860 17389 raft_consensus.cc:2955] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:46.986213 18567 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.986753 18567 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:46.987638 18567 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:47.004201 17318 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:46.996345 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:47.009539 17317 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:47.010027 17317 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:47.013092 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c3c6f4045794af59b877ad412ae6450 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:47.014976 17318 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:47.018891 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:47.019487 17466 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:47.019955 17466 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:47.019428 17317 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:47.025658 17317 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.039016 17466 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:47.055611 17466 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:47.070345 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45696.1us
I20260709 13:17:47.078182 17317 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:47.093582 18572 raft_consensus.cc:993] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:47.094095 18595 raft_consensus.cc:1081] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:47.095867 17997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:17:47.096423 17997 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:47.096773 17997 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.102576 17315 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:47.112044 17215 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.120625 17216 catalog_manager.cc:5697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.128362 17997 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:47.136942 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:47.137527 17396 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:47.143848 17396 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:47.153554 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:47.154484 18595 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:47.154953 18595 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:47.155771 18595 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:47.151881 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:47.159072 17317 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:47.159420 17317 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:47.162640 17317 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:47.164055 17317 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.166810 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:47.167435 17389 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.168576 17997 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:47.177127 17466 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:47.183238 17216 catalog_manager.cc:5697] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:47.188076 18435 raft_consensus.cc:993] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:47.188625 18435 raft_consensus.cc:1081] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:47.188547 17389 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:47.190385 17471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:17:47.190928 17471 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:47.191296 17471 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.191103 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:47.185160 17317 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:47.194097 18567 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:47.194571 17215 catalog_manager.cc:5697] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.194612 18567 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:47.197434 18567 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:47.198522 17471 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:47.200038 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c3c6f4045794af59b877ad412ae6450 with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:47.210059 17471 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:47.211203 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:47.211875 17317 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:47.212499 17317 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:47.213320 17317 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:47.218420 17317 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.222860 18611 tablet_replica.cc:333] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:47.224099 18611 raft_consensus.cc:2243] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:47.224916 18611 raft_consensus.cc:2272] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:47.230151 17317 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:47.233955 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:47.234609 17389 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.234948 17434 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:47.236131 18450 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:47.236600 18450 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:47.237408 18450 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:47.254053 17389 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:47.257859 17216 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.267586 18611 ts_tablet_manager.cc:1916] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:47.273327 17215 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.275219 17217 catalog_manager.cc:5697] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.287483 18611 ts_tablet_manager.cc:1929] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:47.287966 18611 log.cc:1199] T 7c3c6f4045794af59b877ad412ae6450 P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/7c3c6f4045794af59b877ad412ae6450
I20260709 13:17:47.289788 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet 7c3c6f4045794af59b877ad412ae6450 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:47.312516 17998 raft_consensus.cc:1217] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEARNER]: Deduplicated request from leader. Original: 2.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:17:47.394968 17392 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.396229 18595 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.409179 17471 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.410774 18595 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.486430 17471 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:47.488299 18567 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:47.510236 17315 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:47.511596 18523 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:47.534739 17389 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:47.536054 18545 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:47.545204 17315 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:47.549800 18545 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:47.610656 17389 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:47.612150 18523 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:47.631548 17317 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:47.637146 18523 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:47.657271 17471 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.658789 18290 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.674643 17389 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.678042 18403 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:47.700271 17317 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.703989 18556 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.750030 17389 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.768754 18556 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.783257 18564 raft_consensus.cc:1064] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:47.783836 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:47.786023 18564 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:47.802341 17466 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:47.803917 18290 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:47.806921 17998 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:47.808385 18564 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:47.809923 17389 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:47.817317 18290 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:47.832671 18290 raft_consensus.cc:2955] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:47.835953 17998 raft_consensus.cc:2955] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:47.847445 17397 raft_consensus.cc:2955] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:47.861204 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:47.862708 17466 raft_consensus.cc:2955] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:47.883518 17217 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 3 to 5, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:47.948180 17315 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:47.951506 17471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:47.952093 17471 raft_consensus.cc:606] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:47.956478 17997 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:47.957319 17397 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:47.957827 18403 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:47.958796 18290 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:47.960574 17315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:47.961141 17315 raft_consensus.cc:606] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:47.966779 18290 raft_consensus.cc:2955] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:47.970366 17998 raft_consensus.cc:2955] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:47.972863 17397 raft_consensus.cc:2955] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:47.995889 17471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:47.999981 17471 raft_consensus.cc:606] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:47.998690 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef8ac3d116f3443db6462f3a86ce1432 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:48.004173 17397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:17:48.004900 17397 raft_consensus.cc:606] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:48.008601 17471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:48.009219 17471 raft_consensus.cc:606] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:48.012866 17317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:48.013430 17317 raft_consensus.cc:606] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:48.014741 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:48.016400 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:48.018651 17215 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 5 to 6, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.034341 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet ef8ac3d116f3443db6462f3a86ce1432 with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:48.042027 18637 tablet_replica.cc:333] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:48.052450 18637 raft_consensus.cc:2243] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:48.053637 18637 raft_consensus.cc:2272] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:48.057049 18637 ts_tablet_manager.cc:1916] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:48.073500 18637 ts_tablet_manager.cc:1929] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:17:48.073948 18637 log.cc:1199] T ef8ac3d116f3443db6462f3a86ce1432 P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/ef8ac3d116f3443db6462f3a86ce1432
I20260709 13:17:48.075122 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet ef8ac3d116f3443db6462f3a86ce1432 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:48.085482 18403 raft_consensus.cc:993] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:48.086149 18564 raft_consensus.cc:1081] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:48.087751 17998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:17:48.088255 17998 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.088580 17998 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.094825 18613 raft_consensus.cc:993] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:48.094821 17998 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.095506 18556 raft_consensus.cc:1081] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:48.096794 17998 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:48.097095 17317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35772
I20260709 13:17:48.097327 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:48.097609 17317 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.097748 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:48.097929 17315 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.098001 17317 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.098248 17315 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:48.098294 17471 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.099179 17315 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.100399 17315 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.102787 17317 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:48.105283 17471 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:48.105959 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:48.106513 17397 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.106518 17317 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:48.106545 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:48.107273 17315 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:48.107805 18545 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.108321 18545 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:48.109170 18545 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.109869 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:48.110436 17466 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.110756 17466 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:48.111518 17466 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:48.112564 17397 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:17:48.112713 17466 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.113770 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:48.114629 18564 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.115947 18564 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:48.116786 18564 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:48.122080 17466 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:17:48.128214 17216 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 2, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.129477 17215 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.152908 18613 raft_consensus.cc:993] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:48.153432 18556 raft_consensus.cc:1081] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:48.154911 17998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44546
I20260709 13:17:48.155375 17998 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.155678 17998 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.160883 17998 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.162396 17998 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:48.163228 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:48.163439 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:48.163918 17397 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.163980 17466 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.164403 17466 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:48.165059 17466 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.166000 17466 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.170004 17397 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:48.171329 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:48.171661 17466 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:48.172482 18545 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.173113 18545 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:48.174095 18545 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.181571 18605 raft_consensus.cc:993] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:48.182288 18608 raft_consensus.cc:1081] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:48.184309 17466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:32812
I20260709 13:17:48.184983 17466 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.185599 17466 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.189481 17215 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.190534 17466 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.192225 17466 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:48.192905 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:48.193463 17397 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.193459 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:17:48.193975 17397 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:48.194195 17998 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.194644 17397 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.195655 17397 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.200765 17998 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:48.202239 17434 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:48.203351 18450 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.203415 17397 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:48.205171 18450 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:48.206028 18450 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.225073 17215 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 2, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.433683 18641 raft_consensus.cc:993] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:48.434226 18641 raft_consensus.cc:1081] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:48.437649 17317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35772
I20260709 13:17:48.438454 17317 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.438815 17317 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.448498 17317 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:48.451311 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:48.451984 17397 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.455207 17317 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:48.456370 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:48.457093 17471 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.457396 17471 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:48.458179 17471 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:48.459476 17471 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.463508 17397 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:17:48.464744 17286 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:48.465642 18403 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.466101 18403 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:48.466634 17471 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:17:48.466925 18403 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:48.476652 17216 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 2, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.575714 18595 raft_consensus.cc:993] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:48.576252 18595 raft_consensus.cc:1081] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:48.577661 17998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:17:48.578208 17998 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.578511 17998 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.582841 17998 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.584595 17998 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:48.585383 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:48.585923 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:48.586052 17315 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:48.586500 17397 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.586467 17315 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:48.588140 17315 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.589411 17315 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.592821 17471 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:48.592658 17397 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:17:48.594262 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:48.594628 17389 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.595106 18523 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:48.595642 18523 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:48.596623 18595 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:48.596586 18523 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:48.598227 17315 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:17:48.594628 18545 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:17:48.607636 17216 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 3 to 4, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 4 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.613126 17389 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:48.614691 18567 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:48.636782 17315 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:48.641026 18545 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:48.652463 17466 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.657621 18564 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:48.667207 17471 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:48.668798 18567 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:48.757820 17998 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:48.759073 18641 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:48.769331 17389 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:48.772433 18641 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:48.978940 17466 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.980823 18564 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:48.991740 17389 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.993268 18595 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.006795 17315 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:49.008641 18567 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:49.017287 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.032898 17389 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:49.034431 18567 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:49.124369 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.148345 17315 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.155155 17471 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:49.157485 18595 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:49.170231 17285 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aaa77e48390f407cb43bb16febfe2e8d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.172477 17471 raft_consensus.cc:2955] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.170670 18595 raft_consensus.cc:2955] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.176049 17466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:49.176496 17389 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:49.176698 17466 raft_consensus.cc:606] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:49.179996 18403 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.184005 17389 raft_consensus.cc:2955] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.195253 17315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:49.200510 17315 raft_consensus.cc:606] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:49.194901 17215 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 2 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.207640 17389 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.208112 17397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:17:49.209409 17397 raft_consensus.cc:606] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:49.211201 18450 raft_consensus.cc:993] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:49.211638 18450 raft_consensus.cc:1081] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:49.213114 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:49.214864 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:49.216100 17317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35772
I20260709 13:17:49.216683 17317 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.217064 17317 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:49.222162 17360 consensus_peers.cc:597] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 128956e308c048a2af21fae67c6683ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.221637 17471 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:49.222832 17315 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:49.224560 18605 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:49.225710 18608 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:49.241433 17317 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:49.244546 17317 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:49.247097 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:49.247817 18663 raft_consensus.cc:2955] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.247844 17471 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:49.251076 17471 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:49.252213 17471 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:49.263484 17471 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.257084 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:49.266764 17389 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.281493 17466 raft_consensus.cc:2955] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.320266 17467 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.327850 17215 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.344815 17471 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:49.345196 17389 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:49.348208 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:49.349328 18403 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.349766 18403 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:49.348110 17317 raft_consensus.cc:2955] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.350500 18403 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:49.383147 17389 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:49.384378 17434 consensus_peers.cc:597] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 24bd9827b3204adba8158c0366088793. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.385298 18674 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.385896 17317 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:49.387355 18674 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.393635 17220 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.409229 18641 raft_consensus.cc:2955] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.410982 17317 raft_consensus.cc:2955] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.413601 17397 raft_consensus.cc:2955] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.434798 17389 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.432650 17220 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.443724 17467 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:49.445086 17321 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:49.446631 18671 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:49.449909 17360 consensus_peers.cc:597] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96a5582b6bfb4ac592225b49ce6df9be. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.454813 18670 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:49.465795 18671 raft_consensus.cc:2955] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.469568 17468 raft_consensus.cc:2955] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.485283 17321 raft_consensus.cc:2955] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.486176 17220 catalog_manager.cc:5697] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:49.560550 18663 raft_consensus.cc:993] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:49.561151 18663 raft_consensus.cc:1081] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:49.564239 17467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:32812
I20260709 13:17:49.564881 17467 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.565251 17467 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.575228 17467 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:49.577390 17467 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:49.579704 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:49.580124 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:49.580338 17389 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:49.580767 17389 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:49.581606 17389 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:49.583333 17389 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.580741 17321 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.599772 17389 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:17:49.600988 17321 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:17:49.601084 17435 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:49.602110 18673 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.602613 18673 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:49.603513 18673 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:49.621070 17220 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 2 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 3 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.641687 18683 ts_tablet_manager.cc:933] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:49.644207 18683 tablet_copy_client.cc:323] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:49.645931 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet aaa77e48390f407cb43bb16febfe2e8d from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:49.646579 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet aaa77e48390f407cb43bb16febfe2e8d from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-aaa77e48390f407cb43bb16febfe2e8d
I20260709 13:17:49.653846 17332 tablet_copy_source_session.cc:215] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:49.658687 18683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa77e48390f407cb43bb16febfe2e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:49.680409 18683 tablet_copy_client.cc:806] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:49.681077 18683 tablet_copy_client.cc:670] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:49.685585 18683 tablet_copy_client.cc:538] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:49.695652 18683 tablet_bootstrap.cc:492] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:49.726686 18683 tablet_bootstrap.cc:492] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:49.727653 18683 tablet_bootstrap.cc:492] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:49.728374 18683 ts_tablet_manager.cc:1403] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.033s	user 0.026s	sys 0.004s
I20260709 13:17:49.730652 18683 raft_consensus.cc:359] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.731364 18683 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:49.731966 18683 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.734202 18683 ts_tablet_manager.cc:1434] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:17:49.736421 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-aaa77e48390f407cb43bb16febfe2e8d received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:49.736758 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-aaa77e48390f407cb43bb16febfe2e8d on tablet aaa77e48390f407cb43bb16febfe2e8d with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:49.781141 18403 raft_consensus.cc:993] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:49.781697 18595 raft_consensus.cc:1081] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:49.783494 17389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:49.784037 17389 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.784332 17389 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.785863 18683 ts_tablet_manager.cc:933] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:49.787672 18683 tablet_copy_client.cc:323] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:17:49.789717 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet 128956e308c048a2af21fae67c6683ef from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:17:49.790283 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet 128956e308c048a2af21fae67c6683ef from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-128956e308c048a2af21fae67c6683ef
I20260709 13:17:49.790103 17389 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.793282 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:49.793303 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:49.793918 17315 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:49.794332 17315 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:49.794308 17467 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.795212 17315 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.796732 17315 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.798931 17407 tablet_copy_source_session.cc:215] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:49.802282 18683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128956e308c048a2af21fae67c6683ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:49.804302 17315 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:17:49.793381 17389 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:49.809010 17360 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:49.810217 18671 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.810711 18671 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:49.811946 17467 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:17:49.811655 18671 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.819236 18683 tablet_copy_client.cc:806] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:49.819984 18683 tablet_copy_client.cc:670] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:49.824268 18683 tablet_copy_client.cc:538] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:49.826481 17220 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 2 to 3, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 3 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.833572 18683 tablet_bootstrap.cc:492] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:49.840772 17389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:49.841419 17389 raft_consensus.cc:606] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:17:49.854450 17397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:49.855208 17397 raft_consensus.cc:606] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:17:49.856959 17205 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for aaa77e48390f407cb43bb16febfe2e8d already in progress
I20260709 13:17:49.861371 18687 ts_tablet_manager.cc:933] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:49.864408 18683 tablet_bootstrap.cc:492] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:49.864571 18689 ts_tablet_manager.cc:933] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:49.867364 18683 tablet_bootstrap.cc:492] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:49.868170 18683 ts_tablet_manager.cc:1403] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.008s
I20260709 13:17:49.872814 17392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:49.872711 18683 raft_consensus.cc:359] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.873467 17392 raft_consensus.cc:606] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:17:49.874388 18683 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:49.872710 18687 tablet_copy_client.cc:323] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:17:49.875129 18683 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.876273 17389 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.879556 18689 tablet_copy_client.cc:323] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:17:49.876677 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet 96a5582b6bfb4ac592225b49ce6df9be from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:17:49.887404 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet 96a5582b6bfb4ac592225b49ce6df9be from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-96a5582b6bfb4ac592225b49ce6df9be
I20260709 13:17:49.888542 18683 ts_tablet_manager.cc:1434] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.004s
I20260709 13:17:49.888952 18403 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.890513 17406 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-128956e308c048a2af21fae67c6683ef received from {username='slave'} at 127.0.0.1:59472
I20260709 13:17:49.890991 17406 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-128956e308c048a2af21fae67c6683ef on tablet 128956e308c048a2af21fae67c6683ef with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:49.901800 17407 tablet_copy_source_session.cc:215] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:17:49.903378 17268 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:17:49.904001 17268 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for aaa77e48390f407cb43bb16febfe2e8d already in progress
I20260709 13:17:49.904536 17480 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet 24bd9827b3204adba8158c0366088793 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:17:49.905130 17480 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet 24bd9827b3204adba8158c0366088793 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-24bd9827b3204adba8158c0366088793
I20260709 13:17:49.906399 18687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a5582b6bfb4ac592225b49ce6df9be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:49.904309 17268 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for aaa77e48390f407cb43bb16febfe2e8d already in progress
I20260709 13:17:49.923740 18687 tablet_copy_client.cc:806] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:49.924340 18687 tablet_copy_client.cc:670] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:49.927562 17480 tablet_copy_source_session.cc:215] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:49.927850 18687 tablet_copy_client.cc:538] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:49.932216 18689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bd9827b3204adba8158c0366088793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:49.943075 18687 tablet_bootstrap.cc:492] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:49.969693 18689 tablet_copy_client.cc:806] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:49.970844 18689 tablet_copy_client.cc:670] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:49.979220 18687 tablet_bootstrap.cc:492] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:49.975193 18689 tablet_copy_client.cc:538] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:49.980374 18687 tablet_bootstrap.cc:492] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:49.981082 18687 ts_tablet_manager.cc:1403] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.011s
I20260709 13:17:49.985378 18687 raft_consensus.cc:359] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.986182 18687 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:49.986865 18687 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:49.988591 18687 ts_tablet_manager.cc:1434] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:17:49.989683 17468 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.990288 17407 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-96a5582b6bfb4ac592225b49ce6df9be received from {username='slave'} at 127.0.0.1:59472
I20260709 13:17:49.990765 17407 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-96a5582b6bfb4ac592225b49ce6df9be on tablet 96a5582b6bfb4ac592225b49ce6df9be with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:50.006127 18595 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:50.051039 18689 tablet_bootstrap.cc:492] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:50.077870 18689 tablet_bootstrap.cc:492] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:50.080116 18689 tablet_bootstrap.cc:492] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:50.081959 18689 ts_tablet_manager.cc:1403] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.006s
I20260709 13:17:50.084805 18689 raft_consensus.cc:359] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:50.085496 18689 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:50.086025 18689 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:50.088285 18689 ts_tablet_manager.cc:1434] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:17:50.091713 17480 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-24bd9827b3204adba8158c0366088793 received from {username='slave'} at 127.0.0.1:59988
I20260709 13:17:50.092203 17480 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-24bd9827b3204adba8158c0366088793 on tablet 24bd9827b3204adba8158c0366088793 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:50.198491 17997 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Advancing to term 3
I20260709 13:17:50.206265 17997 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:50.209052 18663 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:50.215804 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:50.217330 17998 raft_consensus.cc:1217] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:50.226788 18663 raft_consensus.cc:1064] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
W20260709 13:17:50.227360 18663 raft_consensus.cc:1068] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: Unable to promote non-voter 3747096bb5074ea2bf86037fd17c1160: Service unavailable: leader transfer in progress
I20260709 13:17:50.233270 17321 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:50.235157 18674 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:50.235800 17392 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:50.253173 17467 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:50.238593 18673 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:50.254743 18681 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:50.279052 17997 raft_consensus.cc:1217] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:50.289803 18671 raft_consensus.cc:993] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:50.290457 18671 raft_consensus.cc:1081] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:50.301380 17467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:32812
I20260709 13:17:50.352635 18663 raft_consensus.cc:1064] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
W20260709 13:17:50.353127 18663 raft_consensus.cc:1068] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: Unable to promote non-voter 3747096bb5074ea2bf86037fd17c1160: Service unavailable: leader transfer in progress
I20260709 13:17:50.360911 17467 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:50.361408 17467 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.369891 17467 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:50.381963 17321 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:50.385386 17467 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:50.387723 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:50.388393 17392 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:50.389909 17392 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:50.393654 17392 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:50.395155 17392 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.401974 17997 raft_consensus.cc:1217] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:50.402791 17392 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:17:50.404973 17435 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:50.405849 18711 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:50.406378 18711 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:50.407335 18711 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:50.437147 17215 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 3 to 4, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 4 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:50.449795 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:50.459247 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:50.459868 17315 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.469169 17315 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:17:50.532088 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "036c02de798949eeb02d27e9dd520825"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:50.532727 17321 raft_consensus.cc:606] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:50.537307 17467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:50.537909 17467 raft_consensus.cc:606] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:50.541087 17315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:50.541685 17315 raft_consensus.cc:606] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:50.547622 17467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:50.548149 17467 raft_consensus.cc:606] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:50.554992 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:50.556670 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:50.703178 18708 raft_consensus.cc:1064] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:50.711385 18564 raft_consensus.cc:993] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:50.711898 18564 raft_consensus.cc:1081] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:50.713708 17389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "036c02de798949eeb02d27e9dd520825"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:50.709962 18708 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:50.714382 17389 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:50.714818 17389 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.732015 17998 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:50.722990 17389 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:50.734784 17389 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:50.734891 18671 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:50.736181 17471 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:50.738965 18671 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:50.739605 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:50.740056 17321 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:50.740185 17467 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.742831 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:50.743417 17321 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:50.743788 17321 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:50.744544 17321 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:50.745978 17321 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.754690 18708 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:50.751739 17467 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:50.759157 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:50.761405 18671 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:50.762475 17321 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:50.763511 18671 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:50.764519 18671 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:50.765718 18673 raft_consensus.cc:993] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:50.766232 18673 raft_consensus.cc:1081] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:50.768018 17317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35772
I20260709 13:17:50.768532 17317 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:50.769088 17317 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.784853 17317 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:50.787660 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:50.788247 17389 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.795940 18663 raft_consensus.cc:1064] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:50.799055 18663 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:50.809760 17317 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:50.814275 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:50.819489 17471 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:50.819852 17471 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:50.816584 18681 raft_consensus.cc:2955] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:50.820712 17471 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:50.832965 17471 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.840111 17471 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:17:50.845211 17389 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:17:50.849063 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:50.851745 18564 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:50.852193 18564 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:50.852922 18564 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:50.853554 17997 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:50.853657 17321 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:50.854888 18671 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:50.855189 17215 catalog_manager.cc:5697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:50.857966 18671 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:50.860082 17317 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:50.861820 18711 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:50.869467 18673 raft_consensus.cc:1064] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:50.872331 18673 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:50.884406 17468 raft_consensus.cc:2955] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:50.897343 17999 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEARNER]: Advancing to term 4
I20260709 13:17:50.899236 17317 raft_consensus.cc:2955] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:50.911058 17999 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:50.914214 17215 catalog_manager.cc:5697] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:50.920639 17996 raft_consensus.cc:2955] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:50.914372 18663 raft_consensus.cc:2955] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:50.924688 18706 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:17:50.942827 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 74849.2us
I20260709 13:17:50.992825 17468 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:50.945016 17216 catalog_manager.cc:5697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 2, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.002509 17389 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:17:51.117439 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 107415us
W20260709 13:17:51.117534 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55067.7us
I20260709 13:17:51.150779 17389 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:51.175691 18732 raft_consensus.cc:993] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:51.176218 18732 raft_consensus.cc:1081] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:51.137064 18663 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:17:51.202142 17315 raft_consensus.cc:2955] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.210536 17995 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:51.213656 17996 raft_consensus.cc:2955] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.220467 17321 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:51.222352 17389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:51.222926 17389 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:51.223299 17389 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.223604 18738 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.237175 18663 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.240716 18663 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:51.239519 17216 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.257156 18673 raft_consensus.cc:1064] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:51.259689 18673 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:51.262576 17317 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:51.268121 17998 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:51.262573 17389 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:51.273866 18674 raft_consensus.cc:993] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:51.274362 18674 raft_consensus.cc:1081] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:51.274554 17389 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:51.277348 17468 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:51.283602 17315 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:51.279841 17317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35772
I20260709 13:17:51.284667 17317 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:51.285040 17317 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.281688 18734 raft_consensus.cc:2955] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.289269 18564 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:51.276473 18738 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:17:51.293746 17317 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:51.295388 17205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96a5582b6bfb4ac592225b49ce6df9be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:51.297123 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:51.297705 17389 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.295723 17995 raft_consensus.cc:2955] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.302697 17999 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:51.283718 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:51.303709 17318 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:51.303994 17318 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:51.304811 17318 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:51.305989 17318 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.305354 17321 raft_consensus.cc:2955] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.306412 18674 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:51.308074 18674 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:17:51.312650 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:51.313225 17467 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.313495 17467 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:51.314136 17467 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:51.314990 17467 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.304020 17315 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:51.322885 17317 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:51.326817 17467 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:51.338269 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:51.339506 17397 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:51.340337 18564 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:51.340777 18564 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:51.341529 18564 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:51.344280 17318 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:17:51.346005 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:51.327339 17215 catalog_manager.cc:5697] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 3 to 4, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 1 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.328035 18741 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:51.332619 17389 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:51.332150 18674 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:17:51.335219 17471 raft_consensus.cc:2955] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.353387 17392 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:51.362548 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:51.362823 17392 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:51.363153 17467 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.364472 18743 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:51.364888 18737 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:51.368713 18735 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:51.382464 18735 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:51.383455 18735 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:51.392472 17468 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:51.401484 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a5582b6bfb4ac592225b49ce6df9be with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50014
I20260709 13:17:51.416395 17467 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:17:51.417529 18735 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:51.430137 18742 raft_consensus.cc:2955] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.430923 17216 catalog_manager.cc:5697] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.436094 18711 raft_consensus.cc:2955] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.438695 18756 tablet_replica.cc:333] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:17:51.439868 18756 raft_consensus.cc:2243] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.442234 17995 raft_consensus.cc:2955] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.449126 17396 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:51.457126 18756 raft_consensus.cc:2272] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.460376 18737 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:51.461741 17999 raft_consensus.cc:2955] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.464206 17318 raft_consensus.cc:2955] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.465422 18756 ts_tablet_manager.cc:1916] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:51.471467 17397 raft_consensus.cc:2955] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.480264 17217 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.485045 17395 raft_consensus.cc:2955] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.490147 18756 ts_tablet_manager.cc:1929] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:51.490592 18756 log.cc:1199] T 96a5582b6bfb4ac592225b49ce6df9be P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/96a5582b6bfb4ac592225b49ce6df9be
I20260709 13:17:51.497080 17220 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 3 to 4, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 4 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.499925 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet 96a5582b6bfb4ac592225b49ce6df9be (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:51.502429 17318 raft_consensus.cc:2955] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.521337 17215 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 3 to 6, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.538200 17467 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:51.547137 17316 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:51.549134 18711 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:51.549083 17995 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:51.551874 18711 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:51.558607 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:51.563297 18673 raft_consensus.cc:2955] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.575155 17468 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:51.577466 17318 raft_consensus.cc:2955] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.583441 17999 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:51.588305 18738 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.595467 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aaa77e48390f407cb43bb16febfe2e8d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:51.601769 17996 raft_consensus.cc:2955] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.608794 17998 raft_consensus.cc:2955] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.602883 18673 raft_consensus.cc:2955] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.605594 17395 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:51.614461 17215 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 6 to 7, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 4 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.620055 18738 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.625396 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 24bd9827b3204adba8158c0366088793 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:51.629423 17395 raft_consensus.cc:2955] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.643056 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet aaa77e48390f407cb43bb16febfe2e8d with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:51.646708 17215 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 4, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 1 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.659742 18758 tablet_replica.cc:333] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:51.660980 18758 raft_consensus.cc:2243] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.661760 18758 raft_consensus.cc:2272] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.667254 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet 24bd9827b3204adba8158c0366088793 with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:51.671898 18758 ts_tablet_manager.cc:1916] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:51.687141 18759 tablet_replica.cc:333] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:51.688628 18759 raft_consensus.cc:2243] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.697887 18759 raft_consensus.cc:2272] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.703483 18759 ts_tablet_manager.cc:1916] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:51.801360 18758 ts_tablet_manager.cc:1929] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:17:51.801865 18758 log.cc:1199] T aaa77e48390f407cb43bb16febfe2e8d P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/aaa77e48390f407cb43bb16febfe2e8d
I20260709 13:17:51.809753 18759 ts_tablet_manager.cc:1929] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:51.811100 18759 log.cc:1199] T 24bd9827b3204adba8158c0366088793 P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/24bd9827b3204adba8158c0366088793
I20260709 13:17:51.813720 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet 24bd9827b3204adba8158c0366088793 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:51.818967 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet aaa77e48390f407cb43bb16febfe2e8d (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:51.823963 17321 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:51.830940 18681 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.834462 17395 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:51.840396 17397 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:51.842382 18743 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:51.853133 17995 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:51.854748 18741 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:51.865840 18734 raft_consensus.cc:2955] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.871331 17998 raft_consensus.cc:2955] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.878803 17467 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:51.881603 17205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 128956e308c048a2af21fae67c6683ef with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:51.883934 17467 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:51.890839 17216 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 4 to 5, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.895953 17467 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:51.906215 18564 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:51.908124 18681 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:51.909341 18741 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.914546 17471 raft_consensus.cc:2955] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:51.916069 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet 128956e308c048a2af21fae67c6683ef with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:51.925834 18759 tablet_replica.cc:333] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:51.926894 18759 raft_consensus.cc:2243] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.927601 18759 raft_consensus.cc:2272] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.931420 18759 ts_tablet_manager.cc:1916] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:51.946727 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:51.950747 18759 ts_tablet_manager.cc:1929] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:17:51.953406 18759 log.cc:1199] T 128956e308c048a2af21fae67c6683ef P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/128956e308c048a2af21fae67c6683ef
I20260709 13:17:51.957036 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet 128956e308c048a2af21fae67c6683ef (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:51.999301 17396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:17:51.999926 17396 raft_consensus.cc:606] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:52.002736 17318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:52.003422 17318 raft_consensus.cc:606] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:52.006153 17318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:52.006650 17318 raft_consensus.cc:606] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:52.007979 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:52.009323 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:52.025954 18743 raft_consensus.cc:993] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:52.026479 18732 raft_consensus.cc:1081] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:52.027937 17471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:17:52.028435 17471 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.028766 17471 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.033473 17471 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:52.034966 17471 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:52.035708 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:52.035866 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:52.036388 17318 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.036525 17396 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.036744 17318 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:52.037582 17318 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:52.038446 17318 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.042657 17396 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:52.044827 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:52.045619 18727 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.046273 18727 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:52.046494 17318 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:52.047227 18727 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:52.057863 17216 catalog_manager.cc:5697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.130648 18743 raft_consensus.cc:993] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:52.131192 18732 raft_consensus.cc:1081] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:52.132611 17995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:17:52.133236 17995 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.133512 17995 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.142913 17995 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:52.145388 17995 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:52.146189 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:52.146505 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:52.146835 17322 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.147179 17396 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.147186 17322 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:52.148788 17322 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:52.150097 17322 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.156585 17322 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:52.160148 17962 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:17:52.161123 18729 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.161654 18729 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:52.162580 18729 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:52.169384 17396 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:52.172083 17216 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.298381 18741 raft_consensus.cc:993] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:52.298823 18681 raft_consensus.cc:1081] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:52.300112 17322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35788
I20260709 13:17:52.300491 17322 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.300715 17322 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.304821 17322 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:52.306424 17322 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:52.307466 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:52.308130 17396 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.308495 17396 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:52.308578 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:52.309240 17467 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.309324 17396 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:52.310663 17396 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.315934 17467 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:52.316586 17396 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:52.317171 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:52.317848 18732 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:52.318478 18732 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:52.319205 18732 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:52.328799 17216 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.511916 17322 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.513389 18727 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.526648 17395 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.534685 18727 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.574837 17396 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:52.576102 18729 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:52.590771 17322 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:52.594174 18649 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:52.702028 17396 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:52.703438 18743 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:52.712935 17470 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:52.714443 18743 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:52.990815 17470 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:52.996448 17397 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:52.996619 17318 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:17:52.996915 17434 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2018cf7711d4001a8a9fae2f46d00f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:52.997874 18727 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:52.998642 18673 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:53.012018 18744 raft_consensus.cc:2955] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.017125 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:53.018447 17397 raft_consensus.cc:2955] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.018846 17318 raft_consensus.cc:2955] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.032807 17470 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.045140 17216 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.083050 17318 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:17:53.084357 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0bff337c6c8418e8fe0872b92f3bd6f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.085779 18744 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:17:53.110996 17395 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:53.113605 18727 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:53.169067 18744 raft_consensus.cc:2955] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.172040 17321 raft_consensus.cc:2955] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.180258 17395 raft_consensus.cc:2955] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.189982 17396 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.197741 17214 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 4, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 3 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
W20260709 13:17:53.218199 17360 consensus_peers.cc:597] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16a281c8bb174a28b9e029139de7e00b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.224216 17318 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:53.225716 17471 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:53.226037 18681 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:53.229940 18767 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:53.248705 18767 raft_consensus.cc:2955] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.252943 17322 raft_consensus.cc:2955] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.274055 17216 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.268620 17467 raft_consensus.cc:2955] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.276108 17318 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.284926 17470 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:53.285995 17396 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:53.286473 17285 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b19033ecd72e4ba188910445b70c84d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.287885 18732 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.289784 18778 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.301653 18743 raft_consensus.cc:2955] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.305935 17396 raft_consensus.cc:2955] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.323925 17215 catalog_manager.cc:5697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.327498 17467 raft_consensus.cc:2955] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:17:53.344264 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:53.395458 17396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:17:53.396186 17396 raft_consensus.cc:606] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:53.399498 17318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:53.399931 17318 raft_consensus.cc:606] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:17:53.402448 17467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:53.403002 17467 raft_consensus.cc:606] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:53.405531 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:53.407240 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:53.418771 18797 ts_tablet_manager.cc:933] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:53.420899 18797 tablet_copy_client.cc:323] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:17:53.422371 17480 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet f2018cf7711d4001a8a9fae2f46d00f4 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:17:53.422891 17480 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet f2018cf7711d4001a8a9fae2f46d00f4 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-f2018cf7711d4001a8a9fae2f46d00f4
I20260709 13:17:53.430547 17480 tablet_copy_source_session.cc:215] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:53.434098 18797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2018cf7711d4001a8a9fae2f46d00f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:53.436793 18793 raft_consensus.cc:993] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:53.437332 18793 raft_consensus.cc:1081] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:53.439229 17471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:32812
I20260709 13:17:53.439694 17471 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:53.440032 17471 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.445078 17471 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:53.449481 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:53.450095 17318 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.460644 17318 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:17:53.461844 17434 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:17:53.462539 17471 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:53.463250 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:53.464701 17396 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:53.462595 18785 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:53.465234 17396 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:53.465514 18785 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:53.466228 17396 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:53.466427 18785 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:53.469676 17396 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.470899 18797 tablet_copy_client.cc:806] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:53.471560 18797 tablet_copy_client.cc:670] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:53.481719 17396 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:17:53.482710 18797 tablet_copy_client.cc:538] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:53.513954 17215 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 2 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 3 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.515981 18797 tablet_bootstrap.cc:492] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:53.546259 18797 tablet_bootstrap.cc:492] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:53.547328 18797 tablet_bootstrap.cc:492] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:53.548130 18797 ts_tablet_manager.cc:1403] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.006s
I20260709 13:17:53.551465 18797 raft_consensus.cc:359] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.552503 18797 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:53.553236 18797 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.557215 18797 ts_tablet_manager.cc:1434] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:17:53.559227 17480 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-f2018cf7711d4001a8a9fae2f46d00f4 received from {username='slave'} at 127.0.0.1:59988
I20260709 13:17:53.559715 17480 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-f2018cf7711d4001a8a9fae2f46d00f4 on tablet f2018cf7711d4001a8a9fae2f46d00f4 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:53.601392 18743 raft_consensus.cc:993] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:53.602005 18732 raft_consensus.cc:1081] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:17:53.603519 17396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:17:53.603999 17396 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:53.604346 17396 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.609226 17396 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:53.610915 17396 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:53.611948 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:17:53.612633 17998 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.611899 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:53.614133 17318 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:53.614480 17318 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:53.615221 17318 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:53.620138 17998 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:53.621300 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:53.621467 17318 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.622107 18793 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:53.622720 18793 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:53.623462 18793 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:53.630787 17318 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:17:53.637775 17215 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.676146 18797 ts_tablet_manager.cc:933] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:53.678324 18797 tablet_copy_client.cc:323] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:17:53.679927 17480 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet b0bff337c6c8418e8fe0872b92f3bd6f from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:17:53.680418 17480 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet b0bff337c6c8418e8fe0872b92f3bd6f from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-b0bff337c6c8418e8fe0872b92f3bd6f
I20260709 13:17:53.689152 17480 tablet_copy_source_session.cc:215] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:53.694844 18797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bff337c6c8418e8fe0872b92f3bd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:53.705737 18803 ts_tablet_manager.cc:933] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:53.713516 18803 tablet_copy_client.cc:323] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:17:53.715374 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet 16a281c8bb174a28b9e029139de7e00b from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:17:53.716017 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet 16a281c8bb174a28b9e029139de7e00b from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-16a281c8bb174a28b9e029139de7e00b
I20260709 13:17:53.716732 18797 tablet_copy_client.cc:806] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:53.717348 18797 tablet_copy_client.cc:670] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:53.722540 18797 tablet_copy_client.cc:538] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:53.725979 17407 tablet_copy_source_session.cc:215] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:53.729946 18803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a281c8bb174a28b9e029139de7e00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:53.731791 18797 tablet_bootstrap.cc:492] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:53.759542 18803 tablet_copy_client.cc:806] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:53.760290 18803 tablet_copy_client.cc:670] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:53.764328 18806 ts_tablet_manager.cc:933] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163)
I20260709 13:17:53.765512 18803 tablet_copy_client.cc:538] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:53.770730 18797 tablet_bootstrap.cc:492] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:53.771867 18797 tablet_bootstrap.cc:492] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:53.772630 18797 ts_tablet_manager.cc:1403] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.041s	user 0.029s	sys 0.005s
I20260709 13:17:53.776127 18797 raft_consensus.cc:359] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.777272 18797 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:53.779134 18803 tablet_bootstrap.cc:492] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:53.777966 18797 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.785092 18797 ts_tablet_manager.cc:1434] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:53.788906 17480 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-b0bff337c6c8418e8fe0872b92f3bd6f received from {username='slave'} at 127.0.0.1:59988
I20260709 13:17:53.789369 17480 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-b0bff337c6c8418e8fe0872b92f3bd6f on tablet b0bff337c6c8418e8fe0872b92f3bd6f with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:53.793903 17998 raft_consensus.cc:1217] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:53.800828 18806 tablet_copy_client.cc:323] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.1:40163
I20260709 13:17:53.805015 17332 tablet_copy_service.cc:140] P 7241e45fbfca4b46b6df9be8cebcd863: Received BeginTabletCopySession request for tablet b19033ecd72e4ba188910445b70c84d5 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:51628)
I20260709 13:17:53.805574 17332 tablet_copy_service.cc:161] P 7241e45fbfca4b46b6df9be8cebcd863: Beginning new tablet copy session on tablet b19033ecd72e4ba188910445b70c84d5 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:51628: session id = 3747096bb5074ea2bf86037fd17c1160-b19033ecd72e4ba188910445b70c84d5
I20260709 13:17:53.812891 17332 tablet_copy_source_session.cc:215] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:53.816363 18806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19033ecd72e4ba188910445b70c84d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:53.822994 18803 tablet_bootstrap.cc:492] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:53.823974 18803 tablet_bootstrap.cc:492] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:53.824668 18803 ts_tablet_manager.cc:1403] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.008s
I20260709 13:17:53.828826 18803 raft_consensus.cc:359] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.830958 18803 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:53.831610 18803 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.833928 18806 tablet_copy_client.cc:806] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:53.834144 18803 ts_tablet_manager.cc:1434] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:53.834470 18806 tablet_copy_client.cc:670] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:53.840416 17407 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-16a281c8bb174a28b9e029139de7e00b received from {username='slave'} at 127.0.0.1:59472
I20260709 13:17:53.840943 17407 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-16a281c8bb174a28b9e029139de7e00b on tablet 16a281c8bb174a28b9e029139de7e00b with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:53.842521 18806 tablet_copy_client.cc:538] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:53.854851 18806 tablet_bootstrap.cc:492] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:17:53.872407 18727 raft_consensus.cc:993] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:53.872997 18785 raft_consensus.cc:1081] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:53.874949 17322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35772
I20260709 13:17:53.875545 17322 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:53.875916 17322 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.881335 18806 tablet_bootstrap.cc:492] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:53.882382 18806 tablet_bootstrap.cc:492] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:17:53.882488 17322 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:53.884287 18806 ts_tablet_manager.cc:1403] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.030s	user 0.026s	sys 0.001s
I20260709 13:17:53.885208 17322 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:53.885462 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:53.886071 17395 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.889730 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:53.890368 17467 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:53.890681 17467 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:53.891451 17467 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:53.892665 17467 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.893079 17395 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:53.894415 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:53.895778 18743 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:53.896306 18743 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:53.897325 18743 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:53.898499 18806 raft_consensus.cc:359] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.899448 18806 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:17:53.900339 18806 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:17:53.907801 18806 ts_tablet_manager.cc:1434] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:17:53.910605 17467 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:53.913204 17332 tablet_copy_service.cc:342] P 7241e45fbfca4b46b6df9be8cebcd863: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-b19033ecd72e4ba188910445b70c84d5 received from {username='slave'} at 127.0.0.1:51628
I20260709 13:17:53.913645 17332 tablet_copy_service.cc:434] P 7241e45fbfca4b46b6df9be8cebcd863: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-b19033ecd72e4ba188910445b70c84d5 on tablet b19033ecd72e4ba188910445b70c84d5 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:53.930605 17215 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.993389 17318 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:53.994768 18744 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:54.022590 17395 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:54.026186 18727 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:54.039207 17318 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:54.040934 18681 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:54.097795 17995 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:54.099856 18793 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:54.190384 18744 raft_consensus.cc:1064] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:54.200479 18744 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:54.204139 17995 raft_consensus.cc:1217] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:17:54.234995 17995 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:54.236665 17396 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:54.237284 18824 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:54.243363 18785 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:17:54.283991 17998 raft_consensus.cc:1217] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:54.300325 17321 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:54.316475 18824 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:54.327811 18824 raft_consensus.cc:2955] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.329763 17396 raft_consensus.cc:2955] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.349655 17998 raft_consensus.cc:2955] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.356171 17318 raft_consensus.cc:2955] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.357656 17995 raft_consensus.cc:1217] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:54.370877 17216 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.379923 17396 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:54.388885 18732 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:54.408635 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:54.422470 17467 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:54.434423 17995 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:54.435101 17318 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:54.436172 18821 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:54.438207 18785 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:54.447197 18824 raft_consensus.cc:2955] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.448622 17322 raft_consensus.cc:2955] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.452338 17467 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:54.451799 17998 raft_consensus.cc:2955] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.453881 18743 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:54.459406 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2018cf7711d4001a8a9fae2f46d00f4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:54.494314 17217 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 4 to 5, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 2 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.519538 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet f2018cf7711d4001a8a9fae2f46d00f4 with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:54.536571 18831 tablet_replica.cc:333] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:54.537778 18831 raft_consensus.cc:2243] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.538653 18831 raft_consensus.cc:2272] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.543673 18831 ts_tablet_manager.cc:1916] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:54.560667 18831 ts_tablet_manager.cc:1929] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:17:54.561210 18831 log.cc:1199] T f2018cf7711d4001a8a9fae2f46d00f4 P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/f2018cf7711d4001a8a9fae2f46d00f4
I20260709 13:17:54.563508 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet f2018cf7711d4001a8a9fae2f46d00f4 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:54.568905 18744 raft_consensus.cc:1064] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:54.571549 18744 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:54.590023 17995 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:54.592396 17318 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:54.593053 17397 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:54.592995 18744 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:54.594404 18821 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:54.595424 18824 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:54.617445 18821 raft_consensus.cc:2955] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.619220 17397 raft_consensus.cc:2955] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.622023 17995 raft_consensus.cc:2955] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.637629 17217 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 4 to 5, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.648241 17318 raft_consensus.cc:2955] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.672678 17467 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:54.693802 17998 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:54.694967 17318 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:54.696727 18822 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:54.698230 18822 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:54.704746 18822 raft_consensus.cc:2955] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.715685 17998 raft_consensus.cc:2955] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.718758 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b0bff337c6c8418e8fe0872b92f3bd6f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:54.720503 17318 raft_consensus.cc:2955] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.736984 17216 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 5 to 6, VOTER c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) evicted. New cstate: current_term: 3 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.755329 17387 tablet_service.cc:1558] Processing DeleteTablet for tablet b0bff337c6c8418e8fe0872b92f3bd6f with delete_type TABLET_DATA_TOMBSTONED (TS c23a664ebf3347a4934dee377c8b5101 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40262
I20260709 13:17:54.756348 18831 tablet_replica.cc:333] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:17:54.757294 18831 raft_consensus.cc:2243] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.757951 18831 raft_consensus.cc:2272] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.760252 18831 ts_tablet_manager.cc:1916] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:54.771044 18831 ts_tablet_manager.cc:1929] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:17:54.771432 18831 log.cc:1199] T b0bff337c6c8418e8fe0872b92f3bd6f P c23a664ebf3347a4934dee377c8b5101: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/wals/b0bff337c6c8418e8fe0872b92f3bd6f
I20260709 13:17:54.773133 17205 catalog_manager.cc:5028] TS c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): tablet b0bff337c6c8418e8fe0872b92f3bd6f (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:54.781147 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:54.787823 18767 raft_consensus.cc:1064] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:54.790338 18767 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:54.804551 17998 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:54.804947 17322 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:54.807374 17467 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:54.806457 18681 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:54.809607 18681 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:54.811337 18767 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:54.824618 18767 raft_consensus.cc:2955] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.830561 17322 raft_consensus.cc:2955] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.841552 17467 raft_consensus.cc:2955] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.843195 17998 raft_consensus.cc:2955] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.856072 17220 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: config changed from index 3 to 4, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.865832 17322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:17:54.866477 17322 raft_consensus.cc:606] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:17:54.875741 17397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:17:54.876319 17397 raft_consensus.cc:606] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:17:54.879449 17467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:17:54.880007 17467 raft_consensus.cc:606] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:17:54.882196 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:54.884285 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:54.893389 17397 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:54.899412 17998 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:54.901165 17467 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:54.902817 18767 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:54.904407 18793 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:54.911001 18840 raft_consensus.cc:2955] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.912567 17471 raft_consensus.cc:2955] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.913697 17995 raft_consensus.cc:2955] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.932053 17217 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 4 to 5, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 2 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:54.947768 18778 raft_consensus.cc:1064] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:17:54.948379 18681 raft_consensus.cc:993] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: : Instructing follower 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:54.948971 18681 raft_consensus.cc:1081] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Signalling peer 7241e45fbfca4b46b6df9be8cebcd863 to start an election
I20260709 13:17:54.950171 17205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 16a281c8bb174a28b9e029139de7e00b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:54.950328 18778 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:54.953140 17308 tablet_service.cc:1558] Processing DeleteTablet for tablet 16a281c8bb174a28b9e029139de7e00b with delete_type TABLET_DATA_TOMBSTONED (TS 7241e45fbfca4b46b6df9be8cebcd863 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45370
I20260709 13:17:54.956390 18841 tablet_replica.cc:333] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:17:54.957504 18841 raft_consensus.cc:2243] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.958357 18841 raft_consensus.cc:2272] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.958714 17322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:35788
I20260709 13:17:54.959255 17322 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:54.959646 17322 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:54.961576 18821 raft_consensus.cc:993] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:54.962095 18821 raft_consensus.cc:1081] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:17:54.962091 18841 ts_tablet_manager.cc:1916] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:54.968959 17995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44546
I20260709 13:17:54.969515 17995 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:54.969914 17995 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:54.976572 17995 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:54.979010 18841 ts_tablet_manager.cc:1929] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:17:54.980334 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:54.990295 17467 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:54.990691 17467 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:17:54.991568 17467 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:54.979220 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:54.992755 17467 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:54.992807 17397 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.013890 18841 log.cc:1199] T 16a281c8bb174a28b9e029139de7e00b P 7241e45fbfca4b46b6df9be8cebcd863: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/wals/16a281c8bb174a28b9e029139de7e00b
I20260709 13:17:55.019754 17204 catalog_manager.cc:5028] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): tablet 16a281c8bb174a28b9e029139de7e00b (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:17:55.021595 17322 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:55.027145 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:54.979166 17995 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:55.027763 17396 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:55.028136 17396 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:17:55.029920 17397 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:17:55.029666 17396 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:55.030930 17396 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.032032 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:55.032428 17467 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:17:55.032891 18729 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:55.033458 18729 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:17:55.034328 18729 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:55.048681 17396 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:55.050140 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:17:55.050971 18845 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:55.051818 18845 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:55.052870 18845 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:55.060074 17322 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:55.062024 17467 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:55.063928 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:17:55.064558 17467 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.068045 17998 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 LEARNER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:55.069471 17396 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:55.069602 18843 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:55.078015 18843 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.090934 17467 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:17:55.094318 18743 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.119187 17217 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 2 to 3, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 3 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.135156 18845 raft_consensus.cc:993] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:55.135684 18845 raft_consensus.cc:1081] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:17:55.132426 17216 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.136487 18846 raft_consensus.cc:2955] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:55.138875 17467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:17:55.139762 17467 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.140161 17467 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.142338 17468 raft_consensus.cc:2955] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:55.143747 17998 raft_consensus.cc:2955] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:55.147770 17467 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:55.148737 17397 raft_consensus.cc:2955] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:17:55.152580 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:17:55.153162 17396 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.161468 17396 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:17:55.169867 17467 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:56.046533 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:17:56.047222 17322 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:56.047535 17322 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:17:56.048410 17322 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:56.057535 17322 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.066237 17322 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
W20260709 13:17:57.246368 17437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.000s	sys 0.005s
W20260709 13:17:57.247375 17437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.000s	sys 0.006s
I20260709 13:17:57.335031 18857 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.353727 18855 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.354956 18855 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.359347 18854 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:57.359776 18855 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:57.348356 18856 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:57.363698 18856 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.365118 18859 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.366113 18859 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.368185 18856 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:57.378216 18854 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.347303 18857 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.387584 18857 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:57.391650 18859 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:57.437862 18863 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.438869 18863 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.441967 18863 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:57.394302 18855 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:57.447362 18855 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.450522 18855 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:57.451902 18868 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:57.453027 18868 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.453879 18867 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:57.457463 18854 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:57.459120 18862 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.460314 18862 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.466868 18853 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.467743 18853 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.468312 18785 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.455065 18867 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.455869 18868 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:57.482874 18864 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.483983 18864 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.485872 18861 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.499145 18856 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:57.500243 18856 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.504094 18860 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.504607 18856 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:57.509492 18785 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.510115 18853 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:57.510775 18858 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.512814 18864 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:57.513304 18785 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:57.505060 18860 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.521728 18862 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:57.486845 18861 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.512606 18858 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.535049 18872 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.508665 18854 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:57.540145 18861 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:57.507988 18856 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.540627 18870 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.541587 18856 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.552217 18856 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:57.528177 18859 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.544417 18867 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:57.544992 18866 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.553148 18859 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.553369 18866 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.522177 18860 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:57.545131 18869 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:57.555503 18859 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:57.555950 18869 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:17:57.546141 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.558926 18869 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:57.508858 18857 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.559751 18857 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.562326 18857 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:57.555503 18866 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:57.567257 18884 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.568425 18884 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.574231 18884 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:57.530033 18862 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:57.523085 18864 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.618479 18879 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.606290 18861 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:57.614074 18859 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.615649 18860 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:57.617089 18857 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.619401 18879 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.806447 18881 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:57.626919 18856 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:57.969039 18865 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.970038 18865 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.972693 18865 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:57.976622 18874 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:57.731860 18887 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.732236 18863 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:57.793639 18785 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:57.732550 18854 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.965220 18877 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.975106 18869 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:57.638438 18872 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.978843 18862 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.054390 18894 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:57.983182 18861 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:57.989991 18864 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:57.642776 18870 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.045359 18865 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.992698 18856 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.266328 18886 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:58.287786 18888 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:58.047369 18860 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.047531 18857 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.084748 18882 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:57.978044 18874 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.363726 18891 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:58.364872 18891 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.288214 18886 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.046903 18881 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.049780 18859 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.295984 18869 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.294454 18892 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:58.354516 18890 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:58.370880 18858 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:58.355311 18785 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.266757 18863 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.288877 18888 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.296418 18889 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:58.088201 18887 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.438740 18900 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.439311 18876 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:58.440944 18873 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:58.398828 18865 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.442443 18858 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:58.399384 18866 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:17:58.583470 18020 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec5c0 after lost signal to thread 16195
I20260709 13:17:58.434125 18853 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:17:58.588778 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.003s	sys 0.008s
W20260709 13:17:58.589349 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.004s	sys 0.008s
I20260709 13:17:58.599941 18897 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:58.602407 18895 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:58.393512 18894 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:17:58.612200 17288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.001s
W20260709 13:17:58.613235 17288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.010s	sys 0.001s
I20260709 13:17:58.614147 18886 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:58.603236 18895 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.589867 18892 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.601002 18897 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.615762 18878 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:17:58.625864 17363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.019s	sys 0.033s
I20260709 13:17:58.584750 18875 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:58.629886 18894 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.631146 18893 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:58.625818 18908 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.356546 18877 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.618731 18891 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:17:58.653723 17363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.020s	sys 0.034s
I20260709 13:17:58.680613 18903 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:58.436676 18882 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.644575 18899 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:58.641809 18854 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.645597 18873 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.631970 18853 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.646204 18879 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:58.700307 18904 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:58.608440 18858 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:17:58.717650 17436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.026s
I20260709 13:17:58.717948 18909 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:17:58.718189 17436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.000s	sys 0.027s
I20260709 13:17:58.686168 18894 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:58.688119 18886 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:58.702283 18861 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:58.723667 18914 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:58.707150 18785 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.644755 18878 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.718935 18891 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:17:58.734987 17965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.004s	sys 0.015s
I20260709 13:17:58.689891 18866 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.719682 18862 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.746115 18898 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:17:58.747119 17965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.005s	sys 0.015s
I20260709 13:17:58.724457 18856 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.704185 18896 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:58.680063 18905 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:58.751577 18916 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:58.735956 18860 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.686623 18900 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.632700 18890 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.743178 18887 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:58.747119 18785 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:58.720570 18875 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:17:58.773574 17435 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.067s (SENT)
I20260709 13:17:58.686389 18889 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.782011 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:58.626627 18876 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.794224 18853 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:58.794886 18853 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:58.795215 18895 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:58.795826 18895 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:58.795570 18853 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.785887 18883 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:58.755415 18864 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:58.797811 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:58.752231 18891 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.758535 18906 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:58.774397 18905 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.759411 18856 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:58.778944 18872 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:58.793023 18857 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:58.796411 18895 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.797535 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:58.767989 18886 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.731717 18903 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.775645 18910 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:58.776453 18894 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.793406 18887 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:58.797534 18883 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.825062 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:58.769404 18901 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:58.817866 17394 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:58.752568 18893 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.805306 18896 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.753065 18908 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.790700 18914 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.779439 18899 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.811131 17393 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:58.811571 18881 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.818706 18872 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:58.850723 18875 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.852730 18903 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:58.750379 18904 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.853364 18856 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.854231 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:58.845223 18869 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:58.818332 18785 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.855026 18887 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.863412 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:58.815828 18898 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.770735 18909 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.829690 18916 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:58.922576 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:58.870795 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:59.037704 18896 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:58.979598 17389 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:17:58.869844 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:58.965238 18866 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:58.974844 18886 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.042217 17471 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:17:58.974165 18785 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.901995 18859 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.844995 18902 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.020998 17434 connection.cc:256] RPC call timeout handler was delayed by -1.7857330279998678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
I20260709 13:17:59.055202 18908 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.067728 18890 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:58.978367 18858 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.975070 18863 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.973662 18883 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.978562 18894 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.908335 18895 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.017241 18913 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.861546 18910 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:58.906410 18882 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.085484 18915 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:59.041522 18876 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.867767 18872 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:59.043393 18897 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.023380 18875 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:59.069587 18866 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:59.073391 18892 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:17:59.034090 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 219768us
I20260709 13:17:59.087442 18890 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:59.039156 18914 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:59.073557 18853 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.095789 18785 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:59.054287 17388 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:17:59.081171 18856 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:59.091966 18903 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:59.106254 18905 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.923985 18901 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.109405 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:59.109694 18911 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:59.109537 18866 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:59.092057 18889 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.089774 18863 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:59.114964 17470 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:17:59.115559 18903 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.116242 18910 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.116794 18893 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.117514 18873 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.104956 18891 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:59.123930 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:59.110769 18890 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.114171 18887 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.112551 18876 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:59.120922 18905 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:59.126248 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:59.106869 18915 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.123782 18899 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:58.919248 18906 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.144764 18857 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:59.145668 18857 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:59.146492 18880 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:59.145021 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:59.125792 18896 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:59.129280 18892 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:59.098338 18902 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.124003 18875 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.141737 18854 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:59.128309 18785 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.135980 18863 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.147092 18880 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.144124 18905 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.121295 18913 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:59.137102 18911 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:59.166909 18909 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.181110 18896 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.145053 18920 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:59.395453 18885 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:59.157960 18860 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:59.384006 18924 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:17:59.398025 18860 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:59.167656 18916 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.186106 18882 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:59.399240 18903 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.153239 18876 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.416791 18872 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:59.162955 18864 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:17:59.399457 18857 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.190343 18892 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.398922 18902 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:17:59.424731 18020 debug-util.cc:398] Leaking SignalData structure 0x7b08002ecca0 after lost signal to thread 17254
I20260709 13:17:59.284828 18915 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.342036 18854 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:59.339980 18898 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.190568 18904 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:59.318708 18912 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:59.274405 18921 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:17:59.285739 18925 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:17:59.444986 17466 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:59.445220 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.445418 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:59.398376 18924 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.447806 17317 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:17:59.443325 17321 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:17:59.441592 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:59.396365 18885 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.450704 17314 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:17:59.442855 18866 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.461263 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.463760 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:59.463367 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.434918 18882 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.449893 18864 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:59.396984 18920 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.448068 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.474835 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:59.476490 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.477205 17997 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
W20260709 13:17:59.471112 18020 debug-util.cc:398] Leaking SignalData structure 0x7b0800228b60 after lost signal to thread 17346
I20260709 13:17:59.468549 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:59.482661 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.482226 17463 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:17:59.485062 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.485952 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.485329 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:59.473697 18890 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.491021 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:59.491124 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.491497 18913 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:59.491523 18863 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.491890 17992 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:17:59.494016 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:17:59.481791 18020 debug-util.cc:398] Leaking SignalData structure 0x7b0800337dc0 after lost signal to thread 17347
I20260709 13:17:59.494544 17997 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:59.466112 18921 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.503106 18911 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:59.483680 18906 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.498962 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.506500 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.496119 18905 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.462956 18912 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.512619 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.513728 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:59.514386 17463 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:17:59.517903 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:17:59.518296 18924 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:17:59.498281 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.519511 17990 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:17:59.518029 18864 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.527964 18900 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:17:59.467114 18925 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.491614 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:17:59.534044 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:17:59.534986 17995 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:17:59.544117 18892 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.557510 18912 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.827456 18925 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:17:59.550988 18920 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:00.652122 18901 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:00.692476 18896 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:00.711196 18888 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:00.741782 18854 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:00.753508 17964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.626s	user 0.030s	sys 0.045s
W20260709 13:18:00.754549 17964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.627s	user 0.031s	sys 0.045s
I20260709 13:18:00.754148 17215 catalog_manager.cc:5697] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 2 to 3, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:18:00.755896 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:00.756664 17394 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
W20260709 13:18:00.757237 17394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1248) took 1960 ms (client timeout 2220 ms). Trace:
W20260709 13:18:00.757741 17394 rpcz_store.cc:269] 0709 13:17:58.796513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.846706 (+ 50193us) service_pool.cc:224] Handling call
0709 13:18:00.755728 (+1909022us) spinlock_profiling.cc:243] Waited 947 us on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:00.757155 (+  1427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177792}
I20260709 13:18:00.759415 18878 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:00.760054 18878 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.764490 18878 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:00.760061 18896 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:00.768647 18896 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:00.790200 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800035ee0 after lost signal to thread 16195
I20260709 13:18:01.097661 18878 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:01.125878 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 244828us
W20260709 13:18:01.173406 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 288069us
I20260709 13:18:01.176642 18931 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:01.342926 18931 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:01.346402 18931 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:01.368547 18870 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:01.401988 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800057060 after lost signal to thread 17254
I20260709 13:18:01.408440 18904 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:01.409684 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:01.409919 18904 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:01.410897 18870 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:01.413077 18870 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:01.413539 18870 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.416718 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:01.417464 18904 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:01.418066 18878 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:01.418228 17287 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:01.418519 18878 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:01.418972 18878 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.417480 18865 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:01.432808 17321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 228) took 2313 ms (client timeout 1770 ms). Trace:
W20260709 13:18:01.433429 17321 rpcz_store.cc:269] 0709 13:17:59.119486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.124857 (+  5371us) service_pool.cc:224] Handling call
0709 13:18:01.432510 (+2307653us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54001428d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:01.432682 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667565312}
I20260709 13:18:01.435550 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2040) took 2317 ms. Trace:
I20260709 13:18:01.435860 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 235) took 1986 ms. Trace:
I20260709 13:18:01.440191 17321 rpcz_store.cc:276] 0709 13:17:59.449687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.434561 (+1984874us) service_pool.cc:224] Handling call
0709 13:18:01.435051 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.435338 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.435380 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.435460 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.435546 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.435622 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.435757 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.438925 18855 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:01.442008 18855 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:01.442414 18855 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:01.437419 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1240) took 2635 ms. Trace:
I20260709 13:18:01.439590 17465 rpcz_store.cc:276] 0709 13:17:59.118437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.130743 (+ 12306us) service_pool.cc:224] Handling call
0709 13:17:59.134019 (+  3276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.149698 (+ 15679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.151485 (+  1787us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.156190 (+  4705us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:59.167148 (+ 10958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.428687 (+2261539us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b5400200b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:01.428763 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.435294 (+  6531us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16520064}
I20260709 13:18:01.443212 17392 rpcz_store.cc:276] 0709 13:17:58.785702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.797658 (+ 11956us) service_pool.cc:224] Handling call
0709 13:17:58.800210 (+  2552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.838976 (+ 38766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.839007 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.839070 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:58.839105 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.420436 (+2581331us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b54002bd754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:01.420506 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.420667 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88501120}
W20260709 13:18:01.444398 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1132) took 1958 ms (client timeout 1540 ms). Trace:
W20260709 13:18:01.445302 17465 rpcz_store.cc:269] 0709 13:17:59.486154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.444201 (+1958047us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.444326 (+   125us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:18:01.446280 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:01.446604 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1137) took 1913 ms (client timeout 1504 ms). Trace:
I20260709 13:18:01.446939 17463 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
W20260709 13:18:01.447480 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1135) took 1927 ms (client timeout 1502 ms). Trace:
W20260709 13:18:01.448007 17463 rpcz_store.cc:269] 0709 13:17:59.520308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.526320 (+  6012us) service_pool.cc:224] Handling call
0709 13:18:01.447399 (+1921079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.439324 18878 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:01.451030 18878 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:01.443557 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 236) took 1975 ms. Trace:
I20260709 13:18:01.452394 17321 rpcz_store.cc:276] 0709 13:17:59.468157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.442209 (+1974052us) service_pool.cc:224] Handling call
0709 13:18:01.442780 (+   571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.443050 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.443087 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.443227 (+   140us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.443275 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.443344 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.443488 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.454890 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1245) took 1981 ms. Trace:
W20260709 13:18:01.455255 17434 connection.cc:256] RPC call timeout handler was delayed by -1.2596951400000762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
W20260709 13:18:01.456140 17434 connection.cc:256] RPC call timeout handler was delayed by -1.1903951399999642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
I20260709 13:18:01.455322 17321 rpcz_store.cc:276] 0709 13:17:59.475972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.453730 (+1977758us) service_pool.cc:224] Handling call
0709 13:18:01.454147 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.454423 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.454464 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.454544 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:01.454591 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.454667 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.454810 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.458747 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 237) took 1977 ms. Trace:
W20260709 13:18:01.459385 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1134) took 1939 ms (client timeout 1529 ms). Trace:
I20260709 13:18:01.459259 17321 rpcz_store.cc:276] 0709 13:17:59.481230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.457070 (+1975840us) service_pool.cc:224] Handling call
0709 13:18:01.457929 (+   859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.458272 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.458315 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.458390 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:01.458435 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.458511 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.458670 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:01.460114 17463 rpcz_store.cc:269] 0709 13:17:59.519831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.459092 (+1939261us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.459306 (+   214us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:18:01.461274 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1130) took 2000 ms (client timeout 1661 ms). Trace:
W20260709 13:18:01.456547 17434 connection.cc:256] RPC call timeout handler was delayed by -1.1471951400001217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260709 13:18:01.461778 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1246) took 1972 ms. Trace:
W20260709 13:18:01.461958 17434 connection.cc:256] RPC call timeout handler was delayed by -1.0922951400000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
I20260709 13:18:01.462024 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:01.462599 17434 connection.cc:256] RPC call timeout handler was delayed by -1.0231249550001849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:18:01.447167 17465 rpcz_store.cc:269] 0709 13:17:59.533554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.446366 (+1912812us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.446513 (+   147us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:18:01.463066 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1243) took 2668 ms (client timeout 2240 ms). Trace:
W20260709 13:18:01.463603 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1133) took 1962 ms (client timeout 1691 ms). Trace:
W20260709 13:18:01.465534 17465 rpcz_store.cc:269] 0709 13:17:59.501593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.463419 (+1961826us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.463543 (+   124us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:18:01.461776 17463 rpcz_store.cc:269] 0709 13:17:59.460606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.461115 (+2000509us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.461222 (+   107us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:18:01.466485 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1128) took 2006 ms (client timeout 1749 ms). Trace:
W20260709 13:18:01.466864 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1129) took 2006 ms (client timeout 1821 ms). Trace:
I20260709 13:18:01.467592 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 386) took 1987 ms. Trace:
I20260709 13:18:01.462445 17321 rpcz_store.cc:276] 0709 13:17:59.489531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.460689 (+1971158us) service_pool.cc:224] Handling call
0709 13:18:01.461104 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.461351 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.461388 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.461460 (+    72us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:01.461502 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.461581 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.461712 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:01.463069 17434 connection.cc:256] RPC call timeout handler was delayed by -1.0078249550001601s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 13:18:01.470572 17434 connection.cc:256] RPC call timeout handler was delayed by -1.0078249550001601s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 13:18:01.467417 17463 rpcz_store.cc:269] 0709 13:17:59.460263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.466651 (+2006388us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.466784 (+   133us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:18:01.471511 17434 connection.cc:256] RPC call timeout handler was delayed by -1.0033249550001528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 13:18:01.468205 17997 rpcz_store.cc:276] 0709 13:17:59.480001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.466575 (+1986574us) service_pool.cc:224] Handling call
0709 13:18:01.466898 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.467188 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.467225 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.467295 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.467338 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.467410 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.467529 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:01.463459 17391 rpcz_store.cc:269] 0709 13:17:58.794668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.797000 (+  2332us) service_pool.cc:224] Handling call
0709 13:18:01.461745 (+2664745us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:01.462968 (+  1223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2820864}
I20260709 13:18:01.460457 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 386) took 1986 ms. Trace:
W20260709 13:18:01.476432 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1123) took 2108 ms (client timeout 1970 ms). Trace:
I20260709 13:18:01.476699 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 387) took 1993 ms. Trace:
I20260709 13:18:01.477159 17997 rpcz_store.cc:276] 0709 13:17:59.482961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.472872 (+1989911us) service_pool.cc:224] Handling call
0709 13:18:01.476134 (+  3262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.476363 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.476395 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.476447 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.476476 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.476533 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.476645 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:01.476997 17463 rpcz_store.cc:269] 0709 13:17:59.367925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.476204 (+2108279us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.476338 (+   134us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:18:01.478935 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1124) took 2062 ms (client timeout 1928 ms). Trace:
W20260709 13:18:01.480147 17463 rpcz_store.cc:269] 0709 13:17:59.416677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.478700 (+2062023us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.478866 (+   166us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:18:01.437206 18870 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:01.480943 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62790.1us
I20260709 13:18:01.479597 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 238) took 1987 ms. Trace:
I20260709 13:18:01.481564 17321 rpcz_store.cc:276] 0709 13:17:59.492411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.469119 (+1976708us) service_pool.cc:224] Handling call
0709 13:18:01.477448 (+  8329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.477654 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.477690 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.477757 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.477792 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.479376 (+  1584us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.479531 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.479223 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 388) took 1996 ms. Trace:
I20260709 13:18:01.481751 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:01.482673 17997 rpcz_store.cc:276] 0709 13:17:59.483312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.478094 (+1994782us) service_pool.cc:224] Handling call
0709 13:18:01.478656 (+   562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.478873 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.478900 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.478959 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.479016 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.479067 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.479171 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.474435 17990 rpcz_store.cc:276] 0709 13:17:59.474490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.459493 (+1985003us) service_pool.cc:224] Handling call
0709 13:18:01.459830 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.460065 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.460092 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.460152 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.460205 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.460264 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.460377 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.486011 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 390) took 2002 ms. Trace:
I20260709 13:18:01.486443 17997 rpcz_store.cc:276] 0709 13:17:59.483953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.483653 (+1999700us) service_pool.cc:224] Handling call
0709 13:18:01.485391 (+  1738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.485641 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.485665 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.485722 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.485750 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.485816 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.485959 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.452086 18855 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:17:59.536307 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:01.490674 17393 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
W20260709 13:18:01.491165 17393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2096) took 1958 ms (client timeout 2042 ms). Trace:
W20260709 13:18:01.488763 17287 connection.cc:256] RPC call timeout handler was delayed by -1.0943762639999477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260709 13:18:01.488920 18855 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:01.466876 17465 rpcz_store.cc:269] 0709 13:17:59.459883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.466324 (+2006441us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.466432 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:18:01.489856 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:01.481271 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1126) took 2045 ms (client timeout 1950 ms). Trace:
W20260709 13:18:01.491926 17287 connection.cc:256] RPC call timeout handler was delayed by -1.0602410860001328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 13:18:01.492964 17462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2045) took 2217 ms (client timeout 1526 ms). Trace:
W20260709 13:18:01.493235 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1127) took 2039 ms (client timeout 2034 ms). Trace:
W20260709 13:18:01.493289 17462 rpcz_store.cc:269] 0709 13:17:59.282862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.283007 (+   145us) service_pool.cc:224] Handling call
0709 13:18:01.489639 (+2206632us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:01.492879 (+  3240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40260480}
W20260709 13:18:01.493744 17465 rpcz_store.cc:269] 0709 13:17:59.457914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.493060 (+2035146us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.493173 (+   113us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:18:01.491462 17393 rpcz_store.cc:269] 0709 13:17:59.533036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.535937 (+  2901us) service_pool.cc:224] Handling call
0709 13:18:01.491119 (+1955182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.483711 18933 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:01.495345 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.496274 18870 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:01.496883 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.495358 18933 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:01.497661 18933 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.498029 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.498574 17321 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:01.499351 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.499861 17321 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:01.494866 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.500600 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:01.500867 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1136) took 1980 ms (client timeout 2124 ms). Trace:
I20260709 13:18:01.501178 17321 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
W20260709 13:18:01.501296 17465 rpcz_store.cc:269] 0709 13:17:59.520735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.494588 (+1973853us) service_pool.cc:224] Handling call
0709 13:18:01.500756 (+  6168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.502202 18853 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:01.502405 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.502758 18853 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:01.503217 17465 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:01.504299 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.504760 18853 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:01.510629 18853 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:01.511436 18853 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:01.496933 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2094) took 1968 ms. Trace:
W20260709 13:17:59.539666 18020 debug-util.cc:398] Leaking SignalData structure 0x7b080032d7c0 after lost signal to thread 17421
W20260709 13:18:01.517869 18020 debug-util.cc:398] Leaking SignalData structure 0x7b080032dbc0 after lost signal to thread 17422
I20260709 13:18:01.517606 17395 rpcz_store.cc:276] 0709 13:17:59.529911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.533298 (+  3387us) service_pool.cc:224] Handling call
0709 13:18:01.496407 (+1963109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.496606 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.496630 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.496670 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:01.496697 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.496748 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.496860 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.493662 18785 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:01.519212 18020 debug-util.cc:398] Leaking SignalData structure 0x7b080023bfc0 after lost signal to thread 17495
W20260709 13:18:01.519541 18020 debug-util.cc:398] Leaking SignalData structure 0x7b0800279360 after lost signal to thread 17496
I20260709 13:18:01.494587 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.520776 17462 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
W20260709 13:18:01.521553 17462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2048) took 2120 ms (client timeout 2218 ms). Trace:
W20260709 13:18:01.524384 17388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2095) took 1991 ms (client timeout 1828 ms). Trace:
W20260709 13:18:01.527834 17388 rpcz_store.cc:269] 0709 13:17:59.532657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.524140 (+1991483us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.524288 (+   148us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:18:01.516003 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1234) took 2366 ms. Trace:
I20260709 13:18:01.513496 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.528736 17315 rpcz_store.cc:276] 0709 13:17:59.149588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.157803 (+  8215us) service_pool.cc:224] Handling call
0709 13:18:01.515127 (+2357324us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:01.515351 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.515569 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.515594 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.515636 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.515663 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.515718 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.515821 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27217792}
I20260709 13:18:01.529740 17465 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
W20260709 13:18:01.524505 17462 rpcz_store.cc:269] 0709 13:17:59.400927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.494313 (+2093386us) service_pool.cc:224] Handling call
0709 13:18:01.521477 (+ 27164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.531139 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.525322 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:01.531870 17462 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:01.515161 18933 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:01.533069 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:17:59.521219 18860 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:01.534586 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.535030 18933 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:01.532655 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:01.535955 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.536449 18938 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:01.523847 18853 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:01.529843 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.536890 18938 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:01.537358 18938 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.537281 17467 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
W20260709 13:18:01.538090 17467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2044) took 2347 ms (client timeout 1585 ms). Trace:
W20260709 13:18:01.538693 17467 rpcz_store.cc:269] 0709 13:17:59.190801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.190988 (+   187us) service_pool.cc:224] Handling call
0709 13:18:01.529697 (+2338709us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:01.538005 (+  8308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46113536}
I20260709 13:18:01.539702 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:01.540087 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.540462 18939 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:01.540940 18939 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:01.541318 18939 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:01.541626 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.542994 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.543596 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.544925 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.546424 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.547145 18853 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:01.547647 18853 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:01.548110 18853 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:01.553184 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.553831 17321 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:01.554678 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.555347 17321 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:01.555426 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 381) took 2221 ms. Trace:
I20260709 13:18:01.556634 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:01.555974 17999 rpcz_store.cc:276] 0709 13:17:59.333635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.372381 (+ 38746us) service_pool.cc:224] Handling call
0709 13:17:59.392084 (+ 19703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.541824 (+149740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.541854 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.541900 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:59.541934 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.554986 (+2013052us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400640354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:01.555041 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.555187 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343829376}
I20260709 13:18:01.560113 18861 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:01.560559 18861 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:01.560952 18861 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:01.528498 17463 rpcz_store.cc:269] 0709 13:17:59.438026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.481124 (+2043098us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.481220 (+    96us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:18:01.565879 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.566933 17463 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:01.568305 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.527108 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1235) took 2357 ms. Trace:
I20260709 13:18:01.569125 17463 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:18:01.557993 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:01.544351 17318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1238) took 2170 ms (client timeout 2213 ms). Trace:
I20260709 13:18:01.506959 18874 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:01.577574 17467 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
W20260709 13:18:01.571561 17318 rpcz_store.cc:269] 0709 13:17:59.374045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.374293 (+   248us) service_pool.cc:224] Handling call
0709 13:18:01.543337 (+2169044us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:01.544299 (+   962us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23923456}
I20260709 13:18:01.556115 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.569548 17320 rpcz_store.cc:276] 0709 13:17:59.180894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.223100 (+ 42206us) service_pool.cc:224] Handling call
0709 13:18:01.526351 (+2303251us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:01.526561 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.526748 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.526771 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.526812 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.526850 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.526900 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.526976 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26924800}
I20260709 13:18:01.593084 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.593969 17463 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:01.591885 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:01.585389 18020 debug-util.cc:398] Leaking SignalData structure 0x7b0800370280 after lost signal to thread 18023
W20260709 13:18:01.599619 18020 debug-util.cc:398] Leaking SignalData structure 0x7b0800355ca0 after lost signal to thread 18024
I20260709 13:18:01.601507 18939 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:01.602795 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 374) took 2204 ms. Trace:
I20260709 13:18:01.603803 18939 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:01.590462 18931 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:01.604792 18931 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:01.605201 18931 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:01.605808 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.606484 17462 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:01.607542 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.607699 18853 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:01.609171 17315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1247) took 2105 ms (client timeout 2220 ms). Trace:
W20260709 13:18:01.609727 17315 rpcz_store.cc:269] 0709 13:18:01.547332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.583245 (+ 35913us) service_pool.cc:224] Handling call
0709 13:18:01.609093 (+ 25848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.610198 18938 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:01.597435 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.598816 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.611953 17318 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:01.612197 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.608706 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.615985 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.617100 17470 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:01.615234 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.618278 17318 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:01.603230 17994 rpcz_store.cc:276] 0709 13:17:59.397993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.420150 (+ 22157us) service_pool.cc:224] Handling call
0709 13:17:59.434011 (+ 13861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.490839 (+ 56828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.490881 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.490954 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:59.491017 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.602541 (+2111524us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b54006de554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:01.602596 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.602728 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100012928}
I20260709 13:18:01.619165 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.619825 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.625721 18938 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:01.625774 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.627197 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.620625 17321 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:01.627857 17462 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:01.633297 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.633697 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.633860 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1125) took 2208 ms. Trace:
I20260709 13:18:01.634423 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:01.634860 17285 connection.cc:256] RPC call timeout handler was delayed by -1.2269205420000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 13:18:01.634295 17462 rpcz_store.cc:276] 0709 13:17:59.425662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.628527 (+2202865us) service_pool.cc:224] Handling call
0709 13:18:01.633295 (+  4768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.633480 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.633506 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.633565 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.633599 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.633658 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.633788 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:01.635378 17285 connection.cc:256] RPC call timeout handler was delayed by -1.2215205420000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:18:01.635737 17285 connection.cc:256] RPC call timeout handler was delayed by -1.2044205419999798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 13:18:01.635998 17285 connection.cc:256] RPC call timeout handler was delayed by -1.1837205419999464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:18:01.636256 17285 connection.cc:256] RPC call timeout handler was delayed by -1.1828205419999449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 13:18:01.636348 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1131) took 2175 ms. Trace:
I20260709 13:18:01.637106 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.637768 17315 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:01.636680 17462 rpcz_store.cc:276] 0709 13:17:59.462102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.635602 (+2173500us) service_pool.cc:224] Handling call
0709 13:18:01.635879 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.636065 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.636095 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.636132 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.636159 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.636205 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.636302 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.638595 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.639096 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.639806 17322 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:01.639725 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:01.640252 17322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1236) took 2368 ms (client timeout 1673 ms). Trace:
W20260709 13:18:01.636569 17285 connection.cc:256] RPC call timeout handler was delayed by -1.1729205419999289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
I20260709 13:18:01.634786 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:01.640822 17285 connection.cc:256] RPC call timeout handler was delayed by -1.1576205419999042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 13:18:01.643105 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:01.652464 17285 connection.cc:256] RPC call timeout handler was delayed by -1.1378205419998721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 13:18:01.653152 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.652438 17320 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:18:01.641398 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2034) took 2559 ms. Trace:
W20260709 13:18:01.653466 17285 connection.cc:256] RPC call timeout handler was delayed by -1.0991205420000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:18:01.654968 17285 connection.cc:256] RPC call timeout handler was delayed by -1.0802205420000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260709 13:18:01.635241 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:01.640584 17322 rpcz_store.cc:269] 0709 13:17:59.274954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.286214 (+ 11260us) service_pool.cc:224] Handling call
0709 13:18:01.638961 (+2352747us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:01.640197 (+  1236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26987392}
W20260709 13:18:01.655577 17285 connection.cc:256] RPC call timeout handler was delayed by -1.0559205419999671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
I20260709 13:18:01.655776 17999 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
W20260709 13:18:01.656570 17285 connection.cc:256] RPC call timeout handler was delayed by -1.0091205419998914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 13:18:01.654685 17466 rpcz_store.cc:276] 0709 13:17:59.088551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.095549 (+  6998us) service_pool.cc:224] Handling call
0709 13:17:59.114589 (+ 19040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.447301 (+332712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.641125 (+2193824us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b5400161f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:01.641330 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713877248}
I20260709 13:17:59.543550 18880 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:01.659948 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:01.660830 17464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2046) took 2297 ms (client timeout 1755 ms). Trace:
I20260709 13:18:01.660897 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1243) took 2218 ms. Trace:
I20260709 13:18:01.646229 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.667335 17321 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:01.674163 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2037) took 2556 ms. Trace:
I20260709 13:18:01.673352 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.665437 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.674378 17466 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:01.676148 17468 rpcz_store.cc:276] 0709 13:17:59.117414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.118948 (+  1534us) service_pool.cc:224] Handling call
0709 13:18:01.673247 (+2554299us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfeee 0000000000375939 00007f7d677431e0 00007f7d6780c0c4 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:01.673448 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.673726 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.673766 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.673821 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:01.673863 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.673933 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.674088 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3017344}
I20260709 13:18:01.679886 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:01.661253 17464 rpcz_store.cc:269] 0709 13:17:59.363795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.371379 (+  7584us) service_pool.cc:224] Handling call
0709 13:18:01.643226 (+2271847us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:01.660758 (+ 17532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49545984}
I20260709 13:18:01.637001 18931 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:17:59.530298 18876 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:01.680014 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.682750 18931 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:01.682889 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.680614 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.684056 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.684228 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.670289 18875 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:01.685292 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:01.685612 17434 leader_election.cc:336] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 2.067s (SENT)
I20260709 13:18:01.685876 17997 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:01.681418 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.653415 17315 raft_consensus.cc:2376] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4. Re-sending same reply.
I20260709 13:18:01.711658 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.686290 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.725394 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.676563 17322 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:18:01.725756 18882 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:01.725657 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.726497 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.726981 17999 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:01.642022 18853 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:01.661536 17314 rpcz_store.cc:276] 0709 13:17:59.442326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.520078 (+ 77752us) service_pool.cc:224] Handling call
0709 13:17:59.520367 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.520581 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.525062 (+  4481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.660452 (+2135390us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:01.660527 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.660625 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.660795 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.728205 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.728896 17999 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:18:01.729212 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.730007 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.730655 17999 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:01.730736 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.731359 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.731722 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.732100 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.733214 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:01.734434 17471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2042) took 2603 ms (client timeout 2082 ms). Trace:
I20260709 13:18:01.734604 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:01.735009 17471 rpcz_store.cc:269] 0709 13:17:59.131345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.734243 (+2602898us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:01.734369 (+   126us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:18:01.735816 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.736481 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.736819 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.737144 17319 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:01.737182 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:01.737730 17319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 231) took 2580 ms (client timeout 1786 ms). Trace:
W20260709 13:18:01.738065 17319 rpcz_store.cc:269] 0709 13:17:59.157318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.221543 (+ 64225us) service_pool.cc:224] Handling call
0709 13:18:01.736256 (+2514713us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:01.737676 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26945408}
I20260709 13:18:01.739068 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:01.741472 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1239) took 2346 ms. Trace:
I20260709 13:18:01.714047 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.722669 17992 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:01.724189 18896 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:01.712626 18885 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:01.727087 17995 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:01.743278 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.745046 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:01.747704 17471 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:01.738044 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.741899 17313 rpcz_store.cc:276] 0709 13:17:59.395203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.424139 (+ 28936us) service_pool.cc:224] Handling call
0709 13:18:01.436715 (+2012576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.437091 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.437132 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.437192 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.437243 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.437326 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.741262 (+303936us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54001428d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:01.741409 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4611543424}
I20260709 13:18:01.746316 17321 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:01.750101 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.751328 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.752394 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.750294 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:01.753304 17466 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:01.757714 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.759245 17997 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:01.766166 18877 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:01.767460 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 385) took 2296 ms. Trace:
I20260709 13:18:01.767833 17996 rpcz_store.cc:276] 0709 13:17:59.470622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.527146 (+ 56524us) service_pool.cc:224] Handling call
0709 13:17:59.539328 (+ 12182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.767082 (+2227754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.767121 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.767167 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.767203 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.767265 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.767399 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.769951 17962 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:01.771827 17360 connection.cc:256] RPC call timeout handler was delayed by -2.5897446510000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:18:01.772259 17360 connection.cc:256] RPC call timeout handler was delayed by -2.5897446510000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 13:18:01.772312 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.786700 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.801192 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.773454 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:01.791055 17316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1237) took 2458 ms (client timeout 2240 ms). Trace:
I20260709 13:18:01.802556 18909 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:01.803511 17316 rpcz_store.cc:269] 0709 13:17:59.333092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.339340 (+  6248us) service_pool.cc:224] Handling call
0709 13:18:01.772060 (+2432720us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:01.790995 (+ 18935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24925056}
I20260709 13:18:01.804265 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.784612 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.781495 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.732720 17990 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:18:01.791183 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.756349 18861 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:01.792143 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:01.776346 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:01.773502 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:01.793931 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.794507 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1242) took 2371 ms. Trace:
I20260709 13:18:01.795136 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:01.772457 17388 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:18:01.772627 17360 connection.cc:256] RPC call timeout handler was delayed by -2.5654446510002344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
I20260709 13:18:01.798763 17471 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:01.775784 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1122) took 2500 ms. Trace:
I20260709 13:18:01.795327 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:01.800173 18921 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:01.800273 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:01.744410 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:01.804579 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.003801 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:02.040889 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 426145us
I20260709 13:18:02.003803 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.111543 17394 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:02.107860 17395 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.083467 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:02.109738 17318 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:01.873683 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:02.110819 17996 raft_consensus.cc:2393] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:02.092901 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:02.112665 17360 connection.cc:256] RPC call timeout handler was delayed by -2.4862446510001064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 13:18:01.803104 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.114753 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1121) took 2935 ms. Trace:
W20260709 13:18:02.114818 17360 connection.cc:256] RPC call timeout handler was delayed by -2.421444651000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 13:18:02.115586 17360 connection.cc:256] RPC call timeout handler was delayed by -2.3251446510000733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 13:18:02.116245 17360 connection.cc:256] RPC call timeout handler was delayed by -2.3078314460001366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:18:02.116691 17360 connection.cc:256] RPC call timeout handler was delayed by -2.3053446510000413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:18:02.117120 17360 connection.cc:256] RPC call timeout handler was delayed by -2.2873446510002395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 13:18:02.117525 17360 connection.cc:256] RPC call timeout handler was delayed by -2.2297446510001464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 13:18:02.117908 17360 connection.cc:256] RPC call timeout handler was delayed by -2.0995059470001252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
I20260709 13:18:02.115228 17470 rpcz_store.cc:276] 0709 13:17:59.190118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.221431 (+ 31313us) service_pool.cc:224] Handling call
0709 13:18:01.609493 (+2388062us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:01.609707 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.621135 (+ 11428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.114523 (+493388us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b54001699d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:02.114690 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59874944}
I20260709 13:18:02.114308 17434 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:02.108621 17397 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:02.107218 17317 rpcz_store.cc:276] 0709 13:17:59.424216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.512267 (+ 88051us) service_pool.cc:224] Handling call
0709 13:17:59.520938 (+  8671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.794170 (+2273232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.794199 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.794242 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:01.794271 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.794335 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.794451 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.127154 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:02.127779 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 383436us
I20260709 13:18:02.123641 18939 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:02.129451 18939 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.129855 18939 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.129952 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.130716 17394 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.130714 17997 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:02.014459 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.021361 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.136301 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.131146 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:02.135458 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.136610 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.004988 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.138520 17397 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.137004 17322 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:02.112241 17469 rpcz_store.cc:276] 0709 13:17:59.282868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.319062 (+ 36194us) service_pool.cc:224] Handling call
0709 13:18:01.774732 (+2455670us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:01.774965 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.775200 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.775233 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.775333 (+   100us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:01.775388 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.775472 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.775612 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27624320}
I20260709 13:18:02.141978 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.142813 17392 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.143977 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.132923 18869 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.935333 17993 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:18:02.145274 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.142068 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.148687 17318 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:02.145208 18869 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:02.151006 18869 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.151863 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.150750 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.148429 17392 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.147316 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.152632 17394 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:02.155567 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.159569 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.163633 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.165323 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.166816 18921 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:02.167491 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.163954 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.170320 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.171335 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.171509 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.170550 17397 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.167562 18931 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.167673 18921 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.187526 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:02.169193 17993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 375) took 2760 ms (client timeout 1548 ms). Trace:
I20260709 13:18:02.173947 18882 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:02.190750 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62684.9us
I20260709 13:18:02.190800 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.182907 18877 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.189881 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.194958 17391 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.192673 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:02.196523 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:02.198648 18944 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:02.199096 18944 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:02.199462 18944 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.201133 18940 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:02.201601 18940 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:02.201989 18940 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.183229 18931 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:02.206123 18931 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.207482 17216 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49270 (request call id 323) took 7080 ms. Trace:
I20260709 13:18:02.184536 18921 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:02.203408 18877 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:02.209534 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.210181 18877 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.210953 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.211000 18944 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.209596 18921 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.212312 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.213550 18944 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:02.215586 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 87201.4us
I20260709 13:18:02.204921 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:02.217090 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:02.217625 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:02.221078 17285 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:02.221746 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:02.219733 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.223448 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.222304 18946 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:02.225203 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.226009 17313 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:02.225384 18946 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:02.226661 18946 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.227248 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:02.229195 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 100792us
I20260709 13:18:02.228689 18866 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.230501 18866 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:02.231060 18866 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:02.191669 17993 rpcz_store.cc:269] 0709 13:17:59.398418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.421966 (+ 23548us) service_pool.cc:224] Handling call
0709 13:18:01.800977 (+2379011us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:02.158964 (+357987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3581184}
W20260709 13:18:02.234606 17362 connection.cc:256] RPC call timeout handler was delayed by -2.961056175000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:18:02.235478 17362 connection.cc:256] RPC call timeout handler was delayed by -2.8962561750001896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260709 13:18:02.239396 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:02.222855 18944 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:02.243415 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.229560 18945 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:02.251829 18861 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:02.253988 18909 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:02.254666 18909 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.242800 18944 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:02.259953 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.262943 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.267859 17317 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
W20260709 13:18:02.268491 17362 connection.cc:256] RPC call timeout handler was delayed by -2.7999561750000339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 13:18:02.207866 17216 rpcz_store.cc:276] 0709 13:17:55.127060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.129046 (+  1986us) service_pool.cc:224] Handling call
0709 13:18:02.207226 (+7078180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:01.451036 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:01.451746 (+   710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:01.451798 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:18:01.451830 (+    32us) tablet.cc:662] Decoding operations
0709 13:18:01.452279 (+   449us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:01.452374 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:01.452403 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:01.452702 (+   299us) tablet.cc:701] Row locks acquired
0709 13:18:01.452743 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:18:01.457505 (+  4762us) write_op.cc:270] Start()
0709 13:18:01.457697 (+   192us) write_op.cc:276] Timestamp: P: 1783603081457416 usec, L: 0
0709 13:18:01.457731 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:18:01.458579 (+   848us) log.cc:844] Serialized 538 byte log entry
0709 13:18:01.505792 (+ 47213us) op_driver.cc:464] REPLICATION: finished
0709 13:18:01.629486 (+123694us) write_op.cc:301] APPLY: starting
0709 13:18:01.629643 (+   157us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:01.629795 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:01.629989 (+   194us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:01.630367 (+   378us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:01.630751 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:01.630837 (+    86us) write_op.cc:312] APPLY: finished
0709 13:18:01.631228 (+   391us) log.cc:844] Serialized 23 byte log entry
0709 13:18:01.631433 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:01.631513 (+    80us) write_op.cc:454] Released schema lock
0709 13:18:01.631559 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:01.631905 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:01.631931 (+    26us) write_op.cc:454] Released schema lock
0709 13:18:01.748874 (+116943us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:01.750163 (+  1289us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":123361,"apply.run_cpu_time_us":2430,"apply.run_wall_time_us":2430,"num_ops":1,"prepare.queue_time_us":6311593,"prepare.run_cpu_time_us":10266,"prepare.run_wall_time_us":30782,"raft.queue_time_us":131258,"raft.run_cpu_time_us":138190,"raft.run_wall_time_us":253893,"replication_time_us":47914,"spinlock_wait_cycles":91392,"thread_start_us":149441,"threads_started":3,"wal-append.queue_time_us":23014}]]}
W20260709 13:18:02.269129 17362 connection.cc:256] RPC call timeout handler was delayed by -2.7840386499999568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:18:02.273900 17362 connection.cc:256] RPC call timeout handler was delayed by -2.7801561750000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:18:02.274364 17362 connection.cc:256] RPC call timeout handler was delayed by -2.7621561750002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 13:18:02.274806 17362 connection.cc:256] RPC call timeout handler was delayed by -2.704556175000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 13:18:02.275579 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:02.275787 17362 connection.cc:256] RPC call timeout handler was delayed by -2.289330777000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
I20260709 13:18:02.277022 17469 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 2: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:02.241065 18939 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:02.276571 17362 connection.cc:256] RPC call timeout handler was delayed by -2.1923033250000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 13:18:02.284096 17362 connection.cc:256] RPC call timeout handler was delayed by -2.1891364310001791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 13:18:02.284626 17362 connection.cc:256] RPC call timeout handler was delayed by -2.0291552290000254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 13:18:02.285097 17362 connection.cc:256] RPC call timeout handler was delayed by -1.5143999640001766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
I20260709 13:18:02.285243 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:02.285579 17362 connection.cc:256] RPC call timeout handler was delayed by -1.4522644610001407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
I20260709 13:18:02.248530 18945 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:18:02.286324 17362 connection.cc:256] RPC call timeout handler was delayed by -1.3370644609999545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 13:18:02.287680 17362 connection.cc:256] RPC call timeout handler was delayed by -1.2929644610001105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 13:18:02.288120 17362 connection.cc:256] RPC call timeout handler was delayed by -1.0580644609999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
I20260709 13:18:02.290428 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.267904 18944 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.304236 18939 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:02.307091 18876 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:02.314006 17322 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:02.289649 18945 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.319244 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 369) took 3134 ms. Trace:
I20260709 13:18:02.320753 17998 rpcz_store.cc:276] 0709 13:17:59.151616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.189349 (+ 37733us) service_pool.cc:224] Handling call
0709 13:17:59.221651 (+ 32302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.507827 (+286176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.507857 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.507895 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:59.507945 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.257217 (+2749272us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400680954. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:02.257287 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.259034 (+  1747us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648343936}
W20260709 13:18:02.325239 17251 debug-util.cc:398] Leaking SignalData structure 0x7b08003855e0 after lost signal to thread 17346
W20260709 13:18:02.325623 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800385600 after lost signal to thread 17347
W20260709 13:18:02.320533 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 90276.8us
I20260709 13:18:02.314967 18876 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:02.335220 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.336190 17471 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:18:02.331866 17317 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:02.331641 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 109920us
I20260709 13:18:02.341130 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.342350 18869 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.342756 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.342365 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.344520 17462 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:02.358464 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:02.361709 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60798.5us
I20260709 13:18:02.361745 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.363540 17466 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:02.339450 18876 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:02.365816 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 76728.4us
I20260709 13:18:02.361034 17465 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
W20260709 13:18:02.375941 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 43875.7us
I20260709 13:18:02.376286 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.374958 17285 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:02.337205 18940 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:02.370361 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800385e20 after lost signal to thread 17421
I20260709 13:18:02.383961 18882 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:02.365624 18948 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.386260 18948 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:02.386757 18948 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.386487 18921 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.387253 18884 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:02.387611 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800385e40 after lost signal to thread 17422
W20260709 13:18:02.395586 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800386660 after lost signal to thread 17495
W20260709 13:18:02.395884 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800386680 after lost signal to thread 17496
W20260709 13:18:02.396930 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800386f40 after lost signal to thread 18023
W20260709 13:18:02.397223 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800386f60 after lost signal to thread 18024
I20260709 13:18:02.358013 18861 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:18:02.394062 18884 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:02.360033 18877 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.403254 18958 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.403878 18958 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:02.404284 18958 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.409590 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:02.407683 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.413790 17317 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:02.414601 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.415565 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.415905 18909 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.416473 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.421087 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.441399 17395 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.422498 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.442497 17394 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.420058 18867 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:02.421655 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.384557 18946 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:02.405913 18945 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.418794 18869 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:02.450304 18931 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.472543 18945 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:02.473155 18956 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:02.473542 18956 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:02.473742 18931 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:01.759953 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:02.474447 18956 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.475751 18956 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.475584 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:02.466195 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.467387 17215 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49282 (request call id 324) took 5173 ms. Trace:
I20260709 13:18:02.478103 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.478564 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.461398 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.479961 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.480259 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.470636 18888 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:02.480945 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.482000 18888 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:02.482420 17220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 214) took 7209 ms. Trace:
I20260709 13:18:02.404124 18877 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:02.501710 18909 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:02.418965 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.419866 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.505505 17397 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:02.420735 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.417512 18884 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.417925 18940 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:02.447817 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.450428 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:02.451489 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:02.454234 18896 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.459113 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.459231 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.459897 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:02.514515 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 64142.6us
I20260709 13:18:02.515007 17315 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:02.482980 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.515195 17964 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:02.482923 18888 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.478734 17318 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:02.519886 17393 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.392956 18957 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:18:02.521540 18957 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:02.521889 18957 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:02.521900 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.522608 17397 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:02.522872 18957 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.470108 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.485523 17214 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49294 (request call id 327) took 7212 ms. Trace:
I20260709 13:18:02.525493 17314 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:02.486325 18946 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:02.487277 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.489454 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2088) took 3063 ms. Trace:
I20260709 13:18:02.488971 18944 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:02.490422 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.491448 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.492273 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.420910 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.477777 17215 rpcz_store.cc:276] 0709 13:17:57.294106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.295982 (+  1876us) service_pool.cc:224] Handling call
0709 13:18:02.467323 (+5171341us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:01.487594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:01.488149 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:01.488179 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:18:01.488197 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:01.488663 (+   466us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:01.488709 (+    46us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:01.488732 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:01.488956 (+   224us) tablet.cc:701] Row locks acquired
0709 13:18:01.488973 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:18:01.489104 (+   131us) write_op.cc:270] Start()
0709 13:18:01.489203 (+    99us) write_op.cc:276] Timestamp: P: 1783603081489065 usec, L: 0
0709 13:18:01.489217 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:18:01.489685 (+   468us) log.cc:844] Serialized 595 byte log entry
0709 13:18:01.619109 (+129424us) op_driver.cc:464] REPLICATION: finished
0709 13:18:01.632259 (+ 13150us) write_op.cc:301] APPLY: starting
0709 13:18:01.632339 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:01.632464 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:01.632609 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:01.632931 (+   322us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:01.649414 (+ 16483us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:01.649461 (+    47us) write_op.cc:312] APPLY: finished
0709 13:18:01.649691 (+   230us) log.cc:844] Serialized 23 byte log entry
0709 13:18:01.657418 (+  7727us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:01.658007 (+   589us) write_op.cc:454] Released schema lock
0709 13:18:01.677436 (+ 19429us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":497589,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":12951,"apply.run_cpu_time_us":1932,"apply.run_wall_time_us":79213,"num_ops":1,"prepare.queue_time_us":723952,"prepare.run_cpu_time_us":2186,"prepare.run_wall_time_us":6603,"replication_time_us":129751,"thread_start_us":126023,"threads_started":1}]]}
I20260709 13:18:02.493660 17220 rpcz_store.cc:276] 0709 13:17:55.272626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.406466 (+2133840us) service_pool.cc:224] Handling call
0709 13:18:02.482266 (+5075800us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252859,"reported_tablets":1}
I20260709 13:18:02.508177 17317 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:02.508793 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 129038us
I20260709 13:18:02.515683 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:02.516186 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.514396 18896 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:02.518003 17391 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:02.540243 18948 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.518304 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:02.519155 18880 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.519385 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.520617 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:02.524762 18957 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.525228 17214 rpcz_store.cc:276] 0709 13:17:55.272964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.583824 (+2310860us) service_pool.cc:224] Handling call
0709 13:18:02.485318 (+4901494us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17807,"reported_tablets":1}
I20260709 13:18:02.528644 18921 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:02.529228 18866 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.526377 17389 rpcz_store.cc:276] 0709 13:17:59.427040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.427165 (+   125us) service_pool.cc:224] Handling call
0709 13:17:59.431576 (+  4411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.452447 (+ 20871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.452476 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.452534 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:59.452564 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.489170 (+3036606us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b540038d954. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:02.489231 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.489396 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40280960}
I20260709 13:18:02.532027 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.532631 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:02.532896 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:02.533746 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.551708 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.551512 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.526209 18909 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.533540 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.539516 18869 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.555433 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.555665 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.539788 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.556591 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.557086 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.557561 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.557685 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.558190 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.558746 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.559018 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.559372 17465 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:02.560271 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.560855 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.561003 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.561369 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.562130 18879 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:02.562251 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.563912 18945 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:02.540346 18896 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:02.547363 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 147807us
I20260709 13:18:02.541229 18880 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:02.564049 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.556744 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.550272 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:02.558786 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.567512 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:02.546252 18871 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.551512 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.554147 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:02.554504 17321 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:02.555348 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.564591 18866 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:02.566337 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:02.553015 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 184666us
I20260709 13:18:02.568565 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.544744 18931 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:02.572335 17389 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.572690 18946 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:02.569988 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:02.562147 17464 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:02.573235 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.564999 18880 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.573824 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:02.574749 18946 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.581602 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:02.582067 18921 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:02.582923 18921 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:02.584116 18940 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:02.584605 18940 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:02.597999 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.598637 18948 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:02.567524 18909 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:02.570624 18869 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:02.586624 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.601402 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.565979 17388 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
W20260709 13:18:02.607281 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 229542us
I20260709 13:18:02.603170 17389 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:02.617236 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:02.623016 18877 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:02.623415 18877 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:02.623775 18877 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.623588 18876 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.585366 18945 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:02.618338 17469 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:02.626011 17469 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:02.626562 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:02.627058 17469 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:02.627310 17998 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:02.628139 17469 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:02.631942 17314 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:02.585695 18960 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:02.639722 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 53265.2us
I20260709 13:18:02.618321 18909 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.641652 18877 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.642508 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:02.642822 17998 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:02.571542 18885 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:02.600709 18866 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:02.643985 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:02.644992 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.654186 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:02.646600 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:02.608604 18940 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.650583 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:02.658358 17996 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:18:02.658562 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:02.663810 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:02.644924 18946 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:02.673049 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:02.666410 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:02.647814 18861 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:02.683291 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.675580 17997 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.584271 18921 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.644433 18876 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:02.690559 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:02.692003 17360 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:02.692433 17318 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:02.662475 18931 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:02.687305 17316 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:02.695259 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 120324us
I20260709 13:18:02.696442 17287 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:02.698580 18968 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.699045 18968 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:02.699378 18968 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:02.700979 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 54487.1us
I20260709 13:18:02.672657 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:02.702631 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:18:02.705480 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 88533.6us
I20260709 13:18:02.710525 18967 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:02.711033 18967 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.711359 18967 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.668455 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:02.713564 17285 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.716063 17996 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:02.690069 18959 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:02.717082 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48772.6us
I20260709 13:18:02.720106 17997 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:02.720752 17999 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:02.722470 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:02.727726 18875 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:02.728917 18875 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:02.729247 18875 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:02.729208 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.730333 18875 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.731540 18875 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.733389 18964 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:02.735335 18896 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.738140 18880 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.714516 18876 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:02.744175 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.744318 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.744585 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.744325 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.748572 17317 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:02.747983 17396 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:02.722764 18946 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:02.753449 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45295.8us
I20260709 13:18:02.721889 18959 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:02.755697 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:02.758116 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.758842 18896 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:02.767024 17994 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:02.767359 17393 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 2: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:02.769116 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.769477 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.770285 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.747537 18876 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:02.747299 18944 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:02.775241 18877 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:02.775763 18909 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.778398 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.778834 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:02.779675 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:02.802855 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:02.803553 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:02.804450 17992 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 2: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:02.780212 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.806679 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.788640 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.807792 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.808121 17396 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:02.796790 18876 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.810249 18880 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:02.810583 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.761888 18958 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.812512 18958 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:02.814457 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.807847 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.816413 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.788259 18959 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:02.789680 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 71853.5us
I20260709 13:18:02.764721 18879 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:02.766566 17390 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:02.795758 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.826699 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:02.828256 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 104788us
W20260709 13:18:02.831427 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 109083us
I20260709 13:18:02.755406 18960 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:18:02.823163 18945 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:02.826421 18867 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:02.839079 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:02.829595 18944 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:02.844069 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.846122 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.832715 18879 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:02.847244 17393 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 2: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:02.847936 18879 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.826370 18948 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:18:02.850632 18967 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.853343 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:02.856717 17391 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:02.857532 18967 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:02.832267 18869 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:18:02.858973 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:02.860751 18965 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:02.863673 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:02.871845 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.871958 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.874481 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.833896 18866 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:18:02.881263 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.856073 17465 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.895167 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.896363 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:02.876317 18951 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:02.924355 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.924619 18951 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:02.926453 18951 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.922525 18882 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:02.922775 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.923573 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.951185 18945 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:02.952673 18970 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:02.954525 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 58798.3us
I20260709 13:18:02.956182 17434 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:02.869079 18944 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:02.953182 18952 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:02.953102 18909 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:02.953105 18973 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:02.960605 17391 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:02.955173 18945 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:02.960871 18941 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:02.962282 18968 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.965018 17322 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:02.972177 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:02.968585 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 135592us
I20260709 13:18:02.974860 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.888917 18785 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:18:02.976536 18785 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:02.977020 18785 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:02.978448 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.980118 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:02.984120 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 146210us
I20260709 13:18:02.986127 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:02.893962 18954 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:18:02.978085 18785 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.994104 18945 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:02.984321 18941 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:03.003790 18959 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.995287 17394 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 2: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:03.006119 18968 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:02.985152 18940 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:02.998711 18856 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:02.998800 18871 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.008160 17463 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:02.970041 18973 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:02.998560 18884 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.008898 18940 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:03.001291 18888 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.003851 18941 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:02.971691 18952 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.009249 18954 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.001310 18945 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:02.987062 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.002727 18785 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.012637 18973 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.020017 18952 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:03.020202 18973 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:03.023075 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 240201us
I20260709 13:18:03.017226 18954 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:03.016901 18876 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.021699 18965 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.029173 18952 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:03.030373 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:03.036087 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 202061us
W20260709 13:18:03.037734 17963 leader_election.cc:336] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.541s (SENT)
W20260709 13:18:03.044210 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 84358.8us
I20260709 13:18:03.049291 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.038185 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.051333 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:03.053243 18952 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.053591 18959 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:03.053654 18952 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:03.054215 18952 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.024506 18951 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.069810 18960 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:03.070328 18960 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:03.062736 17963 leader_election.cc:336] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.599s (SENT)
I20260709 13:18:03.062595 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:03.064589 18896 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.065255 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.072268 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:03.093082 17963 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.668s (SENT)
I20260709 13:18:03.093469 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.050220 18968 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:03.094635 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.095391 18956 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.068832 18951 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:03.086457 18947 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.088223 17463 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.096567 18947 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:03.088886 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.097044 18947 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.090507 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.091379 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.094702 18968 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:03.071408 18960 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.101660 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:03.101833 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.104022 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.055130 18955 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.042039 18954 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.105484 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:03.102838 18968 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:03.108395 17963 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.701s (SENT)
I20260709 13:18:03.108860 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.101460 18879 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:18:03.103250 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:03.113041 17396 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.114637 17463 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:03.117154 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:03.117846 17394 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.118206 17313 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:03.105540 18955 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:03.121570 18955 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.122941 18955 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.098577 18861 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.127043 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:03.116000 18970 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:03.101722 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45512.1us
I20260709 13:18:03.127898 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.128875 18931 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:03.129189 18866 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:03.129633 18866 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:03.129886 18931 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.130266 18931 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:03.130558 18866 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.131151 18931 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.132390 18931 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.134263 17465 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:03.107455 17992 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.137853 18940 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:03.123505 18876 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:03.139070 18960 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.140237 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.145706 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:03.146818 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:03.148313 17999 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.150213 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.152227 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.152047 18959 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:03.154810 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:03.152366 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:03.155627 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.152689 18973 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:03.148144 18946 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:03.154671 18867 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:18:03.154271 18959 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.151896 18896 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.234373 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.235096 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:03.235313 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 83134.9us
I20260709 13:18:03.240670 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.230639 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:03.231827 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 85072.7us
I20260709 13:18:03.154211 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:03.243749 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:03.245457 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.246027 17463 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.250910 18861 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.230409 18962 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:03.251605 18962 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:03.252319 18962 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.231230 18785 raft_consensus.cc:2764] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:18:03.252946 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.232632 18977 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:18:03.254546 18954 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.256305 17469 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:03.158324 18909 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:03.261353 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 105801us
I20260709 13:18:03.262769 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.264180 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.264433 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.266132 17964 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:03.268224 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.233731 18973 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:03.273701 17469 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:03.265048 17396 raft_consensus.cc:2376] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4. Re-sending same reply.
I20260709 13:18:03.235617 18946 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:03.237556 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.239367 18959 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:03.242087 18921 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.277204 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.152318 18970 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:18:03.273433 18785 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.286441 17396 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:03.260733 18877 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.286353 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:03.290048 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:03.294104 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50405.5us
I20260709 13:18:03.295161 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:03.297825 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.263679 17314 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:03.277070 18973 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.290663 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:03.279663 18888 raft_consensus.cc:2764] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:03.283764 17465 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.342535 17319 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:03.349236 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.349788 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.350430 17392 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:03.350719 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.351096 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.351361 17391 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:18:03.351868 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.285521 18965 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:18:03.287829 18882 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:03.361012 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 65930.4us
I20260709 13:18:03.367292 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:03.373034 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.352432 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.374614 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:03.375766 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 135151us
I20260709 13:18:03.375967 17360 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.376518 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.377751 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.378149 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.338743 18867 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:03.379143 17397 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:18:03.379482 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:03.381165 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 94880us
I20260709 13:18:03.382387 17360 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.383090 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.298825 18977 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:03.384157 17395 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:03.384265 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.384650 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.284220 18896 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:18:03.365877 18961 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.387255 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.298534 18972 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:03.378207 18921 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.412170 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.415496 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:03.379833 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:03.377909 17393 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:03.386312 18867 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:03.387746 18986 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.383150 18882 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:03.450848 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.426133 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:03.452075 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.385373 18985 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.454643 18876 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:03.454634 18856 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.455252 18876 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:03.455735 18876 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.455830 18952 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.457015 18976 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.458102 18952 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:03.461417 17394 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:03.462402 18988 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:03.462880 18988 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:03.463243 18988 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.366163 18959 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.433597 18970 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:03.465206 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:03.440006 18947 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.413579 18972 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:03.426362 18956 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.441219 18975 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.416081 18888 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.426734 18961 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.445647 18967 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:03.471812 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.486816 17397 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.448875 18867 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.429708 17463 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:03.416905 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.480716 18861 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.391295 18946 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.477715 18975 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:03.466434 18970 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:03.409646 18977 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:03.519656 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 102887us
I20260709 13:18:03.523536 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:03.521229 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53186.4us
I20260709 13:18:03.450146 17390 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:03.424517 18973 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.524446 17286 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.479988 18959 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.475562 18879 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:03.525733 17963 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.527817 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.530455 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:03.525344 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 259289us
I20260709 13:18:03.475924 18972 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.532936 18993 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.516021 18962 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.539764 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:18:03.540884 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.566461 17396 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.543462 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:03.569356 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.573915 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.575040 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.575604 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:03.577507 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.529492 18931 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.578718 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.583920 17395 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.579588 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.519146 18975 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.581605 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.520001 18981 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:18:03.541100 18879 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:03.559716 18888 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.582851 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.564152 18956 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.563843 18993 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:03.525472 18884 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:03.612274 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.578770 17313 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:03.601598 18984 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:03.607219 18978 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:03.607810 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 64411.9us
I20260709 13:18:03.611688 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.592136 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.633952 17463 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:03.579599 18921 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:18:03.594342 18879 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.636682 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.609203 18785 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.643994 17397 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:03.582664 18994 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.616720 18884 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:03.616509 18993 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:03.638962 18968 consensus_meta.cc:287] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 13:18:03.622408 18978 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:03.642855 18948 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.656591 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:03.663465 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.641265 18984 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:03.665542 17392 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:03.669149 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.589550 18882 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.653906 18884 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.709849 17463 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:03.706115 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:03.711582 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.708353 18984 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.643533 18876 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:03.714061 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 132463us
W20260709 13:18:03.634542 18957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.018s	sys 0.058s
W20260709 13:18:03.717887 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 333670us
I20260709 13:18:03.665795 18978 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.657117 18993 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.694450 18947 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:03.729228 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:03.731630 17360 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.732511 18961 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.732879 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:03.733626 18961 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.734015 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:03.735755 18988 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.738087 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:03.739198 17395 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:03.729552 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.737172 18985 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:03.709658 18977 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:03.741518 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.719264 18962 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:03.661549 18968 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.745887 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.753150 17471 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:03.753609 18888 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.754765 17315 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:03.754845 17463 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.758469 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.759778 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.763500 18949 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:03.749370 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:03.764125 18949 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:03.764281 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.617849 18970 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.765345 18941 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.765100 18949 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.763590 18988 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:03.766222 18949 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:03.728657 18957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.018s	sys 0.059s
W20260709 13:18:03.769694 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.766532 18967 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.773931 18967 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.773985 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:03.781908 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.770248 17465 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:03.785022 17466 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:03.745190 18948 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:03.786450 18948 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:03.786892 18948 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.782079 18876 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:03.788070 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:03.793303 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:03.794890 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:03.752805 18952 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:03.798758 17388 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.798969 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:03.799579 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:03.799769 17314 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:03.800822 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:03.804236 18986 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.805135 18956 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.795137 18947 raft_consensus.cc:2764] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:03.806602 18866 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.769049 18973 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:03.821346 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:03.822826 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:03.821746 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:03.820434 18931 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.825282 18931 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.827482 18931 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:03.832041 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.832248 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.833132 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.833225 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.833346 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.833889 17469 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:03.834683 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.813900 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:03.833576 18970 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:03.817930 18990 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:18:03.778904 18941 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:18:03.848946 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.849733 17469 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:03.808744 18968 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:03.817376 18946 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.811190 18952 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:03.839893 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:03.842316 17317 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.844165 17321 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.839975 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.813469 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.852180 17394 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:03.852331 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.841172 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:03.804733 18986 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:03.815541 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:03.852694 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.864048 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:03.865996 17471 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:03.867682 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:03.874979 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.879987 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.875567 17462 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.875963 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.882179 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.883471 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.874321 18958 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:03.884619 18958 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:03.884692 17468 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.886027 18869 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.886420 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.891232 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.859520 18952 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.897233 17395 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:03.861543 18955 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.861650 17990 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.903223 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:03.897413 18869 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.887324 18985 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.887612 18998 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.896136 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.916829 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.909475 18969 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:18:03.908658 18877 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.903538 17313 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.915939 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.898428 18871 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.891598 18997 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.918480 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.869925 18947 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:18:03.913095 18986 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.919094 18875 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.925657 18987 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:03.935372 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.935055 18884 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.919963 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.904706 18988 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:03.961093 17994 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:03.962538 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.963783 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.932451 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:03.897583 18996 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:18:03.938520 18944 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.942252 18969 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:03.947000 18958 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.894304 18975 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:03.940162 18993 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:03.951225 18871 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:18:03.958825 18884 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:03.928743 18961 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:03.966456 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46529.3us
I20260709 13:18:03.973346 18856 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:18:03.984129 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:03.971107 18956 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.984733 18956 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.955396 18994 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:03.989071 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:03.990496 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:03.986034 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.985128 18956 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.993462 17319 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:03.997097 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:03.978152 18785 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.970408 18968 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.970646 18875 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:03.976096 18992 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:18:03.978752 18951 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:18:03.972728 18969 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:04.007869 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.050879 17317 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:03.999423 18853 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.000623 18981 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:04.067283 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 76919.2us
I20260709 13:18:04.071934 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:04.072777 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 164989us
I20260709 13:18:04.073225 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.000772 18961 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.074587 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.029551 18856 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:04.078625 17999 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:04.083292 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:04.058177 18968 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.057864 18785 raft_consensus.cc:2764] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Leader election decision vote started in defunct term 4: won
I20260709 13:18:03.992681 18972 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.095077 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:04.081701 18856 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:04.107064 17314 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.097432 18957 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:04.097868 18999 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.993599 18947 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:18:04.101164 17360 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:04.105885 17287 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.093737 17471 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:04.105937 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.031375 18955 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:18:04.081852 18954 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.096264 18967 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.114352 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:04.129321 18785 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.152580 18965 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:04.160050 17322 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.066941 18884 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:18:04.083756 18875 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.100459 18853 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.050428 18879 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:04.109032 18867 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.000s
I20260709 13:18:04.167127 18867 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.153087 18921 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:04.168430 18993 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:04.168685 18921 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.169667 18867 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:04.170197 17316 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.171334 18921 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.171648 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:04.163442 18965 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:04.172988 18965 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.174525 18871 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:04.175083 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:04.175668 18871 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:04.088251 18969 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.112967 18957 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:04.175868 17465 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:04.123939 17360 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:04.110733 18940 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.164212 17995 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:04.166456 18853 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:04.130966 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:04.177424 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:04.163652 18959 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.601s	user 0.001s	sys 0.009s
I20260709 13:18:04.176926 18977 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.112368 18951 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:18:04.176153 18871 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:04.188694 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:04.171902 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:04.192214 17319 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:04.194247 17321 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:04.152761 18880 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:18:04.199699 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:04.192140 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:04.186923 18964 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:04.210134 18964 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:04.210469 18875 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.223425 18969 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.229200 17465 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:04.230098 18877 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:04.230628 18877 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:04.231158 18970 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:04.231652 18877 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.203548 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.238551 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:04.207628 18972 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.194615 18975 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.191776 18853 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:04.260625 17316 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.261029 18853 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.261942 18879 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:04.263265 18987 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:04.263696 18987 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:04.264006 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:04.179848 18978 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.210558 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:04.211086 18964 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.266332 18978 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.266768 18964 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.267134 18944 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:04.267189 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:04.268450 17994 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:04.211095 18959 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.270437 18884 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:04.271521 18884 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:04.271886 18884 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:04.272126 18985 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:04.272567 18985 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:04.264532 18987 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.273111 17322 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.273607 18987 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.273327 18985 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.274238 17322 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.274642 17318 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.214150 18967 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.163689 18999 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.219357 18880 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:04.220235 17315 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:04.221242 18984 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.222975 19001 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:04.238762 17395 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.207141 18957 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.244067 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:04.245850 18988 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.192915 18940 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:04.266834 18948 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:04.202721 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 78827.8us
I20260709 13:18:04.294550 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:04.295864 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:04.275851 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.215353 18981 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.262140 17316 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:04.282642 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.277371 17287 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.281626 18944 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:04.240793 18877 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:04.282203 18949 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.005s
I20260709 13:18:04.292517 17319 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:04.292784 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 295345us
I20260709 13:18:04.285082 18963 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:18:04.300745 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:04.282835 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 168563us
I20260709 13:18:04.284401 18885 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:18:04.402619 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.294003 18871 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.288641 19001 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:04.287566 18984 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:04.305254 18952 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:04.329571 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53773.1us
W20260709 13:18:04.434383 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.411531 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.284935 18880 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:04.437626 18880 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.439313 18880 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.303162 18976 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:04.389562 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 93806.1us
I20260709 13:18:04.444197 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:04.284569 18970 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:18:04.299606 18940 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.393222 17320 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:04.302462 18967 raft_consensus.cc:2764] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:04.284454 18785 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 13:18:04.391115 18992 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.286798 18951 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:18:04.293834 18985 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.401517 17314 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:04.388123 18962 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.403785 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:04.282219 18884 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.390980 18869 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:04.436352 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.445948 17360 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:04.404382 18956 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.405428 18981 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:18:04.461266 19004 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.394836 19011 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.442329 18946 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.447501 18984 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:04.450219 19002 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:18:04.480966 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:04.451825 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:04.511040 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.488629 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.461189 17391 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:04.483346 18968 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.522321 17360 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:04.527767 18944 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.530158 18944 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.475939 17214 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.523490 18959 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.536698 18977 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.550338 19010 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:04.550952 19010 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:04.554919 18999 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.403949 18949 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 13:18:04.535892 17214 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.474819 18921 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:18:04.631207 18958 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.570384 18962 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.610363 18941 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:04.643956 18941 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:04.644033 18909 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:04.644588 18909 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:04.644917 18941 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.646209 18941 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.645591 18909 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:04.646517 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.647116 18856 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.552142 19010 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.573230 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:04.655651 18856 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.617071 18954 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:04.612068 18968 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:18:04.673120 17393 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:04.682085 18853 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.684419 18853 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:04.687317 19010 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:04.669404 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 96266.7us
I20260709 13:18:04.664739 18948 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.653167 18988 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:04.671473 18952 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:04.673451 18968 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:04.674602 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.704941 17388 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:04.705319 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:04.708479 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:04.716341 17462 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:04.651742 18962 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.658953 18969 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.678314 18956 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.678776 18957 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.662092 18909 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.717478 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:04.723389 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:04.723522 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:04.725803 17318 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:04.688653 18954 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:04.727900 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:04.702852 18968 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:04.747511 18949 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:04.748371 18949 consensus_queue.cc:1243] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:18:04.747184 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 357669us
W20260709 13:18:04.743963 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 458169us
I20260709 13:18:04.571190 19001 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.745397 17319 raft_consensus.cc:2393] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:04.748906 18877 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:04.753949 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.713387 18988 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.750103 18954 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.752497 18853 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.763387 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:04.766142 17469 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.755177 18877 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:04.757787 18963 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.780664 17468 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:04.752300 18958 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:18:04.765818 18944 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.765882 18931 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:04.768440 18853 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.799023 18853 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:04.799835 19017 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.805112 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:04.805724 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.800410 19017 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.774178 19015 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:18:04.823789 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:04.801381 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:04.822290 17395 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:04.830425 17395 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:04.839972 18984 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.834201 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:04.843472 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 439722us
I20260709 13:18:04.846033 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.790796 18944 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.785243 18963 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.801858 18931 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.844257 17464 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:04.825692 18956 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:04.841665 19020 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.875954 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:04.846131 19019 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.882081 18882 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:04.899231 17469 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:04.871407 18877 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:04.885561 19013 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:18:04.901249 17463 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:04.805521 18968 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.886547 18940 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.886335 18876 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.867990 17395 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.851665 19025 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:04.852119 18951 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.895411 18984 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.895892 18880 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.916559 18880 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.917025 18880 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.918509 18871 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.876044 19017 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:04.898095 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49666.3us
W20260709 13:18:04.925091 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.925828 18952 consensus_queue.cc:1175] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3747096bb5074ea2bf86037fd17c1160" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:18:04.926548 17395 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.926812 18877 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.927485 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:04.848224 19021 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:18:04.929189 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:04.929950 19015 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:04.930321 19015 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:04.930390 19016 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.930716 19015 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.931356 18963 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.899049 18882 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:04.933022 18969 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:04.933967 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:04.933764 18969 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.938771 19010 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:04.939266 19010 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:04.939301 18940 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:04.940168 19010 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.905030 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:04.941375 17471 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.941776 17464 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:04.942955 18876 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.945925 18944 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:04.898355 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:04.947708 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:04.948525 18951 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:04.886345 19014 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:18:04.904318 18978 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.949029 18951 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:04.949345 18978 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.949961 18951 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.899894 19020 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.953924 19020 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:04.932569 18882 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.956890 18988 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:04.901129 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:04.957922 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56873.1us
I20260709 13:18:04.903823 18962 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:04.960626 19026 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:04.961520 19026 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:04.962242 18931 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:04.962765 19026 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.965830 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:04.968344 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:04.970643 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:04.973299 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:04.975780 18940 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:04.976238 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:04.976872 18940 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:04.977039 17464 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:04.977918 18940 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:04.978921 17992 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 2: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:04.969982 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:04.985918 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:04.988204 17469 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
W20260709 13:18:04.990770 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 139918us
I20260709 13:18:04.975206 18856 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:04.981108 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 188) took 1143 ms. Trace:
I20260709 13:18:04.993036 18856 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:04.990537 19020 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:04.993847 19020 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.993076 17391 rpcz_store.cc:276] 0709 13:18:03.838007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.846660 (+  8653us) service_pool.cc:224] Handling call
0709 13:18:03.853667 (+  7007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.538313 (+684646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.980720 (+442407us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54004105d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:04.981003 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396415872}
I20260709 13:18:04.994100 18856 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:04.995020 17390 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:04.995754 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:04.996240 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:04.996909 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:04.998086 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:04.993044 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.001088 17394 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:04.987350 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:05.002178 17467 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:05.002880 17964 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:04.946058 19015 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.000722 18963 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.974656 18969 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.009290 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.011400 18853 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:05.011513 18985 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.013978 17395 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:05.000916 19020 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:04.991477 18941 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.021459 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.039235 17469 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:05.033687 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:05.025349 18853 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:05.020169 19017 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:05.128516 19017 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.129035 19017 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:05.131582 19031 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:18:05.131847 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:05.132588 17318 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.133448 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:04.924818 18880 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.154655 17470 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
W20260709 13:18:05.084182 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.094537 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.140986 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1313) took 1292 ms. Trace:
I20260709 13:18:05.156670 17320 rpcz_store.cc:276] 0709 13:18:03.747682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.747940 (+   258us) service_pool.cc:224] Handling call
0709 13:18:03.754117 (+  6177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.453420 (+699303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.039438 (+586018us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54001414d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:05.039699 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467063680}
I20260709 13:18:05.157653 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1016) took 1297 ms. Trace:
I20260709 13:18:05.041234 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:05.159080 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 117970us
I20260709 13:18:05.017590 19021 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:05.164256 17318 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:05.161808 17999 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:05.158294 17315 rpcz_store.cc:276] 0709 13:18:03.840753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.840929 (+   176us) service_pool.cc:224] Handling call
0709 13:18:05.138490 (+1297561us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b5400369054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:05.138588 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826855680}
I20260709 13:18:05.164249 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:04.991937 19025 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.018190 18944 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.141s
I20260709 13:18:05.037736 18988 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.037421 18962 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.157552 18875 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.178531 17388 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:05.166585 19021 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.025422 18963 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.172983 19004 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.170473 18877 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:05.170557 18947 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:05.138583 18941 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.216104 18947 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.194303 19021 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.241226 19016 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.181133 17390 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:05.193765 17990 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:05.198217 18877 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:05.250344 18877 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.253986 19025 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.254788 19025 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.255390 19025 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.185285 18988 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.190421 18954 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:05.235965 19030 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:18:05.233673 18931 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:05.185869 18962 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.194154 18875 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:05.289896 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.359633 19036 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.360421 19036 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.363222 19036 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:05.364181 18957 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:05.364897 18957 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.367802 18963 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.368425 18963 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.200943 19004 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.419380 17319 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
W20260709 13:18:05.437058 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 67623.8us
I20260709 13:18:05.437387 17462 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:05.438519 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:05.439851 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2158) took 1524 ms. Trace:
I20260709 13:18:05.440429 17392 rpcz_store.cc:276] 0709 13:18:03.915378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.915506 (+   128us) service_pool.cc:224] Handling call
0709 13:18:03.915791 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:04.187728 (+271937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:04.187765 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:04.193985 (+  6220us) log.cc:844] Serialized 26 byte log entry
0709 13:18:04.453037 (+259052us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:04.711389 (+258352us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.719442 (+  8053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.369045 (+649603us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54002be154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:05.369090 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:05.369136 (+    46us) raft_consensus.cc:1685] finished
0709 13:18:05.439553 (+ 70417us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.439767 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14298,"prepare.queue_time_us":327365,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":93920,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":3255,"spinlock_wait_cycles":194058496,"thread_start_us":611380,"threads_started":3,"wal-append.queue_time_us":554704}
I20260709 13:18:05.463572 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:05.463927 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:05.464208 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.464676 17321 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:05.464999 17463 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:05.367805 18957 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.419262 18948 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:05.468048 17315 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:05.201033 18853 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.438076 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.475934 17464 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:05.451690 18977 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.472378 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:05.477481 17316 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:05.477137 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:05.474664 19029 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:18:05.474977 18948 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.479107 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:05.480497 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:05.481395 17317 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:05.481310 17318 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:05.482733 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:05.483781 17320 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:05.486022 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1022) took 1385 ms. Trace:
I20260709 13:18:05.486912 19037 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:05.486651 17314 rpcz_store.cc:276] 0709 13:18:04.100627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.269421 (+168794us) service_pool.cc:224] Handling call
0709 13:18:04.269696 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.477202 (+207506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.485736 (+1008534us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54003e17d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:05.485954 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279004032}
I20260709 13:18:05.487619 19037 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.488274 18947 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.462854 18949 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.460963 18986 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.489174 18880 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.436759 18963 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.468142 18931 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:05.472947 19015 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:05.514783 18856 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.522431 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.487214 18884 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.526193 18954 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:05.529814 18875 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.530258 19016 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:05.530344 18988 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.477165 18977 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.488772 18947 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:05.586429 17391 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:05.586794 18987 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.586608 18947 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.587483 19016 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.587436 18987 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.532248 18948 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.534194 19025 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.533934 18931 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.590456 18977 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.590150 19016 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:05.537588 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:05.538535 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:05.538748 17466 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:05.556274 18856 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.597816 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.597958 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:05.598891 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.598845 17468 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.599727 17395 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:05.601372 19019 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:05.601985 19019 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.605185 19019 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.607306 17468 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:05.607470 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.609078 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:05.611393 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.564775 19038 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:05.613169 19038 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.615797 19038 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.616425 19038 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:05.567689 19021 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.553190 19044 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:05.617202 19044 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.617627 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.618721 19021 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.564213 18956 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.619755 19044 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.511564 18944 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:18:05.572207 18957 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.621155 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:05.621105 18957 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.622028 17469 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.620133 18956 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.623457 18957 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.572300 19037 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.515096 18877 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.626282 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:05.626957 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.627027 17396 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:05.574390 17392 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:05.627604 18877 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.616796 19038 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.575373 19004 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:05.576550 18959 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 13:18:05.629019 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.576733 18962 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.630046 18999 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:05.630462 18999 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:05.630657 18962 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:05.631389 18999 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.570041 19017 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.634938 19017 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.635568 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.636283 17464 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:05.635738 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:05.640131 18885 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:05.640583 18885 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:05.641274 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:05.644452 19001 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.583019 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.598795 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:05.647218 17394 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:05.646296 17469 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:05.571388 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.645884 19037 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:05.647698 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48977.2us
I20260709 13:18:05.609206 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.665604 17470 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:05.667160 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:05.652628 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:05.654846 18999 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.668078 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:05.641757 18885 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.668825 17390 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.671459 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.672144 17392 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:05.673727 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:05.636212 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.675624 18969 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:05.648531 18952 raft_consensus.cc:2764] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:05.667248 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.671010 19037 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:05.667958 17396 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.678081 18969 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:05.628716 19038 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.679138 18969 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.681106 19037 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.681737 19025 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:05.683043 19046 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:05.683539 19046 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:05.683115 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:05.684994 19046 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.686416 19021 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:05.685820 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:05.687741 17388 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.688771 19004 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:05.687064 19021 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:05.689411 19004 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.690379 19021 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.690968 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:05.693408 17470 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.661331 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:05.696123 18992 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:05.696612 18992 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:05.697054 18992 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.625726 18956 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.700521 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:05.703725 19044 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:05.704595 19044 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.705041 19044 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.701864 18956 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:05.550529 18949 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.711175 17962 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:05.713275 17470 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:05.714434 17964 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:05.723253 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.729375 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.591208 18988 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.730257 17471 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:05.559433 18896 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:05.593226 18981 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:05.743986 18977 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.749450 17313 consensus_meta.cc:287] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 13:18:05.749202 18977 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.749940 17313 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:05.750326 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:05.750756 19048 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:05.756098 19048 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.756470 18977 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.756599 19048 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.593379 18947 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.755200 17396 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:05.681162 19019 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:05.593703 18948 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.710548 18956 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.691789 19004 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.719439 18951 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:05.761591 18909 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.741411 18949 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.757736 18981 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.775451 18951 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.767671 18956 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.778055 18951 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:05.767843 18948 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.782069 17397 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:05.783174 18949 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.783910 18986 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:05.784389 18986 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:05.784793 18986 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.780754 18909 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.790305 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.801551 19036 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:05.802428 19036 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.805787 18963 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.760324 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.807608 17388 raft_consensus.cc:2393] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:18:05.814251 19020 consensus_meta.cc:287] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.660s	user 0.003s	sys 0.006s
I20260709 13:18:05.814805 19020 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.818707 18987 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.748080 18988 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.822243 18988 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.762828 18884 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:05.791139 17287 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.540s (SENT) [suppressed 83 similar messages]
W20260709 13:18:05.830873 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.834867 18882 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.836211 18856 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.762986 19019 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.840368 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.845729 17396 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:05.764551 18978 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.855049 17286 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:05.849753 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.850196 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.858948 17396 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 2: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:05.858985 17471 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:05.852603 18944 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.793680 18785 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:05.864773 18785 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:05.865952 18785 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.867251 18785 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.783176 18948 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.789317 18957 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:05.861088 18944 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.863559 17964 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:05.861661 18941 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.849061 19019 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:05.870373 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.759203 18896 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.846109 18949 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.857925 18884 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:05.869640 18978 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:05.882827 18884 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.888520 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:05.889510 17471 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:05.891058 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:05.885177 18944 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:05.788331 18992 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.870158 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:05.895695 19025 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:05.894673 18981 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:05.877339 18957 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:05.875276 18963 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:05.912396 17390 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
W20260709 13:18:05.913945 19034 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.671s	user 0.005s	sys 0.000s
I20260709 13:18:05.914039 18941 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.846680 18885 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:05.930227 18963 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.892298 18978 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.893977 18948 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.916615 17313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1020) took 1827 ms (client timeout 2187 ms). Trace:
I20260709 13:18:05.893472 19036 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:05.921069 19025 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:18:06.029191 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.881644 18949 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.033617 17388 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:06.037446 18956 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:06.027319 17313 rpcz_store.cc:269] 0709 13:18:04.089624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.171657 (+ 82033us) service_pool.cc:224] Handling call
0709 13:18:05.916336 (+1744679us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b5400368154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:05.916524 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235120384}
I20260709 13:18:06.038990 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:06.046155 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:06.011144 18963 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.055984 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:05.891733 19038 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.056799 17994 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:06.021894 18978 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:06.062175 17288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.008s	sys 0.111s
W20260709 13:18:06.062620 17288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.008s	sys 0.111s
I20260709 13:18:06.062747 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:06.018870 19020 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.027894 19025 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.065798 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.011646 18941 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.028095 18948 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.040823 18896 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.078676 19001 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.075383 19045 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:06.069188 18988 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:06.070972 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.104049 18968 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.105489 18957 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.087209 18896 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.090830 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.110227 17990 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:18:06.084071 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.111496 17390 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 2: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:06.079423 19001 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.096076 18876 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.116873 18992 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.117658 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:06.083559 18962 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.077298 19038 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.112401 18985 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:06.114369 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.108258 19019 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.094972 18999 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:06.092742 19045 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:06.093009 18949 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.086189 18972 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:06.070380 19020 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:18:06.158490 18985 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:06.160501 17393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.005s	sys 0.009s
W20260709 13:18:06.181389 17285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.040s	sys 0.086s
W20260709 13:18:06.189193 17285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.040s	sys 0.086s
I20260709 13:18:06.130770 18959 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:06.155035 18956 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.114718 18988 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:06.200744 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.173756 19045 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:06.188979 17393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.005s	sys 0.009s
I20260709 13:18:06.121695 19044 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.208492 18949 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:06.209487 19044 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:06.206707 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.209168 18949 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.204804 18985 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.151865 18962 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.211611 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:06.213914 17394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.016s
I20260709 13:18:06.192855 19001 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:06.217288 17392 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.012s
I20260709 13:18:06.219144 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:06.224259 17392 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.008s	sys 0.012s
I20260709 13:18:06.224637 17470 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 2: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:06.220175 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:06.221652 17397 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:06.225263 17469 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:06.221661 17394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.003s	sys 0.016s
W20260709 13:18:06.222441 17995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.045s	sys 0.100s
I20260709 13:18:06.222723 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:06.225871 17995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.045s	sys 0.100s
I20260709 13:18:06.226121 17466 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:06.222213 18984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.027s	sys 0.086s
I20260709 13:18:06.239395 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:06.254315 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.217064 18956 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.257977 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 466847us
I20260709 13:18:06.267064 17471 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.199609 18959 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.223757 18987 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.228283 18885 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.188544 18972 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.256341 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:06.269676 17397 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:06.253031 18884 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.306627 17467 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:06.267428 17395 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
W20260709 13:18:06.273824 17436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.018s
W20260709 13:18:06.307859 17436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.007s	sys 0.019s
I20260709 13:18:06.281983 17469 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:06.309237 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:06.266840 18984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.029s	sys 0.093s
I20260709 13:18:06.262961 18985 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:06.261942 19022 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:06.350827 17962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.007s	sys 0.035s
I20260709 13:18:06.311013 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:06.342829 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.344630 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:06.273551 19050 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.007s	sys 0.017s
W20260709 13:18:06.271008 18969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.028s
I20260709 13:18:06.354074 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.354813 17467 raft_consensus.cc:2368] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 2. Current term is 3.
W20260709 13:18:06.352644 17962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.007s	sys 0.035s
I20260709 13:18:06.360594 17469 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:06.361888 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:06.347754 18931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.017s	sys 0.040s
I20260709 13:18:06.305440 19044 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.363242 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 612972us
I20260709 13:18:06.293229 18981 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:06.366099 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.342368 18941 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:06.274410 18956 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.311606 18853 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:06.362152 18969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.004s	sys 0.029s
I20260709 13:18:06.413188 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.347137 18948 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.349699 18856 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.381958 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.355844 18875 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.366532 18931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.018s	sys 0.040s
I20260709 13:18:06.305678 18987 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.349957 18954 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:06.356621 19052 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.413965 17997 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:06.414454 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.415512 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.359135 18985 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.273248 17287 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:06.425122 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:06.425351 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 158161us
I20260709 13:18:06.436295 17315 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:06.426331 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:06.437456 17319 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 2: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:06.426479 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.437171 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:06.428992 18875 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.429752 18856 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.430078 19010 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:06.430009 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.428987 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.431057 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.487633 17467 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:06.432446 17996 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:06.432652 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.384773 18981 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.361795 19022 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.497632 17991 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:06.498029 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:06.498817 18882 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 13:18:06.443252 18988 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.443040 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:06.441946 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 168793us
I20260709 13:18:06.443697 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:06.444522 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.411695 19019 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.430799 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.489092 17322 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:06.507582 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.508428 17322 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:06.509537 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.510278 17322 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:06.511264 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:06.412632 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:06.388818 19044 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.518934 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:06.498661 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.493531 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.490448 19010 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:06.527252 18992 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:06.527786 18988 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:06.527586 19010 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.528765 19010 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.530614 18981 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:06.419486 19049 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:18:06.353843 18884 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.426945 17466 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:06.538789 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:06.499774 18999 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.435377 19004 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:06.439340 18969 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:06.514392 17319 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:06.588567 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.524945 19053 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:18:06.517624 17322 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:06.518678 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:06.592532 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.593259 17322 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:06.594239 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.595222 17322 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:18:06.519865 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 166166us
I20260709 13:18:06.596120 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.475770 18948 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:06.475529 19047 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:06.518239 18885 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:06.533146 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:06.607100 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 74244.1us
I20260709 13:18:06.435818 18954 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.539584 17466 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.498720 17320 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:18:06.544339 17287 leader_election.cc:400] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 2. Current term is 3.
I20260709 13:18:06.519881 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:06.527697 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:06.528605 18985 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.540206 17313 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 2: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:06.528558 18876 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:18:06.540329 17990 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:06.519320 18931 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:06.531672 18957 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:06.537288 18992 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:06.439495 19052 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.515676 17471 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:06.545169 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1290) took 1005 ms. Trace:
I20260709 13:18:06.596807 17315 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:06.610541 17287 leader_election.cc:403] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:06.584399 18959 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.626951 18948 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.587101 19000 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:06.619180 19077 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.547461 18999 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.623574 17462 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
W20260709 13:18:06.626223 19069 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:18:06.626060 19045 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:06.609576 19055 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:18:06.631661 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:06.768922 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 137352us
I20260709 13:18:06.769702 17463 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:06.634016 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.635175 17469 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:06.607216 18962 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.644512 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.643661 18931 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.622133 18969 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.822836 18969 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.631494 19047 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.617319 18972 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.639143 18957 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:06.655797 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 129198us
I20260709 13:18:06.838377 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:06.656955 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.649230 19076 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:06.614015 17318 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:06.615100 19053 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:06.843570 19053 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:06.843664 19057 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.266s	user 0.004s	sys 0.000s
I20260709 13:18:06.568184 19004 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:06.780270 19025 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.004s
I20260709 13:18:06.851622 19004 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:06.712782 19059 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:18:06.853214 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2185) took 1157 ms. Trace:
I20260709 13:18:06.853639 17394 rpcz_store.cc:276] 0709 13:18:05.695808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.701116 (+  5308us) service_pool.cc:224] Handling call
0709 13:18:05.701514 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.701901 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.701947 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.702452 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.228024 (+525572us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:06.228070 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.228139 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:06.852986 (+624847us) raft_consensus.cc:1685] finished
0709 13:18:06.853011 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.853154 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1529,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"thread_start_us":522983,"threads_started":1,"wal-append.queue_time_us":554930}
W20260709 13:18:06.662096 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.746793 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.616875 18885 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.674151 18948 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.768546 18988 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.676947 19077 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.866962 19082 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:06.809976 18853 raft_consensus.cc:2764] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:06.757138 17319 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
W20260709 13:18:06.871405 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.643724 17393 rpcz_store.cc:276] 0709 13:18:05.536521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.546061 (+  9540us) service_pool.cc:224] Handling call
0709 13:18:05.634872 (+ 88811us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:05.635107 (+   235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.638687 (+  3580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.638736 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.639277 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.207978 (+568701us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:06.431609 (+223631us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.483138 (+ 51529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.494019 (+ 10881us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:06.501599 (+  7580us) raft_consensus.cc:1685] finished
0709 13:18:06.523580 (+ 21981us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.542245 (+ 18665us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1758,"prepare.queue_time_us":163865,"prepare.run_wall_time_us":26163,"raft.queue_time_us":190337,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":12359,"spinlock_wait_cycles":19691776,"thread_start_us":775892,"threads_started":2,"wal-append.queue_time_us":521417}
I20260709 13:18:06.696798 19000 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:06.881875 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1186) took 1390 ms. Trace:
I20260709 13:18:06.882553 18931 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.870630 19044 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:06.887526 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.713668 18992 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.697446 18987 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.697031 18956 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.750941 17466 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:06.882346 17463 rpcz_store.cc:276] 0709 13:18:05.491748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.492001 (+   253us) service_pool.cc:224] Handling call
0709 13:18:06.881716 (+1389715us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000636d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:06.881818 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2810375040}
I20260709 13:18:06.661705 17322 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:06.763962 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.891470 17396 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:06.754853 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:06.767191 18986 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.982s	user 0.011s	sys 0.002s
I20260709 13:18:06.767385 19078 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.893910 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:06.754645 18968 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.650s	user 0.003s	sys 0.008s
I20260709 13:18:06.772699 17462 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:06.754755 19071 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.083s	user 0.002s	sys 0.001s
W20260709 13:18:06.745322 19048 consensus_meta.cc:287] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.988s	user 0.010s	sys 0.004s
W20260709 13:18:06.760121 18785 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.892s	user 0.011s	sys 0.002s
I20260709 13:18:06.755532 18981 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:06.771346 18978 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.693s	user 0.004s	sys 0.007s
I20260709 13:18:06.899751 18986 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.907259 18978 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.907732 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:06.812583 19028 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.534s	user 0.013s	sys 0.000s
I20260709 13:18:06.909158 18986 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:06.816771 19052 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.819111 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:06.910073 17314 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:06.815387 19045 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.827621 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 210) took 1154 ms. Trace:
W20260709 13:18:06.910568 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 91551.1us
I20260709 13:18:06.910919 17392 rpcz_store.cc:276] 0709 13:18:05.673108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.682460 (+  9352us) service_pool.cc:224] Handling call
0709 13:18:05.682807 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.683058 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:06.224782 (+541724us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.826975 (+602193us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b180039b620. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287
0709 13:18:06.827140 (+   165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:06.827213 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:06.827275 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.827369 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.827541 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":622256,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":209482,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":20367,"spinlock_wait_cycles":6102784,"thread_start_us":853459,"threads_started":3,"wal-append.queue_time_us":282521}
I20260709 13:18:06.820283 17465 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:06.912765 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.755290 18876 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:06.919204 18876 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:06.920320 18876 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.904223 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.921729 17390 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:06.923156 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:06.923354 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:06.923894 17390 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.845853 18957 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.844530 19053 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:06.855597 19061 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
I20260709 13:18:06.858309 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.856012 19076 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.857095 18972 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.861227 18856 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.861801 18885 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:06.934300 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.935216 17393 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:06.660303 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.936272 17388 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:06.863749 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 572) took 1999 ms. Trace:
I20260709 13:18:06.937098 18972 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.939462 18972 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.827301 19047 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:06.874555 18875 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:06.850965 19025 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.878150 19077 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.880314 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.949033 17470 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:06.887442 17469 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:06.882014 19000 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:06.891494 17996 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 2: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:06.896677 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.952283 17394 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:06.896262 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.952677 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.953517 17996 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:06.955224 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.937142 17995 rpcz_store.cc:276] 0709 13:18:04.848293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.848464 (+   171us) service_pool.cc:224] Handling call
0709 13:18:05.010200 (+161736us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:05.010377 (+   177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.013194 (+  2817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.013223 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.035521 (+ 22298us) log.cc:844] Serialized 26 byte log entry
0709 13:18:05.650678 (+615157us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b18003aca80. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:18:06.226279 (+575601us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:06.226317 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.226385 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:06.847117 (+620732us) raft_consensus.cc:1685] finished
0709 13:18:06.847135 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.847260 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119024,"raft.queue_time_us":8204,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9088,"spinlock_wait_cycles":18132608,"thread_start_us":575419,"threads_started":1,"wal-append.queue_time_us":1375367}
W20260709 13:18:06.678193 19074 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:18:06.889389 18896 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.783s	user 0.013s	sys 0.000s
I20260709 13:18:06.899214 17993 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:06.899727 17466 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:06.900436 17471 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:06.895383 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.966138 17396 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:06.966212 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.765872 18884 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:06.909075 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.842481 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:06.913821 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:06.912679 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:06.915731 17462 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:06.917595 19064 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.918023 18978 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.918574 18941 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:06.997334 18941 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:06.997833 18941 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:06.998147 18948 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.998832 18941 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.000428 18941 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:06.949074 18785 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:06.899673 19078 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:06.846665 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.004053 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.888597 18949 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.924978 17397 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:06.928370 19081 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:06.942003 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.015105 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.760387 18959 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.015609 19078 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.015133 18954 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:07.016214 18959 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.009188 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:07.018841 17313 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:07.019006 18959 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.988157 19052 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:07.019958 19052 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.022188 19052 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.847791 18962 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.022915 18962 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.899261 19051 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.958264 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:07.045594 17315 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:06.954854 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:07.046144 17394 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:06.961527 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.900967 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:06.962529 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:06.963925 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.965342 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.048853 17468 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:06.970745 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:07.049372 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 150600us
W20260709 13:18:07.049610 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 78962.3us
I20260709 13:18:07.050833 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:06.985481 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.051507 17998 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
W20260709 13:18:06.987133 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 144732us
I20260709 13:18:06.988575 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:07.053627 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 65136.1us
I20260709 13:18:07.054272 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:07.055327 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:07.056543 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:07.057189 17394 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:06.989276 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:06.990378 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 77749.3us
I20260709 13:18:06.991602 17391 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:06.991775 18978 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.992043 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:06.992316 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:06.992552 18972 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.993173 19022 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:06.951159 18909 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:06.921823 18876 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.949838 18944 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:07.002203 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:06.991806 19044 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:06.943235 18951 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:18:06.956439 17393 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:07.011646 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:06.924631 19048 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:06.913467 17990 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:07.024541 19015 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:06.984035 18896 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:06.983604 19053 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.071035 19052 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:07.029213 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.084331 19064 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.034972 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:07.115024 17999 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:07.041050 19076 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.042572 19081 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.043512 19025 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.004354 18875 raft_consensus.cc:2764] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:18:07.004132 18963 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.939s	user 0.004s	sys 0.009s
I20260709 13:18:07.060381 17316 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:07.100497 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:07.064781 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:07.064913 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.067931 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:07.069180 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:07.122988 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 53919.4us
I20260709 13:18:07.070215 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.126156 17998 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:07.071046 17320 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:07.073343 17322 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:07.071341 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.079192 17462 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:07.127498 17996 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:07.127920 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.128521 17462 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:07.108708 19044 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:07.082230 19051 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.085522 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:07.100735 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.134991 17317 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:07.106359 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 94769.9us
I20260709 13:18:07.083845 18978 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.003336 18785 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.070360 19072 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:07.083796 18921 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:07.114874 17321 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:07.015853 17467 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:07.085505 17993 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:07.151796 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.152388 17467 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:07.102600 18948 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:07.098030 18959 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:07.120456 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:07.059288 17964 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:07.119098 19081 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.129477 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.080722 17470 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:07.174378 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.174887 17317 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:07.071220 19010 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.070127 19001 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:07.135435 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.135848 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:07.176944 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.070765 18940 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.084178 18972 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.140715 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:07.178817 17470 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:07.136466 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.112493 19052 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:07.114673 19018 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.099514 18944 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.149819 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:07.149972 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:07.153182 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.121248 17994 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:07.135377 18871 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:07.174085 19021 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.129351 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:07.137763 19064 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.142009 19072 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.178205 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.183075 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.208607 17996 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:07.209890 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:07.185822 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:07.186822 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:07.153200 19022 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.184000 17998 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
W20260709 13:18:07.187605 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 429270us
I20260709 13:18:07.183081 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:07.190124 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.153256 18921 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.185446 19010 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.185916 19052 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.213549 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.169945 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.130663 18963 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:07.230878 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 44129.8us
I20260709 13:18:07.198873 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:07.171018 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 111815us
I20260709 13:18:07.234117 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:07.234398 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:07.143515 18954 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:18:07.191540 17315 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:07.140282 17313 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:07.186875 18951 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:07.204646 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 75367.4us
I20260709 13:18:07.136139 19044 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.177418 19001 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.253671 19001 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.260191 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:07.260987 17471 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.264410 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:07.264972 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:07.265146 17391 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.265609 17389 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:07.256632 17470 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:07.266866 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:07.267733 17318 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.229547 17995 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:07.230439 17996 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:07.193291 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.269604 17394 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:07.269934 17467 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:07.270850 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.272693 17391 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:07.234972 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:07.200002 18871 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.243589 17468 raft_consensus.cc:2376] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3. Re-sending same reply.
I20260709 13:18:07.274216 18871 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.278023 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:07.278393 17322 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:07.222218 19084 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:07.246536 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:07.279078 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:07.279548 17322 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:07.279749 18880 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:07.279893 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:07.225194 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.280474 18880 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:07.190119 18940 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.281424 18880 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.282684 18940 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.248015 18951 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.283674 19044 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.286438 18896 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:07.287137 18896 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:07.289783 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:07.290709 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:07.290854 17467 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:07.291031 18909 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:07.291626 19036 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:07.236007 19062 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:07.292069 19025 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:07.292337 19036 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:07.292673 19025 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:07.293294 19036 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.293602 19025 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.295184 19010 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.225587 18853 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:07.296336 18853 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.249181 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:07.296793 18853 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.249346 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:07.291635 18909 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:07.298130 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48882.6us
I20260709 13:18:07.298789 18909 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.300282 19083 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:07.300742 19083 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:07.193849 19015 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:18:07.301139 19083 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.239392 19077 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.250837 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.226189 18785 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:07.251669 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.194830 18875 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:18:07.253116 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:07.267021 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.175341 18959 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.291716 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:07.341761 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 50105.6us
I20260709 13:18:07.302675 17469 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:07.197934 19018 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.213604 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:07.345633 17471 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:07.304517 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:07.304514 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:07.302700 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:07.346400 17396 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:07.306316 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.306775 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:07.309553 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:07.347940 17389 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 2: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:07.309803 17318 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:07.221261 18962 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.227138 19048 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:07.227173 18978 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.213099 19072 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.317795 17315 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.361385 17397 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:07.288242 18896 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.348031 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:07.224630 18957 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.347292 17394 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:07.374337 17396 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
W20260709 13:18:07.375309 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 320022us
I20260709 13:18:07.382550 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:07.393181 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 342387us
W20260709 13:18:07.418056 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 70108.6us
I20260709 13:18:07.421375 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:07.421721 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:07.423009 17285 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:07.352043 18949 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:07.351545 19067 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:07.430502 18951 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:07.355540 18962 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:18:07.434238 18962 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.434300 18921 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:07.434790 18962 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.435514 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.436342 17993 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:07.417604 17991 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:07.437547 18962 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.438481 18962 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:07.432870 18957 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.439550 18962 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:07.439951 18962 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.440327 18962 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.336526 19077 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.361250 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:07.351989 18885 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:18:07.356191 19047 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:18:07.367558 19048 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.448532 18949 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.447934 19067 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.455669 18987 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:07.488448 18988 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.617s	user 0.005s	sys 0.006s
I20260709 13:18:07.521845 18988 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 2. Current term is 3.
I20260709 13:18:07.525005 19018 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:07.515377 18987 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:07.529636 18987 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.535449 17320 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
W20260709 13:18:07.536058 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.490641 17315 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
W20260709 13:18:07.492043 19088 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:18:07.492223 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 426) took 1430 ms. Trace:
I20260709 13:18:07.493090 19064 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:07.494100 18962 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.495296 17998 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:18:07.498107 17390 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.005s
W20260709 13:18:07.479662 19089 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:18:07.474781 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.499771 18871 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.463251 19046 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.500327 18999 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:07.462355 19051 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:07.502631 19067 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.475775 19045 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:07.502830 19077 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.503381 18949 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.504535 18972 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.504427 19001 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.507853 18853 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.510174 18944 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.509136 19048 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.511437 18963 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.509471 18959 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:07.514118 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 72471.9us
W20260709 13:18:07.577251 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 277345us
I20260709 13:18:07.562723 18957 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:07.606340 17462 raft_consensus.cc:2368] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4.
I20260709 13:18:07.597271 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:07.568102 17390 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:07.610035 17317 raft_consensus.cc:2368] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3.
I20260709 13:18:07.613137 17470 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:07.615063 19072 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.576718 19081 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.615483 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:07.576556 17992 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
W20260709 13:18:07.707288 17999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 427) took 1642 ms (client timeout 1856 ms). Trace:
I20260709 13:18:07.692950 19044 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:07.890341 17999 rpcz_store.cc:269] 0709 13:18:06.065395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.065531 (+   136us) service_pool.cc:224] Handling call
0709 13:18:07.707001 (+1641470us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54006d1354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:07.707206 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411135872}
I20260709 13:18:07.705375 18785 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:07.892246 18785 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:07.892570 19044 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.708537 19021 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:07.619176 18959 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:07.894821 17997 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:07.893311 18785 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.895310 18959 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.895874 18785 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:07.896464 17997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 432) took 1449 ms (client timeout 1590 ms). Trace:
I20260709 13:18:07.566121 17994 rpcz_store.cc:276] 0709 13:18:06.062236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.068945 (+  6709us) service_pool.cc:224] Handling call
0709 13:18:07.491966 (+1423021us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001de2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:07.492134 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2327870208}
W20260709 13:18:07.896929 17997 rpcz_store.cc:269] 0709 13:18:06.449602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.487004 (+ 37402us) service_pool.cc:224] Handling call
0709 13:18:07.251519 (+764515us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:07.896286 (+644767us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5400695d54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:07.896406 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343412864}
I20260709 13:18:07.897694 18959 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.705720 18871 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.619438 19078 raft_consensus.cc:2764] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:07.899569 19081 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.722709 18958 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:07.655157 18853 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.900950 18958 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:07.701195 18962 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.683880 19001 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.902264 18958 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.612952 18988 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:07.904807 18958 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:07.750535 19053 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.639s	user 0.002s	sys 0.006s
W20260709 13:18:07.887609 19052 consensus_meta.cc:287] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.004s
I20260709 13:18:07.718518 18981 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.608728 18972 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.308s
I20260709 13:18:07.919205 19052 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:07.926105 19048 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:07.926573 19072 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:07.927577 19052 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:07.930956 19083 consensus_meta.cc:287] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.629s	user 0.012s	sys 0.000s
I20260709 13:18:07.931375 19083 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:07.932933 19083 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:07.617877 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.966432 17285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.012s	sys 0.016s
W20260709 13:18:07.966992 17285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.012s	sys 0.016s
W20260709 13:18:07.969275 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 546291us
I20260709 13:18:07.970824 17285 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:07.675596 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 254273us
I20260709 13:18:07.974283 17316 raft_consensus.cc:2368] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6.
I20260709 13:18:07.975172 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:07.979038 17321 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:07.989260 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:08.007903 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.009099 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.010027 17389 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:08.010227 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.011031 17388 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.972687 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.017134 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.017356 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.021378 17392 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.015511 17220 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.018703 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.022418 17394 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:07.700555 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2196) took 1090 ms. Trace:
I20260709 13:18:08.023409 17395 rpcz_store.cc:276] 0709 13:18:06.610920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.611054 (+   134us) service_pool.cc:224] Handling call
0709 13:18:06.611479 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.828098 (+216619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.828143 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:06.828199 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:06.828243 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.700205 (+871962us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400302ad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:07.700275 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.700465 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497575808}
I20260709 13:18:08.020109 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.025547 17396 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.030290 17220 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 4 to 5, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:07.610426 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 368250us
I20260709 13:18:08.057586 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.058318 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.058404 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.059267 17469 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
W20260709 13:18:07.676375 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 442283us
I20260709 13:18:08.059638 17471 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:08.041973 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 69564.9us
I20260709 13:18:08.045975 17287 leader_election.cc:400] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4.
I20260709 13:18:08.050045 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.057636 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.062652 17468 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.062493 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:08.059580 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1201) took 1054 ms. Trace:
I20260709 13:18:08.065418 17470 rpcz_store.cc:276] 0709 13:18:07.010225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.266793 (+256568us) service_pool.cc:224] Handling call
0709 13:18:07.711401 (+444608us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540027fbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:08.059298 (+347897us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627718400}
I20260709 13:18:08.070312 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:08.060609 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.050382 17214 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 215) took 3791 ms. Trace:
I20260709 13:18:08.051240 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.050429 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.073673 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:08.074095 17463 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:18:08.074743 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.075384 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.076658 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:08.078631 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:08.079430 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:08.079566 17992 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:08.058604 17467 raft_consensus.cc:2368] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4.
I20260709 13:18:08.081351 17962 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.081689 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.084941 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.085996 17320 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:08.085600 19067 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:08.087100 19046 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.004s
I20260709 13:18:08.088790 19067 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.082078 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.090204 17321 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:07.922115 19000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.010s	sys 0.024s
I20260709 13:18:07.922116 18981 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.093380 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.093894 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:08.094015 18856 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:08.094290 17319 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:08.094936 18856 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:08.095446 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.088676 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:08.096480 17997 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:08.097836 18951 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:08.087795 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.098361 18951 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.098837 18951 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.032238 17388 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:08.032274 17392 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:08.107442 17468 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
W20260709 13:18:08.093397 19000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.011s	sys 0.024s
I20260709 13:18:08.113998 17463 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:08.115417 17396 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:08.116106 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.116950 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:08.118150 17992 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:08.118224 18968 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:08.118997 18968 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.121524 19000 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:08.122007 19000 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.122380 18962 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:08.123029 18962 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:08.125145 18959 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:08.125355 18921 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:08.126157 18921 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.127374 19045 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.128083 19045 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.117043 17996 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:08.129169 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.130045 17394 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:08.132295 18987 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.602s	user 0.003s	sys 0.007s
I20260709 13:18:08.124138 18962 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.048604 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.126119 18959 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.137704 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:08.168037 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:08.168226 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 86674.7us
I20260709 13:18:08.163341 17471 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
W20260709 13:18:08.165840 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 117392us
I20260709 13:18:08.165836 17316 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:08.167654 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:08.181207 19077 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:08.181721 19077 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:08.138756 18876 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:08.183403 18876 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:08.182962 19077 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.183845 18876 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.187048 17287 leader_election.cc:400] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4.
I20260709 13:18:08.187430 17287 leader_election.cc:403] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.137264 18909 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:18:08.188371 17287 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:08.190237 18853 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.190970 18853 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.165724 19044 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:08.122416 19000 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.179561 17220 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 5, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 5 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:18:08.152185 17996 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:08.195230 17468 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:08.198312 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:08.192952 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 116600us
I20260709 13:18:08.195514 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.225818 18909 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:08.226598 18909 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:08.227205 18909 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.146198 18856 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:08.187444 18949 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.000s
I20260709 13:18:08.195163 18968 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.168041 18944 raft_consensus.cc:2764] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:08.152969 18921 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.193401 19044 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.139173 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.134408 18880 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.192816 18958 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.222210 19077 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.167543 19094 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.275019 19094 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.277274 19094 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.146196 19018 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:18:08.277822 18958 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4.
I20260709 13:18:08.141564 18988 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:08.279409 18988 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:08.280853 18988 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.142150 18992 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:08.285094 18992 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:08.286805 18992 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.265275 19044 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.140486 18972 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:08.143335 18963 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:18:08.138326 18986 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:08.291816 18986 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:08.293253 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 214) took 1029 ms. Trace:
I20260709 13:18:08.293350 18986 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.293805 17393 rpcz_store.cc:276] 0709 13:18:07.263685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.266026 (+  2341us) service_pool.cc:224] Handling call
0709 13:18:07.266385 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.492158 (+225773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.492196 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.492762 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.832659 (+339897us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:08.116138 (+283479us) log.cc:844] Serialized 14 byte log entry
0709 13:18:08.229958 (+113820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.230736 (+   778us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540009b0d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:08.230789 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.230854 (+    65us) raft_consensus.cc:1685] finished
0709 13:18:08.261736 (+ 30882us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.293031 (+ 31295us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":274879,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1948,"raft.queue_time_us":13735,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":23460,"spinlock_wait_cycles":506739072,"thread_start_us":391956,"threads_started":2,"wal-append.queue_time_us":434724}
I20260709 13:18:08.145248 19021 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:08.091679 17214 rpcz_store.cc:276] 0709 13:18:04.221141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.244098 (+ 22957us) service_pool.cc:224] Handling call
0709 13:18:08.012140 (+3768042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:04.795733 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:04.796382 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:04.796421 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:18:04.796442 (+    21us) tablet.cc:662] Decoding operations
0709 13:18:04.796905 (+   463us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:04.806657 (+  9752us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:04.807846 (+  1189us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:04.872878 (+ 65032us) tablet.cc:701] Row locks acquired
0709 13:18:04.874747 (+  1869us) write_op.cc:260] PREPARE: finished
0709 13:18:04.902936 (+ 28189us) write_op.cc:270] Start()
0709 13:18:04.915996 (+ 13060us) write_op.cc:276] Timestamp: P: 1783603084902848 usec, L: 0
0709 13:18:04.968895 (+ 52899us) op_driver.cc:348] REPLICATION: starting
0709 13:18:04.975294 (+  6399us) log.cc:844] Serialized 913 byte log entry
0709 13:18:05.767071 (+791777us) op_driver.cc:464] REPLICATION: finished
0709 13:18:06.411584 (+644513us) write_op.cc:301] APPLY: starting
0709 13:18:06.417869 (+  6285us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:06.436170 (+ 18301us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:06.518375 (+ 82205us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:06.596230 (+ 77855us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:06.627237 (+ 31007us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:06.640079 (+ 12842us) write_op.cc:312] APPLY: finished
0709 13:18:06.654757 (+ 14678us) log.cc:844] Serialized 29 byte log entry
0709 13:18:07.071797 (+417040us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.081354 (+  9557us) write_op.cc:454] Released schema lock
0709 13:18:07.081414 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:07.081863 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.081889 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":601557,"apply.run_cpu_time_us":178346,"apply.run_wall_time_us":697189,"num_ops":2,"prepare.queue_time_us":157533,"prepare.run_cpu_time_us":19415,"prepare.run_wall_time_us":376376,"raft.queue_time_us":276228,"raft.run_cpu_time_us":27083,"raft.run_wall_time_us":596559,"replication_time_us":797999,"spinlock_wait_cycles":12544,"thread_start_us":1246647,"threads_started":5,"wal-append.queue_time_us":508395,"wal-append.run_cpu_time_us":13830,"wal-append.run_wall_time_us":1542585}]]}
W20260709 13:18:08.250787 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62546.9us
I20260709 13:18:08.297785 17287 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:08.265403 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.253786 17392 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.165241 18951 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.256491 17394 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:08.263720 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:08.132814 18987 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.270558 19081 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:08.271301 17469 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.265062 18968 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:08.273253 18940 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:08.274093 18959 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.308118 19096 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
W20260709 13:18:08.313663 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 92920.1us
I20260709 13:18:08.257225 17990 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
W20260709 13:18:08.320488 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 95655.7us
I20260709 13:18:08.288777 18992 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.307256 18853 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:08.314535 19078 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:08.331224 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:08.317121 19094 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.337307 19094 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.339788 18987 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.339931 19094 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:08.264416 18949 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.340909 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.341908 17468 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:08.334566 17471 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:08.335705 17391 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:08.336264 18968 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.323135 19081 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:08.346953 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.309307 18880 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.350440 19045 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.355842 18981 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.356724 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.359983 18962 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.360589 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 218) took 1095 ms. Trace:
I20260709 13:18:08.360705 18962 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.361207 17391 rpcz_store.cc:276] 0709 13:18:07.276950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.336459 (+ 59509us) service_pool.cc:224] Handling call
0709 13:18:08.360336 (+1023877us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54004132d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:08.360504 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990651648}
I20260709 13:18:08.363353 18962 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.364048 18958 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:08.365332 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.375239 19021 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:08.375967 19021 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:08.376353 17392 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:08.376467 19021 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.378125 18876 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.379724 18876 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.381124 19092 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:08.381769 19092 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.382241 19092 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:08.383006 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 128664us
I20260709 13:18:08.384457 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.385164 19078 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.382335 18951 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.398315 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:08.401630 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:08.402302 19092 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.404284 17990 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:08.405655 19081 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.406024 18951 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.406942 18951 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.409240 17462 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:08.410044 18951 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.411983 19000 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.413899 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.414529 18968 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.414644 17320 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:08.415906 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.416103 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.416908 17321 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:08.416811 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:08.417404 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.417503 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.418165 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.418488 17466 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:08.418540 17319 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:08.420223 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:08.418179 17313 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:08.421665 17315 raft_consensus.cc:2376] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2. Re-sending same reply.
I20260709 13:18:08.422211 17322 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:08.422377 18981 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.423789 17471 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:08.419247 18963 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:08.425338 18963 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:08.426538 18963 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:08.441880 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 113509us
I20260709 13:18:08.443686 18958 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:08.444777 18958 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.447908 17997 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:08.442695 19052 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:08.448980 19052 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:08.449265 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.450067 17471 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:08.449987 19052 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.451592 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.452224 17471 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:08.453514 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.454250 17471 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:08.456334 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.457068 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.458088 17463 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:08.458015 19021 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.462148 18876 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:08.462559 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 78185.3us
I20260709 13:18:08.463492 17285 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.464285 18962 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:08.464875 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:08.466287 19001 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:08.466776 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:08.466823 19001 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.467597 19001 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.470515 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.472076 17462 raft_consensus.cc:2410] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:08.472882 18968 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:08.473526 18968 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.474635 18949 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.475687 18968 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.476413 19000 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.408552 18880 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:08.477151 17316 raft_consensus.cc:2368] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
I20260709 13:18:08.478542 17360 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.478997 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.479779 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.480062 18968 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:08.480435 18968 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.482190 18968 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.477622 19044 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.482615 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:08.483511 17322 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:08.485296 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.485810 17320 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:08.486011 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.486950 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:08.487495 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.486971 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.487838 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:08.488268 17313 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:08.488322 17318 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:08.488517 17322 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.478240 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.478371 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.489464 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.490136 17463 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 2: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:08.490177 17466 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:08.480648 18949 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:08.477404 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.477300 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.491117 18949 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:08.484333 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:08.499562 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 174268us
I20260709 13:18:08.500370 17469 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:08.505741 17322 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:08.501034 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.515784 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.516485 17462 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.520100 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.522646 17316 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:08.522825 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.523581 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.489616 19044 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.497033 18949 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.450006 19092 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.527503 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.529601 17469 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:08.498255 18972 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:08.533258 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.384728 18909 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.535215 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.531639 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.536934 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.538779 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.540567 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.541282 17463 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:08.542729 17471 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:08.543522 17322 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:08.532745 18972 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.543552 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.534337 19078 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.549418 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:08.550585 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 469431us
I20260709 13:18:08.552783 17468 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:08.549479 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.553046 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.555677 17469 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:08.543319 19021 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.554234 17467 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:08.557446 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.546797 18972 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.561153 19099 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:08.565333 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.568274 19000 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:08.568872 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.569530 17464 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:08.577356 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.579609 19078 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:08.580271 19078 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:08.581475 19078 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.547333 19077 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:08.586292 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:08.586905 18909 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:08.559248 17313 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:08.592653 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.594089 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.594496 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.552627 18876 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:08.596488 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 64984.9us
I20260709 13:18:08.595485 19077 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:08.604862 17462 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:08.604748 17468 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:08.608297 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:08.608907 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 54839.2us
I20260709 13:18:08.609280 17391 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:08.610826 18968 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.611328 18949 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.613420 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.613780 17287 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:08.614101 17392 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:08.610860 17962 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:08.619457 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:08.619719 17315 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:08.615345 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:08.622422 17466 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:08.624948 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:08.625835 18981 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:08.626772 19077 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:08.627800 19077 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.601338 19001 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.639926 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.640870 17462 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:18:08.641526 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.641397 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 110472us
I20260709 13:18:08.632498 19001 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.647220 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.647347 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:08.647627 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:08.649997 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.650382 17319 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:08.620429 19052 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:08.657130 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.649374 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.651290 17392 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.653779 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:08.653982 18968 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.621487 18962 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:08.662580 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:08.663141 17471 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.658334 17318 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:08.666227 17321 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:08.701685 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 90919.9us
I20260709 13:18:08.702837 17316 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:08.704061 17468 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:08.706687 17394 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:08.650918 18986 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:08.710687 18992 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:08.711148 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 95877us
I20260709 13:18:08.660662 19000 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:08.708668 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.711397 18876 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:08.720176 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 86501.1us
I20260709 13:18:08.720871 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.705523 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:08.700340 18962 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:08.708967 18951 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.699659 19099 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:08.714088 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.717118 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.715939 18981 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:08.717368 19000 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.737622 19000 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.738385 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.739678 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.739923 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.734509 17395 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:08.737011 17397 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.743866 17392 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:08.721318 19052 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:08.753947 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.756407 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.740653 17391 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.768060 19052 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.768537 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.771767 19021 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:08.772536 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:08.760433 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 106952us
I20260709 13:18:08.765719 17389 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:08.767046 17313 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:08.741710 19092 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:08.722081 18876 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.795341 17468 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:18:08.723742 18988 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:18:08.726954 19099 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.785774 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.800604 17395 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.802498 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:08.798373 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.741937 18949 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:08.795840 17468 pending_rounds.cc:85] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 3
I20260709 13:18:08.773612 18981 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.833564 18981 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.799049 19096 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.822016 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:08.728976 18951 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.823571 19123 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:08.823659 18963 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:08.823586 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:08.826175 17391 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:08.814739 17468 pending_rounds.cc:107] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:18:08.850394 17468 raft_consensus.cc:2889] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:08.826342 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 53932.5us
I20260709 13:18:08.829835 18885 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:18:08.795686 17393 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.805552 17471 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
W20260709 13:18:08.841634 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 43945.8us
I20260709 13:18:08.842317 17396 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.843291 17389 raft_consensus.cc:2368] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3.
I20260709 13:18:08.832310 18972 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.777626 18986 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:18:08.881095 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:08.881359 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 78966.2us
I20260709 13:18:08.882591 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.883131 17434 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:08.883842 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.884377 18968 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:08.850155 19077 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:08.885794 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:08.886610 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:08.885037 18940 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:08.852245 18944 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:08.908380 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.915560 17395 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:08.888569 19018 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:08.888752 19077 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.890498 19092 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:08.898002 18968 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:08.909264 19081 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:08.919446 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:08.888698 19123 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
W20260709 13:18:08.989013 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 64396.9us
W20260709 13:18:08.984392 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 110639us
I20260709 13:18:08.936206 19018 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.963866 18940 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:08.863988 19096 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:08.969357 19077 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.965327 19045 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:09.021132 19045 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.021593 19045 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:09.024722 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 132802us
I20260709 13:18:09.025682 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.027791 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.028733 18949 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.007521 19018 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.034029 17395 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:09.035698 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 100383us
I20260709 13:18:09.036662 17962 leader_election.cc:400] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3.
I20260709 13:18:09.038833 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.038295 19018 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.040191 17962 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:09.040513 18880 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:09.040995 18880 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.041312 18880 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.042426 19018 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.045326 19092 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.057562 19137 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.058250 19137 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:08.885326 18962 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.056514 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:09.060557 19137 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:08.995831 19081 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:09.000918 17391 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
W20260709 13:18:09.089022 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48911.7us
I20260709 13:18:09.090967 17396 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:09.084303 18958 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.936117 18944 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.083122 18987 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:09.113103 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56764.5us
I20260709 13:18:09.115029 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:09.116696 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.120785 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.113452 18968 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.106249 18963 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:09.134613 19018 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:09.134668 19078 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:09.135202 19018 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:09.135509 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.135721 19018 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.113791 18987 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:18:09.120446 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 257045us
I20260709 13:18:09.064721 19000 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.116029 18958 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.131405 18981 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:09.163928 17962 leader_election.cc:400] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6.
W20260709 13:18:09.164474 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49689.3us
I20260709 13:18:09.112576 18880 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.134119 18963 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:09.173292 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 56755.4us
I20260709 13:18:09.151059 18987 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.181414 18944 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.184906 19081 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.186614 18880 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.187568 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.189081 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:09.159888 18972 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.189944 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:09.194291 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 311200us
I20260709 13:18:09.195549 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:09.197103 18949 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.207523 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:09.207844 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 56423.6us
I20260709 13:18:09.214840 17964 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:09.189445 18963 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.219652 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:09.231753 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:09.232501 17316 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:09.205682 18944 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.240670 17322 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:09.213558 19078 raft_consensus.cc:2764] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:09.243320 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:09.245581 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:09.248265 17318 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:09.250483 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.262624 17313 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:09.263221 17390 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:09.264978 19021 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:09.237847 18981 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.255622 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.275030 17396 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
W20260709 13:18:09.287417 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 82428.1us
I20260709 13:18:09.228096 18885 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:18:09.240257 18958 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.249037 19092 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.293313 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:09.305153 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:09.305176 17316 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:09.305658 17434 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:09.305910 17318 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:09.240453 19099 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.289995 19078 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.282111 17393 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:09.313289 18981 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:09.315514 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 66878.3us
W20260709 13:18:09.318658 19128 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:09.318329 18987 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.298718 18944 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:09.294328 17390 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:09.320482 17392 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:09.328735 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 85489.6us
I20260709 13:18:09.326788 17360 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:09.336215 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.336692 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:09.344626 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 67430.3us
I20260709 13:18:09.326174 18981 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.316083 19140 consensus_queue.cc:1059] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:18:09.361253 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:09.315718 19148 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:09.305019 19092 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.331058 18959 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:09.377712 17392 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:09.363210 18981 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.335418 18944 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:09.379503 17397 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.596s	user 0.014s	sys 0.007s
I20260709 13:18:09.379422 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:09.342803 19000 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.396631 17397 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:09.378993 19148 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:09.366597 19045 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.390731 18944 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.406527 19149 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:09.396250 19021 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:09.410081 19138 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:18:09.404780 18986 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:18:09.438380 18986 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:09.438838 18986 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:09.438468 19021 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.439692 18986 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.417641 19096 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.419274 19150 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:09.421797 19143 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:09.422611 19146 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.424355 19092 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.426172 19018 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.428494 18949 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:09.429888 19077 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.431494 18987 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.409052 19152 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:09.433197 19099 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.403249 19148 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.441354 18986 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:09.472234 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 111062us
I20260709 13:18:09.473145 18949 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.492025 18949 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.493628 17389 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:09.494861 18949 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.477136 18876 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.496201 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:09.481765 19077 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.481976 19146 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.503731 19146 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:09.504284 19146 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.470217 19152 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:09.505097 19078 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.506098 19152 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.451041 19150 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:09.509207 19150 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.483717 18940 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.502959 18981 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.514644 17394 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:09.515501 18981 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:09.516170 18981 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:09.516512 18981 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:09.486486 19018 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:09.489984 18963 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.481680 19045 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.474035 17395 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:09.497079 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:09.497309 19157 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.499048 18951 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.501049 19099 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:09.478696 19129 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.712s	user 0.003s	sys 0.002s
I20260709 13:18:09.525233 19148 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.526809 18963 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:09.527544 19148 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.528254 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:09.529496 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:09.529924 18876 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:09.530449 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:09.530510 18876 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:09.530639 17392 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:09.556367 18988 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:09.556994 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 230297us
I20260709 13:18:09.557928 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.558946 19161 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:09.560246 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.561427 17390 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:09.562060 19161 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:09.546481 18992 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:09.562579 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:09.561094 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:09.560987 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:09.563822 17469 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.565016 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.566074 17997 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:09.520177 18981 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.568979 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:09.569953 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.570657 17397 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:09.572145 17395 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:09.560034 18988 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:09.530812 19044 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:09.574555 17396 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:09.530968 19136 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:09.546804 18951 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.581189 17997 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:09.580895 19136 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.534116 18876 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.582231 19136 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.583091 18988 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:09.531718 19000 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:18:09.574999 19157 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:09.580083 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:09.576790 19053 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:18:09.578065 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1347) took 1087 ms. Trace:
I20260709 13:18:09.579134 17360 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.562903 18992 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.593246 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.595628 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.582247 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.598301 17469 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:09.606537 17397 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:09.546813 18909 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:09.608484 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:09.584812 19150 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.595341 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:09.618430 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 69421us
I20260709 13:18:09.618889 17998 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:09.600977 17317 rpcz_store.cc:276] 0709 13:18:08.487414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.498134 (+ 10720us) service_pool.cc:224] Handling call
0709 13:18:08.526467 (+ 28333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.587733 (+ 61266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.587766 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:08.588332 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:18:08.662772 (+ 74440us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:08.662809 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.406480 (+743671us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5400369054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:09.418095 (+ 11615us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:09.418159 (+    64us) raft_consensus.cc:1685] finished
0709 13:18:09.418174 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.574838 (+156664us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b5400369050. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:09.574980 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16773,"raft.queue_time_us":16957,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":186,"spinlock_wait_cycles":98227456,"thread_start_us":74010,"threads_started":1,"wal-append.queue_time_us":676301}
I20260709 13:18:09.591857 17391 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:09.619365 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:09.622525 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 43489.4us
I20260709 13:18:09.580390 19044 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.630286 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:09.616178 18992 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.631170 17996 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.639714 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.641963 17997 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.643596 17360 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.586521 19157 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.653540 19161 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.655880 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:09.656965 17397 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:09.616830 18962 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:09.596037 19136 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.592430 19146 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.593515 18951 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.691167 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.692665 17997 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:09.637012 19044 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.666270 19159 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.631762 18988 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:18:09.659682 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:09.626027 19092 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:18:09.645671 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:09.657114 19140 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.660066 19148 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.679352 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.694141 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:09.707031 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.707559 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.691995 17395 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:09.707849 17317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:18:09.722787 17317 raft_consensus.cc:606] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.723165 17317 raft_consensus.cc:614] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:09.644225 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.713321 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.645228 18909 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.700711 19167 raft_consensus.cc:2764] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:09.726117 17998 raft_consensus.cc:2410] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:09.707967 18951 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:09.726966 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:09.744973 17995 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.694738 18958 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:18:09.720793 19148 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:09.707123 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:09.770728 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 111374us
I20260709 13:18:09.725018 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.772871 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:09.773733 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 112238us
I20260709 13:18:09.773818 17395 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:09.720942 19018 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:18:09.762902 17393 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:09.776229 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.777311 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:09.747396 19145 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.755988 19045 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.759609 18959 raft_consensus.cc:2764] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:18:09.782588 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:09.772472 19148 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.725272 19140 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.779515 17991 raft_consensus.cc:2368] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4.
I20260709 13:18:09.725083 18962 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:09.792229 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 120285us
I20260709 13:18:09.793063 17466 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:09.787439 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:09.768570 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:09.783078 17360 leader_election.cc:400] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
I20260709 13:18:09.785197 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:09.716467 19159 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.789638 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.778204 18963 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:09.791002 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:09.791713 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:09.793617 17463 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:09.778672 17993 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.795323 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.802912 17998 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.795682 17467 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:09.796993 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:09.798071 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:09.771169 18951 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:18:09.802300 17462 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:09.781348 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:09.789331 18876 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:09.782019 17391 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:09.790293 19157 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.796293 19145 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.781463 18949 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:09.779728 19167 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:18:09.787511 18880 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:09.787667 18885 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:09.867592 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:09.841435 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:09.885356 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:09.917057 17462 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:09.917598 17463 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:09.917888 17471 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:09.919631 17996 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:09.920364 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:09.857432 19174 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:18:09.867151 19170 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:18:09.924579 19175 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:09.856457 17388 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:18:09.918596 19171 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:18:09.817059 18986 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.925782 17994 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:09.944509 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.816483 18963 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:09.931320 17998 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
W20260709 13:18:09.932242 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 156102us
I20260709 13:18:09.820384 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.903318 17465 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:09.842000 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:09.863413 19150 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.863992 19136 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.845044 18958 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.902945 19146 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.887920 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.851097 18944 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.933935 19077 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:09.945209 17996 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.843637 19160 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.172s
W20260709 13:18:09.946557 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 115018us
I20260709 13:18:09.952105 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:18:09.951944 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:09.951858 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:09.952953 17990 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:09.998075 17992 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.953647 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:09.953802 18959 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:09.954279 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:09.954523 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:09.955618 19177 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.956144 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:09.957242 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:10.011904 17470 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:09.923749 19157 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.015022 17315 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:09.957962 18992 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:09.959517 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:09.960882 18963 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.965474 19096 raft_consensus.cc:3055] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:09.965737 19140 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.968142 18962 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:09.969091 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:09.952728 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:09.969779 19183 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:18:09.969925 19145 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:09.971746 17993 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:09.969095 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:09.974112 17468 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:09.975620 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.934772 19175 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:10.014684 18959 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.053282 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:10.045084 19096 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:10.054633 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.054631 19096 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.055460 17313 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:18:10.056409 19096 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.977259 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.046913 18958 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:10.057189 17467 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:10.057298 18958 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.978310 19187 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:18:09.979009 18951 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:09.981318 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.982192 19184 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:10.061031 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:09.983572 19078 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.991593 17995 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:10.062963 19078 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:09.997484 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 174975us
I20260709 13:18:09.987303 17287 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:09.946326 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.065721 17316 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:09.946326 18876 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:09.957479 19159 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.016044 17320 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:10.016497 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:10.018388 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:10.025837 17996 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:10.016635 17321 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:09.986663 19167 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:10.012395 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:10.067816 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 49555.3us
I20260709 13:18:10.068768 19167 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:10.069555 17360 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:10.070592 17321 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:10.071009 18876 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.071134 18949 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:10.001379 19077 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:10.014305 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:10.043099 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:10.072060 17321 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:10.072378 17997 raft_consensus.cc:2368] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
I20260709 13:18:10.068682 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:10.013320 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:10.043730 19161 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.081877 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:10.081981 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.082116 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:10.082773 17990 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:10.083225 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.083995 17317 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 2: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:10.084084 17990 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.049727 19146 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.085191 19146 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.085852 17992 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:10.087352 17317 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:09.978070 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:09.982890 19081 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:10.073293 17315 raft_consensus.cc:2368] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
W20260709 13:18:10.070510 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 54113.5us
W20260709 13:18:10.092986 18981 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.001s
I20260709 13:18:10.074738 19157 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:10.093462 18981 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.049127 17388 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.075605 19159 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:10.076561 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:10.104862 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:10.106132 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:10.077167 19078 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.077523 18992 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.047107 19136 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:10.056569 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:10.078812 18958 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.062362 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.089918 19044 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.080282 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:10.112939 19078 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:10.114248 17322 raft_consensus.cc:2368] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:10.088879 17394 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.090696 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:10.064464 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.095818 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:10.120153 17997 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:10.114741 19044 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.122323 17393 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:10.122424 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.123493 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.115633 19157 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:10.125350 19157 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.125690 19157 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.094480 19152 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:10.097273 19148 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.101378 18944 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.124645 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:10.087392 19146 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.109635 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:10.109709 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 122500us
I20260709 13:18:10.016299 19177 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.089426 19077 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.106541 17465 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.129886 17394 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:10.102207 17285 leader_election.cc:400] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4.
I20260709 13:18:10.115367 19187 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:10.135900 19152 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.137100 19158 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:10.110682 19161 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:10.157879 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48354.1us
I20260709 13:18:10.115082 19184 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.080852 19175 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.116443 19159 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:10.150374 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 352385us
I20260709 13:18:10.152628 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.110585 19150 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:18:10.146312 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:10.131242 19136 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.150729 17393 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.358821 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.208479 17469 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:10.259174 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:10.237174 18981 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.463452 17465 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:10.461170 17360 leader_election.cc:400] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
I20260709 13:18:10.467710 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:10.257222 17462 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:10.481348 17360 leader_election.cc:403] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:18:10.259902 19180 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.336s	user 0.003s	sys 0.000s
W20260709 13:18:10.358245 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.483490 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:10.468014 17396 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:10.467528 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 322713us
I20260709 13:18:10.314584 19177 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:10.249392 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.472978 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:10.454866 18909 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.310783 18951 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.477072 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:10.477703 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.481753 19150 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:10.478366 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:10.478798 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:10.263994 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.157608 19161 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.553299 19161 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.555765 19152 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.557174 19184 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.558522 19167 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.559945 19167 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.534466 18958 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:18:10.561975 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.563139 17315 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:10.563580 19152 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.151280 19187 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:10.564352 19187 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.564141 19152 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.566675 19152 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:10.178617 19198 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.567304 19198 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.569617 19198 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.570140 19198 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
W20260709 13:18:10.564149 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.573477 18949 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:10.574028 18949 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.574551 19077 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.576148 18949 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.576651 18949 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.570833 19198 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:10.577211 18949 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:10.578568 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 110941us
I20260709 13:18:10.579326 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:10.579579 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:10.579974 17392 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:10.163200 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 68065.9us
I20260709 13:18:10.581566 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:10.582187 17285 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:10.583103 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:10.444826 19175 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.420732 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:10.417692 19148 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.456558 19045 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:10.470753 19081 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:10.164004 18944 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:10.453469 19176 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.406652 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:10.531533 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.625105 17995 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:10.529520 18968 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.625593 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.625778 18968 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:10.626207 17396 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:10.626608 18968 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.627636 18968 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.532585 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:10.403854 17314 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:10.534711 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:10.629055 19099 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.629298 17397 raft_consensus.cc:2376] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4. Re-sending same reply.
I20260709 13:18:10.535463 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:10.537137 19188 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:10.547310 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:10.548398 19205 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:10.552711 17388 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:10.533119 17991 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.550580 19177 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.579834 18949 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.584925 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:10.493871 17466 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:10.589949 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.623934 19081 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:10.600231 18940 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:10.600646 17999 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:10.601069 17468 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:10.586779 19152 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:10.602175 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:10.603081 19184 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:10.603786 18958 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:10.606043 19146 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:10.609328 17391 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:10.589886 19096 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:10.609611 18959 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.536466 18951 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.539268 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:10.633411 17392 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:10.675994 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:10.544318 19182 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:18:10.591727 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:10.624347 18944 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:10.648422 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 63610.1us
I20260709 13:18:10.684466 17285 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:10.649923 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 233) took 1106 ms. Trace:
I20260709 13:18:10.635792 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.636212 19176 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.536932 19159 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.673465 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:10.639123 19205 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:10.636299 17389 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.621234 19150 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.674432 19096 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.678768 19136 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.671464 19140 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.629858 19045 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.705529 19045 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.671734 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:10.682797 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 143630us
I20260709 13:18:10.706301 17466 raft_consensus.cc:2368] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
I20260709 13:18:10.706696 17287 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:10.707257 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.708359 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:10.652534 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 448) took 1031 ms. Trace:
I20260709 13:18:10.709648 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.710696 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:10.711606 17466 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.652731 19081 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.635344 19099 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.629674 18962 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.649860 19053 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:10.691124 17395 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:10.692649 19182 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:10.695863 18876 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:10.671792 19146 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:10.699062 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 215635us
I20260709 13:18:10.651774 18940 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:10.683542 17463 raft_consensus.cc:2368] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:10.683588 18958 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:10.689239 18944 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.635480 19077 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.708969 17999 rpcz_store.cc:276] 0709 13:18:09.621452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.653100 (+ 31648us) service_pool.cc:224] Handling call
0709 13:18:10.482732 (+829632us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:10.495032 (+ 12300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.652183 (+157151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.652455 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14948096}
W20260709 13:18:10.713577 19206 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.101s	user 0.000s	sys 0.002s
I20260709 13:18:10.732754 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:10.758311 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.758906 17463 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:10.759068 19150 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.759869 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.730475 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:10.733767 18940 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.728425 19045 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:10.729770 19182 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.734632 17360 leader_election.cc:400] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
I20260709 13:18:10.766649 17360 leader_election.cc:403] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:10.738314 19000 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:10.740382 17466 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:10.724680 19136 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:18:10.742300 19099 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:10.742594 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.745311 19123 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:10.726778 18962 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.747089 17220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49270 (request call id 324) took 5613 ms. Trace:
I20260709 13:18:10.714911 19096 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.684232 19177 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.698989 19158 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:10.762233 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:10.770007 19182 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.760443 17463 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:10.726511 19140 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.761775 19188 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:10.732918 19152 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.754967 18876 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:10.774235 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.778858 17360 leader_election.cc:400] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:10.810738 17466 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:10.811167 17360 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:10.794783 19208 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.112s	user 0.000s	sys 0.002s
I20260709 13:18:10.795392 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:10.708752 17393 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:10.771772 17388 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:10.798873 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:10.798154 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2243) took 1197 ms. Trace:
I20260709 13:18:10.818828 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:10.802279 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:10.767397 19161 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.807803 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:10.792405 17469 raft_consensus.cc:2410] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:10.811883 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.811245 17320 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:10.809463 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.821084 17468 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.821317 17467 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:10.776394 19000 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:10.784677 19077 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
I20260709 13:18:10.813927 17462 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:10.816560 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:10.819490 17999 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:10.821581 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.819083 17396 rpcz_store.cc:276] 0709 13:18:09.600552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.626875 (+1026323us) service_pool.cc:224] Handling call
0709 13:18:10.627213 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.627614 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.627641 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.628111 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.769125 (+141014us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:10.769175 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.769237 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.797070 (+ 27833us) raft_consensus.cc:1685] finished
0709 13:18:10.797091 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.798096 (+  1005us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":131,"thread_start_us":140618,"threads_started":1,"wal-append.queue_time_us":158163}
I20260709 13:18:10.773094 19045 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:10.825403 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 114445us
I20260709 13:18:10.797102 19167 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.839545 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.823407 17963 leader_election.cc:400] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3.
I20260709 13:18:10.840492 17963 leader_election.cc:403] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:10.815943 18959 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:10.849337 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:10.841295 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.781422 17220 rpcz_store.cc:276] 0709 13:18:05.133213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.133481 (+   268us) service_pool.cc:224] Handling call
0709 13:18:05.606671 (+473190us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275e090 00007f7d627fcf3a 00007f7d685b31cc 00007f7d686b137e 00007f7d66b722a4 00007f7d66b72232 00007f7d66b72161 00007f7d66b720dc 00007f7d66b71392 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:10.746992 (+5140321us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:08.367895 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:08.369050 (+  1155us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:08.369120 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:18:08.369151 (+    31us) tablet.cc:662] Decoding operations
0709 13:18:08.370066 (+   915us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:08.370220 (+   154us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:08.370264 (+    44us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:08.370944 (+   680us) tablet.cc:701] Row locks acquired
0709 13:18:08.371009 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:18:08.371234 (+   225us) write_op.cc:270] Start()
0709 13:18:08.371437 (+   203us) write_op.cc:276] Timestamp: P: 1783603088371151 usec, L: 0
0709 13:18:08.371493 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 13:18:08.375364 (+  3871us) log.cc:844] Serialized 1299 byte log entry
0709 13:18:09.467059 (+1091695us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:09.789886 (+322827us) op_driver.cc:464] REPLICATION: finished
0709 13:18:10.101175 (+311289us) write_op.cc:301] APPLY: starting
0709 13:18:10.101272 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:10.101424 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:10.101462 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:10.117019 (+ 15557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:10.307113 (+190094us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:10.307191 (+    78us) write_op.cc:312] APPLY: finished
0709 13:18:10.307570 (+   379us) log.cc:844] Serialized 35 byte log entry
0709 13:18:10.307788 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.307898 (+   110us) write_op.cc:454] Released schema lock
0709 13:18:10.307962 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:10.308404 (+   442us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.308442 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25205,"reported_tablets":5,"spinlock_wait_cycles":69666048,"child_traces":[["op",{"apply.queue_time_us":300978,"apply.run_cpu_time_us":3158,"apply.run_wall_time_us":207201,"num_ops":3,"prepare.queue_time_us":168106,"prepare.run_cpu_time_us":24216,"prepare.run_wall_time_us":275908,"raft.queue_time_us":221012,"raft.run_cpu_time_us":44368,"raft.run_wall_time_us":285856,"replication_time_us":1394975,"spinlock_wait_cycles":15787776,"thread_start_us":658750,"threads_started":4,"wal-append.queue_time_us":390829}]]}
I20260709 13:18:10.853093 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:10.858054 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:10.858214 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 169287us
I20260709 13:18:10.863727 17468 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:10.784250 19146 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.837026 19158 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.836804 19188 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:10.814284 19152 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.855036 17991 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:10.774027 19205 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.818413 19214 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:18:10.845306 19184 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.870208 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:10.855189 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:10.887666 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 92381.8us
I20260709 13:18:10.888497 17466 raft_consensus.cc:2368] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:10.896497 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:10.880683 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:10.889611 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.897624 17396 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:10.889091 19053 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:10.858542 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:10.876259 19136 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.861640 18959 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:10.886574 17390 raft_consensus.cc:2368] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 2. Current term is 3.
I20260709 13:18:10.871127 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.872566 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:10.904640 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45561.3us
I20260709 13:18:10.877280 17314 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:10.884985 19157 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.737s	user 0.011s	sys 0.001s
I20260709 13:18:10.875905 19187 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.907852 17463 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:10.904438 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 602) took 1237 ms. Trace:
I20260709 13:18:10.692096 17464 rpcz_store.cc:276] 0709 13:18:09.537827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.543201 (+  5374us) service_pool.cc:224] Handling call
0709 13:18:09.577599 (+ 34398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.751042 (+173443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.753368 (+  2326us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.796351 (+ 42983us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.052303 (+255952us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:10.092914 (+ 40611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.093027 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.612260 (+519233us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b54002e20a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d62769dbe 00007f7d62774930 00007f7d627748d8 00007f7d62774858 00007f7d62774813 00007f7d62773a9c 00007f7d6865f626 00007f7d68659dd8 00007f7d627b07cb 00007f7d627b32c0
0709 13:18:10.612789 (+   529us) raft_consensus.cc:1685] finished
0709 13:18:10.612826 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.643946 (+ 31120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40495,"raft.queue_time_us":62826,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":36402,"spinlock_wait_cycles":36702080,"thread_start_us":264682,"threads_started":2,"wal-append.queue_time_us":222639}
I20260709 13:18:10.938385 17389 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:10.939709 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.940699 17389 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:10.909231 19218 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:10.835482 18958 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:10.892707 19176 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:10.918830 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.902983 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:10.921461 17994 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:10.930697 17991 rpcz_store.cc:276] 0709 13:18:09.655218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.820995 (+165777us) service_pool.cc:224] Handling call
0709 13:18:10.472775 (+651780us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:10.892988 (+420213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13484288}
I20260709 13:18:10.919528 19219 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:10.933813 19213 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:18:10.930935 19204 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.396s	user 0.000s	sys 0.005s
W20260709 13:18:10.934155 17362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.541s (SENT) [suppressed 22 similar messages]
I20260709 13:18:10.934507 19140 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:10.928555 17313 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:10.941653 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:10.943583 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:10.925452 17393 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:10.914227 19000 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.910492 18876 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:11.004820 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 181549us
I20260709 13:18:11.005262 17396 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
W20260709 13:18:10.914453 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 112251us
W20260709 13:18:11.006583 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 110157us
I20260709 13:18:10.992491 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:10.954116 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:11.004885 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 102003us
I20260709 13:18:10.923981 19188 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:10.927907 19157 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:10.909433 19184 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.006057 17471 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
W20260709 13:18:11.030665 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 96528us
W20260709 13:18:11.033802 17362 leader_election.cc:336] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.567s (SENT)
I20260709 13:18:11.033717 17287 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:11.035624 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:11.043237 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:10.929841 19220 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:11.013082 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2250) took 1049 ms. Trace:
I20260709 13:18:11.046608 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:11.018178 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 99887.5us
I20260709 13:18:10.977631 19152 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:11.052075 17389 rpcz_store.cc:276] 0709 13:18:09.963630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.012058 (+1048428us) service_pool.cc:224] Handling call
0709 13:18:11.012384 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.012578 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.012603 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.012646 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:11.012675 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.012732 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.012877 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.055737 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:11.059517 17467 raft_consensus.cc:2368] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:11.061576 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:11.012070 19177 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:10.926430 19136 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.064049 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2245) took 1102 ms. Trace:
I20260709 13:18:11.070559 17395 rpcz_store.cc:276] 0709 13:18:09.961969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.637056 (+675087us) service_pool.cc:224] Handling call
0709 13:18:10.682904 (+ 45848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.724516 (+ 41612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.063842 (+339326us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b5400124650. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:11.063993 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90506496}
I20260709 13:18:11.037086 19045 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.042752 19217 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:10.978241 19229 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3.
I20260709 13:18:11.072569 19215 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:11.072440 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:11.076262 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2235) took 1531 ms. Trace:
W20260709 13:18:11.092739 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.097818 17316 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:11.104681 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:11.108407 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49500.2us
I20260709 13:18:11.109522 17963 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:11.104110 17394 rpcz_store.cc:276] 0709 13:18:09.535265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.546668 (+ 11403us) service_pool.cc:224] Handling call
0709 13:18:09.957084 (+410416us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:11.064760 (+1107676us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b540013a6d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:11.067077 (+  2317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169162368}
I20260709 13:18:11.062682 19152 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:11.119119 17395 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:11.120054 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 253) took 1105 ms. Trace:
I20260709 13:18:11.120553 17395 rpcz_store.cc:276] 0709 13:18:10.014611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.071826 (+1057215us) service_pool.cc:224] Handling call
0709 13:18:11.104091 (+ 32265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.119672 (+ 15581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.119981 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.045919 19140 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 13:18:11.202139 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 166547us
I20260709 13:18:11.115150 17997 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:11.068691 19161 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.097455 18885 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:11.045727 19218 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:18:11.251016 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2244) took 1530 ms. Trace:
W20260709 13:18:11.251468 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 146867us
I20260709 13:18:11.097410 19217 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:11.251494 17397 rpcz_store.cc:276] 0709 13:18:09.720962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.635343 (+914381us) service_pool.cc:224] Handling call
0709 13:18:10.635796 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.636224 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.636264 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.642761 (+  6497us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.817892 (+175131us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:10.817934 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.818027 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.250751 (+432724us) raft_consensus.cc:1685] finished
0709 13:18:11.250775 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.250946 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":587,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":6403,"thread_start_us":174720,"threads_started":1,"wal-append.queue_time_us":178758}
I20260709 13:18:11.054920 18963 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:18:11.252507 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:11.253247 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:11.114964 19177 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.041787 18959 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.200407 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:11.124460 17464 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:11.047415 19219 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.042178 19053 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:11.258468 18951 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.005s
I20260709 13:18:11.276568 17990 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 2: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:11.256740 19188 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.265234 19158 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:11.261174 19217 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.260994 19224 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:11.277050 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:11.059458 19220 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.274788 19140 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:11.255247 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 145840us
I20260709 13:18:11.338462 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:11.296134 19152 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:11.306310 19225 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.346487 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 247) took 1366 ms. Trace:
I20260709 13:18:11.304149 19158 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:11.357772 19223 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 13:18:11.358471 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2253) took 1372 ms (client timeout 1647 ms). Trace:
W20260709 13:18:11.360957 19197 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.803s	user 0.003s	sys 0.000s
I20260709 13:18:11.391410 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:11.392242 17998 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:11.390194 19099 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.366793 19230 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.359s	user 0.002s	sys 0.000s
I20260709 13:18:11.356810 19219 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.306974 19177 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:11.402022 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:11.348106 17991 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 3: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:11.343564 19140 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.298336 18951 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.394905 19099 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.372121 19187 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.411109 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:11.421773 19161 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:11.390988 17390 rpcz_store.cc:269] 0709 13:18:09.986288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.062104 (+ 75816us) service_pool.cc:224] Handling call
0709 13:18:11.358208 (+1296104us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54003020d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:11.358392 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696131456}
I20260709 13:18:11.422377 19161 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.422755 19161 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.422935 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:11.423584 17390 raft_consensus.cc:2376] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3. Re-sending same reply.
I20260709 13:18:11.425005 18963 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:11.412585 19148 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:11.438614 19148 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.439009 19210 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.439496 19210 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.441300 17990 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:11.441465 19210 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.442024 19235 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:11.442428 19235 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.442741 19235 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:11.444975 19226 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:11.445902 19221 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 13:18:11.387578 19225 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.447188 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2249) took 1483 ms. Trace:
W20260709 13:18:11.447968 18940 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.682s	user 0.004s	sys 0.004s
I20260709 13:18:11.449203 19225 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:11.395644 19233 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:11.402412 19045 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.447767 17391 rpcz_store.cc:276] 0709 13:18:09.963320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.679991 (+716671us) service_pool.cc:224] Handling call
0709 13:18:10.680639 (+   648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.702088 (+ 21449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.713164 (+ 11076us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.743241 (+ 30077us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.893584 (+150343us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:10.897080 (+  3496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.905038 (+  7958us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.446822 (+541784us) raft_consensus.cc:1685] finished
0709 13:18:11.446860 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.447098 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6678,"raft.queue_time_us":15037,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":13943,"thread_start_us":132642,"threads_started":1,"wal-append.queue_time_us":235783}
I20260709 13:18:11.309557 19188 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.405366 19140 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.430941 19160 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:11.436384 17998 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:11.413313 19157 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:11.380115 19152 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.378444 17393 rpcz_store.cc:276] 0709 13:18:09.980458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.074564 (+1094106us) service_pool.cc:224] Handling call
0709 13:18:11.260156 (+185592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.287827 (+ 27671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.291563 (+  3736us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.297305 (+  5742us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:11.301842 (+  4537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.334307 (+ 32465us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.346408 (+ 12101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.656316 17463 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:11.657891 17393 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:11.663772 19099 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.407243 19177 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.495003 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:11.666263 17997 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:11.667760 19177 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:11.493738 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2247) took 1531 ms. Trace:
I20260709 13:18:11.669661 17392 rpcz_store.cc:276] 0709 13:18:09.962707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.677941 (+715234us) service_pool.cc:224] Handling call
0709 13:18:10.694827 (+ 16886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.697430 (+  2603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.697459 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.712160 (+ 14701us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.852470 (+140310us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:10.852521 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.852585 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.493390 (+640805us) raft_consensus.cc:1685] finished
0709 13:18:11.493422 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.493652 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2086,"raft.queue_time_us":3480,"spinlock_wait_cycles":30441344,"thread_start_us":91637,"threads_started":1,"wal-append.queue_time_us":235269}
I20260709 13:18:11.676587 18951 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:11.512082 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 447) took 1573 ms. Trace:
W20260709 13:18:11.627007 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.655210 18944 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.891s	user 0.006s	sys 0.005s
W20260709 13:18:11.433955 19096 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 13:18:11.687454 17996 rpcz_store.cc:276] 0709 13:18:09.938397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.083769 (+145372us) service_pool.cc:224] Handling call
0709 13:18:10.084093 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.087233 (+  3140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.087263 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.087729 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.143030 (+ 55301us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:10.143093 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.143202 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.926734 (+783532us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:11.501998 (+575264us) raft_consensus.cc:1685] finished
0709 13:18:11.502033 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.511963 (+  9930us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2611,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":15881088,"thread_start_us":54907,"threads_started":1,"wal-append.queue_time_us":374067}
I20260709 13:18:11.449790 19225 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:11.448511 18940 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:11.473189 19081 consensus_meta.cc:287] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.001s
I20260709 13:18:11.678779 19152 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:11.730644 17392 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:11.718835 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:11.546411 17390 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:11.540477 19220 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.461069 19226 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:11.517815 19176 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.460862 19149 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:11.689105 19136 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.741559 19188 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:11.733357 19165 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:11.743127 19219 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.750888 17471 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:11.752147 18940 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:11.763770 17320 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.000s	sys 0.060s
W20260709 13:18:11.771437 17320 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.000s	sys 0.060s
W20260709 13:18:11.764214 17285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.032s	sys 0.079s
W20260709 13:18:11.772126 17285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.032s	sys 0.079s
W20260709 13:18:11.772748 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.026s	sys 0.046s
I20260709 13:18:11.719987 19096 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.734473 19225 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.720103 18944 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.753974 19210 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.776633 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:11.755471 19149 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:11.778074 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.026s	sys 0.046s
I20260709 13:18:11.779259 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:11.793766 17392 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:11.764679 19165 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:11.744638 19081 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.774081 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:11.788265 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:11.720590 19045 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.809127 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:11.810175 17392 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
W20260709 13:18:11.795990 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 543577us
I20260709 13:18:11.811666 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:11.756634 19176 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.800527 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:11.834336 17997 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:11.834336 18940 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:11.835536 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:11.787616 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:11.806197 17470 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:11.535295 19158 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:11.812386 17465 raft_consensus.cc:2368] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7.
I20260709 13:18:11.812469 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:11.773237 19219 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.841506 19158 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.841944 19219 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:11.807209 19175 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.201s	user 0.011s	sys 0.003s
W20260709 13:18:11.845741 17394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.004s	sys 0.007s
W20260709 13:18:11.846138 17394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.004s	sys 0.007s
W20260709 13:18:11.848001 19192 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.491s	user 0.024s	sys 0.023s
W20260709 13:18:11.848421 19192 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.491s	user 0.025s	sys 0.024s
I20260709 13:18:11.847872 18940 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:11.849380 18940 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:11.849845 18940 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:11.853891 19245 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.858500 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 71006us
I20260709 13:18:11.859480 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:11.860323 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:11.867606 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:11.800251 19198 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.814383 19182 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.998s	user 0.011s	sys 0.001s
W20260709 13:18:11.871524 17396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.010s	sys 0.009s
W20260709 13:18:11.871954 17396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.010s	sys 0.009s
W20260709 13:18:11.830701 19218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.008s	sys 0.055s
I20260709 13:18:11.795857 19210 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.854574 19245 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.870455 19219 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:11.869539 19176 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.935423 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 249) took 1243 ms. Trace:
I20260709 13:18:11.938861 17471 rpcz_store.cc:276] 0709 13:18:10.691784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.043607 (+351823us) service_pool.cc:224] Handling call
0709 13:18:11.043897 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.769095 (+725198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.935147 (+166052us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b5400384ad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:11.935341 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625314048}
W20260709 13:18:11.907791 19218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.008s	sys 0.056s
I20260709 13:18:11.944155 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:11.901170 19175 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:11.948419 19220 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:11.928525 19188 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.954845 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:11.955786 17471 raft_consensus.cc:2368] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:11.908582 19241 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:11.962337 19241 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:11.925829 19149 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.963326 19241 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.963966 18944 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.937355 19211 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:11.964234 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1222) took 1379 ms (client timeout 1752 ms). Trace:
I20260709 13:18:11.964816 19211 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:11.964877 17465 rpcz_store.cc:269] 0709 13:18:10.585043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.586933 (+  1890us) service_pool.cc:224] Handling call
0709 13:18:11.963925 (+1376992us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001afed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:11.964130 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2536792320}
I20260709 13:18:11.967118 19211 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:11.967510 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2178) took 1253 ms. Trace:
I20260709 13:18:11.870007 19226 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.969305 19267 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:11.970069 19267 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:11.944031 19217 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
I20260709 13:18:11.903002 19198 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.990769 19203 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:11.991312 19203 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:11.991696 19203 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.926371 19136 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:11.993747 19096 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:11.972011 19081 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:11.902673 19182 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:12.000736 17993 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:12.001986 19161 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
I20260709 13:18:12.007452 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:12.010610 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:12.010679 19045 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:12.002301 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:12.008620 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 250) took 1316 ms. Trace:
W20260709 13:18:12.029237 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.004s	sys 0.026s
I20260709 13:18:11.963346 19149 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.041908 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 455) took 1218 ms. Trace:
I20260709 13:18:12.004406 19148 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:12.042730 17470 rpcz_store.cc:276] 0709 13:18:10.692029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.042249 (+350220us) service_pool.cc:224] Handling call
0709 13:18:11.065575 (+ 23326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.839160 (+773585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.008353 (+169193us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b5400061154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:12.008556 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702679808}
I20260709 13:18:11.987911 19184 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:12.041105 17467 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:11.961865 19188 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:11.968024 17465 rpcz_store.cc:276] 0709 13:18:10.714412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.966402 (+1251990us) service_pool.cc:224] Handling call
0709 13:18:11.966812 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.967063 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.967105 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.967169 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:11.967221 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.967300 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.967435 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.041251 17471 raft_consensus.cc:2368] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7.
I20260709 13:18:11.958153 19175 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:12.043105 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.004s	sys 0.026s
I20260709 13:18:12.001046 19245 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:12.061858 18958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.020s	sys 0.068s
I20260709 13:18:12.058418 17995 rpcz_store.cc:276] 0709 13:18:10.823028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.823184 (+   156us) service_pool.cc:224] Handling call
0709 13:18:12.002153 (+1178969us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:12.041834 (+ 39681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3822464}
W20260709 13:18:12.036969 18885 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.023s	sys 0.037s
W20260709 13:18:12.042253 19053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.010s	sys 0.024s
W20260709 13:18:12.037721 19229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.007s	sys 0.005s
I20260709 13:18:12.082545 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1368) took 1602 ms. Trace:
I20260709 13:18:12.064004 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 607) took 1006 ms. Trace:
W20260709 13:18:12.114203 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.085497 17389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.011s	sys 0.022s
I20260709 13:18:11.905149 19165 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:12.038955 18876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.004s	sys 0.029s
W20260709 13:18:12.077896 19215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.002s	sys 0.006s
W20260709 13:18:12.117552 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 779133us
W20260709 13:18:12.123451 19053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.010s	sys 0.025s
W20260709 13:18:12.070593 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.136591 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.070943 17464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.004s	sys 0.009s
I20260709 13:18:11.994565 19217 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:12.120373 18958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.020s	sys 0.068s
W20260709 13:18:12.128778 17389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.012s	sys 0.022s
I20260709 13:18:12.045248 19161 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:12.120761 18885 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.024s	sys 0.037s
I20260709 13:18:12.129608 17317 rpcz_store.cc:276] 0709 13:18:10.479791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.480260 (+   469us) service_pool.cc:224] Handling call
0709 13:18:10.480548 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.480748 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:10.485056 (+  4308us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.045373 (+1560317us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b18000747a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:18:12.081758 (+ 36385us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.081829 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:12.082185 (+   356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.082278 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.082461 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4140,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":33026,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4893,"spinlock_wait_cycles":4988160,"thread_start_us":24178,"threads_started":1}
W20260709 13:18:12.132277 18876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.004s	sys 0.029s
W20260709 13:18:12.115149 18949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.003s	sys 0.006s
W20260709 13:18:12.135365 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 275973us
W20260709 13:18:12.123970 19159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.005s	sys 0.041s
W20260709 13:18:12.129053 19229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.008s	sys 0.006s
I20260709 13:18:12.121534 19237 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.183626 19237 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:12.185209 19247 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.186120 19237 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:12.189414 19256 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:18:12.190764 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2255) took 2110 ms. Trace:
I20260709 13:18:12.191140 17394 rpcz_store.cc:276] 0709 13:18:10.080284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.112040 (+1031756us) service_pool.cc:224] Handling call
0709 13:18:11.112358 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.112894 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.112968 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.174293 (+ 61325us) log.cc:844] Serialized 26 byte log entry
0709 13:18:11.846633 (+672340us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:11.846692 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.846782 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.190532 (+343750us) raft_consensus.cc:1685] finished
0709 13:18:12.190553 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.190686 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1975,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":98006,"thread_start_us":558361,"threads_started":1,"wal-append.queue_time_us":661239}
I20260709 13:18:12.197804 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2252) took 2194 ms. Trace:
W20260709 13:18:12.136508 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 273345us
W20260709 13:18:12.132887 17314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.023s	sys 0.016s
W20260709 13:18:12.134517 19215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.003s	sys 0.007s
I20260709 13:18:12.130045 19225 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:12.140585 17464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.005s	sys 0.009s
I20260709 13:18:12.133502 19165 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.147791 19219 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:12.182472 19159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.006s	sys 0.041s
I20260709 13:18:12.234424 17397 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:18:12.224025 17314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.024s	sys 0.016s
I20260709 13:18:12.138878 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:12.175949 18949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.004s	sys 0.006s
W20260709 13:18:12.226842 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.191159 19198 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:12.198402 17389 rpcz_store.cc:276] 0709 13:18:09.964263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.055827 (+1091564us) service_pool.cc:224] Handling call
0709 13:18:11.056228 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.056523 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:11.301500 (+244977us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.157837 (+856337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.157908 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:12.157975 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.158065 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.158214 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45888,"prepare.queue_time_us":143180,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4218,"raft.queue_time_us":10674,"thread_start_us":1032881,"threads_started":2}
I20260709 13:18:12.152072 18885 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:12.288404 18885 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:12.293191 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 345) took 1419 ms. Trace:
I20260709 13:18:12.177614 19045 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.271418 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 402455us
I20260709 13:18:12.234459 19219 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:12.285655 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:12.218804 19215 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:12.372020 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 86464us
I20260709 13:18:12.234763 19225 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.372944 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.129884 17993 rpcz_store.cc:276] 0709 13:18:11.057873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.062347 (+  4474us) service_pool.cc:224] Handling call
0709 13:18:12.000101 (+937754us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:12.000337 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.039264 (+ 38927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.061973 (+ 22709us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228720512}
W20260709 13:18:12.388247 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 247998us
I20260709 13:18:12.380511 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:12.390988 17394 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:12.376813 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:12.392423 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:12.393275 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:12.414745 18951 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.415572 18951 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:12.315693 19252 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.140s	user 0.000s	sys 0.003s
I20260709 13:18:12.207867 19192 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:18:12.420573 17463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.008s	sys 0.023s
W20260709 13:18:12.502121 17463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.008s	sys 0.023s
W20260709 13:18:12.382978 19235 consensus_meta.cc:287] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.940s	user 0.006s	sys 0.004s
W20260709 13:18:12.457928 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 44474us
I20260709 13:18:12.459901 19239 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.383451 19217 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:12.376925 19267 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:12.389171 19045 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:12.294024 17314 rpcz_store.cc:276] 0709 13:18:10.873326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.935188 (+ 61862us) service_pool.cc:224] Handling call
0709 13:18:10.935543 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.935777 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:10.936133 (+   356us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.277257 (+1341124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.287191 (+  9934us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:12.287266 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.292881 (+  5615us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.293097 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28817,"prepare.queue_time_us":5940,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":125643,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":104099,"thread_start_us":1243393,"threads_started":2,"wal-append.queue_time_us":417604,"wal-append.run_cpu_time_us":1201,"wal-append.run_wall_time_us":1001247}
I20260709 13:18:12.374692 19276 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.171s
I20260709 13:18:12.380811 19198 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:18:12.395021 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 251) took 1694 ms. Trace:
I20260709 13:18:12.438936 19225 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:12.536903 19246 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.537590 19161 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:12.713088 19203 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.000s
I20260709 13:18:12.491358 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:12.493100 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.380544 18876 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.381871 19182 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:12.422955 18959 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:12.642987 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.763338 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:12.545334 19081 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.213s
I20260709 13:18:12.540236 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:12.675107 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 282739us
W20260709 13:18:12.678011 17462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1223) took 2092 ms (client timeout 1567 ms). Trace:
W20260709 13:18:12.505084 19226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.020s
W20260709 13:18:12.509284 19273 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
W20260709 13:18:12.688971 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 295747us
I20260709 13:18:12.501222 19158 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.642889 19205 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.537819 19247 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:12.535773 19188 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:12.688462 19123 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.541853 18951 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:12.732547 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2251) took 2768 ms. Trace:
I20260709 13:18:12.418969 19053 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:18:12.738328 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.676153 19175 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:12.741298 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.743672 17318 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
W20260709 13:18:12.749876 17469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1224) took 2156 ms (client timeout 1541 ms). Trace:
I20260709 13:18:12.713085 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:12.756793 18962 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:12.758244 19259 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.373s	user 0.000s	sys 0.000s
I20260709 13:18:12.758383 17215 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 3 to 4, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 4 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.655635 17316 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:12.598160 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:12.807514 17394 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:18:12.742656 18940 consensus_meta.cc:287] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.892s	user 0.009s	sys 0.004s
I20260709 13:18:12.525446 19235 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:12.771879 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 231727us
I20260709 13:18:12.810389 17362 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:12.536499 19215 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:12.784303 19253 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:12.783183 17462 rpcz_store.cc:269] 0709 13:18:10.585489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.585610 (+   121us) service_pool.cc:224] Handling call
0709 13:18:12.677668 (+2092058us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54001f7a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:12.677900 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379889536}
I20260709 13:18:12.795418 17396 rpcz_store.cc:276] 0709 13:18:09.963944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.046434 (+1082490us) service_pool.cc:224] Handling call
0709 13:18:11.046762 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.055066 (+  8304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.055099 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.055574 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:18:11.872376 (+816802us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:11.872419 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.872488 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.732215 (+859727us) raft_consensus.cc:1685] finished
0709 13:18:12.732246 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.732456 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":10117,"thread_start_us":757864,"threads_started":1,"wal-append.queue_time_us":1021327}
I20260709 13:18:12.816254 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:12.741827 19277 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:12.521195 19192 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:12.803612 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:12.797930 17469 rpcz_store.cc:269] 0709 13:18:10.585813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.585992 (+   179us) service_pool.cc:224] Handling call
0709 13:18:12.733806 (+2147814us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54001699d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:12.742087 (+  8281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302605696}
I20260709 13:18:12.770486 18959 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.769886 19218 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.783593 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:12.785566 19226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.008s	sys 0.025s
I20260709 13:18:12.706969 19239 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:12.744025 19217 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:18:12.751711 18876 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:12.754565 19203 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:12.824404 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:12.823945 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:12.806291 19165 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 13:18:12.817938 17215 catalog_manager.cc:5697] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 2, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:18:12.849337 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:12.850869 19175 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:12.852789 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:12.772531 19229 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:12.853979 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:12.855702 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:12.793874 19161 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.805473 18951 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.866385 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:12.746469 19246 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:12.792986 19158 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:12.930114 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.870642 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:12.822971 19188 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:12.930099 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 146583us
I20260709 13:18:12.851766 19078 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.860831 18959 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.792286 19152 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.815958 19216 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:18:12.813133 18940 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:12.931293 19241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.029s	sys 0.059s
I20260709 13:18:12.974118 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2174) took 2264 ms. Trace:
I20260709 13:18:12.813351 19248 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 13:18:12.870023 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:12.929044 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:12.934264 18876 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:12.944640 19262 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.552s	user 0.001s	sys 0.000s
W20260709 13:18:12.973135 18885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.080s	sys 0.098s
I20260709 13:18:12.942090 17995 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:12.944517 17469 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:13.008435 17215 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 2 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 3 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.857187 19277 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:12.946439 19226 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:12.982916 19222 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.924s	user 0.000s	sys 0.011s
I20260709 13:18:12.941174 19264 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:12.865967 19218 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:12.977975 18951 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.011101 19045 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.440277 19045 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.440862 19045 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:13.443871 19269 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.507s	user 0.000s	sys 0.000s
I20260709 13:18:13.432971 17395 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:13.058853 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 399409us
W20260709 13:18:13.457614 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 442629us
I20260709 13:18:13.458642 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:13.397096 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 457943us
I20260709 13:18:13.083432 17462 raft_consensus.cc:2368] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
W20260709 13:18:13.072767 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 262461us
I20260709 13:18:13.467746 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:12.731298 17464 rpcz_store.cc:276] 0709 13:18:10.700779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.458036 (+757257us) service_pool.cc:224] Handling call
0709 13:18:11.458409 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.458801 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:11.459102 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.254096 (+794994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.275781 (+ 21685us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:12.322804 (+ 47023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.373431 (+ 50627us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.389809 (+ 16378us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":550297,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":155538,"spinlock_wait_cycles":155365376,"thread_start_us":759698,"threads_started":1,"wal-append.queue_time_us":1013642}
I20260709 13:18:13.458770 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:13.469897 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:13.471792 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1248) took 1289 ms. Trace:
I20260709 13:18:13.466595 17463 rpcz_store.cc:276] 0709 13:18:10.710020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.677332 (+967312us) service_pool.cc:224] Handling call
0709 13:18:11.677975 (+   643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.678448 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.678488 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.711752 (+ 33264us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.502525 (+790773us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:12.502562 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.502626 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.973704 (+471078us) raft_consensus.cc:1685] finished
0709 13:18:12.973725 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.974052 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":879,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":23196,"thread_start_us":753176,"threads_started":1,"wal-append.queue_time_us":688187}
I20260709 13:18:13.485766 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2256) took 3364 ms. Trace:
I20260709 13:18:13.490897 17395 rpcz_store.cc:276] 0709 13:18:10.080624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.121590 (+1040966us) service_pool.cc:224] Handling call
0709 13:18:13.432465 (+2310875us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:13.432734 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.445079 (+ 12345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.445335 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11917184}
I20260709 13:18:13.486444 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1328) took 2765 ms. Trace:
I20260709 13:18:13.488739 17469 rpcz_store.cc:276] 0709 13:18:12.179951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.854938 (+674987us) service_pool.cc:224] Handling call
0709 13:18:13.468763 (+613825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.492460 17397 rpcz_store.cc:276] 0709 13:18:10.700581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.267404 (+566823us) service_pool.cc:224] Handling call
0709 13:18:11.287329 (+ 19925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.234868 (+947539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.465260 (+1230392us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b540009b5d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:13.465554 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177491200}
I20260709 13:18:13.283833 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:13.061087 19078 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:13.494506 19297 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:18:13.494212 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:13.434345 19265 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.460s	user 0.000s	sys 0.000s
I20260709 13:18:13.493290 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:13.435175 19281 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
W20260709 13:18:13.456948 18885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.093s	sys 0.103s
I20260709 13:18:13.498916 17397 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:13.499043 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:13.495900 17396 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:13.338949 19280 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.544s	user 0.000s	sys 0.002s
I20260709 13:18:13.014110 19198 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:13.487838 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:13.503976 17469 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:13.326045 19249 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 13:18:13.534927 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:13.505493 17394 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:18:13.494122 18962 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:13.169188 19294 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.510176 17215 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 2 to 3, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 3 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.428576 19229 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.417009 19303 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.495203 19248 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:13.460027 19203 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:13.290031 19295 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.994340 19175 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.305058 19225 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:13.486522 19241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.033s	sys 0.068s
I20260709 13:18:13.495486 19235 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:13.502506 19233 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:13.053584 19188 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.632253 17396 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:13.656656 19293 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:13.654052 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1343) took 1115 ms. Trace:
I20260709 13:18:13.612305 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:13.660908 17468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1228) took 3068 ms (client timeout 1996 ms). Trace:
I20260709 13:18:13.659261 17396 rpcz_store.cc:276] 0709 13:18:12.538787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.072399 (+533612us) service_pool.cc:224] Handling call
0709 13:18:13.653839 (+581440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.657565 19293 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.675159 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:13.619690 19239 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:13.676211 17396 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:13.677063 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1344) took 1138 ms. Trace:
I20260709 13:18:13.679080 17396 rpcz_store.cc:276] 0709 13:18:12.539112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.674819 (+1135707us) service_pool.cc:224] Handling call
0709 13:18:13.676980 (+  2161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.608587 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2181) took 2878 ms. Trace:
I20260709 13:18:13.685509 17469 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:13.684852 17471 rpcz_store.cc:276] 0709 13:18:10.730521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.071519 (+1340998us) service_pool.cc:224] Handling call
0709 13:18:12.071938 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.072445 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.072487 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.073158 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.393087 (+319929us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:12.393153 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.393271 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.608257 (+1214986us) raft_consensus.cc:1685] finished
0709 13:18:13.608288 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.608497 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":669,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":319309,"threads_started":1,"wal-append.queue_time_us":719209}
I20260709 13:18:13.518819 18963 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:13.545608 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:13.496572 19152 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.516530 19198 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:13.611325 18951 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.536072 18958 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.621593 19158 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.625193 19295 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.536060 19216 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:18:13.536223 19192 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:13.614656 19140 consensus_meta.cc:287] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.899s	user 0.015s	sys 0.000s
I20260709 13:18:13.545554 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1335) took 1042 ms. Trace:
I20260709 13:18:13.738360 17395 rpcz_store.cc:276] 0709 13:18:12.502747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.506717 (+1003970us) service_pool.cc:224] Handling call
0709 13:18:13.545464 (+ 38747us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:13.629349 19149 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.570s	user 0.013s	sys 0.000s
I20260709 13:18:13.630118 19225 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:13.661533 17468 rpcz_store.cc:269] 0709 13:18:10.592535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.675645 (+ 83110us) service_pool.cc:224] Handling call
0709 13:18:13.660628 (+2984983us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540020f654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:13.660783 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328545664}
W20260709 13:18:13.690035 19301 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:18:13.656812 19210 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.693536 17397 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:13.744899 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:13.745107 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1341) took 1207 ms. Trace:
I20260709 13:18:13.745504 17397 rpcz_store.cc:276] 0709 13:18:12.538166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.518709 (+980543us) service_pool.cc:224] Handling call
0709 13:18:13.745051 (+226342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.745816 17395 raft_consensus.cc:2410] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:13.694994 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2194) took 1163 ms. Trace:
I20260709 13:18:13.731498 18951 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:13.747083 17469 rpcz_store.cc:276] 0709 13:18:12.522898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.492951 (+970053us) service_pool.cc:224] Handling call
0709 13:18:13.686547 (+193596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.743825 19225 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:13.715463 19291 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:18:13.721733 17394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1347) took 1181 ms (client timeout 1513 ms). Trace:
W20260709 13:18:13.774910 17394 rpcz_store.cc:269] 0709 13:18:12.539906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.812338 (+272432us) service_pool.cc:224] Handling call
0709 13:18:13.721456 (+909118us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b540023d2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:13.721642 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298545024}
I20260709 13:18:13.746766 17993 raft_consensus.cc:2410] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:13.662436 19241 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.609400 19248 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:13.545876 18962 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:13.793484 18962 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:13.793839 19248 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.795254 19248 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.741248 19140 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:13.689399 19243 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:18:13.726639 19260 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.895s	user 0.004s	sys 0.021s
W20260709 13:18:13.727177 19290 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:18:13.804629 19225 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.727531 19152 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.659659 19246 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:13.807519 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2182) took 3076 ms. Trace:
I20260709 13:18:13.798689 19241 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:13.609652 19229 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.731891 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 344) took 2859 ms. Trace:
I20260709 13:18:13.728490 19198 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:13.615418 19303 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.731633 18958 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.623430 19294 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:13.741736 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:13.832522 17468 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:13.833166 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2191) took 1376 ms. Trace:
I20260709 13:18:13.833635 17468 rpcz_store.cc:276] 0709 13:18:12.457196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.741469 (+1284273us) service_pool.cc:224] Handling call
0709 13:18:13.833084 (+ 91615us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.738399 19158 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.741132 19192 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.728915 18876 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:13.823005 19205 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.028s	user 0.011s	sys 0.002s
I20260709 13:18:13.617012 17215 catalog_manager.cc:5697] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 3 to 4, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 4 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.749805 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1334) took 1247 ms. Trace:
I20260709 13:18:13.723537 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:13.809144 19211 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:13.778586 19302 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:13.790020 17436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.005s	sys 0.036s
I20260709 13:18:13.799566 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:13.803503 19296 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:13.806066 19146 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:13.808712 18962 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.813827 19243 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.797184 19218 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:13.824029 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.824972 17470 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:13.822063 17322 rpcz_store.cc:276] 0709 13:18:10.869117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.902414 (+ 33297us) service_pool.cc:224] Handling call
0709 13:18:10.916765 (+ 14351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.962041 (+ 45276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.962094 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.760660 (+1798566us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b2c00014ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:18:12.772617 (+ 11957us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.010326 (+237709us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:13.010375 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.010471 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.675831 (+665360us) raft_consensus.cc:1685] finished
0709 13:18:13.675852 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.728490 (+ 52638us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14944,"raft.queue_time_us":35681,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":39715,"spinlock_wait_cycles":14463360,"thread_start_us":197160,"threads_started":1,"wal-append.queue_time_us":359542}
I20260709 13:18:13.777467 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2262) took 2078 ms. Trace:
I20260709 13:18:13.824461 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:13.821362 19078 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:13.827967 19188 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.828758 19140 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:13.811028 19161 consensus_meta.cc:287] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.838s	user 0.008s	sys 0.004s
I20260709 13:18:13.837337 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:13.839035 19192 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:13.839126 19158 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:13.748001 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:13.894632 17469 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:13.895242 17469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1251) took 1708 ms (client timeout 2243 ms). Trace:
W20260709 13:18:13.895718 17469 rpcz_store.cc:269] 0709 13:18:12.187084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.747747 (+1560663us) service_pool.cc:224] Handling call
0709 13:18:13.895172 (+147425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.778255 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:13.897224 17394 raft_consensus.cc:2410] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:13.840788 17395 rpcz_store.cc:276] 0709 13:18:12.502454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.741384 (+1238930us) service_pool.cc:224] Handling call
0709 13:18:13.749726 (+  8342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.786293 18951 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:13.841053 17471 raft_consensus.cc:2376] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3. Re-sending same reply.
I20260709 13:18:13.873739 19175 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.835635 18958 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.906221 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:13.838547 18940 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.875710 17464 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:13.885342 19303 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.873061 19226 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:13.916107 19226 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:13.888833 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 347) took 1510 ms. Trace:
I20260709 13:18:13.889110 19161 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:13.899271 17471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1250) took 1713 ms (client timeout 1996 ms). Trace:
I20260709 13:18:13.896266 19277 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:13.854240 17436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.005s	sys 0.036s
W20260709 13:18:13.923308 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.908743 19248 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.909220 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:13.879783 17396 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:13.924055 18962 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.904524 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:13.914251 17468 raft_consensus.cc:2410] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:13.909228 19242 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:13.921176 17471 rpcz_store.cc:269] 0709 13:18:12.186249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.723147 (+1536898us) service_pool.cc:224] Handling call
0709 13:18:13.899209 (+176062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.900897 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1342) took 1362 ms. Trace:
I20260709 13:18:13.872622 19302 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:13.923686 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.918748 17317 rpcz_store.cc:276] 0709 13:18:12.378965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.384489 (+  5524us) service_pool.cc:224] Handling call
0709 13:18:12.384868 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.394080 (+  9212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.412601 (+ 18521us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.704353 (+291752us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.059769 (+355416us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.284528 (+224759us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.333984 (+ 49456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.334274 (+   290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.888205 (+553931us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b1800410920. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:18:13.888506 (+   301us) raft_consensus.cc:1685] finished
0709 13:18:13.888604 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.888766 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50611,"prepare.queue_time_us":278650,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":57062,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":142624,"spinlock_wait_cycles":15451008,"thread_start_us":311468,"threads_started":1,"wal-append.queue_time_us":1069797}
W20260709 13:18:13.861572 19220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.001s	sys 0.054s
I20260709 13:18:13.917155 19226 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:13.924204 17395 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:14.246706 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.290710 17437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.017s	sys 0.021s
W20260709 13:18:14.359766 17437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.020s	sys 0.022s
I20260709 13:18:14.362521 17999 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:14.266724 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.027441 17462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1249) took 1843 ms (client timeout 1900 ms). Trace:
W20260709 13:18:14.366079 17462 rpcz_store.cc:269] 0709 13:18:12.184083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.816942 (+632859us) service_pool.cc:224] Handling call
0709 13:18:14.027117 (+1210175us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000636d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:14.027344 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324081408}
W20260709 13:18:14.360661 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 2.0646e+06us
I20260709 13:18:14.362347 17394 rpcz_store.cc:276] 0709 13:18:12.538500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.776016 (+1237516us) service_pool.cc:224] Handling call
0709 13:18:13.900791 (+124775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.808081 17465 rpcz_store.cc:276] 0709 13:18:10.730763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.119955 (+1389192us) service_pool.cc:224] Handling call
0709 13:18:12.137946 (+ 17991us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.419710 (+281764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.456279 (+ 36569us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.709867 (+253588us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.049938 (+340071us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.057223 (+  7285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.079196 (+ 21973us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.807261 (+728065us) raft_consensus.cc:1685] finished
0709 13:18:13.807284 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.807453 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14612,"raft.queue_time_us":163427,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":68279,"thread_start_us":282031,"threads_started":1,"wal-append.queue_time_us":579687}
I20260709 13:18:13.926856 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 343) took 3066 ms. Trace:
I20260709 13:18:14.372959 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:14.382913 17471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2193) took 1874 ms (client timeout 1992 ms). Trace:
I20260709 13:18:14.373548 17320 rpcz_store.cc:276] 0709 13:18:10.860703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.905095 (+ 44392us) service_pool.cc:224] Handling call
0709 13:18:10.918206 (+ 13111us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.776292 (+858086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.776322 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.792491 (+ 16169us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.075711 (+283220us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:12.075755 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.926344 (+1850589us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400274a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:13.926408 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.926470 (+    62us) raft_consensus.cc:1685] finished
0709 13:18:13.926490 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.926779 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":227258,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":16865,"spinlock_wait_cycles":456726912,"thread_start_us":780809,"threads_started":2,"wal-append.queue_time_us":998743}
I20260709 13:18:14.384480 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:14.385519 17469 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:14.386055 17469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1253) took 1982 ms (client timeout 2093 ms). Trace:
W20260709 13:18:14.386484 17469 rpcz_store.cc:269] 0709 13:18:12.403450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.911126 (+1507676us) service_pool.cc:224] Handling call
0709 13:18:14.385981 (+474855us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:13.986429 19272 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.671s	user 0.006s	sys 0.007s
W20260709 13:18:14.313051 19219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.011s	sys 0.029s
I20260709 13:18:14.390221 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:13.924350 18940 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.215116 19270 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.007s	sys 0.029s
W20260709 13:18:14.373030 19220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.350s	user 0.007s	sys 0.071s
I20260709 13:18:13.957700 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2266) took 2209 ms. Trace:
I20260709 13:18:13.925257 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:13.988202 19267 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:14.009697 19303 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.398131 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:14.391353 19192 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:14.150539 19228 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:14.369903 17285 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:14.399837 17462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2195) took 1854 ms (client timeout 2178 ms). Trace:
W20260709 13:18:14.440274 17462 rpcz_store.cc:269] 0709 13:18:12.545943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.381446 (+1835503us) service_pool.cc:224] Handling call
0709 13:18:14.399761 (+ 18315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.126163 19243 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:13.994274 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:13.931056 19293 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:13.879366 17393 rpcz_store.cc:276] 0709 13:18:11.698587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.711142 (+ 12555us) service_pool.cc:224] Handling call
0709 13:18:13.681175 (+1970033us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfeee 0000000000375939 00007f7d677431e0 00007f7d6780c0c4 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:13.721415 (+ 40240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.732962 (+ 11547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.737464 (+  4502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.738971 (+  1507us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.742066 (+  3095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.745301 (+  3235us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.774827 (+ 29526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11190144}
I20260709 13:18:14.372040 19167 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.115386 19295 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:14.373312 19242 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:14.029547 17464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2190) took 1572 ms (client timeout 1722 ms). Trace:
W20260709 13:18:14.383608 17471 rpcz_store.cc:269] 0709 13:18:12.508668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.372640 (+1863972us) service_pool.cc:224] Handling call
0709 13:18:14.382819 (+ 10179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.396241 19294 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:14.406827 17388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.356s	user 0.019s	sys 0.054s
I20260709 13:18:14.418903 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:14.465520 17469 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
W20260709 13:18:14.433233 19250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.037s	sys 0.026s
I20260709 13:18:14.466048 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1254) took 2052 ms. Trace:
I20260709 13:18:14.466642 17469 rpcz_store.cc:276] 0709 13:18:12.413303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.392444 (+1979141us) service_pool.cc:224] Handling call
0709 13:18:14.465976 (+ 73532us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:14.394680 19219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.012s	sys 0.030s
W20260709 13:18:14.425318 17286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.015s	sys 0.021s
W20260709 13:18:14.470024 17286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.015s	sys 0.021s
I20260709 13:18:14.439664 19228 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:14.397506 19226 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:14.434099 17389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.696s	user 0.011s	sys 0.035s
W20260709 13:18:14.480935 17389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.743s	user 0.011s	sys 0.035s
W20260709 13:18:14.405181 19270 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.411s	user 0.008s	sys 0.035s
I20260709 13:18:13.924057 19248 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:14.441550 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 71768.1us
I20260709 13:18:14.443110 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1338) took 1934 ms. Trace:
W20260709 13:18:14.436466 18949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.382s	user 0.018s	sys 0.026s
I20260709 13:18:14.231526 19239 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:14.458141 18876 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:14.428481 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:14.463567 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2185) took 3732 ms. Trace:
I20260709 13:18:14.433476 19267 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:14.468287 17462 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:14.417491 18940 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:14.442286 19303 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:14.556990 17434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.160s	user 0.017s	sys 0.017s
I20260709 13:18:14.477335 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2179) took 3751 ms. Trace:
I20260709 13:18:14.447075 19158 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:14.449136 19220 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:14.482331 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2270) took 2108 ms. Trace:
I20260709 13:18:14.455042 19045 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:14.511797 17394 rpcz_store.cc:276] 0709 13:18:12.508321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.380861 (+1872540us) service_pool.cc:224] Handling call
0709 13:18:14.443032 (+ 62171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.455976 19229 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:14.458717 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:14.589341 17463 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:14.469463 17388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.453s	user 0.019s	sys 0.054s
I20260709 13:18:14.529271 17396 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:14.529569 17395 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
W20260709 13:18:14.592450 17395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1337) took 2089 ms (client timeout 2455 ms). Trace:
W20260709 13:18:14.592489 17396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1345) took 2053 ms (client timeout 1909 ms). Trace:
I20260709 13:18:14.466339 18951 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:14.464501 19167 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:14.459851 17391 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
W20260709 13:18:14.505115 19250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.037s	sys 0.027s
W20260709 13:18:14.467629 17992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 464) took 2390 ms (client timeout 2970 ms). Trace:
I20260709 13:18:14.531275 17471 rpcz_store.cc:276] 0709 13:18:10.731454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.462544 (+3731090us) service_pool.cc:224] Handling call
0709 13:18:14.462935 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.463161 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.463189 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.463231 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:14.463281 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.463353 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.463498 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.534169 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2184) took 3803 ms. Trace:
I20260709 13:18:14.533376 19219 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:14.544075 19302 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:14.513144 18949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.529s	user 0.019s	sys 0.026s
I20260709 13:18:14.550885 18940 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:14.533501 19242 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:14.533747 18962 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:18:14.552891 17393 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:14.423269 17390 rpcz_store.cc:276] 0709 13:18:11.748565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.751698 (+  3133us) service_pool.cc:224] Handling call
0709 13:18:13.726192 (+1974494us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:13.759385 (+ 33193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.786543 (+ 27158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.797765 (+ 11222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.800549 (+  2784us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.809266 (+  8717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.811388 (+  2122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.957363 (+145975us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b540023c3d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:13.957601 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59314816}
W20260709 13:18:14.466027 17464 rpcz_store.cc:269] 0709 13:18:12.456893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.535884 (+1078991us) service_pool.cc:224] Handling call
0709 13:18:14.029292 (+493408us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003845d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:14.029452 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416324480}
I20260709 13:18:14.534476 19239 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:14.425663 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.009s	sys 0.030s
W20260709 13:18:14.632706 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.009s	sys 0.030s
W20260709 13:18:14.632812 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.010s	sys 0.036s
I20260709 13:18:14.557598 17470 rpcz_store.cc:276] 0709 13:18:10.726151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.065113 (+1338962us) service_pool.cc:224] Handling call
0709 13:18:12.119503 (+ 54390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.877466 (+1757963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.477029 (+599563us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54004213d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:14.477245 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3921487616}
W20260709 13:18:14.558527 17434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.018s	sys 0.017s
I20260709 13:18:14.536823 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:14.537114 17363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.256s	user 0.013s	sys 0.045s
W20260709 13:18:14.634033 17363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.353s	user 0.013s	sys 0.046s
W20260709 13:18:14.613322 17287 connection.cc:256] RPC call timeout handler was delayed by -1.6096130749999702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:18:14.535326 17361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.247s	user 0.026s	sys 0.034s
W20260709 13:18:14.641419 17361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.381s	user 0.026s	sys 0.034s
I20260709 13:18:14.563409 17389 rpcz_store.cc:276] 0709 13:18:12.373815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.374311 (+   496us) service_pool.cc:224] Handling call
0709 13:18:12.374611 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.374808 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:12.736181 (+361373us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.481939 (+1745758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.481993 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:14.482045 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.482119 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.482263 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":447014,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":25057,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":17256,"thread_start_us":2099557,"threads_started":2}
W20260709 13:18:14.584461 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.565768 17362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.031s	sys 0.018s
W20260709 13:18:14.642990 17362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.031s	sys 0.018s
W20260709 13:18:14.643766 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 1.17388e+06us
W20260709 13:18:14.587190 17468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1252) took 2399 ms (client timeout 2244 ms). Trace:
W20260709 13:18:14.530560 18992 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.021s	sys 0.026s
W20260709 13:18:14.645566 17468 rpcz_store.cc:269] 0709 13:18:12.187747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.837014 (+1649267us) service_pool.cc:224] Handling call
0709 13:18:14.586925 (+749911us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b54003840d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:14.587107 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72520576}
W20260709 13:18:14.592893 17395 rpcz_store.cc:269] 0709 13:18:12.503263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.897908 (+1394645us) service_pool.cc:224] Handling call
0709 13:18:14.592388 (+694480us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:14.593078 17396 rpcz_store.cc:269] 0709 13:18:12.539376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.688145 (+1148769us) service_pool.cc:224] Handling call
0709 13:18:14.592407 (+904262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.645083 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:14.599300 17999 raft_consensus.cc:2410] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:18:14.599960 17215 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.044s	sys 0.074s
I20260709 13:18:14.533238 19081 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:14.585484 19053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.010s	sys 0.021s
W20260709 13:18:14.667501 17215 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.047s	sys 0.074s
W20260709 13:18:14.667826 19053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.010s	sys 0.021s
I20260709 13:18:14.669900 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:14.672287 17463 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
W20260709 13:18:14.565286 19215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.011s	sys 0.026s
I20260709 13:18:14.571233 19220 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.611783 17394 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:14.606626 17465 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:14.612152 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:14.673121 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2198) took 2033 ms (client timeout 1542 ms). Trace:
I20260709 13:18:14.617132 17462 rpcz_store.cc:276] 0709 13:18:10.731225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.460307 (+3729082us) service_pool.cc:224] Handling call
0709 13:18:14.468057 (+  7750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.533871 (+ 65814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.534108 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:14.630117 19275 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.920s	user 0.000s	sys 0.014s
W20260709 13:18:14.534858 18959 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.377s	user 0.009s	sys 0.005s
I20260709 13:18:14.655884 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:14.613008 19268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.279s	user 0.023s	sys 0.020s
I20260709 13:18:14.662400 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:14.665161 17287 connection.cc:256] RPC call timeout handler was delayed by -1.3855070590000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
I20260709 13:18:14.664606 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:14.633251 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.010s	sys 0.036s
I20260709 13:18:14.673700 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1346) took 2134 ms. Trace:
W20260709 13:18:14.673666 17463 rpcz_store.cc:269] 0709 13:18:12.639687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.538393 (+898706us) service_pool.cc:224] Handling call
0709 13:18:14.458489 (+920096us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:14.673021 (+214532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6675840}
I20260709 13:18:14.627123 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 458) took 3225 ms. Trace:
W20260709 13:18:14.648725 18992 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.022s	sys 0.027s
I20260709 13:18:14.680660 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:14.681032 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:14.683892 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:14.623196 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2265) took 2876 ms (client timeout 3011 ms). Trace:
I20260709 13:18:14.696130 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:14.681720 19215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.012s	sys 0.027s
I20260709 13:18:14.663168 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2272) took 2273 ms. Trace:
I20260709 13:18:14.617712 19219 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:14.667618 19081 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:14.765542 19268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.444s	user 0.027s	sys 0.030s
W20260709 13:18:14.765924 17287 connection.cc:256] RPC call timeout handler was delayed by -1.1567238810000617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 13:18:14.727869 17288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.013s	sys 0.046s
I20260709 13:18:14.675064 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1336) took 2172 ms. Trace:
I20260709 13:18:14.681094 19220 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.701993 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:14.736974 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.724697 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2196) took 2123 ms (client timeout 2821 ms). Trace:
I20260709 13:18:14.729032 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:14.823019 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:14.695542 18959 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:14.744234 19308 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:18:14.720537 19306 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:14.675467 19311 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:14.634670 19267 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:14.655745 19099 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.669328 18951 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.663818 19228 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:14.680927 18940 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:14.766215 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 1.25724e+06us
I20260709 13:18:14.766408 17394 rpcz_store.cc:276] 0709 13:18:12.539632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.597277 (+2057645us) service_pool.cc:224] Handling call
0709 13:18:14.611460 (+ 14183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.673449 (+ 61989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.673648 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:14.774345 17435 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.011s	sys 0.013s
W20260709 13:18:14.774410 19182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.008s	sys 0.010s
I20260709 13:18:14.764719 19294 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:14.775853 17391 rpcz_store.cc:269] 0709 13:18:11.738507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.750827 (+ 12320us) service_pool.cc:224] Handling call
0709 13:18:13.994064 (+2243237us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:14.612925 (+618861us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12523904}
I20260709 13:18:14.776436 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:14.764179 19045 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.766209 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 101689us
W20260709 13:18:14.764988 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 120015us
I20260709 13:18:14.773406 17470 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
W20260709 13:18:14.788815 17288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.248s	user 0.013s	sys 0.046s
I20260709 13:18:14.786118 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:14.791975 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:14.792726 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:14.777487 19146 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.901s	user 0.007s	sys 0.007s
W20260709 13:18:14.774399 19264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.173s	user 0.007s	sys 0.018s
W20260709 13:18:14.610090 17992 rpcz_store.cc:269] 0709 13:18:12.070530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.079852 (+  9322us) service_pool.cc:224] Handling call
0709 13:18:14.444151 (+2364299us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001a8bd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:14.456929 (+ 12778us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2881123584}
I20260709 13:18:14.856282 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:14.846984 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 57023us
I20260709 13:18:14.763258 19316 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:14.914746 17390 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:14.787192 19235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.017s	sys 0.041s
I20260709 13:18:14.774283 19309 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:14.862985 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 504072us
I20260709 13:18:14.863868 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:14.956779 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.956903 17396 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.846253 19303 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:14.874833 17435 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.011s	sys 0.013s
W20260709 13:18:14.876164 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.862016 19248 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:14.865335 19250 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:14.915346 17362 leader_election.cc:400] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:14.894330 17463 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:14.847728 17991 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:14.922566 17996 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:14.865998 19239 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:14.784294 19158 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:14.766907 17994 rpcz_store.cc:276] 0709 13:18:11.388610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.390973 (+  2363us) service_pool.cc:224] Handling call
0709 13:18:11.394743 (+  3770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.437179 (+2042436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.437240 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.437306 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:13.437372 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.591447 (+1154075us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54006054d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:14.600153 (+  8706us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.614290 (+ 14137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4696380672}
I20260709 13:18:14.934703 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:14.986590 17394 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
W20260709 13:18:14.879561 19182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.009s	sys 0.010s
W20260709 13:18:14.819979 17465 rpcz_store.cc:269] 0709 13:18:12.597643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.394003 (+1796360us) service_pool.cc:224] Handling call
0709 13:18:14.721243 (+327240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:14.944892 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88681.5us
I20260709 13:18:14.934963 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:14.952068 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:14.998728 17470 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:14.922169 19264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.386s	user 0.007s	sys 0.019s
I20260709 13:18:14.957391 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2176) took 4246 ms. Trace:
W20260709 13:18:14.958714 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 913812us
W20260709 13:18:14.959734 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.963936 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:14.964184 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.002971 17319 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:14.964646 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:14.967180 17322 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.004263 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.005697 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.005965 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.007092 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:14.976719 17362 leader_election.cc:403] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:14.824275 17393 rpcz_store.cc:276] 0709 13:18:12.503015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.469324 (+1966309us) service_pool.cc:224] Handling call
0709 13:18:14.552583 (+ 83259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.626045 (+ 73462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.669230 (+ 43185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.978258 17997 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:14.950627 19316 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:15.010653 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2187) took 4135 ms. Trace:
W20260709 13:18:15.010778 19326 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:15.011099 17469 rpcz_store.cc:276] 0709 13:18:10.875491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.471586 (+3596095us) service_pool.cc:224] Handling call
0709 13:18:14.472082 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.473276 (+  1194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.473323 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.473933 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.866412 (+392479us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:14.866454 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.866520 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:15.010428 (+143908us) raft_consensus.cc:1685] finished
0709 13:18:15.010450 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.010594 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":392019,"threads_started":1,"wal-append.queue_time_us":534567}
I20260709 13:18:15.011059 19316 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:15.014246 19226 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:18:15.016404 17992 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:15.017366 17314 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:15.017899 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:15.018530 17394 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.968717 19167 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:14.933106 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:14.875522 18951 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.042955 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.043758 18951 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:14.935982 19274 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:15.044625 19274 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:14.873980 19099 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:15.045753 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48093.1us
I20260709 13:18:14.957221 19317 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.979020 19158 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:14.918150 19294 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:14.937502 19228 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:15.025157 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 110029us
I20260709 13:18:15.001180 17466 rpcz_store.cc:276] 0709 13:18:10.710483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.723620 (+1013137us) service_pool.cc:224] Handling call
0709 13:18:11.724092 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.730522 (+  6430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.730555 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.755161 (+ 24606us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.143232 (+388071us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:12.143290 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.143378 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.629365 (+2485987us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:14.915667 (+286302us) raft_consensus.cc:1685] finished
0709 13:18:14.915698 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.957322 (+ 41624us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5867,"raft.queue_time_us":5988,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":23120,"spinlock_wait_cycles":36949760,"thread_start_us":365568,"threads_started":1,"wal-append.queue_time_us":625745}
I20260709 13:18:14.967689 19241 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:14.969445 17993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 459) took 2156 ms (client timeout 1765 ms). Trace:
I20260709 13:18:14.880057 18940 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.037046 17317 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:18:14.982230 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.879611 19311 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.039837 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:15.040455 19324 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:15.040552 17396 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:15.041026 19250 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:15.097303 19313 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
W20260709 13:18:14.949878 19235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.017s	sys 0.052s
I20260709 13:18:14.943552 19242 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:18:15.113509 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:14.995929 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 253) took 3896 ms. Trace:
I20260709 13:18:15.119746 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.018565 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:14.947991 19045 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.121150 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:14.998122 19283 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.391s	user 0.000s	sys 0.006s
I20260709 13:18:15.048184 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.122661 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.123132 17321 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:15.124003 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.124605 17321 raft_consensus.cc:2376] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2. Re-sending same reply.
I20260709 13:18:14.967862 19243 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:18:14.991176 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:15.049706 17394 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
W20260709 13:18:15.071040 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 391519us
I20260709 13:18:14.972520 19248 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:18:15.087751 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:15.092794 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.098313 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:15.000972 19264 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:15.102294 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.071434 19158 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.060746 19226 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.046841 19322 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:14.983973 17315 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:18:15.110109 19198 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.272s	user 0.014s	sys 0.005s
I20260709 13:18:15.135075 17468 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.125547 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.119565 17463 rpcz_store.cc:276] 0709 13:18:11.099745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.977828 (+3878083us) service_pool.cc:224] Handling call
0709 13:18:14.995367 (+ 17539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.995557 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.995593 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.995638 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.995685 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.995741 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.995870 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.207050 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.207957 17470 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:15.201320 19294 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:15.208735 19248 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:15.209084 19081 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:15.202257 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:15.221235 17462 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
W20260709 13:18:15.209960 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 122323us
I20260709 13:18:15.222503 17362 leader_election.cc:400] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:15.222587 17317 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:15.222837 17362 leader_election.cc:403] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:15.224462 17362 leader_election.cc:400] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
W20260709 13:18:15.210963 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 250413us
I20260709 13:18:15.205581 19099 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:15.212533 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:15.227260 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.114717 18958 consensus_meta.cc:287] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.199s	user 0.014s	sys 0.000s
I20260709 13:18:15.220077 17466 raft_consensus.cc:2410] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:15.216490 17322 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:15.245115 17362 leader_election.cc:403] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:15.245496 17322 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.121165 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.246277 17316 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:15.221577 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:15.103133 18992 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:18:15.226224 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.227309 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.250622 17315 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.214329 17394 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:15.252009 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2188) took 4047 ms. Trace:
I20260709 13:18:15.210073 19314 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:15.221149 19248 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:15.159160 19327 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:18:15.159621 19312 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:18:15.116158 17465 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:15.171855 19219 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:15.231087 19311 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:15.231859 19335 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:18:15.229481 17468 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:14.783792 17388 rpcz_store.cc:276] 0709 13:18:12.376602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.379955 (+  3353us) service_pool.cc:224] Handling call
0709 13:18:12.380332 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.380550 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:12.718979 (+338429us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.600505 (+1881526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.609314 (+  8809us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:14.612819 (+  3505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.623648 (+ 10829us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.649873 (+ 26225us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":441573,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":723334,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":2177619,"threads_started":3,"wal-append.queue_time_us":732676,"wal-append.run_cpu_time_us":3231,"wal-append.run_wall_time_us":1341904}
W20260709 13:18:15.100554 17993 rpcz_store.cc:269] 0709 13:18:12.801556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.805784 (+  4228us) service_pool.cc:224] Handling call
0709 13:18:14.927156 (+2121372us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54004443d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:14.957723 (+ 30567us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635380096}
I20260709 13:18:15.246917 17470 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:15.247857 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.252115 17362 leader_election.cc:400] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7.
I20260709 13:18:15.265664 17362 leader_election.cc:403] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:15.266641 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:15.230307 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:15.252486 17466 rpcz_store.cc:276] 0709 13:18:11.204495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.249879 (+4045384us) service_pool.cc:224] Handling call
0709 13:18:15.250237 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.251671 (+  1434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.251701 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.251748 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:15.251787 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.251848 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.251954 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.244134 19294 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:15.251130 19243 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.204134 17390 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:15.268895 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:15.218600 19198 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:15.259961 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45588.8us
I20260709 13:18:15.258530 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 254) took 4157 ms. Trace:
I20260709 13:18:15.239802 19220 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.251581 19321 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:15.243933 19309 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:15.227828 17391 raft_consensus.cc:2376] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6. Re-sending same reply.
I20260709 13:18:15.253957 18959 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:15.126698 18962 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:15.277169 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2192) took 2768 ms. Trace:
I20260709 13:18:15.253577 19314 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:15.283306 19315 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.249297 18958 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:15.280301 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.221731 19226 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.279277 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2199) took 2635 ms. Trace:
I20260709 13:18:15.281104 17466 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:15.281320 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.279734 17462 rpcz_store.cc:276] 0709 13:18:11.101252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.244816 (+4143564us) service_pool.cc:224] Handling call
0709 13:18:15.258007 (+ 13191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.258216 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.258246 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.258275 (+    29us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:15.258331 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.258384 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.258481 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.282418 19268 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.285172 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:15.277275 19146 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.277618 17315 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:15.301986 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.304345 17397 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:15.292101 17470 rpcz_store.cc:276] 0709 13:18:12.501461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.269422 (+2767961us) service_pool.cc:224] Handling call
0709 13:18:15.269707 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.269877 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.269900 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.269936 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:15.269966 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.270028 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.270115 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:15.284721 17362 connection.cc:256] RPC call timeout handler was delayed by -1.381215678999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 13:18:15.298243 17463 rpcz_store.cc:276] 0709 13:18:12.644256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.269301 (+2625045us) service_pool.cc:224] Handling call
0709 13:18:15.278814 (+  9513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.278988 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.279011 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.279052 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:15.279083 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.279132 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.279227 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.280143 19316 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:15.292296 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:15.307554 17471 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:15.269980 19322 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7.
I20260709 13:18:15.298826 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2197) took 2663 ms. Trace:
I20260709 13:18:15.308557 17466 rpcz_store.cc:276] 0709 13:18:12.635631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.275857 (+2640226us) service_pool.cc:224] Handling call
0709 13:18:15.276237 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.298572 (+ 22335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.298771 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.306036 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.279229 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.306222 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.310647 17470 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:15.311178 17317 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
W20260709 13:18:15.306324 17362 connection.cc:256] RPC call timeout handler was delayed by -1.2948156790000667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 13:18:15.312273 17362 connection.cc:256] RPC call timeout handler was delayed by -1.2075156789999255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 13:18:15.312978 17362 connection.cc:256] RPC call timeout handler was delayed by -1.0716156789999332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 13:18:15.125366 19250 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.315325 17471 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.289674 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.317112 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:15.318450 17470 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:15.318661 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.319233 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:15.319754 17470 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.327314 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.328603 17319 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.326654 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:15.337160 17470 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:15.338532 17463 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.338862 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.293390 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.341871 17470 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:15.291868 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1246) took 3383 ms. Trace:
I20260709 13:18:15.359180 17465 rpcz_store.cc:276] 0709 13:18:11.908674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.270383 (+3361709us) service_pool.cc:224] Handling call
0709 13:18:15.291090 (+ 20707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.291441 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:15.291472 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.291544 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:15.291586 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.291669 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.291807 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102}
I20260709 13:18:15.287528 19220 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:15.294454 19315 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.292270 19314 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.362823 19315 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:15.354606 18958 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:15.355021 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.365381 19158 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.366506 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.366853 19242 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:15.311360 19239 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:15.367636 19239 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.368027 19239 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.369199 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.369978 17315 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:15.289041 19309 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:15.355472 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:15.338362 19276 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:15.365979 19198 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:15.372211 19309 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:15.375188 19339 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:15.375732 19339 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:15.375927 17315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:18:15.376461 19158 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:15.376554 17315 raft_consensus.cc:606] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:15.342860 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.291357 19323 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:15.308975 19248 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.284556 19264 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.342859 17463 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.290223 18962 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.390413 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2269) took 3577 ms. Trace:
W20260709 13:18:15.400972 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 74431.5us
I20260709 13:18:15.377003 17315 raft_consensus.cc:614] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:15.401693 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:15.377856 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.307087 19316 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:15.401170 17392 rpcz_store.cc:276] 0709 13:18:11.812566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.812740 (+   174us) service_pool.cc:224] Handling call
0709 13:18:11.813101 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.935597 (+3122496us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:14.935632 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.935679 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.935718 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.390194 (+454476us) spinlock_profiling.cc:243] Waited 3.11 s on lock 0x7b54004128d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:15.390241 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.390358 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8323,"raft.queue_time_us":8987,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":17482,"spinlock_wait_cycles":7161045248}
I20260709 13:18:15.385478 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.406827 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.352880 17317 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.398763 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:15.280324 19243 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:15.408866 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 107678us
I20260709 13:18:15.463040 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:15.434494 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.464170 17315 raft_consensus.cc:2376] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3. Re-sending same reply.
W20260709 13:18:15.460758 17362 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.900s (SENT)
W20260709 13:18:15.464855 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 63219.2us
W20260709 13:18:15.409375 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.464176 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.467103 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.468284 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.469033 17392 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:15.469944 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:15.470495 17392 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.464869 19302 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:18:15.473272 19274 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:15.388808 19226 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:15.377723 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:15.466415 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.468343 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2180) took 4742 ms. Trace:
W20260709 13:18:15.475548 17362 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.996s (SENT)
I20260709 13:18:15.476217 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:15.465358 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:15.399382 17464 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:15.396495 18962 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:15.386518 19323 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:15.408711 19316 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.479023 19150 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:15.477304 18958 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:15.331180 17388 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
W20260709 13:18:15.533102 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 48300.8us
I20260709 13:18:15.533499 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:15.307031 19268 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.475380 18992 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:15.478466 19226 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.537076 17317 raft_consensus.cc:2410] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:15.461748 19220 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:15.339803 18940 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:15.536890 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:15.390190 19248 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.383165 19317 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.468387 19216 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:15.475958 17467 rpcz_store.cc:276] 0709 13:18:10.726406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.065678 (+1339272us) service_pool.cc:224] Handling call
0709 13:18:12.119008 (+ 53330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.156346 (+2037338us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:14.626199 (+469853us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.003779 (+377580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.003848 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:15.003913 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.468104 (+464191us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b540020fb54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:15.468151 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.468282 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":882394,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":123,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":4684635520,"thread_start_us":831888,"threads_started":2,"wal-append.queue_time_us":478179}
I20260709 13:18:15.547935 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:15.405155 19309 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:15.555799 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 80264.6us
W20260709 13:18:15.595952 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48156.6us
I20260709 13:18:15.566746 19346 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.596827 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:15.597157 17362 leader_election.cc:336] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.244s (SENT)
I20260709 13:18:15.597899 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:15.557610 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.600265 17315 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:15.558735 17392 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:15.533106 17391 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:15.604200 17314 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:15.605067 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.605692 17391 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:15.606633 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.607214 17391 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:15.608069 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.608932 17393 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.609428 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2205) took 1002 ms. Trace:
I20260709 13:18:15.609901 17468 rpcz_store.cc:276] 0709 13:18:14.606617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.669657 (+ 63040us) service_pool.cc:224] Handling call
0709 13:18:15.609223 (+939566us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400200b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:15.609337 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068108544}
I20260709 13:18:15.610574 17466 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.611018 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:15.611781 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.612037 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.612278 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:15.612450 17393 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:15.382472 17390 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:15.627040 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.627837 17390 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:15.582738 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45956.6us
I20260709 13:18:15.629362 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:15.630632 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:15.630697 19274 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:15.631335 19274 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:15.583617 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.633750 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:15.585641 17397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1332) took 3165 ms (client timeout 2312 ms). Trace:
I20260709 13:18:15.381853 19239 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.636170 19219 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:15.636968 19219 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:15.637322 19239 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:15.637435 19219 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:15.637633 19268 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:15.638392 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:15.638957 17395 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.638545 19219 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.560135 19302 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.545971 19235 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:15.577680 19220 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.578807 19322 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.376804 19339 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.603909 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.612860 17990 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.613252 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.613441 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:15.613878 17391 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:15.614265 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:15.658203 17997 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:15.614658 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.619588 19323 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:15.590705 19318 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.578159 18992 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.621304 19243 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:15.593211 19216 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.622397 19346 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.655067 19220 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.666324 19216 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.573382 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:15.667906 19346 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:15.668701 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 95421.6us
W20260709 13:18:15.634845 17397 rpcz_store.cc:269] 0709 13:18:12.420476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.761014 (+1340538us) service_pool.cc:224] Handling call
0709 13:18:15.585312 (+1824298us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400253d54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:15.585534 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328473856}
I20260709 13:18:15.384963 19314 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:15.653841 19146 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.557044 18958 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:15.649730 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.580957 19198 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:18:15.602595 19250 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:15.602860 19182 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:15.624179 19264 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.652407 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:15.661051 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:15.635679 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:15.670212 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:15.601763 19309 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:15.663215 17395 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:15.638619 19081 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:15.730162 17393 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:15.664943 19318 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.658114 19053 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:18:15.708252 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.701804 19323 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:15.703502 18958 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:15.726363 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 56208.7us
I20260709 13:18:15.735513 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:15.700057 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:15.709146 17397 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:15.739480 17319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4295303b785442b287bf068dfd2e160c"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:18:15.740453 17319 raft_consensus.cc:606] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:15.741519 17319 raft_consensus.cc:614] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:15.732290 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 134188us
I20260709 13:18:15.752041 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:15.715782 19182 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:15.759133 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:15.732568 19146 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.727219 19250 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:15.660513 19274 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:15.733952 19318 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.734162 17390 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.750190 17391 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:15.820377 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 61355.9us
I20260709 13:18:15.823417 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:15.824186 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 72294us
I20260709 13:18:15.832396 17287 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:15.858572 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.873775 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.762709 19203 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:16.227834 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:16.019214 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.236030 19314 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:16.002323 19316 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:16.038143 19360 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:18:16.074736 17999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.007s
W20260709 13:18:15.959616 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 307856us
I20260709 13:18:15.877128 19320 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.041076 19355 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:15.940779 19358 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:16.027714 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1093) took 1066 ms. Trace:
W20260709 13:18:15.938844 17964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 3.312s (SENT) [suppressed 27 similar messages]
I20260709 13:18:15.892082 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:16.012833 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2286) took 1229 ms. Trace:
W20260709 13:18:16.115190 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.902338 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.889092 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:15.826434 19081 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:16.231339 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 397726us
I20260709 13:18:15.830621 19243 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:16.241671 17999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.010s	sys 0.018s
I20260709 13:18:15.827657 19182 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:16.050184 17389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2276) took 1370 ms (client timeout 1647 ms). Trace:
I20260709 13:18:16.268441 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.262414 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:16.254956 17392 rpcz_store.cc:276] 0709 13:18:14.782980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.654835 (+871855us) service_pool.cc:224] Handling call
0709 13:18:15.661239 (+  6404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.662865 (+  1626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.662891 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.669152 (+  6261us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.751811 (+ 82659us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:15.751852 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.751922 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.012632 (+260710us) raft_consensus.cc:1685] finished
0709 13:18:16.012649 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.012777 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1266,"raft.queue_time_us":1388,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":50539,"thread_start_us":82268,"threads_started":1,"wal-append.queue_time_us":267688}
I20260709 13:18:16.257344 17998 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:16.258736 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:16.278394 17389 rpcz_store.cc:269] 0709 13:18:14.679434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.695802 (+ 16368us) service_pool.cc:224] Handling call
0709 13:18:16.049916 (+1354114us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54003020d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:16.050098 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1900490112}
I20260709 13:18:16.288697 17287 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:16.271927 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 469) took 1035 ms. Trace:
W20260709 13:18:16.260241 17286 connection.cc:256] RPC call timeout handler was delayed by -1.2541943500000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 13:18:16.121104 19345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.005s	sys 0.010s
W20260709 13:18:15.935891 19350 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 13:18:15.948817 19352 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:18:15.824433 19322 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:15.995496 19356 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:16.302106 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:18:16.274672 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 240128us
W20260709 13:18:16.276001 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.303388 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.253631 17320 rpcz_store.cc:276] 0709 13:18:14.962788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.007275 (+ 44487us) service_pool.cc:224] Handling call
0709 13:18:15.007670 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.007939 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:15.049006 (+ 41067us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.606228 (+557222us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b18002e3060. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:18:16.027222 (+420994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.027304 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:16.027372 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.027462 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.027631 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40888,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":4355,"raft.queue_time_us":236139,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":41648,"spinlock_wait_cycles":29465472,"thread_start_us":420616,"threads_started":2}
I20260709 13:18:16.277792 17393 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:16.273783 19243 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.949136 19210 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:16.256114 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.039774 19219 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:16.289639 17999 rpcz_store.cc:276] 0709 13:18:15.236491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.236664 (+   173us) service_pool.cc:224] Handling call
0709 13:18:15.244436 (+  7772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.244642 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:15.559732 (+315090us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.271547 (+711815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.271626 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:16.271698 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.271756 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.271874 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":354959,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":93,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"thread_start_us":1006206,"threads_started":2,"wal-append.queue_time_us":578217}
W20260709 13:18:16.245570 19216 consensus_meta.cc:287] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.001s
I20260709 13:18:15.999841 18992 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:16.329495 17435 connection.cc:256] RPC call timeout handler was delayed by -1.0144368280000435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 13:18:16.298501 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.001461 19309 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:16.040370 17388 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:16.339956 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.341228 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:16.340629 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:16.342389 17392 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:16.342499 17470 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:16.329996 19210 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.346112 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.346345 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.348301 19210 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:16.315228 19219 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:16.351178 19219 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.356283 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.356462 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.352732 19219 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:16.357774 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.358536 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:16.357113 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:16.357151 17999 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:16.359510 17469 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:16.360319 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.357020 17320 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:16.360885 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.364645 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.262087 19081 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:16.250397 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2288) took 1466 ms. Trace:
I20260709 13:18:16.274722 19248 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:16.242003 19316 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:16.043696 19270 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.254s
I20260709 13:18:16.314157 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:16.405882 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 91813.4us
I20260709 13:18:16.263759 19358 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:16.250178 19355 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:16.171913 19220 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:16.297377 19053 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:16.320055 19353 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:18:16.320369 18958 consensus_meta.cc:287] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.003s
I20260709 13:18:16.295796 19099 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.308305 19361 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:18:16.321587 19267 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.321674 19325 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.325378 19045 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:15.998438 19250 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:16.251694 17390 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:16.313614 19243 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.327008 19276 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:16.259425 18962 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:18:16.328727 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:16.336123 19372 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:16.336438 19215 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:16.477229 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.484997 19215 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:16.485873 19215 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:16.486809 19215 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.358700 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.489692 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.490294 19274 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.490823 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.365077 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.365885 17999 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:16.299638 19374 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:18:16.492170 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:16.369197 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.493921 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.370049 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.494382 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.495296 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.495673 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.496028 17320 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:16.372356 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.492166 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:16.497759 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.498409 17996 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
W20260709 13:18:16.261292 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 369312us
W20260709 13:18:16.499449 19349 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.542s	user 0.001s	sys 0.000s
W20260709 13:18:16.386288 17434 connection.cc:256] RPC call timeout handler was delayed by -3.4621700339998824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 13:18:16.500792 17434 connection.cc:256] RPC call timeout handler was delayed by -3.407270034000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 13:18:16.500999 19372 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.501892 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.502511 17322 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
W20260709 13:18:16.502641 17434 connection.cc:256] RPC call timeout handler was delayed by -3.3472596560000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
W20260709 13:18:16.502983 17434 connection.cc:256] RPC call timeout handler was delayed by -3.3406700339999134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:18:16.503278 17434 connection.cc:256] RPC call timeout handler was delayed by -3.2077596560000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2312s for a response
W20260709 13:18:16.503580 17434 connection.cc:256] RPC call timeout handler was delayed by -3.1552700340000683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:18:16.503960 17434 connection.cc:256] RPC call timeout handler was delayed by -3.0580700339999112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 13:18:16.504249 17434 connection.cc:256] RPC call timeout handler was delayed by -2.9329700339999363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23620000000000002s for a response
I20260709 13:18:16.504484 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1354) took 1188 ms. Trace:
I20260709 13:18:16.504928 17388 rpcz_store.cc:276] 0709 13:18:15.316495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.592692 (+276197us) service_pool.cc:224] Handling call
0709 13:18:16.504303 (+911611us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5400125054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:16.504426 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6457216}
I20260709 13:18:16.505561 17999 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.505726 19228 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.506309 19228 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.506909 18962 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.507743 18962 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:16.508052 18962 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:16.263197 19320 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.438789 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:16.333032 19216 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.405177 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.452467 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.366314 19182 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.411437 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.481159 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:16.418383 19355 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.536590 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:16.424865 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:16.506937 19354 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.677s	user 0.001s	sys 0.000s
I20260709 13:18:16.405586 19318 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:16.505273 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 265) took 1493 ms. Trace:
W20260709 13:18:16.437908 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 499075us
W20260709 13:18:16.504514 17434 connection.cc:256] RPC call timeout handler was delayed by -2.8492700340000283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24550000000000002s for a response
W20260709 13:18:16.549849 17434 connection.cc:256] RPC call timeout handler was delayed by -2.7903709540000818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3148s for a response
I20260709 13:18:16.514950 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.505299 17395 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:16.526940 17392 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
W20260709 13:18:16.550199 17434 connection.cc:256] RPC call timeout handler was delayed by -2.5927700340000683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.274s for a response
I20260709 13:18:16.529860 17999 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:16.504665 19345 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.555619 17996 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:18:16.473953 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 159673us
I20260709 13:18:16.439639 19242 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:16.508634 19228 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:16.473248 19325 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:16.537861 19359 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.413s	user 0.000s	sys 0.015s
I20260709 13:18:16.369325 17391 rpcz_store.cc:276] 0709 13:18:14.784300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.660923 (+876623us) service_pool.cc:224] Handling call
0709 13:18:15.709763 (+ 48840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.877493 (+167730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.250113 (+372620us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b540036fbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:16.250323 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22218496}
I20260709 13:18:16.555333 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:16.585951 17392 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
W20260709 13:18:16.540614 17990 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.870s	user 0.013s	sys 0.004s
I20260709 13:18:16.578120 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:16.563340 17468 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:16.574232 19242 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:16.589208 19362 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:18:16.591069 19242 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:16.593451 19357 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:16.549495 17465 rpcz_store.cc:276] 0709 13:18:15.012074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.360615 (+348541us) service_pool.cc:224] Handling call
0709 13:18:15.361029 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.366200 (+  5171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.366238 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.372942 (+  6704us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.671233 (+298291us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:15.676078 (+  4845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.705837 (+ 29759us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.498844 (+793007us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:16.504911 (+  6067us) raft_consensus.cc:1685] finished
0709 13:18:16.504946 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.505212 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":7426304,"thread_start_us":284103,"threads_started":1,"wal-append.queue_time_us":380161}
I20260709 13:18:16.585158 19099 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:16.594764 19325 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:16.596104 19229 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:16.596609 19229 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.597076 19229 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.598830 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.600181 19341 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:16.600596 19341 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:16.600754 19320 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:16.601449 19341 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:16.602561 19341 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.574645 19372 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:16.607919 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:16.533293 19081 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.445721 18958 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.609170 17990 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
W20260709 13:18:16.609658 19348 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.984s	user 0.003s	sys 0.033s
I20260709 13:18:16.609889 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 631) took 1001 ms. Trace:
I20260709 13:18:16.610353 17990 rpcz_store.cc:276] 0709 13:18:15.608027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.612019 (+  3992us) service_pool.cc:224] Handling call
0709 13:18:16.609814 (+997795us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.610888 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2204) took 2008 ms. Trace:
I20260709 13:18:16.611048 18958 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:16.508756 18962 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:16.611294 17462 rpcz_store.cc:276] 0709 13:18:14.602849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.299236 (+696387us) service_pool.cc:224] Handling call
0709 13:18:15.317421 (+ 18185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.317762 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.317791 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.318221 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.633208 (+314987us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b180034bdc0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:18:15.706486 (+ 73278us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:15.706531 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.706606 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.496414 (+789808us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:16.610686 (+114272us) raft_consensus.cc:1685] finished
0709 13:18:16.610705 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.610833 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3253,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12832,"spinlock_wait_cycles":132929152,"thread_start_us":73065,"threads_started":1,"wal-append.queue_time_us":752363}
I20260709 13:18:16.612427 18962 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.612996 17314 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:16.614020 19182 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:16.573339 17463 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:16.558473 19276 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:16.565261 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:16.615440 17466 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:16.575435 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 94383.1us
I20260709 13:18:16.615505 19276 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.617895 19293 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:16.618175 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 262) took 1362 ms. Trace:
I20260709 13:18:16.618880 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:16.619503 17393 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:16.620164 19099 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:16.621102 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 257) took 1377 ms. Trace:
I20260709 13:18:16.621292 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 355) took 1526 ms. Trace:
I20260709 13:18:16.621230 19099 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:16.621556 17395 rpcz_store.cc:276] 0709 13:18:15.244230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.729177 (+484947us) service_pool.cc:224] Handling call
0709 13:18:16.505087 (+775910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.550845 (+ 45758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.620907 (+ 70062us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b5400125050. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:16.621043 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783248256}
I20260709 13:18:16.618170 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:16.624651 19216 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:16.625295 17388 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:16.625905 19220 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:16.626158 19371 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:18:16.580183 19228 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.618605 17392 rpcz_store.cc:276] 0709 13:18:15.255836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.617205 (+1361369us) service_pool.cc:224] Handling call
0709 13:18:16.617527 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.617815 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.617847 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.617894 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:16.617936 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.618004 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.618120 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1254,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105}
I20260709 13:18:16.627605 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2279) took 1944 ms. Trace:
I20260709 13:18:16.567569 17997 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:16.586040 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:16.573007 19345 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.427295 19358 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:16.608693 17391 raft_consensus.cc:2376] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3. Re-sending same reply.
I20260709 13:18:16.608352 19229 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.626039 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2290) took 1001 ms. Trace:
I20260709 13:18:16.577082 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:16.673327 17470 raft_consensus.cc:2376] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4. Re-sending same reply.
I20260709 13:18:16.628508 17469 raft_consensus.cc:2376] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2. Re-sending same reply.
I20260709 13:18:16.552145 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:16.628978 17389 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:16.677397 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 261) took 1421 ms. Trace:
W20260709 13:18:16.628285 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.628010 17396 rpcz_store.cc:276] 0709 13:18:14.683253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.114045 (+430792us) service_pool.cc:224] Handling call
0709 13:18:15.622649 (+508604us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfe9c 00007f7d5f6cfa5b 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:15.622893 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.623379 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.623411 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.640249 (+ 16838us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.123017 (+482768us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:16.123087 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.123185 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.625538 (+502353us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:16.627399 (+  1861us) raft_consensus.cc:1685] finished
0709 13:18:16.627421 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.627550 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6135,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"spinlock_wait_cycles":11609600,"thread_start_us":437620,"threads_started":1,"wal-append.queue_time_us":753620}
I20260709 13:18:16.621831 17321 rpcz_store.cc:276] 0709 13:18:15.094900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.232921 (+138021us) service_pool.cc:224] Handling call
0709 13:18:15.233315 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.395327 (+162012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.395358 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.395402 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:15.395448 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.621091 (+1225643us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400274f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:16.621137 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.621242 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372120320}
W20260709 13:18:16.638195 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.640996 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 309056us
I20260709 13:18:16.627040 19228 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.635186 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:16.627622 18992 consensus_queue.cc:1175] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7108577e5754060b7e468a43dfdcdeb" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
W20260709 13:18:16.736526 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.609702 19081 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.705825 17462 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:16.679849 17392 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:16.755326 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2291) took 1130 ms. Trace:
I20260709 13:18:16.755810 17392 rpcz_store.cc:276] 0709 13:18:15.625215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.627643 (+1002428us) service_pool.cc:224] Handling call
0709 13:18:16.663050 (+ 35407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.755109 (+ 92059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.755273 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:16.736104 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.757889 17321 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:16.677888 17389 rpcz_store.cc:276] 0709 13:18:15.255576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.616384 (+1360808us) service_pool.cc:224] Handling call
0709 13:18:16.616733 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.677013 (+ 60280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.677323 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.759708 17389 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:16.760476 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2293) took 1134 ms. Trace:
I20260709 13:18:16.760962 17389 rpcz_store.cc:276] 0709 13:18:15.625752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.759139 (+1133387us) service_pool.cc:224] Handling call
0709 13:18:16.759473 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.760161 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.760410 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.748334 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2292) took 1122 ms. Trace:
W20260709 13:18:16.749178 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.752254 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.762173 17396 rpcz_store.cc:276] 0709 13:18:15.625480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.747286 (+1121806us) service_pool.cc:224] Handling call
0709 13:18:16.747681 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.747946 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.747983 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.748047 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:16.748095 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.748145 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.748278 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:16.753630 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.701879 19358 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:16.772410 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.718312 19339 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.775370 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:16.714144 19318 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:16.708043 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:16.715711 19345 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:16.777379 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 226089us
I20260709 13:18:16.779855 17462 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:16.786389 19248 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:16.688853 17390 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
W20260709 13:18:16.806224 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 256093us
I20260709 13:18:16.807238 17964 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:16.708827 19243 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:16.808606 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 264862us
I20260709 13:18:16.773412 19053 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:16.809087 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.752766 18962 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.840535 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:16.840737 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:16.841331 17316 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:16.815785 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:16.842070 17392 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.675462 17388 rpcz_store.cc:276] 0709 13:18:15.624901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.624530 (+999629us) service_pool.cc:224] Handling call
0709 13:18:16.624904 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.625768 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.625983 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.851401 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.777792 19216 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:16.858230 17462 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:16.803314 19248 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:16.862994 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 116903us
I20260709 13:18:16.777386 19378 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:18:16.837095 17314 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.869998 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:16.866385 17313 raft_consensus.cc:2410] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:16.890481 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:16.803869 19379 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
W20260709 13:18:16.906738 17394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1349) took 1592 ms (client timeout 2116 ms). Trace:
W20260709 13:18:16.907193 17394 rpcz_store.cc:269] 0709 13:18:15.314182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.890194 (+1576012us) service_pool.cc:224] Handling call
0709 13:18:16.906671 (+ 16477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.907399 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.899242 17316 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:16.868925 19248 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:16.914409 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.915084 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.916282 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.849495 19355 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:16.866438 19276 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:18:16.916307 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.860595 18962 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.920358 17394 pending_rounds.cc:85] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 5
I20260709 13:18:16.930869 17394 pending_rounds.cc:107] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:18:16.931210 17394 raft_consensus.cc:2889] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:16.920418 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:16.868413 19216 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:16.908897 19372 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:16.938129 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 97672.9us
W20260709 13:18:16.938733 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 114446us
I20260709 13:18:17.030187 17317 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:16.917527 19345 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:18:16.939308 17322 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:16.934424 19365 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:17.048012 19365 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:17.048553 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 268) took 1741 ms. Trace:
I20260709 13:18:17.048974 19365 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:17.049116 17393 rpcz_store.cc:276] 0709 13:18:15.308554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.620113 (+1311559us) service_pool.cc:224] Handling call
0709 13:18:16.620428 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.620747 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.620775 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.678578 (+ 57803us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.866891 (+188313us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:16.867086 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.867206 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.048338 (+181132us) raft_consensus.cc:1685] finished
0709 13:18:17.048359 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.048496 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2697,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":93,"thread_start_us":154070,"threads_started":1,"wal-append.queue_time_us":340764}
W20260709 13:18:17.048907 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 67548us
I20260709 13:18:17.030234 17390 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:18:17.051891 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:17.052248 17390 pending_rounds.cc:85] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 5
I20260709 13:18:17.052663 17390 pending_rounds.cc:107] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:18:16.890980 19386 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
W20260709 13:18:16.946722 19347 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 1.314s	user 0.000s	sys 0.014s
I20260709 13:18:16.905203 17392 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:16.909708 19385 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.144s
I20260709 13:18:17.143725 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:17.202842 17471 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:17.029717 19229 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:17.236438 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 54855.4us
W20260709 13:18:17.281103 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 324320us
W20260709 13:18:17.297688 19387 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.361s	user 0.000s	sys 0.000s
W20260709 13:18:17.299738 19390 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.257s	user 0.000s	sys 0.000s
I20260709 13:18:17.153680 17390 raft_consensus.cc:2889] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:17.147414 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:17.354781 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 470) took 2117 ms. Trace:
I20260709 13:18:16.933710 19276 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:17.044814 19382 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.261s
I20260709 13:18:17.250252 19386 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:17.313611 19385 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.242086 19378 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.169s
W20260709 13:18:17.463208 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.374032 17992 rpcz_store.cc:276] 0709 13:18:15.237423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.625241 (+1387818us) service_pool.cc:224] Handling call
0709 13:18:16.625624 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.625938 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.625971 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.626483 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.861156 (+234673us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:16.881862 (+ 20706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.907184 (+ 25322us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.336895 (+429711us) raft_consensus.cc:1685] finished
0709 13:18:17.336930 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.354643 (+ 17713us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":234264,"threads_started":1,"wal-append.queue_time_us":279644}
W20260709 13:18:17.448355 19389 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:18:17.478775 19216 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:17.479583 19216 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:17.374512 19228 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:16.933175 19053 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:17.506654 19276 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:17.407684 17314 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:17.444006 19382 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:17.491663 19216 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:17.450959 19385 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:17.517813 17467 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.003s	sys 0.024s
W20260709 13:18:17.879158 19370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.028s	sys 0.035s
I20260709 13:18:17.917215 19276 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:18:17.859493 17464 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.000s	sys 0.009s
W20260709 13:18:17.919251 19370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.029s	sys 0.037s
W20260709 13:18:17.919569 17464 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.000s	sys 0.009s
W20260709 13:18:17.920733 17467 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.004s	sys 0.029s
W20260709 13:18:17.852005 19267 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.389s	user 0.011s	sys 0.003s
I20260709 13:18:17.921537 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2221) took 1358 ms. Trace:
I20260709 13:18:17.921828 19314 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.922312 19314 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:17.650198 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 367872us
I20260709 13:18:17.923815 19267 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.925266 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:17.925550 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:17.925987 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:17.926582 17469 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.925283 17992 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:17.722010 19396 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:17.927800 17313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1086) took 2993 ms (client timeout 2042 ms). Trace:
I20260709 13:18:17.925321 17994 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:17.964354 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.928493 19396 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:17.721882 19403 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.210s
I20260709 13:18:17.929113 17992 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:17.929785 17999 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:18.018162 17469 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:17.930056 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:18.019829 17995 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:18.019910 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:17.633800 17434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.007s	sys 0.001s
W20260709 13:18:18.021086 17434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.009s	sys 0.006s
W20260709 13:18:18.021414 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 1.06537e+06us
I20260709 13:18:18.024960 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2306) took 1402 ms. Trace:
I20260709 13:18:18.025591 17389 rpcz_store.cc:276] 0709 13:18:16.619998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.021996 (+1401998us) service_pool.cc:224] Handling call
0709 13:18:18.022316 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.022492 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.022521 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.022562 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:18.022593 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.022660 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.022783 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.931341 19314 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:17.931319 19385 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:17.826256 19341 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.223s	user 0.013s	sys 0.000s
I20260709 13:18:17.746654 19398 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:17.527375 19386 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:17.491030 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2294) took 1856 ms. Trace:
I20260709 13:18:17.925963 17466 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:17.939052 19358 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.150s	user 0.009s	sys 0.003s
I20260709 13:18:18.050756 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:17.509742 19355 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:17.935742 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.913195 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:17.938326 17965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.020s	sys 0.033s
I20260709 13:18:17.922027 17467 rpcz_store.cc:276] 0709 13:18:16.563157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.575953 (+ 12796us) service_pool.cc:224] Handling call
0709 13:18:16.576326 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.576597 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:16.851903 (+275306us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.921183 (+1069280us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.921233 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:17.921285 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.921359 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.921481 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9904,"prepare.queue_time_us":453858,"prepare.run_wall_time_us":66,"raft.queue_time_us":670019,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":23320,"spinlock_wait_cycles":25003776,"thread_start_us":1282943,"threads_started":3,"wal-append.queue_time_us":385541}
I20260709 13:18:18.052412 17471 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.053488 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:18.037237 17992 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:18.035748 17469 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:18.055209 17992 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.056237 17992 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.057235 17469 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:18.057739 17469 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:18.037823 17396 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:18.043257 17319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1404) took 1638 ms (client timeout 2111 ms). Trace:
I20260709 13:18:18.060675 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:18.061542 17396 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:18.062487 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:18.044902 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:18.065482 19395 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 13:18:17.938930 19339 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.151s	user 0.012s	sys 0.000s
I20260709 13:18:18.068228 17998 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
W20260709 13:18:17.633477 17394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.007s	sys 0.001s
W20260709 13:18:18.061141 17319 rpcz_store.cc:269] 0709 13:18:16.379643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.493658 (+114015us) service_pool.cc:224] Handling call
0709 13:18:18.018004 (+1524346us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540010ca54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:18.018175 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839385984}
W20260709 13:18:18.069013 17394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.009s	sys 0.001s
I20260709 13:18:18.069077 19412 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.069110 19314 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:18.039053 19216 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.069693 19412 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:18.070403 19216 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.071717 17471 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:18.072438 19412 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:18.075380 19081 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.323s	user 0.010s	sys 0.001s
I20260709 13:18:18.075966 17321 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:18.075590 17992 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:18.078366 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:17.938180 17313 rpcz_store.cc:269] 0709 13:18:14.934279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.938574 (+  4295us) service_pool.cc:224] Handling call
0709 13:18:16.473011 (+1534437us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfeee 0000000000375939 00007f7d677431e0 00007f7d6780c0c4 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:17.927545 (+1454534us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400369a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:17.927704 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728805632}
W20260709 13:18:18.052479 17965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.020s	sys 0.033s
I20260709 13:18:17.533546 19382 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:18.084267 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.084321 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:18.095722 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:18.081324 19406 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:18.086336 17469 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:18.098421 17469 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.103507 17396 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:18.110574 17466 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:18.114671 17396 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:18.052030 19386 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.047435 19398 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:18.042160 19396 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.924376 19267 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:18.097095 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:18.133311 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.142127 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.082129 19411 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:18.135666 17469 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:18.109652 19412 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:18.132824 19248 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.204s	user 0.012s	sys 0.000s
W20260709 13:18:18.139014 19318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.001s	sys 0.014s
W20260709 13:18:18.152927 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 55903.8us
I20260709 13:18:18.146018 17469 pending_rounds.cc:85] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 1
I20260709 13:18:18.176882 17469 pending_rounds.cc:107] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:18.184139 17469 raft_consensus.cc:2889] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:18.141372 19386 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.048826 17390 rpcz_store.cc:276] 0709 13:18:15.626017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.868668 (+1242651us) service_pool.cc:224] Handling call
0709 13:18:16.910503 (+ 41835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.410348 (+499845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.481964 (+ 71616us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.116201 19314 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:18.196296 17997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 470) took 1840 ms (client timeout 2323 ms). Trace:
I20260709 13:18:18.150449 19339 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.176473 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:18.150085 19216 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:18:18.175673 19318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.001s	sys 0.014s
I20260709 13:18:18.197685 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:18.216420 17468 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:18.217016 17468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2222) took 1653 ms (client timeout 2127 ms). Trace:
I20260709 13:18:18.173797 19406 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:18.209292 17997 rpcz_store.cc:269] 0709 13:18:16.356086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.357497 (+  1411us) service_pool.cc:224] Handling call
0709 13:18:18.196050 (+1838553us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400661054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:18.196231 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473809280}
W20260709 13:18:18.217388 17468 rpcz_store.cc:269] 0709 13:18:16.563442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.589775 (+ 26333us) service_pool.cc:224] Handling call
0709 13:18:18.196733 (+1606958us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:18.216942 (+ 20209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105184000}
I20260709 13:18:18.218490 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:18.175449 19408 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:18.236577 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.183424 19248 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:18.241461 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.189s	user 0.000s	sys 0.011s
I20260709 13:18:18.178218 19412 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.227931 19402 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:18.259126 17362 leader_election.cc:336] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.093s (SENT)
W20260709 13:18:18.247144 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 159338us
I20260709 13:18:18.209728 19411 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:18.254681 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.001s	sys 0.013s
I20260709 13:18:18.256119 17396 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:18.239948 19406 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:18.224434 19216 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.221642 19339 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:18.262033 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.267889 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.273283 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:18.269660 17396 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:18:18.268138 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 1.21621e+06us
I20260709 13:18:18.276130 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:18.277256 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:18.265259 19406 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.278841 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:18.279951 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 51194.3us
I20260709 13:18:18.259521 19402 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.264063 19403 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:18.263976 19419 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.289017 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:18.248310 19408 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:18:18.265594 19416 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:18.299409 19419 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:18.305001 19401 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:18:18.290482 19402 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.289924 19424 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.309523 19424 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:18.312024 19391 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.487s	user 0.001s	sys 0.001s
W20260709 13:18:18.315625 19410 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:18:18.317065 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2302) took 1909 ms. Trace:
I20260709 13:18:18.317183 19411 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:18.317447 17394 rpcz_store.cc:276] 0709 13:18:16.407757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.909827 (+502070us) service_pool.cc:224] Handling call
0709 13:18:16.913111 (+  3284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.931827 (+ 18716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.931866 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.932346 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.069508 (+1137162us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:18.069548 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.069639 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.316850 (+247211us) raft_consensus.cc:1685] finished
0709 13:18:18.316868 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.317006 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1136843,"threads_started":1,"wal-append.queue_time_us":1117386}
I20260709 13:18:18.319099 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:18.319810 17394 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:18.322297 19267 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:18.324816 19412 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:18.330513 19216 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:18.332335 19314 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:18.334173 19248 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:18.336524 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:18.280714 19406 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.343219 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2303) took 1935 ms. Trace:
I20260709 13:18:18.324528 19365 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.248080 19398 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:18.346973 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:18.347671 19216 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:18.347862 19320 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:18.297089 19413 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.296401 19426 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:18.288093 19182 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 13:18:18.347649 19414 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:18:18.348685 19399 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:18:18.343387 19416 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.376211 19407 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:18.380861 19426 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:18.380488 19413 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.389034 19398 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.391757 19432 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:18.401819 19416 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:18.402415 19432 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:18.403043 19432 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.394157 19407 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.405442 19407 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.411074 19413 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:18.413522 19432 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:18.416643 19432 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:18.417470 19432 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:18.418020 19432 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:18.419184 19432 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.396530 19426 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.458515 19402 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.460810 19402 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:18.463024 19407 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.472249 19407 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:18.500708 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 227263us
I20260709 13:18:18.501488 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:18.503629 17287 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:18.518519 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 239580us
I20260709 13:18:18.343760 17393 rpcz_store.cc:276] 0709 13:18:16.408086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.931857 (+1523771us) service_pool.cc:224] Handling call
0709 13:18:17.932166 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.932374 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:18.258833 (+326459us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.342747 (+ 83914us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.342813 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:18.342877 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.343033 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.343159 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":460409,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":357,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":2615,"thread_start_us":409275,"threads_started":2}
I20260709 13:18:18.524725 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:18.527046 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2228) took 1492 ms. Trace:
I20260709 13:18:18.317092 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2227) took 1742 ms. Trace:
I20260709 13:18:18.529219 17315 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:18:18.384276 19320 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:18.452463 19396 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.466495 19406 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.581554 19081 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.580551 17464 rpcz_store.cc:276] 0709 13:18:16.574815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.838519 (+263704us) service_pool.cc:224] Handling call
0709 13:18:16.874454 (+ 35935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.920220 (+1045766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.920257 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.920918 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.252958 (+332040us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:18.253558 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.263182 (+  9624us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.316743 (+ 53561us) raft_consensus.cc:1685] finished
0709 13:18:18.316783 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.317006 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":640004,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":30311,"thread_start_us":1295204,"threads_started":2,"wal-append.queue_time_us":351968}
I20260709 13:18:18.582826 19081 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:18.464018 19386 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.469225 19426 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:18.549214 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.556078 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 267047us
I20260709 13:18:18.571852 19413 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.573215 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:18.601485 19413 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.574079 19436 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.577979 19416 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:18.580821 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:18.581120 19399 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:18.585361 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 82082.2us
I20260709 13:18:18.586450 19182 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:18.586599 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:18.586786 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:18.577612 17462 rpcz_store.cc:276] 0709 13:18:17.034902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.035180 (+   278us) service_pool.cc:224] Handling call
0709 13:18:17.919908 (+884728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.920230 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.920254 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.937542 (+ 17288us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.253953 (+316411us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:18.253992 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.254063 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.526521 (+272458us) raft_consensus.cc:1685] finished
0709 13:18:18.526555 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.526827 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156726,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"spinlock_wait_cycles":45824,"thread_start_us":180748,"threads_started":1,"wal-append.queue_time_us":318025}
I20260709 13:18:18.593436 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:18.598183 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.599164 19081 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:18.600083 19396 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:18.600394 19426 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:18.905048 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 298319us
W20260709 13:18:18.885675 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 280190us
I20260709 13:18:18.620398 17394 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:18.686062 17316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 372) took 1573 ms (client timeout 1544 ms). Trace:
W20260709 13:18:18.691108 17317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1399) took 2227 ms (client timeout 1590 ms). Trace:
I20260709 13:18:18.686142 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 260) took 3430 ms. Trace:
I20260709 13:18:18.919291 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:18.685738 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:18.917484 17316 rpcz_store.cc:269] 0709 13:18:17.030440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.603055 (+1572615us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:18.603255 (+   200us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:18:18.626730 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:18.917110 17389 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:18.605450 19182 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:18.605321 19422 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.916991 19416 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.621114 19421 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:18.625671 17465 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:18.623730 19386 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:18.919476 17317 rpcz_store.cc:269] 0709 13:18:16.373466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.490594 (+117128us) service_pool.cc:224] Handling call
0709 13:18:18.600493 (+2109899us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54001419d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:18.600770 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238930816}
I20260709 13:18:18.615545 19339 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:18.924561 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 344061us
I20260709 13:18:18.621428 19406 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:18.930980 19439 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:18.624034 17388 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:18.687628 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2305) took 2067 ms. Trace:
I20260709 13:18:18.934434 17393 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:18.934000 19182 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:18.934820 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.929996 17997 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:18.613883 18962 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:18.690153 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:18.627631 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:18.936353 19439 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.605262 19399 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.941663 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2223) took 2378 ms. Trace:
I20260709 13:18:18.942440 19421 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:18.942726 17991 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:18.937284 19320 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:18.947835 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:18.940297 19439 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.952978 19365 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:18.953888 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:18.955967 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 639) took 1025 ms. Trace:
I20260709 13:18:18.956555 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:18.958168 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:19.018805 17997 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:18.958525 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:18.959542 19422 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:18.960969 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:18.962617 19053 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:19.022545 17995 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:19.022953 19053 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:19.023392 19053 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:18.963982 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.015991 17465 rpcz_store.cc:276] 0709 13:18:16.563693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.594375 (+ 30682us) service_pool.cc:224] Handling call
0709 13:18:18.624640 (+2030265us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:18.625072 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.936181 (+311109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.940384 (+  4203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94966144}
I20260709 13:18:19.025380 17320 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
W20260709 13:18:19.026516 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 72864.5us
I20260709 13:18:19.027567 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:19.027849 19422 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:18.975198 19416 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:18.977006 17317 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:18:19.006867 19398 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.007s
I20260709 13:18:18.940423 19081 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:18:19.010710 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2300) took 2751 ms. Trace:
I20260709 13:18:18.938344 17391 rpcz_store.cc:276] 0709 13:18:16.619684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.628198 (+2008514us) service_pool.cc:224] Handling call
0709 13:18:18.686456 (+ 58258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.686963 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.687005 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.687094 (+    89us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:18.687181 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.687256 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.687407 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:19.012096 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2304) took 2299 ms. Trace:
I20260709 13:18:18.920125 17397 rpcz_store.cc:276] 0709 13:18:15.255219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.010534 (+755315us) service_pool.cc:224] Handling call
0709 13:18:16.074092 (+ 63558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.349363 (+275271us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:16.555634 (+206271us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.804149 (+248515us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.804362 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.804419 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:16.804487 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.630881 (+1826394us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b1800317fe0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419
0709 13:18:18.685519 (+ 54638us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54001397d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:18.685606 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.685923 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":313,"prepare.queue_time_us":359522,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":203,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":73086,"spinlock_wait_cycles":690260480,"thread_start_us":447115,"threads_started":2,"wal-append.queue_time_us":350416,"wal-append.run_cpu_time_us":2749,"wal-append.run_wall_time_us":1390377}
I20260709 13:18:19.014364 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.059108 17316 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:19.019807 19421 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.020406 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:19.027670 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 69449.7us
I20260709 13:18:19.064905 17991 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:19.065726 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:18.966120 19425 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:18.968787 19413 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:19.037633 17993 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:19.019016 17990 rpcz_store.cc:276] 0709 13:18:17.930660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.017890 (+ 87230us) service_pool.cc:224] Handling call
0709 13:18:18.689689 (+671799us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:18.955854 (+266165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8828800}
I20260709 13:18:19.024654 19053 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.068820 19053 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.039669 19422 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.040328 18962 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:19.041057 17287 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:19.064859 17994 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:19.042039 17388 rpcz_store.cc:276] 0709 13:18:16.259079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.871902 (+612823us) service_pool.cc:224] Handling call
0709 13:18:18.622716 (+1750814us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:18.623245 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.937635 (+314390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.010638 (+ 73003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4147456}
I20260709 13:18:19.081686 17313 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:19.078111 18962 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.083047 18962 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.082983 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:19.084268 17994 raft_consensus.cc:2368] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4.
I20260709 13:18:19.084633 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:19.085436 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:19.085402 17990 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.086886 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:19.088703 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:19.090087 17994 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:19.091917 19426 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.092594 19426 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:19.093936 19426 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.094751 19406 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:19.095242 19406 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.095429 17990 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:19.096131 19406 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.099087 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:19.100153 17319 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:19.100556 17317 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:19.100661 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.101183 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.101547 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:19.102303 17319 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.101641 17315 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:19.102823 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.103171 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:19.103879 17322 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.104262 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:19.110491 19399 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:19.110688 19406 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:19.113890 19393 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.374s	user 0.003s	sys 0.010s
I20260709 13:18:19.116432 19406 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:19.117511 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 76641.9us
I20260709 13:18:19.119197 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:19.121323 19397 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.377s	user 0.012s	sys 0.001s
I20260709 13:18:19.121428 18992 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.122272 18992 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:19.123399 18992 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.124884 19184 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:19.125716 19184 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:19.126796 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:19.127367 19184 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.128082 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:19.054718 17392 rpcz_store.cc:276] 0709 13:18:16.619358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.033238 (+1413880us) service_pool.cc:224] Handling call
0709 13:18:18.033732 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.253597 (+219865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.253629 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.279507 (+ 25878us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.769619 (+490112us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:18.769757 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.769892 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.769976 (+    84us) raft_consensus.cc:1685] finished
0709 13:18:18.769995 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.918897 (+148902us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":215091,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5206,"thread_start_us":264451,"threads_started":2,"wal-append.queue_time_us":402789}
I20260709 13:18:19.128947 19398 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.129367 19365 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:19.130012 19422 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.130445 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:19.139858 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 176021us
I20260709 13:18:19.131229 19406 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:19.131639 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.112349 19439 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.135521 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:19.138612 19398 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:19.139467 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 179153us
I20260709 13:18:19.141845 19406 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.118528 19382 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.145256 19398 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.146178 19365 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:19.157871 19406 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.157564 19182 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:19.168141 19341 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:18:19.168366 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 269) took 3833 ms. Trace:
I20260709 13:18:19.168570 19442 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:19.169051 19396 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:19.173866 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:19.187047 19422 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:19.188408 19365 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.189417 19424 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:19.174706 19439 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:19.174997 19382 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.164078 19386 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:19.175464 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.192673 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:19.162467 17360 connection.cc:256] RPC call timeout handler was delayed by -1.2223915989998204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 13:18:19.207348 17360 connection.cc:256] RPC call timeout handler was delayed by -1.1627643670001362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 13:18:19.207756 17360 connection.cc:256] RPC call timeout handler was delayed by -1.1627643670001362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 13:18:19.208142 17360 connection.cc:256] RPC call timeout handler was delayed by -1.0592643669999688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:18:19.208473 17360 connection.cc:256] RPC call timeout handler was delayed by -1.0592643669999688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:18:19.208709 17360 connection.cc:256] RPC call timeout handler was delayed by -1.0567203719999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 13:18:19.155161 19325 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:19.165014 17396 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:19.181116 17322 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:19.179557 17395 rpcz_store.cc:276] 0709 13:18:15.319459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.622793 (+1303334us) service_pool.cc:224] Handling call
0709 13:18:16.623111 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.635952 (+ 12841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.635994 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.636440 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.911244 (+274804us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:16.911281 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.911346 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.112809 (+2201463us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:19.137516 (+ 24707us) raft_consensus.cc:1685] finished
0709 13:18:19.137547 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.153078 (+ 15531us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12459,"raft.queue_time_us":13282,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":24964,"spinlock_wait_cycles":97272704,"thread_start_us":210630,"threads_started":1,"wal-append.queue_time_us":913704}
W20260709 13:18:19.185107 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 57173.6us
W20260709 13:18:19.213335 17360 connection.cc:256] RPC call timeout handler was delayed by -1.0108203719998983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
I20260709 13:18:19.194504 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:19.228533 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.227512 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 55410.2us
I20260709 13:18:19.207479 19182 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:19.187119 19372 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:19.235484 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 63900.6us
I20260709 13:18:19.246276 17319 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:19.251750 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:19.249480 19424 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:19.258661 19372 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.259492 19424 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.260200 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:19.260946 19446 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 13:18:19.264986 17321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 369) took 2390 ms (client timeout 1890 ms). Trace:
W20260709 13:18:19.265471 17321 rpcz_store.cc:269] 0709 13:18:16.874773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.875210 (+   437us) service_pool.cc:224] Handling call
0709 13:18:19.264566 (+2389356us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400369554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:19.264756 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2678110464}
I20260709 13:18:19.266321 19422 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.231377 19439 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:19.214195 19442 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.268397 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:19.275386 19424 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:19.269527 18962 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.278079 19409 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:19.278168 18962 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:19.278646 19409 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:19.279843 19409 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.275606 19422 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:19.289533 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 55987.5us
W20260709 13:18:19.286937 17285 connection.cc:256] RPC call timeout handler was delayed by -1.056738987000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 13:18:19.289007 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 57903.7us
I20260709 13:18:19.297056 19182 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.305691 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 636) took 1377 ms. Trace:
I20260709 13:18:19.306267 17999 rpcz_store.cc:276] 0709 13:18:17.927695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.927803 (+   108us) service_pool.cc:224] Handling call
0709 13:18:17.928051 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.018858 (+ 90807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.305102 (+1286244us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b5400246154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:19.305462 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3291008}
W20260709 13:18:19.308282 17362 leader_election.cc:336] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.970s (SENT)
I20260709 13:18:19.309068 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:19.310261 19422 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:19.310803 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.314342 19442 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:19.268224 19439 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.245168 19386 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:19.323254 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.325219 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:19.331645 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 69046.9us
W20260709 13:18:19.338284 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.339146 19366 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.339795 19366 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.340692 19250 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.341439 19250 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.342190 19366 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:19.342653 19453 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.338008 19372 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:19.343417 19453 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.347189 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:19.333650 19409 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.340041 18962 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.343922 19250 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:19.363257 19053 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:18:19.363560 19422 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:19.354056 19424 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.363355 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:19.364893 19386 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:19.365309 19378 raft_consensus.cc:2764] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:18:19.369536 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 51924.2us
I20260709 13:18:19.369237 19452 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:19.370498 19458 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:19.371534 19439 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:19.396438 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.375552 17470 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:19.376107 19398 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.397137 19413 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:19.398321 19413 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:19.333002 19442 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.399699 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.400458 19416 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:19.401043 19416 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:19.388005 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.389458 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:19.388803 19424 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.394755 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.398773 19413 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.399386 19442 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.388794 19372 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.394387 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.376750 19184 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:18:19.401561 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.414299 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.426221 17462 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:19.402031 19398 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:19.427651 17963 connection.cc:256] RPC call timeout handler was delayed by -1.2183637959997213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2867s for a response
I20260709 13:18:19.416484 19413 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:19.431488 17465 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:19.429319 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.427655 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:19.436144 17464 raft_consensus.cc:2410] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:19.426131 19382 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.441752 19453 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:19.442142 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:19.467830 19385 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:19.468374 19385 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:19.468992 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.469787 17466 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:19.469573 19385 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.470263 19365 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.443006 17463 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:19.470902 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.471204 19385 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.471665 17466 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:19.472105 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.429786 19452 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.472911 17463 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:19.473202 19452 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.446719 19293 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.474167 19293 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.475198 19453 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:19.475685 19452 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:19.476347 19293 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:19.429901 19053 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:18:19.476878 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:19.474184 19366 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:18:19.456079 17471 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.449225 17434 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:19.459540 19416 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.461015 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.461163 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:19.461511 19203 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.461935 19345 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:19.463825 19442 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:19.465358 19402 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:19.466444 19419 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:19.429553 19422 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:19.467114 19434 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.532s	user 0.009s	sys 0.024s
W20260709 13:18:19.441803 19459 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:18:19.467063 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 77774.5us
I20260709 13:18:19.467895 19382 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.445034 19184 consensus_queue.cc:1243] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:19.480763 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:19.419390 19372 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.429646 18962 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.478683 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:19.472546 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.485021 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.489346 17319 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.553821 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.478507 19366 raft_consensus.cc:2764] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:19.488667 19203 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:19.486068 17318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1396) took 3126 ms (client timeout 2339 ms). Trace:
W20260709 13:18:19.545897 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 96729.9us
I20260709 13:18:19.554322 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:19.559033 17471 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.486663 19458 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:19.548148 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.548770 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:19.547865 17467 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:19.543306 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:19.550577 19243 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:19.553701 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:19.482122 19403 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:19.554493 17322 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
W20260709 13:18:19.543771 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 64705.5us
I20260709 13:18:19.556416 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:19.550899 17321 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:19.568379 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:19.557341 17318 rpcz_store.cc:269] 0709 13:18:16.359954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.360101 (+   147us) service_pool.cc:224] Handling call
0709 13:18:19.485621 (+3125520us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b5400211e54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:19.485839 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4375549184}
I20260709 13:18:19.476537 17469 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:19.557773 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:19.562029 17463 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.561473 17462 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.570349 17470 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.573071 17465 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.574378 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:19.575766 17464 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.575932 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.557940 19416 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.582963 17468 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:19.544909 19402 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:19.584383 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.491937 19345 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.559835 19203 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.592095 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.590691 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.589771 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.596058 17471 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.570582 19403 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.551937 19053 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:18:19.576293 19419 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:19.610941 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.624251 17463 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
W20260709 13:18:19.598238 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 119606us
I20260709 13:18:19.623111 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.626315 17467 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.617497 17466 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:19.631052 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.628811 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:19.633564 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 81747.9us
I20260709 13:18:19.591408 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:19.631780 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:19.642133 17393 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:19.623955 19419 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.645849 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:19.646131 17470 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.644521 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.643097 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.646915 17466 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:19.647565 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:19.647980 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.648591 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.650307 17393 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:19.651590 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:19.652267 17393 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:19.653173 17471 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.653240 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:19.654044 17393 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:19.654142 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.655055 17471 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.648713 17466 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:19.655856 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.656229 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.664150 19365 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.665016 19419 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.665705 19372 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:19.644989 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.676908 19458 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:19.677160 17998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 480) took 3231 ms (client timeout 2111 ms). Trace:
I20260709 13:18:19.655068 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:19.656694 17471 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.671033 17469 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:19.681811 17465 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:19.636593 19424 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:19.684993 17467 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:19.680526 17393 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:19.685281 17468 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:19.678340 17998 rpcz_store.cc:269] 0709 13:18:16.405980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.495436 (+ 89456us) service_pool.cc:224] Handling call
0709 13:18:19.611341 (+3115905us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54006d1fd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:19.637774 (+ 26433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3615004032}
W20260709 13:18:19.688653 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 63452.3us
I20260709 13:18:19.690943 17462 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:19.692245 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.692677 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.693909 17469 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.697464 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:19.700446 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.700737 17468 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:19.701124 17471 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:19.702107 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:19.702648 17471 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:19.702824 17468 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:19.704321 17468 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.705037 19365 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:19.705506 17465 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:19.706768 17465 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:19.708110 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:19.713135 19220 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.713658 19220 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:19.713812 17319 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:19.714069 19220 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.634394 19406 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.722155 17464 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:19.696050 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:19.683212 19398 raft_consensus.cc:2764] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:19.748859 17470 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:19.719585 17388 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:19.769994 17462 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:19.764303 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:19.778854 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 83053.4us
I20260709 13:18:19.779601 17286 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:19.783653 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.784793 17319 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.786561 17467 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:19.788654 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:19.802843 17468 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:19.810997 19469 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:18:19.813050 19454 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:19.813619 19454 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.814002 19454 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.778524 19365 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:19.781067 19366 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:19.781128 19339 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.828186 19448 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:19.798688 19081 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:19.845041 19448 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.845824 19081 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.846287 19081 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:19.849706 19467 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:18:19.838946 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 101595us
I20260709 13:18:19.841053 19424 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.865144 19424 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.865636 19424 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.866163 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:19.882922 19081 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:19.831239 19366 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.898195 19366 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.902503 19413 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:19.904928 17362 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.593s (SENT)
I20260709 13:18:19.876775 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:19.905566 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:19.908478 17463 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.837178 18962 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:19.866144 19403 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:19.945034 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.927217 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.929318 19345 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:19.981266 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:19.789011 19402 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.982615 17466 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:19.984969 19220 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:19.990852 17964 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.555s (SENT)
I20260709 13:18:20.012745 19403 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:20.013394 19402 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.013626 19448 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:20.017858 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:20.018982 17314 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
W20260709 13:18:20.019232 19466 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.539s	user 0.005s	sys 0.000s
I20260709 13:18:19.987825 19203 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:20.023298 19382 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:19.914644 19339 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:19.929219 19419 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:20.060098 17322 raft_consensus.cc:2393] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:20.079780 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:20.080336 19081 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:20.080704 17318 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:20.080906 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:20.023733 17396 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:18:20.082792 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 488180us
I20260709 13:18:20.081611 17390 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:20.084863 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:20.085672 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 275) took 1802 ms (client timeout 1890 ms). Trace:
I20260709 13:18:20.086186 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:20.086537 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 95730.6us
I20260709 13:18:20.087752 17464 pending_rounds.cc:85] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 5
I20260709 13:18:20.088121 17464 pending_rounds.cc:107] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:18:20.088443 17464 raft_consensus.cc:2889] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.089129 19345 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.089398 19399 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.089663 19345 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.090075 19399 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.090196 19345 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.090710 19399 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:20.086151 17390 rpcz_store.cc:269] 0709 13:18:18.283495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.523661 (+240166us) service_pool.cc:224] Handling call
0709 13:18:20.080586 (+1556925us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:20.085591 (+  5005us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30527872}
I20260709 13:18:20.095245 17390 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:18:20.096129 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.109323 19413 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:20.145288 19413 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:20.147635 19413 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:20.088550 17964 leader_election.cc:336] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.963s (SENT)
W20260709 13:18:20.153672 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 65178.4us
I20260709 13:18:20.120419 17469 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:20.104701 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:20.157634 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 468058us
W20260709 13:18:20.121551 17215 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49294 (request call id 328) took 13739 ms (client timeout 15000 ms). Trace:
I20260709 13:18:20.125080 19458 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.161064 19320 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:20.161726 19320 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.162246 19320 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:20.158360 17215 rpcz_store.cc:269] 0709 13:18:06.382049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.382173 (+   124us) service_pool.cc:224] Handling call
0709 13:18:20.121203 (+13739030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:15.019716 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:15.241030 (+221314us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:15.241077 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:18:15.241101 (+    24us) tablet.cc:662] Decoding operations
0709 13:18:15.241843 (+   742us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:15.241905 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:15.241940 (+    35us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:15.242508 (+   568us) tablet.cc:701] Row locks acquired
0709 13:18:15.242526 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:15.242707 (+   181us) write_op.cc:270] Start()
0709 13:18:15.242825 (+   118us) write_op.cc:276] Timestamp: P: 1783603095242658 usec, L: 0
0709 13:18:15.242848 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:15.279818 (+ 36970us) log.cc:844] Serialized 2069 byte log entry
0709 13:18:16.721074 (+1441256us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:18.238369 (+1517295us) op_driver.cc:464] REPLICATION: finished
0709 13:18:18.597440 (+359071us) write_op.cc:301] APPLY: starting
0709 13:18:18.630456 (+ 33016us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:18.630800 (+   344us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:18.630855 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:18.685250 (+ 54395us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:18.685683 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:18:18.685755 (+    72us) write_op.cc:312] APPLY: finished
0709 13:18:18.686288 (+   533us) log.cc:844] Serialized 47 byte log entry
0709 13:18:18.686628 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:18.686875 (+   247us) write_op.cc:454] Released schema lock
0709 13:18:18.687007 (+   132us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:18.687680 (+   673us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:18.687712 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":329207,"apply.run_cpu_time_us":4642,"apply.run_wall_time_us":114818,"num_ops":5,"prepare.queue_time_us":1094511,"prepare.run_cpu_time_us":63659,"prepare.run_wall_time_us":526786,"raft.queue_time_us":701913,"raft.run_cpu_time_us":18744,"raft.run_wall_time_us":220016,"replication_time_us":2967103,"spinlock_wait_cycles":14455040,"thread_start_us":1555555,"threads_started":4,"wal-append.queue_time_us":340749,"wal-append.run_cpu_time_us":25909,"wal-append.run_wall_time_us":4055114}]]}
I20260709 13:18:20.059026 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1121) took 1487 ms. Trace:
I20260709 13:18:20.170125 17313 rpcz_store.cc:276] 0709 13:18:18.572188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.572522 (+   334us) service_pool.cc:224] Handling call
0709 13:18:20.058741 (+1486219us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003e21d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:20.058912 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394755328}
I20260709 13:18:20.024433 19406 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:20.132696 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.064800 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:20.133725 17389 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:20.172320 17319 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.120873 19366 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:20.141424 19419 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:20.107350 19182 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:20.119055 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.149432 19436 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:20.150065 19416 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:20.151165 19345 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:20.157723 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 53146.7us
I20260709 13:18:20.161235 19458 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:20.058673 19220 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:20.136101 19339 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:20.137420 17220 catalog_manager.cc:5697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 3, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 3 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.181638 17463 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:20.190810 19182 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:20.218304 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:20.219091 17990 raft_consensus.cc:2376] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4. Re-sending same reply.
I20260709 13:18:20.219435 19182 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:20.220393 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:20.176400 19366 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:20.023283 19203 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:20.177536 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 104457us
I20260709 13:18:20.220211 17220 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.205276 19436 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.228092 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.221351 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:20.221560 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.222195 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:20.222668 18962 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:20.225289 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:20.225630 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:20.228238 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.266345 17470 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:20.266489 17992 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:20.267369 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.268106 17470 raft_consensus.cc:2376] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5. Re-sending same reply.
I20260709 13:18:20.269052 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.269794 17470 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:20.270540 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.271217 17470 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:20.230510 17467 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:20.063925 19424 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:20.275168 19424 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:20.225775 19182 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.236310 17220 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 2 to 3, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 3 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:18:20.185935 17319 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:20.256506 17999 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:20.284965 17469 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:18:20.235029 17465 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.024s	sys 0.028s
W20260709 13:18:20.285643 17465 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.025s	sys 0.029s
I20260709 13:18:20.283895 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:20.177417 19454 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:20.287145 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 97081us
W20260709 13:18:20.283821 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58309.6us
I20260709 13:18:20.290885 17286 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:20.292289 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.209353 19341 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:18:20.302202 19399 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:20.304533 19399 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:20.305539 17467 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:20.307545 17998 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:20.307878 19220 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.292637 19366 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:20.293208 17994 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:20.230865 19458 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:20.324255 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:20.313709 17434 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:20.297392 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:20.316571 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 99243.5us
I20260709 13:18:20.327556 17996 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:20.323602 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:20.328394 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:20.329164 17322 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.316512 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.330394 17466 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:20.324925 17389 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.335995 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.336874 17467 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:20.336280 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:20.319108 19220 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.319008 19366 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.312772 19053 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 13:18:20.360069 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 53810.5us
I20260709 13:18:20.337901 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:20.355347 19220 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.369009 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:20.369971 17992 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:20.370889 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:20.371650 17996 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:20.373126 17220 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 3 to 4, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 4 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.375515 17220 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:20.376968 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 472040us
W20260709 13:18:20.378422 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.378908 17362 leader_election.cc:336] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.645s (SENT)
I20260709 13:18:20.379271 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:20.381027 19220 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:20.383308 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:20.383980 17397 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.384148 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.362298 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.384791 17466 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:20.392961 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.393561 17466 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:20.401186 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 64953.3us
I20260709 13:18:20.325511 19365 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:20.405100 17322 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:20.356752 19339 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:20.404542 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.361801 19366 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.391132 17313 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:20.405107 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.385187 19402 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:20.419296 17220 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:18:20.420899 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:20.421691 17996 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.415532 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:20.402997 17394 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:20.418128 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.417384 17469 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:20.422516 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:20.424131 17319 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:20.420117 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.027s
W20260709 13:18:20.429919 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.001s	sys 0.027s
I20260709 13:18:20.429970 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.431079 17470 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:20.432243 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.414813 19382 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:20.423141 17468 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:20.407883 19422 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:20.414014 19339 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.439594 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.419577 17390 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:18:20.445581 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.447190 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:20.457178 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:20.445755 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 591623us
I20260709 13:18:20.458015 17467 raft_consensus.cc:2376] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3. Re-sending same reply.
I20260709 13:18:20.459792 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.460484 17469 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
W20260709 13:18:20.460877 17362 leader_election.cc:336] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.720s (SENT)
I20260709 13:18:20.461539 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:20.448966 17390 pending_rounds.cc:85] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 3
I20260709 13:18:20.473136 17390 pending_rounds.cc:107] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:18:20.473465 17390 raft_consensus.cc:2889] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.477205 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.478488 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.479233 17469 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:20.480110 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.463778 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.481268 17470 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:20.482040 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.482539 17470 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.453186 19385 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:20.464599 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.485109 17468 raft_consensus.cc:2376] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4. Re-sending same reply.
I20260709 13:18:20.485991 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.486691 17468 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:20.487381 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.488019 17468 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:20.466531 17992 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:20.488638 17990 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:20.466050 17220 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 3, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 3 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.490162 17220 catalog_manager.cc:5697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 3, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 3 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.491904 17220 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:20.493918 19475 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:20.495606 19446 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:20.497897 19446 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:20.498759 19452 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:20.499176 19453 consensus_queue.cc:1059] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:20.500222 18962 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:20.480666 17469 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.495267 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:20.471987 17397 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:20.448762 19339 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.471889 17319 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:20.500476 19341 raft_consensus.cc:3055] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:20.488682 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.493939 17220 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 2, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.508353 17468 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.508494 17996 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:20.511113 17466 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:20.510350 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:20.453279 19345 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:20.500615 18962 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:20.538582 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.538736 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 90955.3us
I20260709 13:18:20.539975 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.541033 17466 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:20.543768 17220 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 3 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.507073 19458 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.512012 17470 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:20.516587 17389 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:20.514669 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:20.566584 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51990us
W20260709 13:18:20.515898 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 57557us
I20260709 13:18:20.537635 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.512698 19424 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:20.473635 19320 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:20.574193 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 79037.5us
I20260709 13:18:20.513583 19220 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:20.513767 19341 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:20.571409 17220 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 3 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.573421 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.576013 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.512885 19399 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:18:20.579619 17220 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 2 to 4, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 4 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.548604 19402 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:20.578701 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 63788.5us
I20260709 13:18:20.564651 19345 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:20.553799 19454 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:20.586825 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.572744 19436 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:20.590706 17467 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.595629 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.601182 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.577284 19446 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:20.608055 17470 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:20.610913 19341 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:20.612229 19341 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:20.610924 19472 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:18:20.621348 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:20.622731 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:20.623646 17990 raft_consensus.cc:2410] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:20.625202 17434 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:20.628199 17463 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:20.629961 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:20.603407 19345 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:20.635985 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:20.638342 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.639727 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:20.639919 19345 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:20.625097 19446 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:20.644500 19366 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:20.645581 19446 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:20.640547 17313 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:20.579631 19458 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:20.609509 19182 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:20.650547 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:20.688369 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:20.690142 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 65024.9us
W20260709 13:18:20.695031 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 110887us
I20260709 13:18:20.695281 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:20.696033 17466 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:20.696630 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2320) took 1115 ms. Trace:
I20260709 13:18:20.698127 17318 raft_consensus.cc:2410] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:20.696537 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:20.700042 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.702042 17470 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:20.636861 19453 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:20.697098 17392 rpcz_store.cc:276] 0709 13:18:19.545613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.550867 (+  5254us) service_pool.cc:224] Handling call
0709 13:18:19.581433 (+ 30566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.633867 (+ 52434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.633903 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.687772 (+ 53869us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.226533 (+538761us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:20.226589 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.226679 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.661083 (+434404us) raft_consensus.cc:1685] finished
0709 13:18:20.661105 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.661258 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7524,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":13172,"thread_start_us":455706,"threads_started":1,"wal-append.queue_time_us":722693}
I20260709 13:18:20.713073 17470 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:18:20.663057 19448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.028s	sys 0.050s
I20260709 13:18:20.660468 19402 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:20.717504 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 293) took 1262 ms. Trace:
I20260709 13:18:20.687988 19182 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:20.716622 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:20.694809 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:20.720948 19448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.028s	sys 0.051s
I20260709 13:18:20.712862 19220 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:18:20.720897 19413 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260709 13:18:20.735435 17465 rpcz_store.cc:276] 0709 13:18:19.447210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.708329 (+261119us) service_pool.cc:224] Handling call
0709 13:18:19.708556 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.708719 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:20.288440 (+579721us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.695371 (+406931us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.695432 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:20.709808 (+ 14376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.709901 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.710055 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":747315,"prepare.run_cpu_time_us":5693,"prepare.run_wall_time_us":24832,"raft.queue_time_us":33848,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":11519,"thread_start_us":938132,"threads_started":2}
I20260709 13:18:20.740023 17463 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:20.723569 19382 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:20.741983 17470 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:20.743371 19399 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:20.619470 18962 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:20.745704 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:20.762437 17468 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:20.765408 17465 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:20.779034 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.783305 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 228529us
I20260709 13:18:20.712675 19453 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:20.724453 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:20.794363 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48832us
I20260709 13:18:20.795392 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:20.721045 19081 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:18:20.801525 17468 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:20.762286 19413 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:20.816378 17467 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:20.819423 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:20.820248 17389 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.788235 19341 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:20.822037 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:20.832209 17393 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.719633 19385 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:20.829936 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:20.818483 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:20.834823 17392 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:20.810192 17992 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:20.839644 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:20.840494 17396 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
W20260709 13:18:20.842219 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.842037 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:20.842936 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 225660us
I20260709 13:18:20.799605 19496 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:20.828521 19402 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:20.871376 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:20.874567 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:20.839190 19406 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:20.840044 19081 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:20.889155 17392 raft_consensus.cc:2368] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4.
I20260709 13:18:20.827070 19454 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:18:20.863524 17389 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:20.946738 17467 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:20.950098 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:20.950920 17389 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.955062 17465 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:20.956190 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49024.5us
I20260709 13:18:20.956714 17392 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:20.957109 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.960826 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:20.896226 19486 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
W20260709 13:18:20.963646 17964 leader_election.cc:336] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.985s (SENT)
I20260709 13:18:20.864650 19366 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:20.969394 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 272941us
I20260709 13:18:20.838728 19182 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:20.978034 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:20.987352 17465 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.907521 19081 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:20.945370 19436 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:20.951678 19320 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:21.005973 19488 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 13:18:20.961565 19053 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.872216 19496 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:21.009197 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 113231us
I20260709 13:18:20.965197 19402 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:21.011657 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.013477 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:20.865965 19453 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:21.019248 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.032612 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:20.998401 17469 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:20.985085 17467 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:21.026425 17964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.981s (SENT) [suppressed 60 similar messages]
I20260709 13:18:21.018143 19458 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:21.062813 19458 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:18:21.031689 19491 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
I20260709 13:18:21.034230 19436 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:21.067281 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:21.068730 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:21.069288 17389 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:21.070569 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:21.072458 17319 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:21.032786 19366 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:18:21.079607 17396 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 3: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:21.069754 17995 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.084964 17466 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:20.951577 19382 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:21.011723 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:21.014446 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:21.107668 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.121270 17319 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:21.127033 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.153425 17392 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:21.129983 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.076297 19182 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.067003 19458 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:21.015827 19053 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:21.137073 19497 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:18:21.138017 19494 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:18:21.138993 19500 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:18:21.139876 19492 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:18:21.239353 19402 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:21.240367 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2334) took 1591 ms. Trace:
W20260709 13:18:21.140610 19493 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
W20260709 13:18:21.141431 19498 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:18:21.240820 17388 rpcz_store.cc:276] 0709 13:18:19.648728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.767797 (+119069us) service_pool.cc:224] Handling call
0709 13:18:19.768335 (+   538us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:20.278534 (+510199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.290150 (+ 11616us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:20.416533 (+126383us) log.cc:844] Serialized 52 byte log entry
0709 13:18:20.722909 (+306376us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.723072 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.723274 (+   202us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.240117 (+516843us) raft_consensus.cc:1685] finished
0709 13:18:21.240143 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.240296 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13683,"raft.queue_time_us":375889,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":159,"thread_start_us":646851,"threads_started":2,"wal-append.queue_time_us":433281}
I20260709 13:18:21.242599 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2244) took 1036 ms. Trace:
I20260709 13:18:21.141503 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:21.161986 17397 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:18:21.181740 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 220976us
I20260709 13:18:21.099732 19320 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.108124 19220 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:21.194599 17465 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:21.126734 19453 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.010094 19385 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:21.197510 17389 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
W20260709 13:18:21.202101 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 360164us
W20260709 13:18:21.203018 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 232579us
I20260709 13:18:21.206359 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.207224 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:21.210086 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.206720 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:21.182663 17391 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.166030 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:21.183701 19483 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:21.227924 17467 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:21.128825 19490 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:18:21.093079 19081 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:21.238963 17360 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:21.239838 19511 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:18:21.247139 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.242940 17462 rpcz_store.cc:276] 0709 13:18:20.206107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.253548 (+ 47441us) service_pool.cc:224] Handling call
0709 13:18:20.298895 (+ 45347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.299342 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:20.299379 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.314828 (+ 15449us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.624934 (+310106us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.624975 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.625053 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.242401 (+617348us) raft_consensus.cc:1685] finished
0709 13:18:21.242422 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.242543 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2052,"raft.queue_time_us":1046,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5874,"thread_start_us":265336,"threads_started":1,"wal-append.queue_time_us":461748}
I20260709 13:18:21.856663 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:21.245343 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:21.857568 17362 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.787s (SENT)
I20260709 13:18:21.858135 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:21.736452 17995 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.000s
W20260709 13:18:21.859006 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.854666 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2265) took 1388 ms. Trace:
I20260709 13:18:21.698428 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:21.856817 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2339) took 1543 ms. Trace:
W20260709 13:18:21.860095 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.869434 17319 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.651309 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:21.858217 17321 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:21.870708 17394 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:21.866042 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.872169 17964 leader_election.cc:336] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 3.312s (SENT)
W20260709 13:18:21.585670 17393 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.002s
I20260709 13:18:21.867838 17396 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:21.859169 17995 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:21.874339 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 494) took 1035 ms. Trace:
I20260709 13:18:21.873795 17393 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:21.874729 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:21.870087 17392 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:21.875826 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 279) took 1077 ms. Trace:
I20260709 13:18:21.867302 17463 rpcz_store.cc:276] 0709 13:18:20.466584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.794651 (+328067us) service_pool.cc:224] Handling call
0709 13:18:20.818645 (+ 23994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.838213 (+ 19568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.838253 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.862847 (+ 24594us) log.cc:844] Serialized 26 byte log entry
0709 13:18:21.190620 (+327773us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:21.190679 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.192404 (+  1725us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.243155 (+ 50751us) raft_consensus.cc:1685] finished
0709 13:18:21.243175 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.854603 (+611428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8805,"raft.queue_time_us":11023,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":24398,"thread_start_us":245996,"threads_started":1,"wal-append.queue_time_us":348219}
I20260709 13:18:21.876211 17393 rpcz_store.cc:276] 0709 13:18:20.798678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.798832 (+   154us) service_pool.cc:224] Handling call
0709 13:18:21.875767 (+1076935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.872681 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:21.875123 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 657) took 1560 ms. Trace:
W20260709 13:18:21.853000 19339 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.314s	user 0.013s	sys 0.001s
W20260709 13:18:21.854143 19494 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.615s	user 0.003s	sys 0.053s
W20260709 13:18:21.672686 19523 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:18:21.248106 19503 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:21.886708 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:21.883307 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 488) took 1188 ms. Trace:
I20260709 13:18:21.868407 17395 rpcz_store.cc:276] 0709 13:18:20.313466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.318681 (+  5215us) service_pool.cc:224] Handling call
0709 13:18:20.332283 (+ 13602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.384746 (+ 52463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.384791 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.408234 (+ 23443us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.771199 (+362965us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:20.771250 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.771331 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.243270 (+471939us) raft_consensus.cc:1685] finished
0709 13:18:21.243288 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.856762 (+613474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30188,"raft.queue_time_us":31981,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11307,"thread_start_us":318644,"threads_started":1,"wal-append.queue_time_us":402895}
W20260709 13:18:21.704957 19487 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.944s	user 0.003s	sys 0.002s
I20260709 13:18:21.874856 17995 rpcz_store.cc:276] 0709 13:18:20.838981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.068410 (+229429us) service_pool.cc:224] Handling call
0709 13:18:21.874255 (+805845us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.886854 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.893353 17397 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:21.893913 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 663) took 1381 ms. Trace:
I20260709 13:18:21.328867 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:21.329342 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:21.242988 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:21.288729 19406 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:21.880098 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:21.891340 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:21.902619 17395 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.904560 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:21.883497 19365 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:21.327036 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 653) took 1093 ms. Trace:
I20260709 13:18:21.555224 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:21.856894 19220 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.917129 19220 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.917533 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 485) took 1283 ms. Trace:
I20260709 13:18:21.918089 17990 rpcz_store.cc:276] 0709 13:18:20.633896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.635111 (+  1215us) service_pool.cc:224] Handling call
0709 13:18:21.555038 (+919927us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:21.917423 (+362385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16033024}
I20260709 13:18:21.453367 19515 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.920607 19515 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:21.923441 19515 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:21.924079 19515 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.529736 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 652) took 1301 ms. Trace:
I20260709 13:18:21.894300 17996 rpcz_store.cc:276] 0709 13:18:20.512524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.538210 (+ 25686us) service_pool.cc:224] Handling call
0709 13:18:20.538626 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.588866 (+ 50240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.588903 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.610009 (+ 21106us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.843865 (+233856us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.843909 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.843980 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.893738 (+1049758us) raft_consensus.cc:1685] finished
0709 13:18:21.893757 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.893861 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158242,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":222531,"threads_started":1,"wal-append.queue_time_us":406970}
I20260709 13:18:21.322036 19496 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:21.878901 17997 rpcz_store.cc:276] 0709 13:18:20.314536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.314667 (+   131us) service_pool.cc:224] Handling call
0709 13:18:20.328148 (+ 13481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.365446 (+ 37298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.365488 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.365972 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.486813 (+120841us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4800041ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:18:20.689459 (+202646us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:20.689678 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.689883 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.243262 (+553379us) raft_consensus.cc:1685] finished
0709 13:18:21.243279 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.875050 (+631771us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7033,"raft.run_cpu_time_us":2924,"raft.run_wall_time_us":114551,"spinlock_wait_cycles":29858048,"thread_start_us":322140,"threads_started":1,"wal-append.queue_time_us":480137}
I20260709 13:18:21.900050 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1277) took 2325 ms. Trace:
I20260709 13:18:21.925200 17993 rpcz_store.cc:276] 0709 13:18:20.228008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.229646 (+  1638us) service_pool.cc:224] Handling call
0709 13:18:20.609196 (+379550us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfeee 0000000000375939 00007f7d677431e0 00007f7d6780c0c4 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:20.617650 (+  8454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.633055 (+ 15405us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:20.861895 (+228840us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.231276 (+369381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.233504 (+  2228us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:21.270023 (+ 36519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.330355 (+ 60332us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.474355 (+144000us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":296557,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":5686,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":52811,"spinlock_wait_cycles":6384512,"thread_start_us":348183,"threads_started":2,"wal-append.queue_time_us":692962}
I20260709 13:18:21.901648 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:21.927479 17393 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.901836 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:21.929481 17389 raft_consensus.cc:2368] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8.
I20260709 13:18:21.930706 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.931535 17389 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:21.932271 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:21.897153 19521 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.889739 17999 rpcz_store.cc:276] 0709 13:18:20.699190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.698001 (+998811us) service_pool.cc:224] Handling call
0709 13:18:21.883242 (+185241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.907122 17995 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:21.951879 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 493) took 1141 ms. Trace:
I20260709 13:18:21.952207 17995 rpcz_store.cc:276] 0709 13:18:20.810861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.898645 (+1087784us) service_pool.cc:224] Handling call
0709 13:18:21.906884 (+  8239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.951609 (+ 44725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.951827 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.887836 19520 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.895391 18962 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.906424 17992 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:21.884146 19483 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:21.916581 17319 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:21.926074 17464 rpcz_store.cc:276] 0709 13:18:19.574812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.085300 (+510488us) service_pool.cc:224] Handling call
0709 13:18:20.085673 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.095742 (+ 10069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.095779 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.096329 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.543083 (+446754us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:20.543137 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.543232 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.668450 (+1125218us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:21.892973 (+224523us) raft_consensus.cc:1685] finished
0709 13:18:21.893002 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.899978 (+  6976us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47498624,"thread_start_us":446235,"threads_started":1,"wal-append.queue_time_us":602567}
I20260709 13:18:21.873479 19320 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:21.932812 17389 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.903098 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.966588 17392 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:21.953680 17393 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:21.967185 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 391) took 1010 ms. Trace:
I20260709 13:18:21.967851 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.901297 19501 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:21.900243 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.957790 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:21.911084 17397 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.897907 19458 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:21.967561 17322 rpcz_store.cc:276] 0709 13:18:20.951106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.952871 (+  1765us) service_pool.cc:224] Handling call
0709 13:18:20.953241 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.220181 (+266940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.220227 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:21.224506 (+  4279us) log.cc:844] Serialized 26 byte log entry
0709 13:18:21.673224 (+448718us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:21.673260 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.673338 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.961578 (+288240us) raft_consensus.cc:1685] finished
0709 13:18:21.961597 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.961720 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8892,"raft.queue_time_us":78407,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":55706,"thread_start_us":679845,"threads_started":2,"wal-append.queue_time_us":644632}
W20260709 13:18:21.960222 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88114.6us
W20260709 13:18:21.973966 17964 leader_election.cc:336] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.544s (SENT)
I20260709 13:18:21.897887 19081 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.888126 19339 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:21.969972 17393 raft_consensus.cc:2368] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5.
I20260709 13:18:21.989094 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.945307 19402 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:21.965883 17388 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:21.988807 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.989996 17434 leader_election.cc:400] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4.
W20260709 13:18:21.999316 17964 leader_election.cc:336] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.675s (SENT)
I20260709 13:18:21.999619 17434 leader_election.cc:403] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:21.990756 17392 raft_consensus.cc:2410] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:21.993808 19320 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:21.958994 19365 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:21.924736 19515 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.006639 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 284) took 1065 ms. Trace:
I20260709 13:18:22.007079 17392 rpcz_store.cc:276] 0709 13:18:20.945952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.981567 (+1035615us) service_pool.cc:224] Handling call
0709 13:18:22.006570 (+ 25003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707392}
W20260709 13:18:21.998149 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.994549 19406 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.005191 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2266) took 1494 ms. Trace:
I20260709 13:18:22.014257 17397 raft_consensus.cc:2410] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:22.015012 17396 raft_consensus.cc:2410] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:21.968956 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 489) took 1264 ms. Trace:
I20260709 13:18:22.015794 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:22.019819 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 53927.1us
I20260709 13:18:22.020028 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:22.017122 17468 rpcz_store.cc:276] 0709 13:18:20.510417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.808495 (+298078us) service_pool.cc:224] Handling call
0709 13:18:20.837319 (+ 28824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.058255 (+220936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.058307 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:21.059088 (+   781us) log.cc:844] Serialized 26 byte log entry
0709 13:18:21.288969 (+229881us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:21.289013 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.289085 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:22.004925 (+715840us) raft_consensus.cc:1685] finished
0709 13:18:22.004945 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.005117 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30578,"raft.queue_time_us":34648,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":9155,"thread_start_us":415814,"threads_started":2,"wal-append.queue_time_us":943731}
I20260709 13:18:21.969586 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 491) took 1193 ms. Trace:
I20260709 13:18:22.022704 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:22.023319 17392 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.972295 19053 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:22.026829 17998 raft_consensus.cc:2393] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:22.027639 17389 raft_consensus.cc:2410] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:22.033022 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:22.035853 17395 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:22.037302 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:22.038091 17395 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.028615 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:22.046064 17964 leader_election.cc:336] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.729s (SENT)
I20260709 13:18:22.047300 17393 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:22.048746 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:22.050060 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:22.050194 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:22.051203 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:22.051458 17390 raft_consensus.cc:2410] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:22.051658 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:22.052559 17396 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:22.053543 17998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 487) took 1365 ms (client timeout 1771 ms). Trace:
I20260709 13:18:22.053501 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:22.051824 17393 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:22.054252 17998 rpcz_store.cc:269] 0709 13:18:20.688004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.689415 (+  1411us) service_pool.cc:224] Handling call
0709 13:18:22.053292 (+1363877us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54004583d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:22.053476 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2957253888}
W20260709 13:18:22.053483 17964 leader_election.cc:336] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.763s (SENT)
I20260709 13:18:22.048709 17394 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:22.055429 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:22.055557 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2350) took 1149 ms. Trace:
I20260709 13:18:22.056545 17396 raft_consensus.cc:2368] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6.
I20260709 13:18:22.014837 19490 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.057626 17397 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.052446 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:21.962036 19520 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:22.056085 17394 rpcz_store.cc:276] 0709 13:18:20.905834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.905951 (+   117us) service_pool.cc:224] Handling call
0709 13:18:21.651080 (+745129us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:22.055497 (+404417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10291456}
I20260709 13:18:21.962553 19521 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.027280 19501 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:22.059499 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 290) took 1049 ms. Trace:
W20260709 13:18:22.130661 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 77222.7us
I20260709 13:18:22.131305 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:22.072561 17397 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:22.041617 19458 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.050798 19483 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:22.131973 17396 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.130672 17389 rpcz_store.cc:276] 0709 13:18:21.010372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.028334 (+1017962us) service_pool.cc:224] Handling call
0709 13:18:22.059422 (+ 31088us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.019878 17992 rpcz_store.cc:276] 0709 13:18:20.704653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.328396 (+623743us) service_pool.cc:224] Handling call
0709 13:18:21.964803 (+636407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.139127 17389 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:22.020882 19402 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.028615 17994 rpcz_store.cc:276] 0709 13:18:20.775955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.328953 (+552998us) service_pool.cc:224] Handling call
0709 13:18:21.966058 (+637105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:22.142261 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 283727us
I20260709 13:18:22.073294 19522 raft_consensus.cc:2764] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:18:22.143989 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 269304us
I20260709 13:18:22.130539 19320 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.148293 17395 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:22.157670 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.150017 17393 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:22.151259 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2352) took 1235 ms. Trace:
I20260709 13:18:22.151196 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 286) took 1174 ms. Trace:
W20260709 13:18:22.144665 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 111794us
W20260709 13:18:22.167744 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.168045 17397 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:22.159279 17389 rpcz_store.cc:276] 0709 13:18:20.967588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.136043 (+1168455us) service_pool.cc:224] Handling call
0709 13:18:22.138908 (+  2865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.141971 (+  3063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.142227 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.159206 17394 rpcz_store.cc:276] 0709 13:18:20.906496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.130526 (+1224030us) service_pool.cc:224] Handling call
0709 13:18:22.140868 (+ 10342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.141058 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.141088 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.141132 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:22.141166 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.141241 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.141361 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.154837 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:22.173569 17322 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:22.175105 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:22.183841 17963 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.669s (SENT)
I20260709 13:18:22.130601 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:22.187282 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 329750us
I20260709 13:18:22.188038 17435 leader_election.cc:400] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4.
I20260709 13:18:22.188556 17435 leader_election.cc:403] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:22.190287 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 285) took 1231 ms. Trace:
I20260709 13:18:22.190519 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:22.190914 17397 rpcz_store.cc:276] 0709 13:18:20.959224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.136054 (+1176830us) service_pool.cc:224] Handling call
0709 13:18:22.165387 (+ 29333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.168698 (+  3311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.190002 (+ 21304us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b5400253350. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:22.190206 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66543360}
I20260709 13:18:22.187275 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:22.195343 17393 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:22.213495 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:22.214660 17362 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.814s (SENT)
I20260709 13:18:22.215168 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:22.216333 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:22.184417 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:22.218029 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:22.218955 17389 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:22.219722 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 289) took 1229 ms. Trace:
I20260709 13:18:22.220093 17389 rpcz_store.cc:276] 0709 13:18:20.990783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.169279 (+1178496us) service_pool.cc:224] Handling call
0709 13:18:22.218757 (+ 49478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.219444 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.219663 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.074110 19490 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.224074 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:22.223843 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 287) took 1255 ms. Trace:
I20260709 13:18:22.226600 17395 rpcz_store.cc:276] 0709 13:18:20.967975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.156425 (+1188450us) service_pool.cc:224] Handling call
0709 13:18:22.156742 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.187012 (+ 30270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.187051 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.216051 (+ 29000us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:22.223502 (+  7451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.223609 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.223764 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.229394 17397 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:22.201356 17390 raft_consensus.cc:2410] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:22.184808 19483 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.240526 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:22.241048 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53886.7us
W20260709 13:18:22.235913 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 996910us
I20260709 13:18:22.157024 19365 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:18:22.269253 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 85439.6us
I20260709 13:18:22.225662 19522 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.277362 17963 leader_election.cc:336] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.675s (SENT)
I20260709 13:18:22.278053 17963 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:22.271451 17464 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:22.279075 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.135963 19501 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.274958 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:22.277115 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:22.281927 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:22.282526 17470 raft_consensus.cc:2376] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7. Re-sending same reply.
W20260709 13:18:22.281196 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60964us
I20260709 13:18:22.269781 17998 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:18:22.280288 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.284878 17963 leader_election.cc:336] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.890s (SENT)
W20260709 13:18:22.285923 17963 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.075s (SENT)
I20260709 13:18:22.285491 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:22.287525 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:22.285962 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.303242 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.304507 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.305105 17469 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:22.272883 17388 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:22.310256 17321 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:22.305991 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:22.262544 19182 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.072s	user 0.012s	sys 0.000s
I20260709 13:18:22.311556 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.311851 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.312798 17322 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:22.244047 19385 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:22.297724 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 142867us
I20260709 13:18:22.309026 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.319268 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:22.307345 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.320395 17467 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:22.312203 17470 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:22.233587 19496 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:18:22.275321 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:22.323004 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 134750us
I20260709 13:18:22.323185 17471 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:22.296398 19320 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.322892 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:22.269907 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 495) took 1422 ms. Trace:
I20260709 13:18:22.322714 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:22.326731 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.327298 17462 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:22.335927 17462 pending_rounds.cc:85] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 5
I20260709 13:18:22.336189 17462 pending_rounds.cc:107] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:22.336433 17462 raft_consensus.cc:2889] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:22.327961 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:22.337320 17470 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:22.339547 17362 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.860s (SENT)
I20260709 13:18:22.340332 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:22.328166 17321 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:22.276326 19529 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:22.330400 17320 raft_consensus.cc:2410] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:22.316208 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 295) took 1093 ms. Trace:
I20260709 13:18:22.344153 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:22.351382 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 163509us
I20260709 13:18:22.352511 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:22.355751 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:22.273646 19382 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:18:22.315626 19454 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:22.362373 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 96505us
I20260709 13:18:22.358601 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:22.359480 17469 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:22.363508 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.315390 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:22.364750 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 79425.4us
I20260709 13:18:22.263780 19535 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:18:22.300061 19053 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:18:22.368546 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:22.369994 17470 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:22.370584 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:22.354626 19515 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:22.377481 17998 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:22.335448 19528 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4.
I20260709 13:18:22.360488 19532 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:18:22.346109 19540 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:22.358516 19495 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:22.354494 17388 rpcz_store.cc:276] 0709 13:18:21.223081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.056694 (+833613us) service_pool.cc:224] Handling call
0709 13:18:22.316123 (+259429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.909761 17991 rpcz_store.cc:276] 0709 13:18:20.233904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.238079 (+  4175us) service_pool.cc:224] Handling call
0709 13:18:20.603476 (+365397us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfeee 0000000000375939 00007f7d677431e0 00007f7d6780c0c4 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:20.608340 (+  4864us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.621176 (+ 12836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.621225 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.621872 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.871232 (+249360us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:21.222287 (+351055us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.237180 (+ 14893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.289494 (+ 52314us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.326546 (+ 37052us) raft_consensus.cc:1685] finished
0709 13:18:21.326707 (+   161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.326936 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1925,"prepare.queue_time_us":251333,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":90260,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"spinlock_wait_cycles":6664064,"thread_start_us":483538,"threads_started":2,"wal-append.queue_time_us":479037}
I20260709 13:18:22.327121 19505 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:18:22.333841 19543 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:22.389951 17994 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:22.390004 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:22.392127 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:22.410043 17995 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:22.410637 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1140) took 1164 ms. Trace:
I20260709 13:18:22.380681 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:22.389690 19545 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.377687 19382 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:18:22.382259 19521 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:22.393800 19495 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:22.302500 19522 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.390482 19542 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:22.411058 17320 rpcz_store.cc:276] 0709 13:18:21.246146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.246302 (+   156us) service_pool.cc:224] Handling call
0709 13:18:21.957626 (+711324us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfe9c 00007f7d5f6cfa5b 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:22.410468 (+452842us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b540036a454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:22.410579 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847138176}
I20260709 13:18:22.413233 17318 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
W20260709 13:18:22.404592 17964 leader_election.cc:336] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.086s (SENT)
I20260709 13:18:22.406304 19402 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:22.390115 19536 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:18:22.438793 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:22.457099 17995 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:18:22.402467 19515 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:22.462005 17466 raft_consensus.cc:2376] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5. Re-sending same reply.
I20260709 13:18:22.459815 19529 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:22.467209 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 98148.7us
I20260709 13:18:22.470148 17392 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:22.430433 19531 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:22.482759 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 100444us
W20260709 13:18:22.488178 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 96825.4us
I20260709 13:18:22.488121 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:22.416077 19520 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:22.492571 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 198667us
I20260709 13:18:22.493373 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:22.483054 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:22.435786 19547 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:22.499852 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:22.500742 17999 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:22.495638 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:22.414964 19546 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:18:22.429539 19543 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:22.506219 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:22.508884 17995 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:22.488117 19528 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:22.492158 17992 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:22.438242 19545 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:18:22.489244 19490 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:22.514233 19552 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:22.514652 19544 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.515542 19544 raft_consensus.cc:2764] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:22.514720 19552 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:22.524936 17396 raft_consensus.cc:2410] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:18:22.538959 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 56041.2us
I20260709 13:18:22.542716 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:22.456143 19542 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:22.523422 19530 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.190s	user 0.001s	sys 0.001s
W20260709 13:18:22.538722 19533 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:18:22.516670 19501 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:22.528798 19537 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.517052 19550 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.546130 19454 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:22.557811 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:22.560973 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:22.545172 19531 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:22.562522 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:22.540256 19554 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.571455 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:22.560971 19529 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:22.575479 19382 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.576303 19483 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:22.529250 19528 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:22.601871 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 86060.8us
W20260709 13:18:22.602798 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.569962 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:22.579699 19531 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:22.576740 19483 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:22.587153 19520 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.587685 19339 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:22.588064 19385 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:22.588414 19454 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.589054 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:22.590687 19220 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.004s
W20260709 13:18:22.590945 19534 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:18:22.587746 19532 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:22.592381 19543 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:22.598946 19453 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.000s
I20260709 13:18:22.599787 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:22.566084 19501 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.569027 19496 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.550995 19541 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:22.544600 19544 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:22.613505 17998 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:22.333878 17990 rpcz_store.cc:276] 0709 13:18:20.847437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.919253 (+1071816us) service_pool.cc:224] Handling call
0709 13:18:21.919683 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.919968 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:21.920439 (+   471us) log.cc:844] Serialized 14 byte log entry
0709 13:18:22.201660 (+281221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.215968 (+ 14308us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:22.226030 (+ 10062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.236597 (+ 10567us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.264248 (+ 27651us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4548,"prepare.queue_time_us":8173,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":19871,"raft.queue_time_us":6294,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":18398,"thread_start_us":221433,"threads_started":1,"wal-append.queue_time_us":482597}
I20260709 13:18:22.566898 19557 raft_consensus.cc:2764] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:22.581355 19345 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.578352 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:22.630652 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 316445us
W20260709 13:18:22.632066 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 68369.6us
I20260709 13:18:22.544631 19495 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.567164 19537 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:22.567217 19550 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:22.603760 19552 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:22.642620 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 318679us
W20260709 13:18:22.682595 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 93628.2us
W20260709 13:18:22.746510 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.778298 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:22.642906 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 103186us
W20260709 13:18:22.756686 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 390676us
I20260709 13:18:22.777657 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:22.784138 17319 raft_consensus.cc:2410] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:18:22.736562 17435 leader_election.cc:336] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.835s (SENT)
I20260709 13:18:22.787453 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:22.787333 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:22.667179 19458 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
W20260709 13:18:22.667062 18962 consensus_meta.cc:287] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.000s
I20260709 13:18:22.783241 19220 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.803318 17314 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:22.801218 19568 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:18:22.802232 19495 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.639715 19540 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:22.809329 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:22.802496 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:22.810202 17397 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
W20260709 13:18:22.667896 17391 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.769s	user 0.005s	sys 0.005s
W20260709 13:18:22.684379 19549 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 13:18:22.667402 19538 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
W20260709 13:18:22.805364 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 205648us
I20260709 13:18:22.633031 19385 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:22.812173 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:22.812474 19220 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:22.778415 19501 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:22.813337 19501 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.813176 19385 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.814443 19385 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.778939 19496 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.682837 19564 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:22.785576 19406 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:22.811825 19382 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:22.805053 19529 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:22.709705 19522 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:22.726229 19565 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:22.658434 19547 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:22.817669 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:22.793694 19339 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.824508 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:22.824445 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:22.840662 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 115389us
I20260709 13:18:22.824172 19496 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.827643 19532 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:22.828259 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47216.1us
I20260709 13:18:22.831211 19564 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.834052 19345 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.829375 19490 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.802263 17390 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:22.832484 17997 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:22.812423 19568 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:22.632709 19520 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.835314 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:22.881731 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 104483us
I20260709 13:18:22.805876 19458 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4.
I20260709 13:18:22.822064 19557 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.839110 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:22.841202 17999 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
W20260709 13:18:22.841439 17435 leader_election.cc:336] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.889s (SENT)
I20260709 13:18:22.841984 17389 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:22.818089 17391 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:22.828680 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:22.663722 19483 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.829002 19554 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.812490 19320 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:18:22.838414 19522 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:22.898484 17362 leader_election.cc:336] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.015s (SENT)
I20260709 13:18:22.898504 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:22.876168 17991 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:22.872717 19564 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.875772 19339 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.881698 19568 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:22.962441 17362 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:22.963344 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 134722us
I20260709 13:18:23.003403 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:22.840096 19565 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:22.741300 19531 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.895960 19453 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:18:23.027882 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:22.902161 19543 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.959278 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2349) took 2051 ms. Trace:
I20260709 13:18:22.901640 19546 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 13:18:23.002003 19483 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.007067 19458 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.067960 17468 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:22.972707 19365 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:18:22.962898 19536 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:23.082437 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 200013us
W20260709 13:18:23.083583 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 242148us
W20260709 13:18:23.084470 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 272304us
W20260709 13:18:23.086225 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 129514us
I20260709 13:18:23.089169 19575 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:23.089600 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.094961 19550 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:23.065255 17391 rpcz_store.cc:276] 0709 13:18:20.905414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.953104 (+ 47690us) service_pool.cc:224] Handling call
0709 13:18:22.956538 (+2003434us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:23.104419 17435 leader_election.cc:336] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.909s (SENT)
I20260709 13:18:23.136970 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:23.104825 17362 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.030s (SENT)
I20260709 13:18:23.137831 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:23.098660 19536 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:23.080018 19382 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:23.104951 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 77192.5us
I20260709 13:18:23.117971 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:22.895568 19540 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:23.098505 19543 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:23.079008 19553 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:23.141628 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:23.144855 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46101.2us
W20260709 13:18:23.145364 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 306280us
I20260709 13:18:23.151192 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:23.085142 19458 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:22.982508 19554 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:23.141379 19577 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:18:23.186105 17435 leader_election.cc:336] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.157s (SENT)
I20260709 13:18:23.186823 17435 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:23.190836 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 92503.7us
I20260709 13:18:23.192586 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:23.192919 17362 connection.cc:256] RPC call timeout handler was delayed by -1.1262562260001232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24460000000000004s for a response
W20260709 13:18:23.193657 17362 leader_election.cc:336] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.084s (SENT)
I20260709 13:18:23.190419 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:23.138181 19529 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:23.205365 17322 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:23.109630 19501 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:23.144881 19553 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.206238 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:23.006454 19547 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:23.225725 17462 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:23.066665 19532 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:23.227137 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:23.227818 17996 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:23.215912 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:23.215973 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:23.216789 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 438533us
I20260709 13:18:23.218828 17321 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:23.219687 17362 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.120s (SENT)
I20260709 13:18:23.231148 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:23.231210 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:23.157684 19550 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:23.188699 19081 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.189s	user 0.005s	sys 0.009s
I20260709 13:18:23.182642 19320 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:23.230086 17463 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:23.233316 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:23.235013 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:23.235157 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:23.235600 17319 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.236467 17318 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:23.235234 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:23.194816 19566 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.206372 19339 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.242558 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:23.206691 19543 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:23.093492 19568 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:23.188858 19591 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:23.194950 19586 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:23.250304 17315 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:23.250803 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58284.5us
W20260709 13:18:23.251698 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.244216 17998 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:23.244552 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58503.1us
I20260709 13:18:23.246152 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:23.219741 19553 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.195969 19531 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.238936 19053 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.233564 19536 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:23.388070 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:23.532563 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 294370us
W20260709 13:18:23.269121 17435 leader_election.cc:336] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.312s (SENT)
I20260709 13:18:23.733709 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:23.639580 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.470923 17319 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:23.243304 19544 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:23.537737 19567 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:18:23.806233 17462 raft_consensus.cc:2410] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:23.257611 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:23.248478 19520 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:23.666623 19385 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.002s
W20260709 13:18:23.703131 19595 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:18:23.541572 19582 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 13:18:23.702171 19501 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:23.258070 19550 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.654s
I20260709 13:18:23.537415 19583 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.697s
W20260709 13:18:24.224005 19320 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.012s	sys 0.020s
W20260709 13:18:24.395414 19320 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.015s	sys 0.029s
I20260709 13:18:23.990648 19554 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:23.399063 17470 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:24.396202 19320 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:23.549203 17321 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:23.983870 19522 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:24.396951 19559 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.705752 19483 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.001s
I20260709 13:18:23.468264 17996 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:23.534804 19502 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:23.398694 19566 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.467465 19565 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:23.537362 19596 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.532513 19584 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 1.304s
I20260709 13:18:23.483055 19529 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:24.397363 19320 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:23.388032 19568 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:23.885627 17465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.009s	sys 0.005s
I20260709 13:18:24.397048 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 396) took 1192 ms. Trace:
W20260709 13:18:24.494168 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 763273us
W20260709 13:18:24.501798 17465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.017s	sys 0.021s
I20260709 13:18:24.501861 17321 rpcz_store.cc:276] 0709 13:18:23.204731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.205945 (+  1214us) service_pool.cc:224] Handling call
0709 13:18:24.396983 (+1191038us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:23.935920 17963 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.008s	sys 0.013s
W20260709 13:18:24.275411 19496 consensus_meta.cc:287] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.402s	user 0.011s	sys 0.002s
W20260709 13:18:23.935707 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.001s	sys 0.018s
I20260709 13:18:23.537281 19571 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.452872 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 497) took 1652 ms. Trace:
W20260709 13:18:24.404445 17362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.167s	user 0.005s	sys 0.006s
I20260709 13:18:24.404800 19542 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:24.405583 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.004s	sys 0.006s
W20260709 13:18:24.310051 19495 consensus_meta.cc:287] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.489s	user 0.009s	sys 0.003s
I20260709 13:18:23.703783 19585 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.811661 19543 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:24.493140 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2360) took 1676 ms. Trace:
W20260709 13:18:24.352392 19564 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.346s	user 0.010s	sys 0.000s
I20260709 13:18:23.701864 19578 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:24.451932 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 951813us
W20260709 13:18:24.224416 17467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.000s	sys 0.032s
I20260709 13:18:24.398092 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 392) took 1198 ms. Trace:
W20260709 13:18:24.502723 17963 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.008s	sys 0.037s
I20260709 13:18:24.401247 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 671) took 1205 ms. Trace:
I20260709 13:18:23.537706 19563 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:24.503665 17362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.266s	user 0.006s	sys 0.006s
I20260709 13:18:24.502205 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:24.450702 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 315) took 1155 ms. Trace:
W20260709 13:18:24.225863 19345 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.016s	sys 0.029s
W20260709 13:18:24.520764 17962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.263s	user 0.005s	sys 0.017s
W20260709 13:18:24.652988 17962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.396s	user 0.006s	sys 0.017s
W20260709 13:18:24.653424 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 1.39608e+06us
I20260709 13:18:24.647356 17462 rpcz_store.cc:276] 0709 13:18:23.245464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.256565 (+ 11101us) service_pool.cc:224] Handling call
0709 13:18:24.400458 (+1143893us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:24.655033 17962 connection.cc:256] RPC call timeout handler was delayed by -1.130012324000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
I20260709 13:18:24.255201 19402 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:23.935799 19535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.011s
I20260709 13:18:23.875968 19536 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:24.503903 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.004s	sys 0.006s
W20260709 13:18:24.503255 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.276s	user 0.015s	sys 0.029s
W20260709 13:18:24.795979 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 1.56917e+06us
W20260709 13:18:24.244664 19593 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.833s	user 0.001s	sys 0.001s
W20260709 13:18:24.237265 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.679838 19345 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.217s	user 0.024s	sys 0.037s
I20260709 13:18:23.929553 19575 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.817116 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:24.520360 17998 rpcz_store.cc:276] 0709 13:18:22.800565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.800753 (+   188us) service_pool.cc:224] Handling call
0709 13:18:22.816592 (+ 15839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.255506 (+438914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.452532 (+1197026us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54006054d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:24.452786 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983046016}
W20260709 13:18:24.655557 17962 connection.cc:256] RPC call timeout handler was delayed by -1.0332239310000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
I20260709 13:18:24.405438 19589 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:24.683702 19535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.295s	user 0.021s	sys 0.036s
I20260709 13:18:24.405633 19502 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:23.907464 19531 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:24.457258 19522 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.885180 19531 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:24.887856 19531 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:24.522622 19553 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.166s	user 0.004s	sys 0.007s
I20260709 13:18:24.888677 19553 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.891724 19553 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:23.525969 19592 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 1.034s
I20260709 13:18:24.893841 19589 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:24.686124 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 183963us
I20260709 13:18:24.689054 19570 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:24.678872 19402 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:24.075032 19588 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:24.695683 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2288) took 1496 ms. Trace:
W20260709 13:18:24.650656 19582 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:18:24.698060 17314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1138) took 3478 ms (client timeout 1550 ms). Trace:
W20260709 13:18:24.698912 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 1.47911e+06us
I20260709 13:18:24.915802 19402 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:24.705662 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:24.917025 19402 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.917189 17462 raft_consensus.cc:2376] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5. Re-sending same reply.
W20260709 13:18:24.917902 17462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 316) took 1672 ms (client timeout 2132 ms). Trace:
W20260709 13:18:24.918304 17462 rpcz_store.cc:269] 0709 13:18:23.246970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.705284 (+1458314us) service_pool.cc:224] Handling call
0709 13:18:24.917833 (+212549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.530809 19496 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.869174 19617 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.871654 19583 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.929273 17992 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:24.405622 19559 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.929569 19583 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.679961 19564 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.461308 19458 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:24.932197 19613 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.932929 19613 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.712031 19543 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:24.522418 17313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 394) took 1313 ms (client timeout 1695 ms). Trace:
W20260709 13:18:24.934809 17313 rpcz_store.cc:269] 0709 13:18:23.203934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.209281 (+  5347us) service_pool.cc:224] Handling call
0709 13:18:24.516761 (+1307480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.679041 19585 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:24.406141 19053 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:24.721467 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2291) took 1521 ms. Trace:
I20260709 13:18:24.937491 19585 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:24.936421 17464 rpcz_store.cc:276] 0709 13:18:23.209297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.236336 (+ 27039us) service_pool.cc:224] Handling call
0709 13:18:23.248894 (+ 12558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.249233 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.249273 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.356435 (+107162us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.486019 (+129584us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:23.486070 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.486173 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.721151 (+1234978us) raft_consensus.cc:1685] finished
0709 13:18:24.721184 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.721383 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":626125,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":77808,"thread_start_us":46242,"threads_started":1,"wal-append.queue_time_us":1319201}
I20260709 13:18:24.938459 19617 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:24.364709 19339 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.117s	user 0.010s	sys 0.000s
W20260709 13:18:24.737222 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49439.6us
W20260709 13:18:24.520587 19540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.000s	sys 0.022s
I20260709 13:18:24.648339 17319 rpcz_store.cc:276] 0709 13:18:23.203108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.215577 (+ 12469us) service_pool.cc:224] Handling call
0709 13:18:24.398036 (+1182459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.878535 19619 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:24.797008 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:24.957230 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 160383us
I20260709 13:18:24.520592 17392 rpcz_store.cc:276] 0709 13:18:22.816507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.816865 (+   358us) service_pool.cc:224] Handling call
0709 13:18:22.817181 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.831740 (+ 14559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.831787 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:22.832350 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.243022 (+410672us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:23.243096 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.243230 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.492907 (+1249677us) raft_consensus.cc:1685] finished
0709 13:18:24.492929 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.493074 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5022,"raft.queue_time_us":5162,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3206,"thread_start_us":360192,"threads_started":1,"wal-append.queue_time_us":551307}
I20260709 13:18:24.805186 19365 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.879200 19495 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:24.884379 17993 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:24.967268 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:24.967788 17396 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:24.968053 17394 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:24.727339 19454 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.914454 19522 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:24.900440 17469 rpcz_store.cc:276] 0709 13:18:23.199296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.216900 (+ 17604us) service_pool.cc:224] Handling call
0709 13:18:23.217223 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.230523 (+ 13300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.230577 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.237774 (+  7197us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.770018 (+532244us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:23.770075 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.770148 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.695354 (+925206us) raft_consensus.cc:1685] finished
0709 13:18:24.695396 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.695595 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":17054,"thread_start_us":371504,"threads_started":1,"wal-append.queue_time_us":1251924}
W20260709 13:18:24.920950 17286 connection.cc:256] RPC call timeout handler was delayed by -1.2197089930000402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3085s for a response
I20260709 13:18:24.971472 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:24.962430 19588 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:24.450918 17388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.003s	sys 0.009s
I20260709 13:18:24.679574 19563 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.938898 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:24.896068 19610 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:24.227340 17964 leader_election.cc:336] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.831s (SENT)
I20260709 13:18:24.982239 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:24.982497 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:24.982882 17464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 321) took 1731 ms (client timeout 2213 ms). Trace:
W20260709 13:18:24.983116 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 755740us
W20260709 13:18:24.983271 17464 rpcz_store.cc:269] 0709 13:18:23.251869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.938615 (+1686746us) service_pool.cc:224] Handling call
0709 13:18:24.982822 (+ 44207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:24.977725 17388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.721s	user 0.013s	sys 0.016s
I20260709 13:18:24.919600 19570 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:24.956300 19540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.413s	user 0.001s	sys 0.028s
W20260709 13:18:24.915400 17314 rpcz_store.cc:269] 0709 13:18:21.219261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.222781 (+  3520us) service_pool.cc:224] Handling call
0709 13:18:24.697750 (+3474969us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54001414d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:24.697944 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071528320}
I20260709 13:18:24.503666 19571 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.964701 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2285) took 1766 ms. Trace:
I20260709 13:18:24.932233 19564 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:24.970865 17389 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:18:24.991081 17389 pending_rounds.cc:85] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 4
W20260709 13:18:24.927388 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 1.67124e+06us
I20260709 13:18:24.972183 17393 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:24.991624 17389 pending_rounds.cc:107] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:18:24.927680 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:24.958693 19339 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:24.975107 17469 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:24.964625 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:24.978477 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:24.993994 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 318) took 1746 ms. Trace:
I20260709 13:18:24.979864 19613 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:24.973804 18962 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.977846 19588 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:24.973876 17993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 673) took 1447 ms (client timeout 1641 ms). Trace:
I20260709 13:18:24.985040 19501 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.983287 17394 raft_consensus.cc:2376] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4. Re-sending same reply.
I20260709 13:18:24.986104 19570 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.994350 17469 rpcz_store.cc:276] 0709 13:18:23.249181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.974439 (+1725258us) service_pool.cc:224] Handling call
0709 13:18:24.974834 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.993711 (+ 18877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.993921 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:24.995340 17435 leader_election.cc:336] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.362s (SENT)
I20260709 13:18:24.971951 19495 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.990847 17471 rpcz_store.cc:276] 0709 13:18:23.198141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.216436 (+ 18295us) service_pool.cc:224] Handling call
0709 13:18:23.239112 (+ 22676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.244130 (+  5018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.244174 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.363626 (+119452us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.929641 (+566015us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:23.929709 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.929816 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.964436 (+1034620us) raft_consensus.cc:1685] finished
0709 13:18:24.964463 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.964643 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4617,"raft.queue_time_us":5073,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":3723,"thread_start_us":477709,"threads_started":1,"wal-append.queue_time_us":1487699}
I20260709 13:18:25.005020 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:25.004700 17469 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:25.006953 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 320) took 1755 ms. Trace:
I20260709 13:18:25.007510 17469 rpcz_store.cc:276] 0709 13:18:23.251496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.004035 (+1752539us) service_pool.cc:224] Handling call
0709 13:18:25.004440 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.006417 (+  1977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.006700 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:25.010483 17469 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:25.011387 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 322) took 1759 ms. Trace:
I20260709 13:18:25.011886 17469 rpcz_store.cc:276] 0709 13:18:23.252367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.009776 (+1757409us) service_pool.cc:224] Handling call
0709 13:18:25.010158 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.011061 (+   903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.011302 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.996184 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:24.648422 19578 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:24.970474 19365 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.992091 17389 raft_consensus.cc:2889] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:24.999760 17462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 317) took 1752 ms (client timeout 2215 ms). Trace:
I20260709 13:18:24.985121 19592 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:18:25.107323 17462 rpcz_store.cc:269] 0709 13:18:23.247434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.927261 (+1679827us) service_pool.cc:224] Handling call
0709 13:18:24.999685 (+ 72424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.995766 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 319) took 1742 ms. Trace:
I20260709 13:18:25.013984 17396 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:24.974208 19454 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:24.960556 19619 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:25.002779 17993 rpcz_store.cc:269] 0709 13:18:23.526365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.663785 (+137420us) service_pool.cc:224] Handling call
0709 13:18:24.972092 (+1308307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.974105 19502 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:25.003059 19588 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.014883 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2356) took 2219 ms. Trace:
I20260709 13:18:24.999827 19613 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.018738 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:25.002918 18962 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:25.027688 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 323) took 1775 ms. Trace:
I20260709 13:18:25.038203 19617 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.038414 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.040421 19571 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.040184 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:25.042652 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 672) took 1846 ms. Trace:
I20260709 13:18:25.052434 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:25.052695 17435 leader_election.cc:336] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.455s (SENT)
I20260709 13:18:24.985040 19610 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:25.053712 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:25.021111 19522 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.030463 19563 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.030181 19495 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:25.059042 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:25.065217 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 187246us
I20260709 13:18:25.061867 19583 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:25.089066 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 1.83655e+06us
W20260709 13:18:25.209379 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.211419 17963 leader_election.cc:336] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.946s (SENT)
I20260709 13:18:25.211894 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:25.090054 17996 rpcz_store.cc:276] 0709 13:18:23.195773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.196153 (+   380us) service_pool.cc:224] Handling call
0709 13:18:24.401189 (+1205036us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:25.088685 17467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.733s	user 0.013s	sys 0.061s
W20260709 13:18:25.097568 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.213505 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.108407 17464 rpcz_store.cc:276] 0709 13:18:23.249655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.984025 (+1734370us) service_pool.cc:224] Handling call
0709 13:18:24.990024 (+  5999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.990240 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.990276 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.990331 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:24.990428 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.990503 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.992085 (+  1582us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:25.089815 19598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.012s	sys 0.012s
I20260709 13:18:25.116266 19592 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:25.117910 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 201583us
I20260709 13:18:25.125509 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:25.106053 19531 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.151643 17394 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:25.108240 19578 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.151005 17471 rpcz_store.cc:276] 0709 13:18:23.252681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.021669 (+1768988us) service_pool.cc:224] Handling call
0709 13:18:25.027193 (+  5524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.027375 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.027399 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.027437 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:25.027474 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.027534 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.027632 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:25.157182 17322 raft_consensus.cc:2376] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5. Re-sending same reply.
I20260709 13:18:25.156605 17998 rpcz_store.cc:276] 0709 13:18:23.196483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.871641 (+1675158us) service_pool.cc:224] Handling call
0709 13:18:24.874821 (+  3180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.875044 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:24.875332 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.042209 (+166877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.042279 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:25.042346 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.042432 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.042583 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1744,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":2432,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":8677,"thread_start_us":166481,"threads_started":1,"wal-append.queue_time_us":230412}
I20260709 13:18:25.159415 19502 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.161703 19365 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.163837 19454 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.128577 19458 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:25.174564 17314 raft_consensus.cc:2376] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5. Re-sending same reply.
I20260709 13:18:25.184057 18962 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.188292 19563 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.254391 19563 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:25.226549 19505 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:25.255326 19505 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:25.188895 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.258597 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:25.259361 17392 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:25.190632 17286 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:25.260236 19621 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:18:25.191135 19543 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.261209 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:25.262084 17464 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:25.261883 19543 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:25.263368 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:25.193809 19571 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:25.196942 19550 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.200234 17995 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:25.226385 19053 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:25.200626 19617 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:25.270551 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 80026.9us
I20260709 13:18:25.242373 19545 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.214741 17964 leader_election.cc:336] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.132s (SENT)
W20260709 13:18:25.275830 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 61126.1us
W20260709 13:18:25.226958 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 194654us
W20260709 13:18:25.227922 17362 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.191s (SENT)
W20260709 13:18:25.276655 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.276926 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.235510 19583 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:25.247247 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:25.276394 17964 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.215s (SENT)
I20260709 13:18:25.278605 17996 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.245232 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:25.225658 19598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.012s	sys 0.012s
I20260709 13:18:25.151373 19613 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:25.280488 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:25.281104 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:25.238261 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:25.253034 19458 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:25.266902 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 78109.5us
I20260709 13:18:25.264942 19566 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:25.286990 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.236440 19402 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.206301 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:25.273782 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2293) took 2041 ms. Trace:
I20260709 13:18:25.269160 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:25.274864 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:25.256628 19563 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:25.276381 19454 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:25.232268 17963 connection.cc:256] RPC call timeout handler was delayed by -1.3482894429998851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 13:18:25.246117 19616 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.282673 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.285750 17435 connection.cc:256] RPC call timeout handler was delayed by -2.1282474660001753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
I20260709 13:18:25.285547 17995 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:25.286077 19591 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.242409 19495 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:18:25.242623 19529 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.289553 17467 rpcz_store.cc:276] 0709 13:18:23.232502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.238378 (+  5876us) service_pool.cc:224] Handling call
0709 13:18:23.248095 (+  9717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.248284 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:25.213384 (+1965100us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.273339 (+ 59955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.273412 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:25.273476 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.273559 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.273704 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1402154,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":100,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7302,"thread_start_us":1917266,"threads_started":2}
W20260709 13:18:25.293084 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 65192.3us
W20260709 13:18:25.303238 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.295058 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.277916 18962 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:25.243777 19531 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:25.296281 17963 connection.cc:256] RPC call timeout handler was delayed by -1.2504867009999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 13:18:25.298882 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 670) took 2105 ms. Trace:
W20260709 13:18:25.305312 17963 connection.cc:256] RPC call timeout handler was delayed by -1.1640867009998601s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 13:18:25.305724 17963 connection.cc:256] RPC call timeout handler was delayed by -1.1020010899999306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 13:18:25.306396 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:25.277129 19617 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:25.288276 19382 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:25.276597 19550 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:25.301349 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:25.307358 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:25.310865 19633 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:18:25.312728 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:25.297116 19454 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.318269 17998 raft_consensus.cc:2376] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6. Re-sending same reply.
I20260709 13:18:25.319121 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:25.325127 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:25.325531 17467 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:25.319217 17464 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:25.305361 17999 rpcz_store.cc:276] 0709 13:18:23.189859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.189996 (+   137us) service_pool.cc:224] Handling call
0709 13:18:25.199299 (+2009303us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfe9c 00007f7d5f6cfa5b 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:25.199501 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.199731 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:25.200049 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.295343 (+ 95294us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.295391 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:25.295428 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.295493 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.295605 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":157,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":86,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7639,"spinlock_wait_cycles":9632896,"thread_start_us":94952,"threads_started":1}
I20260709 13:18:25.327713 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.329331 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 499) took 2825 ms. Trace:
I20260709 13:18:25.289553 19320 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:18:25.282207 19545 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:25.338548 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.332765 17997 rpcz_store.cc:276] 0709 13:18:22.504384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.508476 (+  4092us) service_pool.cc:224] Handling call
0709 13:18:22.592214 (+ 83738us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:22.592458 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.880628 (+288170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.329013 (+2448385us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54002afdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:25.329248 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541602432}
I20260709 13:18:25.353650 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:25.355136 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:25.369946 17464 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:25.313041 19339 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:25.313643 19574 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:25.330439 19220 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:25.331382 19627 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:25.357880 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:25.380014 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 70845.1us
I20260709 13:18:25.359239 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:25.300680 19616 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:25.360150 19545 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.360654 19613 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:25.361050 19629 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 13:18:25.361967 19638 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:18:25.362483 19550 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.365165 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:25.366083 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 67896.8us
I20260709 13:18:25.366889 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:25.393060 17435 connection.cc:256] RPC call timeout handler was delayed by -1.8640744970000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32610000000000006s for a response
I20260709 13:18:25.393288 17394 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:25.318645 18962 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:25.295945 19566 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:25.360185 19617 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:25.324397 17993 raft_consensus.cc:2410] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:25.295185 19402 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:25.332113 19454 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.381090 17997 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:25.383046 19627 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:25.389158 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:25.313517 19529 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:25.394541 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:25.392454 17999 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
W20260709 13:18:25.398713 17435 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.740s (SENT)
I20260709 13:18:25.366007 19458 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:25.385943 19623 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:18:25.373427 19339 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:25.373718 19574 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:25.368885 17996 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:25.407704 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:25.392365 19320 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:25.388314 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:25.390131 19382 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:25.418025 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.417126 17464 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:25.418663 17394 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:25.411345 17467 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:25.413261 19627 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.415252 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:25.415757 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:25.419212 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 97541.1us
I20260709 13:18:25.421700 17997 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
W20260709 13:18:25.414259 19596 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.763s	user 0.012s	sys 0.000s
W20260709 13:18:25.427579 17468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 295) took 3148 ms (client timeout 2215 ms). Trace:
W20260709 13:18:25.428478 17468 rpcz_store.cc:269] 0709 13:18:22.274573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.274698 (+   125us) service_pool.cc:224] Handling call
0709 13:18:25.423163 (+3148465us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b540020f654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:25.423253 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556429696}
I20260709 13:18:25.429423 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:25.429915 17464 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:25.403724 19619 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:25.431459 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:25.427893 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:25.431839 17963 leader_election.cc:336] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.213s (SENT)
I20260709 13:18:25.418686 19339 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.433401 17394 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.433624 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:25.436182 19537 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:25.437088 17435 connection.cc:256] RPC call timeout handler was delayed by -1.6413458879999325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
W20260709 13:18:25.448256 17435 connection.cc:256] RPC call timeout handler was delayed by -1.34935892600015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:18:25.448604 17435 connection.cc:256] RPC call timeout handler was delayed by -1.2818129660001887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 13:18:25.448900 17435 connection.cc:256] RPC call timeout handler was delayed by -1.1430443470001137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 13:18:25.437203 19382 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:25.450409 17435 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.512s (SENT)
I20260709 13:18:25.426101 17390 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 1.
I20260709 13:18:25.425379 19495 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:18:25.451313 19550 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.416828 19501 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.451838 19550 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:25.452425 18962 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:25.452461 19501 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:25.454038 19573 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 2.399s	user 0.010s	sys 0.028s
I20260709 13:18:25.420162 19220 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:25.454918 17996 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:18:25.445503 17464 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:25.450812 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:25.453938 19550 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:25.447095 19402 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.430953 19458 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.470801 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:25.429039 19320 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:25.470736 17435 leader_election.cc:336] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.608s (SENT)
I20260709 13:18:25.439153 19592 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:25.480219 17963 leader_election.cc:336] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.701s (SENT)
I20260709 13:18:25.481997 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:25.452685 19543 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:25.439082 19596 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.484517 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:25.485816 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 325) took 2232 ms. Trace:
I20260709 13:18:25.486954 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.440166 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 326) took 2186 ms. Trace:
I20260709 13:18:25.124773 17388 rpcz_store.cc:276] 0709 13:18:22.795602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.798305 (+  2703us) service_pool.cc:224] Handling call
0709 13:18:22.803197 (+  4892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.803396 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:22.844023 (+ 40627us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.987983 (+2143960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.989829 (+  1846us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:24.995744 (+  5915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.999336 (+  3592us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.013525 (+ 14189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":152698,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":967,"raft.queue_time_us":1152615,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":150,"thread_start_us":2164993,"threads_started":3,"wal-append.queue_time_us":1030944,"wal-append.run_cpu_time_us":1621,"wal-append.run_wall_time_us":1168149}
I20260709 13:18:25.528503 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:25.529968 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.486335 17462 rpcz_store.cc:276] 0709 13:18:23.253213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.108075 (+1854862us) service_pool.cc:224] Handling call
0709 13:18:25.128532 (+ 20457us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:25.128958 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.128989 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:25.150430 (+ 21441us) log.cc:844] Serialized 52 byte log entry
0709 13:18:25.293746 (+143316us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:25.293774 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.293822 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.485583 (+191761us) raft_consensus.cc:1685] finished
0709 13:18:25.485615 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.485762 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":20630,"thread_start_us":53544,"threads_started":1,"wal-append.queue_time_us":183106}
I20260709 13:18:25.470322 19522 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.470495 19220 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:25.485116 19639 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:18:25.504210 17467 rpcz_store.cc:276] 0709 13:18:23.253429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.423450 (+2170021us) service_pool.cc:224] Handling call
0709 13:18:25.439837 (+ 16387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.439962 (+   125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.439978 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.440006 (+    28us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:25.440024 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.440056 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.440128 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:25.479632 19495 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.523355 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:25.523993 19599 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.455s	user 0.031s	sys 0.032s
W20260709 13:18:25.531522 19643 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:18:25.532063 19645 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:25.535663 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:25.535799 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 65094us
I20260709 13:18:25.541344 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 664) took 3051 ms. Trace:
W20260709 13:18:25.520033 19536 consensus_meta.cc:287] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.001s
I20260709 13:18:25.546996 17394 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:25.477447 19570 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:25.551920 17435 leader_election.cc:336] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.682s (SENT)
I20260709 13:18:25.599177 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:25.534440 19543 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.520219 19592 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.524888 19616 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.606528 19558 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.540871 19537 raft_consensus.cc:2764] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:25.552554 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:25.539981 19531 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:25.595620 19617 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.538756 19220 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.542217 19402 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:25.551087 19529 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:25.611856 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.606570 19610 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:25.614784 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62914.1us
W20260709 13:18:25.697633 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 145297us
W20260709 13:18:25.698145 17435 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.716s (SENT)
I20260709 13:18:25.698563 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:25.537971 19591 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.548300 19645 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:25.479307 19574 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:25.609762 19634 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:18:25.607164 19558 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:25.613794 17462 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:18:25.610442 19501 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:25.610245 19522 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.698565 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.711308 19596 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.702693 19645 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.713429 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.714821 19610 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:25.717206 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.720273 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.686611 19543 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:25.725277 17435 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.777s (SENT)
I20260709 13:18:25.725739 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:25.700766 19548 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.637s	user 0.030s	sys 0.069s
I20260709 13:18:25.735849 17396 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:25.687548 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:25.733204 19548 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.834s	user 0.031s	sys 0.069s
I20260709 13:18:25.742303 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.743161 17394 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:25.750304 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.728163 19531 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:25.738445 19600 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.665s	user 0.015s	sys 0.016s
I20260709 13:18:25.732362 19610 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:25.757730 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.755285 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:25.760766 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:25.738298 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.763715 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.765342 17394 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:25.744753 19543 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:25.751245 19402 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.686342 19320 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:25.776983 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:25.778307 17464 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:25.772053 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:25.772699 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 324) took 2519 ms. Trace:
I20260709 13:18:25.748709 19529 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.763425 19647 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:25.749296 17388 raft_consensus.cc:2376] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6. Re-sending same reply.
I20260709 13:18:25.766680 19495 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:25.821363 17469 rpcz_store.cc:276] 0709 13:18:23.252992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.107843 (+1854851us) service_pool.cc:224] Handling call
0709 13:18:25.108333 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.108861 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.108905 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.114652 (+  5747us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.155845 (+ 41193us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:25.155884 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.155929 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.772463 (+616534us) raft_consensus.cc:1685] finished
0709 13:18:25.772496 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.772636 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9058,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4682,"thread_start_us":40833,"threads_started":1,"wal-append.queue_time_us":168891}
I20260709 13:18:25.821190 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.827663 17394 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:25.828962 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.829891 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:25.830818 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:25.831442 17394 raft_consensus.cc:2410] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:25.832094 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.832540 17394 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:25.823148 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:25.839715 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:25.834702 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2361) took 3009 ms. Trace:
I20260709 13:18:25.844897 17394 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:25.774533 17391 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:25.596638 17994 rpcz_store.cc:276] 0709 13:18:22.490194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.493335 (+  3141us) service_pool.cc:224] Handling call
0709 13:18:22.523255 (+ 29920us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.526776 (+  3521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.526817 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:22.527406 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.834838 (+307432us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:22.835373 (+   535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.842213 (+  6840us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.453481 (+2611268us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:25.517353 (+ 63872us) raft_consensus.cc:1685] finished
0709 13:18:25.519542 (+  2189us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.541288 (+ 21746us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":207,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":18016640,"thread_start_us":289607,"threads_started":1,"wal-append.queue_time_us":368849}
I20260709 13:18:25.845257 17397 rpcz_store.cc:276] 0709 13:18:22.824974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.825170 (+   196us) service_pool.cc:224] Handling call
0709 13:18:22.837109 (+ 11939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.183931 (+346822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.183978 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.184584 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.761859 (+577275us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:23.761921 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.762028 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.533789 (+1771761us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:25.824508 (+290719us) raft_consensus.cc:1685] finished
0709 13:18:25.824532 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.834653 (+ 10121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3813,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":30168,"spinlock_wait_cycles":65912704,"thread_start_us":457187,"threads_started":2,"wal-append.queue_time_us":713969}
I20260709 13:18:25.824347 19647 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.848142 17394 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:25.849258 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:25.848138 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 83515.5us
I20260709 13:18:25.826965 19495 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.855232 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:25.855290 19647 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.859627 19548 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:25.860212 19502 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.609s	user 0.006s	sys 0.005s
W20260709 13:18:25.875422 17470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2284) took 2677 ms (client timeout 1772 ms). Trace:
W20260709 13:18:25.875880 17470 rpcz_store.cc:269] 0709 13:18:23.197776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.215617 (+ 17841us) service_pool.cc:224] Handling call
0709 13:18:25.875258 (+2659641us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540041fad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:25.875355 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388738944}
I20260709 13:18:25.845119 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:25.857663 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:25.850438 19535 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:25.826329 19610 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.861545 19570 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:25.860328 19543 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:25.860963 19495 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:25.865213 19652 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:18:25.860210 19548 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:25.907632 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 50003.9us
I20260709 13:18:25.920966 17999 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:25.921053 19548 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.922478 19535 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.907362 19586 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:25.923003 19535 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.923303 19586 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:25.923763 19586 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.914616 19528 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:25.935745 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:25.937919 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.913130 19588 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.002s
W20260709 13:18:25.925341 19648 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.376s	user 0.002s	sys 0.000s
I20260709 13:18:25.879709 19645 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:25.933585 19490 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:25.948215 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.948231 19588 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:25.959239 19657 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:18:25.961692 19658 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:18:25.987284 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:25.994127 19647 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.095151 19647 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:25.926246 19220 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:26.185444 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.098603 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:26.121349 17393 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:18:26.187973 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 191502us
I20260709 13:18:26.121071 17999 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:25.994453 19490 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.231124 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2289) took 3031 ms. Trace:
I20260709 13:18:26.231500 17465 rpcz_store.cc:276] 0709 13:18:23.199618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.220801 (+ 21183us) service_pool.cc:224] Handling call
0709 13:18:23.240166 (+ 19365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.502361 (+1262195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.502395 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.312705 (+810310us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b2c0014aa78. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:18:25.334537 (+ 21832us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.731186 (+396649us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:25.731238 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.731315 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.159059 (+427744us) raft_consensus.cc:1685] finished
0709 13:18:26.159095 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.231067 (+ 71972us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99920,"raft.queue_time_us":19178,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":48888,"spinlock_wait_cycles":71119744,"thread_start_us":1607150,"threads_started":2,"wal-append.queue_time_us":487559}
W20260709 13:18:26.235307 17360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 2.944s (SENT) [suppressed 53 similar messages]
W20260709 13:18:26.236732 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 381555us
I20260709 13:18:26.190183 19610 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:26.239715 19660 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:18:26.190186 19528 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.239425 19610 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.243112 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:26.230932 19490 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:26.266486 19659 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:18:26.268028 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:26.268766 17994 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:26.268414 19505 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.269107 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:26.269845 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:26.270578 17994 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:26.249872 19591 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:26.271131 17992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 500) took 3714 ms (client timeout 1968 ms). Trace:
W20260709 13:18:26.271657 17992 rpcz_store.cc:269] 0709 13:18:22.556634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.557651 (+  1017us) service_pool.cc:224] Handling call
0709 13:18:26.270882 (+3713231us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b5400583ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:26.271054 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4933499264}
I20260709 13:18:26.272094 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:26.238376 19543 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:26.245787 19647 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.241981 18962 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.245847 19382 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.249992 19646 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.242247 19528 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.281849 19591 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:26.293612 17362 connection.cc:256] RPC call timeout handler was delayed by -4.359215254999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:18:26.320322 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.325831 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.288987 17991 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:26.337749 17468 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:26.278050 19537 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:18:26.338035 17470 raft_consensus.cc:2376] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8. Re-sending same reply.
W20260709 13:18:26.342216 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 53316.8us
I20260709 13:18:26.345150 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.346549 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.347361 17464 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:26.348517 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.351303 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.246703 19548 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.353116 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.354493 17469 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:26.355495 17468 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:26.321977 19591 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.322310 19402 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.357889 17462 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:26.356559 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.285511 19647 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.359383 17470 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:26.287653 19543 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.362289 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.289407 18962 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:26.350631 19578 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.099s	user 0.009s	sys 0.004s
I20260709 13:18:26.364825 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.367798 17465 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:26.369344 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.369872 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.373854 17469 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:26.374756 17315 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:26.375746 19566 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:26.375800 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.377580 17322 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:26.379253 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.380507 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.381111 17322 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:26.381283 19535 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.382692 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.382881 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2368) took 1194 ms. Trace:
I20260709 13:18:26.383387 17322 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:26.385483 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.336795 19646 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.384624 19610 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.363024 19591 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.290661 19382 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.395757 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:26.398833 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 78599.6us
I20260709 13:18:26.399094 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.365136 19670 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:26.403813 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.404253 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:26.369217 19537 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:26.405170 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:26.370213 19645 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:26.407960 19339 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.928s	user 0.006s	sys 0.002s
I20260709 13:18:26.425674 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.409978 19382 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.410285 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.411232 17316 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:26.377594 19664 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:26.411955 17317 raft_consensus.cc:2368] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5.
W20260709 13:18:26.383777 19454 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.969s	user 0.004s	sys 0.005s
I20260709 13:18:26.371551 19588 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:26.421835 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.364138 19402 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:26.426699 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.426677 17320 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:26.432785 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:26.403656 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.383452 19535 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:26.383285 17391 rpcz_store.cc:276] 0709 13:18:25.188705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.382058 (+1193353us) service_pool.cc:224] Handling call
0709 13:18:26.382366 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.382555 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.382581 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.382629 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:26.382661 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.382721 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.382822 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:26.434039 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:26.436151 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:26.413069 19670 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:26.437311 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:26.429706 17992 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.438668 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:26.372280 19578 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.429726 19339 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.409997 19495 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.445658 19548 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.448386 19402 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:26.439906 19627 consensus_meta.cc:287] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.008s	user 0.006s	sys 0.006s
I20260709 13:18:26.436125 19645 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.449429 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.452769 17464 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:26.453166 17317 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:26.454075 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.454329 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:26.454653 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.454949 17470 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:26.455295 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.439831 19545 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.456125 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.456729 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.456918 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.436784 19220 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.439955 19610 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.426510 19537 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.476321 17466 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 2: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:26.455691 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.438807 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:26.457791 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.458033 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:26.477535 17465 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:26.454447 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.451663 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:26.465632 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 302) took 1506 ms. Trace:
I20260709 13:18:26.433578 19454 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.490044 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:26.479195 17389 rpcz_store.cc:276] 0709 13:18:24.959245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.959357 (+   112us) service_pool.cc:224] Handling call
0709 13:18:24.959628 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.118519 (+158891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.465339 (+1346820us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b54003020d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:26.465562 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13552896}
I20260709 13:18:26.491230 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.491779 17389 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:26.492638 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.479991 19670 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.481400 19220 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:26.483006 19495 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.457777 17313 raft_consensus.cc:2410] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:26.458348 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:26.486289 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.476379 19610 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.490332 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:26.459033 19624 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.205s	user 0.011s	sys 0.008s
I20260709 13:18:26.494801 17998 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.438644 19588 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:26.517035 17990 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:18:26.517585 19631 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.265s	user 0.010s	sys 0.000s
I20260709 13:18:26.497222 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:26.494251 19402 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.518919 19402 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.521191 19402 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:26.521338 19543 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.521746 19402 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.522274 19402 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.523344 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2290) took 3323 ms. Trace:
I20260709 13:18:26.524312 19339 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:26.512992 19563 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:26.523715 17463 rpcz_store.cc:276] 0709 13:18:23.199934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.234562 (+ 34628us) service_pool.cc:224] Handling call
0709 13:18:23.237074 (+  2512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.703383 (+1466309us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:24.703788 (+   405us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.898957 (+195169us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.917283 (+ 18326us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.917332 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:24.917373 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.523135 (+1605762us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54001694d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:26.523177 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.523291 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17833,"prepare.queue_time_us":20615,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":62872,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":226,"spinlock_wait_cycles":3371532544,"thread_start_us":163200,"threads_started":1,"wal-append.queue_time_us":173114,"wal-append.run_cpu_time_us":2112,"wal-append.run_wall_time_us":1117114}
I20260709 13:18:26.525527 19563 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:26.526412 19563 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:26.527005 19662 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.688s	user 0.009s	sys 0.010s
I20260709 13:18:26.515856 19610 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:26.530153 19630 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.265s	user 0.000s	sys 0.009s
I20260709 13:18:26.530269 19454 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:26.532109 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 399) took 1845 ms. Trace:
I20260709 13:18:26.532495 17321 rpcz_store.cc:276] 0709 13:18:24.686480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.686828 (+   348us) service_pool.cc:224] Handling call
0709 13:18:24.687271 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:24.687808 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.687849 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:24.688743 (+   894us) log.cc:844] Serialized 52 byte log entry
0709 13:18:25.122701 (+433958us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:25.122741 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.122806 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.458420 (+1335614us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:26.531785 (+ 73365us) raft_consensus.cc:1685] finished
0709 13:18:26.531808 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.532028 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5718,"raft.queue_time_us":2876,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":5876,"spinlock_wait_cycles":13496704,"thread_start_us":245277,"threads_started":1,"wal-append.queue_time_us":427408}
I20260709 13:18:26.534287 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:26.534673 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:26.534893 17995 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.535184 19537 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.535852 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.536084 18962 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.501868 19645 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:26.497941 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:26.537930 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:26.494050 19671 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:18:26.458889 19646 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.463168 19559 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:26.501575 19545 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.501744 19220 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.505858 19578 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:26.506127 19496 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.506201 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.507871 19591 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.508096 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.511454 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.513125 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.503791 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:26.516458 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:26.497125 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.502666 19647 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.493247 17389 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:26.582664 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:26.583446 17389 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:26.524616 19586 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
I20260709 13:18:26.536517 17321 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
W20260709 13:18:26.558643 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 47322.4us
I20260709 13:18:26.590940 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:26.545171 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 669) took 3357 ms. Trace:
I20260709 13:18:26.559891 19537 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.566004 19402 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:26.566705 19591 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:26.567358 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:26.567965 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:26.572032 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 68352.7us
I20260709 13:18:26.579775 17465 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:26.592041 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:26.474603 19627 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.553381 19545 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:26.557755 19645 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:26.632580 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.632398 17389 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:26.652832 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:26.633747 17995 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:26.568627 19578 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:18:26.636370 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.572317 19670 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:26.654426 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 62465.5us
I20260709 13:18:26.649668 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.589955 19559 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:26.634394 19672 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:26.654894 17391 raft_consensus.cc:2376] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3. Re-sending same reply.
I20260709 13:18:26.643972 19402 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.653961 17318 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:26.644315 19671 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:26.656008 17994 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:26.673254 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:26.673866 17317 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.658299 17389 raft_consensus.cc:2410] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:26.630086 19586 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.654224 19545 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.630381 19543 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:18:26.654744 19645 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.664779 19559 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.684372 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:26.686219 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.670450 19672 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.697285 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:26.669211 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.701279 19671 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:26.702689 17388 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.704712 19627 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:26.707497 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.715122 17318 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:26.719923 19559 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.669653 19676 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:26.663713 19365 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:18:26.729285 17391 raft_consensus.cc:2376] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5. Re-sending same reply.
I20260709 13:18:26.765138 17318 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:26.721256 19561 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:26.730480 19220 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:26.732124 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:26.627511 17991 rpcz_store.cc:276] 0709 13:18:23.189254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.189862 (+   608us) service_pool.cc:224] Handling call
0709 13:18:26.279350 (+3089488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.343375 (+ 64025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.528741 (+185366us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b5400583ed0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:26.545096 (+ 16355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7078713088}
I20260709 13:18:26.726454 17992 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:26.733266 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 303) took 1773 ms. Trace:
W20260709 13:18:26.771242 19636 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.517s	user 0.012s	sys 0.013s
I20260709 13:18:26.770535 17395 rpcz_store.cc:276] 0709 13:18:24.959500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.959625 (+   125us) service_pool.cc:224] Handling call
0709 13:18:24.970675 (+ 11050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.970858 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:25.113453 (+142595us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.732498 (+1619045us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b1800045460. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a
0709 13:18:26.732751 (+   253us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.732864 (+   113us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:26.732929 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.733036 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.733193 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202468,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":166,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":16116736,"thread_start_us":229019,"threads_started":2,"wal-append.queue_time_us":140400}
I20260709 13:18:26.734411 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 310) took 1747 ms. Trace:
I20260709 13:18:26.772975 17393 rpcz_store.cc:276] 0709 13:18:24.987074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.995924 (+  8850us) service_pool.cc:224] Handling call
0709 13:18:26.734172 (+1738248us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54004128d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:26.734332 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2354290048}
I20260709 13:18:26.774096 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.774152 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.775220 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:26.775283 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.775938 17393 raft_consensus.cc:2368] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5.
I20260709 13:18:26.776436 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:26.701237 19679 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.739811 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 506) took 1505 ms. Trace:
I20260709 13:18:26.740445 19617 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.721710 19672 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.676484 19402 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.736599 19528 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:26.743268 19505 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:26.749366 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:26.713801 19645 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.633896 19566 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:26.696408 19490 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.768318 17318 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:26.777202 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 301) took 1818 ms (client timeout 1946 ms). Trace:
I20260709 13:18:26.777917 17314 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:18:26.778882 17322 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:18:26.779464 17360 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 1.550s (SENT)
I20260709 13:18:26.836002 17360 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:26.837181 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 57746.1us
I20260709 13:18:26.838862 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:26.739251 17313 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:26.772511 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.781495 17317 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:26.840644 17395 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 1.
I20260709 13:18:26.841048 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.776652 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.841849 17393 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
W20260709 13:18:26.784508 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 119491us
I20260709 13:18:26.842543 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:26.843297 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:26.786770 19586 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:26.792783 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.795527 19679 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:18:26.794343 19667 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.353s	user 0.005s	sys 0.000s
I20260709 13:18:26.795609 19561 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:26.821403 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 72116us
I20260709 13:18:26.854144 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:26.833343 17390 rpcz_store.cc:269] 0709 13:18:24.958900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.960180 (+  1280us) service_pool.cc:224] Handling call
0709 13:18:26.777041 (+1816861us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b5400015754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:26.777146 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973712128}
I20260709 13:18:26.844416 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:26.802572 19596 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:26.845636 17397 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:26.794941 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 505) took 1560 ms. Trace:
I20260709 13:18:26.778411 19610 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.847651 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:26.852048 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.875059 17285 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:26.875279 17393 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:26.876123 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.876708 17393 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:26.877607 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:26.878575 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:26.848701 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:26.802232 17391 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.882617 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.846181 19543 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.853413 19537 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.873250 17996 rpcz_store.cc:276] 0709 13:18:25.234325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.428346 (+194021us) service_pool.cc:224] Handling call
0709 13:18:25.444607 (+ 16261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.455449 (+ 10842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.794687 (+1339238us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b54005f0354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:26.794872 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23186304}
I20260709 13:18:26.846519 19670 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:26.767499 19676 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.882843 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:26.853284 19528 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.880623 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:26.879046 17393 raft_consensus.cc:2376] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5. Re-sending same reply.
I20260709 13:18:26.865289 19220 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:26.853070 19679 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.887532 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.870318 19536 raft_consensus.cc:2764] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:26.889932 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:26.891206 18962 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:26.892678 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.893927 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:26.874532 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:26.897219 17397 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
I20260709 13:18:26.898649 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.906006 17392 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:26.907249 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:26.907974 17392 raft_consensus.cc:2376] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3. Re-sending same reply.
I20260709 13:18:26.885919 19454 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.888453 19452 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.917888 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.885470 19681 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.893231 19586 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:26.921491 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.896440 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.893792 19578 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.945505 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:26.951270 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.953347 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.954075 17392 raft_consensus.cc:2368] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5.
I20260709 13:18:26.893110 19539 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.954938 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.911563 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:26.882064 19596 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:26.955856 17392 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:26.891180 19588 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
W20260709 13:18:26.922803 19677 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:18:26.855093 19545 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.999933 17318 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:18:26.965476 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 61021.1us
I20260709 13:18:26.969923 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:27.002148 17392 raft_consensus.cc:2376] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4. Re-sending same reply.
I20260709 13:18:27.003481 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:27.004606 17392 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:27.005590 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:27.006917 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.974393 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 676) took 1847 ms. Trace:
I20260709 13:18:27.007777 17997 rpcz_store.cc:276] 0709 13:18:25.126629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.422316 (+295687us) service_pool.cc:224] Handling call
0709 13:18:25.431359 (+  9043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.741167 (+1309808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.741203 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.741241 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:26.741268 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.974051 (+232783us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001a9854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:26.974120 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.974311 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3011840384}
I20260709 13:18:26.979549 17962 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:26.902045 19220 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:27.009963 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:27.010351 19220 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.011940 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:26.911990 19528 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.922533 19681 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.986456 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:26.917376 19454 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:26.953075 19453 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:26.961124 17390 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:27.018854 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:27.013020 19647 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:27.021178 19647 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.021694 19647 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.952802 17990 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:26.994311 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:26.995905 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.965024 19586 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.995908 19558 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:26.999570 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:26.921890 19452 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:27.039824 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.049741 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 159896us
W20260709 13:18:27.052786 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 53293.5us
I20260709 13:18:27.056725 17397 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.057687 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:27.058617 17394 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:26.919242 19675 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:18:27.020596 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:27.067803 18962 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:18:27.071659 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 70692.6us
I20260709 13:18:27.014626 19454 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.073531 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.074162 17465 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:26.898114 19561 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.986982 19578 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:18:27.052224 19496 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:27.077306 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:27.083683 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.084163 17394 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.077540 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.084800 17467 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.016009 19681 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.054144 19452 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:27.088215 17396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 313) took 2065 ms (client timeout 2206 ms). Trace:
I20260709 13:18:27.054929 19502 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:27.052439 19453 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:27.054144 19339 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.055395 19589 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.059322 19558 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:27.079128 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.055994 19586 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:27.109319 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 51699.3us
I20260709 13:18:27.092264 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.087080 19691 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.084074 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:27.119395 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:27.119962 17318 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
W20260709 13:18:27.088707 17396 rpcz_store.cc:269] 0709 13:18:25.022605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.109533 (+ 86928us) service_pool.cc:224] Handling call
0709 13:18:27.088036 (+1978503us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b540013abd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:27.088153 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749666176}
I20260709 13:18:27.083823 19496 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.099263 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.079224 19402 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:27.129153 19402 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:27.090363 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:27.111258 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.100370 19490 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:27.133380 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.116564 17467 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:27.135039 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.117767 19596 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.121709 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.137423 17470 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:27.138309 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.125217 19691 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.139381 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.139895 17470 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.067406 19539 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:18:27.129716 19402 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.121165 19535 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:27.130853 17463 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:27.128746 19496 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.107558 19578 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:27.136171 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.156930 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.157568 17467 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.158987 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.107961 19502 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:27.140815 19691 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:27.127118 19697 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:27.093221 19675 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:27.118489 19589 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:27.141601 17465 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:27.121958 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:27.146938 17394 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:27.174438 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:27.147680 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.175621 17469 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:27.148095 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 57853.9us
I20260709 13:18:27.113317 19559 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:26.801980 17993 rpcz_store.cc:276] 0709 13:18:25.234611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.431834 (+197223us) service_pool.cc:224] Handling call
0709 13:18:25.483965 (+ 52131us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.726369 (+242404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.726404 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.726931 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.833905 (+106974us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:25.848175 (+ 14270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.739195 (+891020us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540057a8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:26.739272 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.739348 (+    76us) raft_consensus.cc:1685] finished
0709 13:18:26.739387 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.739722 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13035,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":30238,"spinlock_wait_cycles":285102464,"thread_start_us":96660,"threads_started":1,"wal-append.queue_time_us":177335}
I20260709 13:18:27.126894 19672 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.152794 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:27.153462 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.184762 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:27.159713 17463 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.164140 17470 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:27.166850 17467 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:27.193976 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.195289 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.195958 17467 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:27.109212 19339 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.200038 19339 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:27.144076 19646 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:27.200767 19646 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:27.201263 19646 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.141448 19610 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:27.179314 17394 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:27.205948 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2372) took 2006 ms. Trace:
I20260709 13:18:27.206383 17394 rpcz_store.cc:276] 0709 13:18:25.199576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.178691 (+1979115us) service_pool.cc:224] Handling call
0709 13:18:27.179081 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.205624 (+ 26543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.205885 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.208338 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2373) took 2008 ms. Trace:
I20260709 13:18:27.208739 17394 rpcz_store.cc:276] 0709 13:18:25.199776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.207340 (+2007564us) service_pool.cc:224] Handling call
0709 13:18:27.207717 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.207940 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.207970 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.208025 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:27.208077 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.208144 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.208275 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.212595 17467 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:27.217680 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2374) took 2017 ms. Trace:
I20260709 13:18:27.224376 17394 rpcz_store.cc:276] 0709 13:18:25.199997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.215239 (+2015242us) service_pool.cc:224] Handling call
0709 13:18:27.217016 (+  1777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.217234 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.217272 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.217328 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:27.217371 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.217439 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.217573 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.225545 17467 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:27.231067 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2376) took 2030 ms. Trace:
I20260709 13:18:27.236778 17394 rpcz_store.cc:276] 0709 13:18:25.200526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.230162 (+2029636us) service_pool.cc:224] Handling call
0709 13:18:27.230491 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.230685 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.230720 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.230774 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:27.230823 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.230889 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.231000 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.243108 19646 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.248152 17463 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
W20260709 13:18:27.249361 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 75045.3us
I20260709 13:18:27.156090 19578 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:27.264542 17392 raft_consensus.cc:2368] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 7.
I20260709 13:18:27.149001 19490 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:18:27.173015 19589 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:27.171557 19676 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.256342 19690 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:27.249179 19535 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:27.299618 17469 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:27.264554 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:27.171203 19693 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
W20260709 13:18:27.306190 17963 leader_election.cc:336] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.885s (SENT)
I20260709 13:18:27.306722 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:27.246531 19698 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:18:27.301321 19552 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.246723 19697 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.270426 19545 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:27.293998 19691 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:27.250293 19453 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.272827 19365 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:18:27.307590 19339 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.310650 19578 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.329775 19578 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.331621 19679 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.332968 19583 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:27.345079 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.361752 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 55595.7us
I20260709 13:18:27.322127 19676 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.385438 19676 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:27.363121 17990 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:27.311107 19502 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.365685 19672 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:27.367105 19697 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:27.370230 17391 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:27.370384 19528 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:27.370242 17434 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:27.375097 19598 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.398792 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:27.371145 19645 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.002s
I20260709 13:18:27.372400 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:27.373224 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.360905 19545 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.375378 19402 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.377631 19646 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:27.381258 17963 leader_election.cc:336] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.925s (SENT)
I20260709 13:18:27.412222 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:27.382723 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2370) took 2183 ms. Trace:
I20260709 13:18:27.414031 17397 rpcz_store.cc:276] 0709 13:18:25.199120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.029828 (+1830708us) service_pool.cc:224] Handling call
0709 13:18:27.030245 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.057179 (+ 26934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.382409 (+325230us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b5400012f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:27.382645 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60488576}
I20260709 13:18:27.322611 19691 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.418943 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:27.408577 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 272791us
I20260709 13:18:27.324409 19339 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.416344 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2383) took 2032 ms. Trace:
I20260709 13:18:27.418490 17321 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.421047 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:27.421175 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:27.362370 19690 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:27.421778 17321 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.399771 19598 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:27.427345 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:27.429059 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:27.429966 17996 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:27.411353 19694 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:27.411743 19698 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:27.433476 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:27.411600 19672 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:27.434903 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.436074 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:27.437297 19681 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.433362 19452 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.440317 19679 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.441030 17318 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:27.441425 19681 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.433202 19528 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:27.442097 17463 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:27.442513 17321 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:27.442241 19528 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.444437 19528 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:27.444234 19452 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.361258 19535 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:27.447276 19637 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 2.194s	user 0.006s	sys 0.015s
I20260709 13:18:27.448062 19365 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:27.451390 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:27.452013 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2369) took 2263 ms. Trace:
I20260709 13:18:27.452283 19537 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:27.452929 19537 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:27.415856 19545 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.455112 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:27.471644 17393 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.433221 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:27.426963 19697 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:27.457530 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:27.458847 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1399) took 1114 ms. Trace:
I20260709 13:18:27.473878 17389 rpcz_store.cc:276] 0709 13:18:26.344337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.652609 (+308272us) service_pool.cc:224] Handling call
0709 13:18:27.458595 (+805986us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b540023cdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:27.458774 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10114816}
W20260709 13:18:27.459340 17999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 512) took 1496 ms (client timeout 1892 ms). Trace:
W20260709 13:18:27.475528 17999 rpcz_store.cc:269] 0709 13:18:25.962718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.986930 (+ 24212us) service_pool.cc:224] Handling call
0709 13:18:27.459177 (+1472247us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b54006cedd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:27.459291 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113807104}
I20260709 13:18:27.432500 19501 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.486810 19501 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:27.487160 19691 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.427954 19610 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:18:27.489359 17994 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.489769 19610 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:27.490166 19610 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:27.490876 19610 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.491967 19610 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.472200 19588 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:27.485405 19520 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:27.452543 17388 rpcz_store.cc:276] 0709 13:18:25.198867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.919902 (+721035us) service_pool.cc:224] Handling call
0709 13:18:25.920253 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.741970 (+821717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.451696 (+709726us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540038e854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:27.451925 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739186432}
I20260709 13:18:27.486049 19496 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.487236 19501 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.485033 19672 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:27.413154 19645 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.488534 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:27.493330 19588 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.517298 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:27.499787 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:27.483875 19454 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.435081 19694 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.493034 19598 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.458988 19569 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:27.646718 19569 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.647114 19569 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.575405 19690 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.455567 19556 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.531479 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:27.456769 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:27.567009 17393 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:27.519584 19596 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.568238 19568 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.456529 19539 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.610051 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:27.453846 19537 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.481102 19646 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:18:27.611600 17389 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:27.589519 19520 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:27.614024 17287 leader_election.cc:336] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.772s (SENT)
I20260709 13:18:27.617591 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.643940 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:27.686592 17467 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.644343 17471 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:27.686417 17287 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:27.645052 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 156578us
W20260709 13:18:27.687568 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.645574 19698 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:27.646205 19713 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:27.655386 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2391) took 1164 ms. Trace:
I20260709 13:18:27.663766 17390 raft_consensus.cc:2368] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:27.649236 19556 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.436863 19710 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:27.664305 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:27.699731 17389 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.654439 19645 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:27.665861 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:27.643319 19694 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.646744 19719 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.691727 17393 rpcz_store.cc:276] 0709 13:18:26.491283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.892238 (+400955us) service_pool.cc:224] Handling call
0709 13:18:27.454931 (+562693us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:27.655328 (+200397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16965504}
I20260709 13:18:27.678942 19598 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:27.692188 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 78241.9us
I20260709 13:18:27.498986 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:27.712286 17999 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:27.609546 19502 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:18:27.656932 19539 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:27.713732 19539 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.715165 19539 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.705367 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.717707 19646 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.718129 17469 pending_rounds.cc:85] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 1
I20260709 13:18:27.718591 17469 pending_rounds.cc:107] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:27.718878 17469 raft_consensus.cc:2889] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.719257 19645 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.678310 19536 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:27.707957 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:27.618366 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.691437 19081 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:27.656857 19596 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.718201 19646 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:27.689178 19647 consensus_meta.cc:287] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.667s	user 0.012s	sys 0.001s
I20260709 13:18:27.665318 17391 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:27.668776 17994 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:27.722812 17462 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:27.711380 17471 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:27.723296 17315 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:27.662730 19568 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.707396 19627 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:27.700536 19669 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:27.719862 19645 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.744297 17389 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:27.745913 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:27.707736 19672 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.711036 19710 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:27.747994 17467 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:27.748621 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:27.725942 19558 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.722350 19536 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:27.748037 19627 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.775794 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:27.780925 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:27.702240 19713 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.786585 19713 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:27.727424 19496 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:27.742588 19722 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:27.796584 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:27.798429 17388 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.798123 19536 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.799434 19536 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.772203 19645 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.788794 19627 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.756454 19081 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:18:27.751909 19520 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.770409 17391 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:27.754896 19672 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.753087 19502 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:27.770483 19568 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.791913 19345 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.804422 19728 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:18:27.802646 19646 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.742856 19647 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.794075 19546 raft_consensus.cc:2764] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:27.788882 19558 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.720533 19719 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:27.822441 17422 heartbeater.cc:646] Failed to heartbeat to 127.15.208.62:46299 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.208.62:46299 timed out after 15.000s (SENT)
I20260709 13:18:27.824431 17393 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:27.826424 19646 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.826614 19719 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.829203 17997 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:27.830243 19647 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:27.830412 19501 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.831843 17995 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:27.832419 17388 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:27.819515 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2384) took 2391 ms. Trace:
I20260709 13:18:27.823804 19521 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:27.834280 19454 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.835857 19558 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.815376 19345 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.853258 19345 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.836359 19569 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.858461 19569 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:27.861311 17314 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:18:27.863265 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.814684 19502 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:27.802963 19722 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.812580 19710 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.846401 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.752549 19669 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.842180 17391 rpcz_store.cc:276] 0709 13:18:25.428423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.769705 (+2341282us) service_pool.cc:224] Handling call
0709 13:18:27.770159 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.808032 (+ 37873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.818565 (+ 10533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:27.867060 17469 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:27.843499 19521 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:27.891065 19719 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:27.892371 19719 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:27.892897 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:27.893795 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1450) took 1083 ms. Trace:
I20260709 13:18:27.894100 17313 rpcz_store.cc:276] 0709 13:18:26.810526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.889453 (+ 78927us) service_pool.cc:224] Handling call
0709 13:18:27.870315 (+980862us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:27.893722 (+ 23407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6032128}
I20260709 13:18:27.895474 19669 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:27.894606 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:27.895287 19339 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:27.896754 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:27.897514 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:27.905618 19668 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.461s	user 0.007s	sys 0.000s
I20260709 13:18:27.911868 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:27.861639 19501 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:27.935469 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 400) took 2957 ms. Trace:
I20260709 13:18:27.936084 17319 rpcz_store.cc:276] 0709 13:18:24.956744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.956897 (+   153us) service_pool.cc:224] Handling call
0709 13:18:24.957224 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.962464 (+  5240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.962495 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.964695 (+  2200us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.226647 (+1261952us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b18003aa080. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:18:26.365184 (+138537us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:26.365223 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.365309 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.905062 (+1539753us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:27.913441 (+  8379us) raft_consensus.cc:1685] finished
0709 13:18:27.913473 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.913638 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2984,"raft.queue_time_us":3945,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6649,"spinlock_wait_cycles":14660224,"thread_start_us":138357,"threads_started":1,"wal-append.queue_time_us":1460856}
I20260709 13:18:27.896754 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:27.941871 19610 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.933854 19703 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:27.961231 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:27.945096 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:28.002992 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:27.996583 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:28.009095 17319 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:27.993837 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:28.068943 19719 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:28.000165 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:28.083480 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:28.084693 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:28.085803 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:27.973143 19502 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:28.092944 17391 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:28.098666 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:28.096662 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:27.973220 19610 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:27.972859 19568 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.093897 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:28.098141 19691 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.973182 19703 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:28.099781 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:28.095052 17388 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.105324 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:28.115829 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:28.120431 17319 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:27.941847 19521 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:28.128087 19694 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:28.103313 19719 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:28.132829 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:28.115008 19505 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:28.136538 17469 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:28.134471 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:28.118667 19672 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:28.115696 19588 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:28.138330 17319 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:28.149398 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1421) took 1699 ms. Trace:
I20260709 13:18:28.150130 17390 rpcz_store.cc:276] 0709 13:18:26.450047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.020259 (+570212us) service_pool.cc:224] Handling call
0709 13:18:28.149058 (+1128799us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54002be154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:28.149293 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315221376}
I20260709 13:18:28.152148 17390 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:28.152421 19345 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:28.112107 19568 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:28.154651 19345 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:28.100790 19627 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:28.156594 19627 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:28.137406 19505 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:28.157358 19505 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.139873 19719 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:28.159258 19719 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:28.161633 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:28.162933 17313 raft_consensus.cc:2410] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:28.121435 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 322) took 1933 ms. Trace:
I20260709 13:18:28.164424 17391 rpcz_store.cc:276] 0709 13:18:26.187574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.084328 (+1896754us) service_pool.cc:224] Handling call
0709 13:18:28.084689 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.101767 (+ 17078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.120028 (+ 18261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.166522 17391 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:28.167255 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2386) took 1677 ms. Trace:
I20260709 13:18:28.167678 17391 rpcz_store.cc:276] 0709 13:18:26.490020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.165616 (+1675596us) service_pool.cc:224] Handling call
0709 13:18:28.166072 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.166941 (+   869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.167180 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.156620 19568 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:28.178853 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2388) took 1688 ms. Trace:
I20260709 13:18:28.179283 17389 rpcz_store.cc:276] 0709 13:18:26.490537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.178058 (+1687521us) service_pool.cc:224] Handling call
0709 13:18:28.178346 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.178527 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.178556 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.178597 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:28.178630 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.178682 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.178780 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.180179 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:28.181348 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:28.183888 17313 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:28.185729 19596 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:28.189527 19676 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:28.190972 19676 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.191514 19694 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:28.193619 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2390) took 1702 ms. Trace:
I20260709 13:18:28.194191 17389 rpcz_store.cc:276] 0709 13:18:26.490976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.180183 (+1689207us) service_pool.cc:224] Handling call
0709 13:18:28.180469 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.180628 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.180649 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.180686 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:28.180714 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.180760 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.193563 (+ 12803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.196120 17389 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:28.196961 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2394) took 1700 ms. Trace:
I20260709 13:18:28.197870 17389 rpcz_store.cc:276] 0709 13:18:26.496266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.195520 (+1699254us) service_pool.cc:224] Handling call
0709 13:18:28.195889 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.196658 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.196901 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:28.204592 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.225066 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 147859us
W20260709 13:18:28.229209 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.230455 17389 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:28.231060 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.231155 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2396) took 1507 ms. Trace:
I20260709 13:18:28.231710 17389 rpcz_store.cc:276] 0709 13:18:26.723384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.229923 (+1506539us) service_pool.cc:224] Handling call
0709 13:18:28.230256 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.230860 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.231079 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:28.235719 17466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 327) took 3044 ms (client timeout 1629 ms). Trace:
W20260709 13:18:28.237053 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.238443 17468 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:28.242754 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:28.243788 17314 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:28.251655 19712 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.681s	user 0.002s	sys 0.000s
W20260709 13:18:28.236315 17466 rpcz_store.cc:269] 0709 13:18:25.190899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.205996 (+ 15097us) service_pool.cc:224] Handling call
0709 13:18:28.235401 (+3029405us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400331dd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:28.235619 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2728830848}
I20260709 13:18:28.266005 17319 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:28.267618 17319 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:28.230335 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1396) took 1891 ms. Trace:
I20260709 13:18:28.269942 17390 rpcz_store.cc:276] 0709 13:18:26.338621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.151458 (+1812837us) service_pool.cc:224] Handling call
0709 13:18:28.151872 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.152664 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.228809 (+ 76145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.271217 19586 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:28.271468 17390 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:28.272120 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2399) took 1386 ms. Trace:
I20260709 13:18:28.119168 19691 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:28.273486 19661 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 2.431s	user 0.006s	sys 0.006s
I20260709 13:18:28.279913 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2387) took 1789 ms. Trace:
I20260709 13:18:28.282435 17391 rpcz_store.cc:276] 0709 13:18:26.490290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.168675 (+1678385us) service_pool.cc:224] Handling call
0709 13:18:28.261758 (+ 93083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.279547 (+ 17789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.279577 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.279618 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:28.279651 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.279712 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.279822 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.272444 17390 rpcz_store.cc:276] 0709 13:18:26.885400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.270749 (+1385349us) service_pool.cc:224] Handling call
0709 13:18:28.271116 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.271847 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.272065 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.261475 19703 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:28.293962 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:28.296244 17435 connection.cc:256] RPC call timeout handler was delayed by -1.646515681999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 13:18:28.296442 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2400) took 1377 ms. Trace:
W20260709 13:18:28.296993 17435 connection.cc:256] RPC call timeout handler was delayed by -1.4575156819998938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 13:18:28.296788 17391 rpcz_store.cc:276] 0709 13:18:26.919058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.283727 (+1364669us) service_pool.cc:224] Handling call
0709 13:18:28.295956 (+ 12229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.296132 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.296155 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.296194 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:28.296220 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.296274 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.296379 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:28.297628 17435 connection.cc:256] RPC call timeout handler was delayed by -1.2109156819999498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 13:18:28.298017 17435 connection.cc:256] RPC call timeout handler was delayed by -1.2019156819999353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 13:18:28.298401 17435 connection.cc:256] RPC call timeout handler was delayed by -1.159236404000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:18:28.298616 17391 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:28.298802 17435 connection.cc:256] RPC call timeout handler was delayed by -1.1434156819998407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:18:28.299234 17435 connection.cc:256] RPC call timeout handler was delayed by -1.0768156819999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:18:28.299535 17435 connection.cc:256] RPC call timeout handler was delayed by -1.0462156819999109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 13:18:28.300223 17435 connection.cc:256] RPC call timeout handler was delayed by -1.044415681999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 13:18:28.302151 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:28.302934 17471 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:28.310212 17471 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:28.311029 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 325) took 1049 ms. Trace:
I20260709 13:18:28.311596 17391 rpcz_store.cc:276] 0709 13:18:27.262124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.297832 (+1035708us) service_pool.cc:224] Handling call
0709 13:18:28.298452 (+   620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.299212 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.310975 (+ 11763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.309657 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:28.313187 17391 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:28.314431 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:28.285162 17313 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:28.317291 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:28.319015 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:28.319463 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 324) took 1059 ms. Trace:
I20260709 13:18:28.320232 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:28.320458 19568 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:28.320971 19568 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.321305 19568 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:28.321384 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:28.321964 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:28.322533 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:28.323104 17471 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:28.323917 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:28.319856 17390 rpcz_store.cc:276] 0709 13:18:27.259720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.299619 (+1039899us) service_pool.cc:224] Handling call
0709 13:18:28.318846 (+ 19227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.319063 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.319097 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.319158 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:28.319199 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.319261 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.319405 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.325887 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:28.322549 17395 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:28.324819 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:28.334941 17471 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:28.346997 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:28.351758 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:28.353014 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:28.367756 17466 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.325683 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:28.335762 19698 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:28.374965 17471 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:28.305160 17388 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:28.446273 17471 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:28.454764 17466 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:28.403716 19698 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:28.304970 19596 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:18:28.402698 17391 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 2.
W20260709 13:18:28.463495 17964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.001s	sys 0.028s
I20260709 13:18:28.466429 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:28.466444 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:28.552526 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:28.551091 17391 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:28.554872 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:28.555701 17391 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:28.553455 17395 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:28.449297 19694 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:28.584477 17964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.402s	user 0.001s	sys 0.029s
W20260709 13:18:28.585075 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 1.40314e+06us
I20260709 13:18:28.484361 19610 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:28.669202 19505 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.005s
W20260709 13:18:28.670244 19740 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:18:28.669983 19505 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:28.671840 19694 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:28.672588 19694 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:28.673336 19505 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:28.675182 19694 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:28.703403 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.680953 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:28.602442 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:28.464443 19698 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:28.798524 19505 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.806196 19691 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:28.739974 19730 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:18:28.563118 19568 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:28.832490 17390 raft_consensus.cc:2410] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:29.003227 17390 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:18:29.004662 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 334) took 1300 ms. Trace:
I20260709 13:18:29.005280 17390 rpcz_store.cc:276] 0709 13:18:27.704342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.002319 (+1297977us) service_pool.cc:224] Handling call
0709 13:18:29.002840 (+   521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.004278 (+  1438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.004588 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:28.841586 17993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 521) took 1440 ms (client timeout 1558 ms). Trace:
I20260709 13:18:28.895494 19568 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:29.012725 17993 rpcz_store.cc:269] 0709 13:18:27.400815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.408184 (+  7369us) service_pool.cc:224] Handling call
0709 13:18:28.680730 (+1272546us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:28.841490 (+160760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17825152}
W20260709 13:18:28.812809 19676 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
I20260709 13:18:29.016772 17462 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:18:29.017442 17462 pending_rounds.cc:85] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 6
I20260709 13:18:29.017760 17462 pending_rounds.cc:107] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:18:29.018093 17462 raft_consensus.cc:2889] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:29.027313 17390 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:29.028260 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 335) took 1323 ms. Trace:
I20260709 13:18:29.046447 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2404) took 1293 ms. Trace:
I20260709 13:18:29.076089 19568 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.079845 19568 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:28.878471 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.035s	sys 0.036s
W20260709 13:18:29.081135 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.037s	sys 0.039s
W20260709 13:18:29.081753 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 767329us
I20260709 13:18:29.082489 19568 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:29.082803 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:29.062945 19735 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.398s	user 0.008s	sys 0.024s
I20260709 13:18:28.911145 19698 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:29.086748 19698 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:28.877713 19502 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.087373 19698 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:29.087881 19502 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:28.877719 19505 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:29.094848 19505 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:28.894296 19453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.000s	sys 0.006s
W20260709 13:18:29.181161 19453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.000s	sys 0.009s
W20260709 13:18:29.104787 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 480492us
W20260709 13:18:29.054296 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 468400us
W20260709 13:18:29.182168 17434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.018s	sys 0.020s
W20260709 13:18:29.182574 17434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.018s	sys 0.020s
I20260709 13:18:29.182626 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 417) took 1699 ms. Trace:
I20260709 13:18:29.054376 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:29.123740 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.182806 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:29.123476 17391 rpcz_store.cc:276] 0709 13:18:27.753238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.045271 (+1292033us) service_pool.cc:224] Handling call
0709 13:18:29.045720 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.045966 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.046007 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.046069 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:29.046123 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.046202 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.046356 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.124887 19559 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:29.123740 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1321) took 2804 ms. Trace:
I20260709 13:18:29.127118 19574 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:29.073383 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.028715 17390 rpcz_store.cc:276] 0709 13:18:27.705311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.026328 (+1321017us) service_pool.cc:224] Handling call
0709 13:18:29.026792 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.027859 (+  1067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.028181 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.135831 19502 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:29.136721 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:29.137853 19710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.020s	sys 0.017s
I20260709 13:18:29.142603 17466 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:29.142917 19757 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:29.143831 19747 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:29.144029 19691 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.145305 19556 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:29.147475 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2338) took 1425 ms. Trace:
I20260709 13:18:29.200507 17462 rpcz_store.cc:276] 0709 13:18:27.721690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.795051 (+ 73361us) service_pool.cc:224] Handling call
0709 13:18:27.810152 (+ 15101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.018676 (+1208524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.147309 (+128633us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400281c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:29.147432 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2773779200}
W20260709 13:18:29.148113 19558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.000s	sys 0.008s
I20260709 13:18:29.144165 19676 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:29.150900 19617 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:29.209052 19617 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:29.209770 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.210173 19617 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:29.176654 19703 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.177022 19561 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.155977 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2314) took 2035 ms (client timeout 1772 ms). Trace:
I20260709 13:18:29.185542 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:29.211555 19703 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:29.211901 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.211694 19561 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:29.189445 17468 rpcz_store.cc:276] 0709 13:18:26.319390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.357327 (+ 37937us) service_pool.cc:224] Handling call
0709 13:18:28.238180 (+1880853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.238983 (+   803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.123518 (+884535us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5400331dd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.123679 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4324643200}
I20260709 13:18:29.213675 17994 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:29.193118 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2405) took 1396 ms. Trace:
I20260709 13:18:29.213936 19561 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:29.211719 17465 rpcz_store.cc:269] 0709 13:18:27.120241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.124611 (+  4370us) service_pool.cc:224] Handling call
0709 13:18:29.153715 (+2029104us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b540041fad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.155902 (+  2187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13756160}
W20260709 13:18:29.191792 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.214886 19691 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:29.118309 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.212124 17391 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:29.213745 19703 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:29.211043 17992 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:29.207751 19596 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.185791 17964 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:29.208417 19676 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:29.170017 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.173240 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1173) took 1652 ms. Trace:
W20260709 13:18:29.164244 17315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1152) took 2794 ms (client timeout 3221 ms). Trace:
I20260709 13:18:29.177939 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.183133 17320 rpcz_store.cc:276] 0709 13:18:27.483223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.182382 (+699159us) service_pool.cc:224] Handling call
0709 13:18:28.182658 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.182855 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:28.277995 (+ 95140us) log.cc:844] Serialized 14 byte log entry
0709 13:18:28.484757 (+206762us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.168761 (+684004us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18003aa6e0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:18:29.182277 (+ 13516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.182336 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:29.182381 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.182444 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.182563 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91595,"prepare.queue_time_us":194761,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":700879,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2963,"spinlock_wait_cycles":6670080,"thread_start_us":282134,"threads_started":2,"wal-append.queue_time_us":551294}
I20260709 13:18:29.162549 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:29.214277 17395 rpcz_store.cc:276] 0709 13:18:27.796500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.192115 (+1395615us) service_pool.cc:224] Handling call
0709 13:18:29.192429 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.192683 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.192730 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.192785 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:29.192829 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.192924 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.193050 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:29.498631 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.519446 17314 rpcz_store.cc:276] 0709 13:18:27.520545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.244570 (+724025us) service_pool.cc:224] Handling call
0709 13:18:28.257382 (+ 12812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.257605 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:28.483411 (+225806us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.172820 (+689409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.172915 (+    95us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:29.172962 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.173035 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.173174 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":389498,"prepare.queue_time_us":103985,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":390582,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":461257,"threads_started":2,"wal-append.queue_time_us":631129}
W20260709 13:18:29.518990 17315 rpcz_store.cc:269] 0709 13:18:26.371014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.378972 (+  7958us) service_pool.cc:224] Handling call
0709 13:18:29.164057 (+2785085us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400141ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.164177 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3089672448}
I20260709 13:18:29.518317 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2408) took 1388 ms. Trace:
I20260709 13:18:29.515336 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.534631 19545 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:29.535375 19521 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:29.536832 19757 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:29.537959 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 352077us
W20260709 13:18:29.284821 17990 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 518) took 2195 ms (client timeout 1623 ms). Trace:
W20260709 13:18:29.541662 17990 rpcz_store.cc:269] 0709 13:18:27.089799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.093238 (+  3439us) service_pool.cc:224] Handling call
0709 13:18:29.284562 (+2191324us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54006d1fd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.284720 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410819840}
I20260709 13:18:29.546275 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 418) took 2062 ms. Trace:
W20260709 13:18:29.547744 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.211575 19617 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.548856 19596 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:29.549990 17392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1420) took 3113 ms (client timeout 3261 ms). Trace:
W20260709 13:18:29.550457 17392 rpcz_store.cc:269] 0709 13:18:26.436301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.006626 (+570325us) service_pool.cc:224] Handling call
0709 13:18:29.549492 (+2542866us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400254254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.549807 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590591872}
I20260709 13:18:29.552148 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:29.511449 17318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1175) took 1855 ms (client timeout 1900 ms). Trace:
I20260709 13:18:29.189760 19505 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:29.518798 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:29.534132 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 318214us
W20260709 13:18:29.517925 17321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1170) took 2094 ms (client timeout 1806 ms). Trace:
I20260709 13:18:29.522316 17395 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260709 13:18:29.495117 17220 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 216) took 11436 ms (client timeout 15000 ms). Trace:
I20260709 13:18:29.546907 17313 rpcz_store.cc:276] 0709 13:18:27.483527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.190175 (+706648us) service_pool.cc:224] Handling call
0709 13:18:28.275283 (+ 85108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.336037 (+ 60754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.545656 (+1209619us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b540035bbd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.545972 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170571008}
I20260709 13:18:29.288980 19589 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:29.359154 19689 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 2.240s	user 0.002s	sys 0.009s
W20260709 13:18:29.197621 19710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.020s	sys 0.017s
W20260709 13:18:29.581988 17321 rpcz_store.cc:269] 0709 13:18:27.423070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.445224 (+ 22154us) service_pool.cc:224] Handling call
0709 13:18:29.162376 (+1717152us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:29.517688 (+355312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58421504}
I20260709 13:18:29.618779 19589 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:29.593393 19691 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:29.518788 17316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1452) took 2669 ms (client timeout 2631 ms). Trace:
I20260709 13:18:29.267993 19752 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:29.620241 17321 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:29.620662 19752 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:29.343214 19762 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:18:29.367530 19722 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:29.205138 19558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.000s	sys 0.009s
I20260709 13:18:29.621281 19752 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.599191 17391 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:29.624748 17313 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:29.625528 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 429) took 1447 ms. Trace:
I20260709 13:18:29.288340 19540 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.625864 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:29.582723 17220 rpcz_store.cc:269] 0709 13:18:18.058784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.058966 (+   182us) service_pool.cc:224] Handling call
0709 13:18:29.494852 (+11435886us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:21.599579 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:21.642097 (+ 42518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:21.642164 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:18:21.642191 (+    27us) tablet.cc:662] Decoding operations
0709 13:18:21.771117 (+128926us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:21.771243 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:21.771288 (+    45us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:18:22.134247 (+362959us) tablet.cc:701] Row locks acquired
0709 13:18:22.138511 (+  4264us) write_op.cc:260] PREPARE: finished
0709 13:18:22.138733 (+   222us) write_op.cc:270] Start()
0709 13:18:22.138916 (+   183us) write_op.cc:276] Timestamp: P: 1783603102138650 usec, L: 0
0709 13:18:22.138942 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:18:22.281917 (+142975us) log.cc:844] Serialized 5090 byte log entry
0709 13:18:22.745754 (+463837us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d5f6ea0ac 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b
0709 13:18:24.342151 (+1596397us) op_driver.cc:464] REPLICATION: finished
0709 13:18:24.978260 (+636109us) write_op.cc:301] APPLY: starting
0709 13:18:24.980455 (+  2195us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:25.017102 (+ 36647us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:25.017128 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:25.071960 (+ 54832us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:25.150134 (+ 78174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:18:25.150189 (+    55us) write_op.cc:312] APPLY: finished
0709 13:18:25.150496 (+   307us) log.cc:844] Serialized 95 byte log entry
0709 13:18:25.247766 (+ 97270us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:25.270489 (+ 22723us) write_op.cc:454] Released schema lock
0709 13:18:25.275053 (+  4564us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:25.299229 (+ 24176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:25.300458 (+  1229us) write_op.cc:454] Released schema lock
0709 13:18:27.394414 (+2093956us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b1800318a00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db
0709 13:18:27.446760 (+ 52346us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
Metrics: {"mutex_wait_us":348199,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":620966,"apply.run_cpu_time_us":18775,"apply.run_wall_time_us":314215,"num_ops":13,"prepare.queue_time_us":951611,"prepare.run_cpu_time_us":23335,"prepare.run_wall_time_us":1282044,"raft.queue_time_us":1074411,"raft.run_cpu_time_us":26804,"raft.run_wall_time_us":748365,"replication_time_us":2088271,"spinlock_wait_cycles":32010496,"thread_start_us":1618483,"threads_started":5,"wal-append.queue_time_us":768437,"wal-append.run_cpu_time_us":34778,"wal-append.run_wall_time_us":4625778}]]}
I20260709 13:18:29.534636 17390 rpcz_store.cc:276] 0709 13:18:28.129243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.206350 (+1077107us) service_pool.cc:224] Handling call
0709 13:18:29.516584 (+310234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.517396 (+   812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.517455 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.517547 (+    92us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:29.517720 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.517851 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.518030 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:29.354146 19705 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.786s	user 0.008s	sys 0.020s
I20260709 13:18:29.600387 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:29.629282 17392 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:29.630829 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:29.631389 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:29.631704 17392 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:29.341387 19723 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.631s	user 0.006s	sys 0.013s
I20260709 13:18:29.632359 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1428) took 1314 ms. Trace:
I20260709 13:18:29.205571 19747 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:29.635154 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:29.562731 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 425989us
I20260709 13:18:29.637240 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.638025 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:29.638348 17992 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:29.641184 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.641774 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2330) took 2025 ms. Trace:
I20260709 13:18:29.642181 17464 rpcz_store.cc:276] 0709 13:18:27.616254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.616369 (+   115us) service_pool.cc:224] Handling call
0709 13:18:27.645005 (+ 28636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.645395 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.645427 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.645962 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.705720 (+ 59758us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:27.705756 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.705815 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.340615 (+1634800us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:29.641180 (+300565us) raft_consensus.cc:1685] finished
0709 13:18:29.641223 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.641568 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2116,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":9690368,"thread_start_us":59414,"threads_started":1,"wal-append.queue_time_us":64074}
I20260709 13:18:29.596688 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 519) took 2444 ms. Trace:
I20260709 13:18:29.644354 17997 rpcz_store.cc:276] 0709 13:18:27.151959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.152108 (+   149us) service_pool.cc:224] Handling call
0709 13:18:27.172358 (+ 20250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.829693 (+657335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.584587 (+1754894us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b5400680954. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:29.596475 (+ 11888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509954944}
I20260709 13:18:29.603560 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.646037 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:29.646908 17397 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:29.647063 19691 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:29.647634 19691 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:29.648074 19691 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.648343 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.649217 17322 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
W20260709 13:18:29.649783 17322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1169) took 2228 ms (client timeout 1890 ms). Trace:
W20260709 13:18:29.649912 17995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 507) took 2229 ms (client timeout 1827 ms). Trace:
W20260709 13:18:29.650172 17322 rpcz_store.cc:269] 0709 13:18:27.421848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.454218 (+ 32370us) service_pool.cc:224] Handling call
0709 13:18:29.648005 (+2193787us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:29.649716 (+  1711us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37537664}
W20260709 13:18:29.650470 17995 rpcz_store.cc:269] 0709 13:18:27.420116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.427124 (+  7008us) service_pool.cc:224] Handling call
0709 13:18:29.649387 (+2222263us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5400695d54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.649696 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921762048}
W20260709 13:18:29.603893 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 65593.6us
I20260709 13:18:29.654543 17467 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:29.655294 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2347) took 1524 ms. Trace:
I20260709 13:18:29.655743 17467 rpcz_store.cc:276] 0709 13:18:28.130564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.653099 (+1522535us) service_pool.cc:224] Handling call
0709 13:18:29.653802 (+   703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.655003 (+  1201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.655218 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:29.620056 17316 rpcz_store.cc:269] 0709 13:18:26.849204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.897310 (+ 48106us) service_pool.cc:224] Handling call
0709 13:18:27.450496 (+553186us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:29.177742 (+1727246us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfe9c 00007f7d5f6cfa5b 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:29.518573 (+340831us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51657984}
W20260709 13:18:29.244064 19750 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:18:29.552755 19596 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:29.565379 17214 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49282 (request call id 325) took 20994 ms (client timeout 15000 ms). Trace:
I20260709 13:18:29.558179 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.606341 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 423) took 2066 ms. Trace:
I20260709 13:18:29.583747 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1332) took 1278 ms. Trace:
I20260709 13:18:29.559911 19676 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:29.553844 17396 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:29.629372 19540 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:29.616001 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2398) took 2836 ms. Trace:
I20260709 13:18:29.621052 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 428) took 1496 ms. Trace:
I20260709 13:18:29.582185 17395 pending_rounds.cc:85] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 2
I20260709 13:18:29.663223 17395 pending_rounds.cc:107] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:29.662990 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:29.663533 17391 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:29.663650 17395 raft_consensus.cc:2889] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:29.556900 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:29.664546 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:29.581696 17318 rpcz_store.cc:269] 0709 13:18:27.656153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.093654 (+437501us) service_pool.cc:224] Handling call
0709 13:18:29.510890 (+1417236us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000c9ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.511193 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2458708352}
I20260709 13:18:29.665011 19757 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.422379 17394 rpcz_store.cc:276] 0709 13:18:25.383999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.244313 (+1860314us) service_pool.cc:224] Handling call
0709 13:18:27.244677 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.244961 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:27.316173 (+ 71212us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.416040 (+ 99867us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.416087 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:27.416127 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.416191 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.416295 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130688,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":74,"thread_start_us":170373,"threads_started":2}
I20260709 13:18:29.665515 17391 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:29.662618 17321 rpcz_store.cc:276] 0709 13:18:28.125198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.619135 (+1493937us) service_pool.cc:224] Handling call
0709 13:18:29.619707 (+   572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.620733 (+  1026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.620983 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.662565 17389 rpcz_store.cc:276] 0709 13:18:26.779782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.232683 (+1452901us) service_pool.cc:224] Handling call
0709 13:18:29.151813 (+919130us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:29.152016 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.152410 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:29.165055 (+ 12645us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.516485 (+351430us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.517946 (+  1461us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.518251 (+   305us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:29.518702 (+   451us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.518928 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.519093 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.615564 (+ 96471us) raft_consensus.cc:1685] finished
0709 13:18:29.615603 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.615811 (+   208us) inbound_call.cc:177] Queueing success response
0709 13:18:29.616361 (+   550us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b18003bfe00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:18:29.648087 (+ 31726us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b18003bfe00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
Metrics: {"prepare.queue_time_us":15440,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":122,"raft.queue_time_us":26229,"raft.run_cpu_time_us":547,"raft.run_wall_time_us":540,"spinlock_wait_cycles":57663488,"thread_start_us":362502,"threads_started":2,"wal-append.queue_time_us":436069}
I20260709 13:18:29.668125 19676 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.669024 19676 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:29.670111 19747 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:29.671882 19676 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:29.480821 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 290430us
W20260709 13:18:29.659062 17214 rpcz_store.cc:269] 0709 13:18:08.585309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.585940 (+   631us) service_pool.cc:224] Handling call
0709 13:18:08.983773 (+397833us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275e090 00007f7d627fcf3a 00007f7d685b31cc 00007f7d686b137e 00007f7d66b722a4 00007f7d66b72232 00007f7d66b72161 00007f7d66b720dc 00007f7d66b71392 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:29.564266 (+20580493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2654782,"reported_tablets":7,"spinlock_wait_cycles":131782912}
I20260709 13:18:29.640563 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:29.664595 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2409) took 1380 ms. Trace:
I20260709 13:18:29.680423 17395 rpcz_store.cc:276] 0709 13:18:28.284607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.520746 (+1236139us) service_pool.cc:224] Handling call
0709 13:18:29.521391 (+   645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.664326 (+142935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.664509 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.660228 17319 rpcz_store.cc:276] 0709 13:18:27.540213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.604872 (+2064659us) service_pool.cc:224] Handling call
0709 13:18:29.605370 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.605884 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.605926 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.606007 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:29.606042 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.606117 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.606258 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.666747 17391 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:29.685734 19676 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:29.686432 19676 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:29.688576 19676 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.625877 17313 rpcz_store.cc:276] 0709 13:18:28.178096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.623952 (+1445856us) service_pool.cc:224] Handling call
0709 13:18:29.624419 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.625291 (+   872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.625476 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:29.693593 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53193us
I20260709 13:18:29.689690 19365 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:29.694942 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:29.695327 19365 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:29.695793 19365 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:29.696112 19747 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:29.696905 19747 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:29.697461 17393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 326) took 2433 ms (client timeout 2071 ms). Trace:
W20260709 13:18:29.698228 17393 rpcz_store.cc:269] 0709 13:18:27.263325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.707738 (+444413us) service_pool.cc:224] Handling call
0709 13:18:29.696811 (+1989073us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400253354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.697086 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234242944}
I20260709 13:18:29.698405 19747 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:29.703336 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:29.704437 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2371) took 4505 ms. Trace:
I20260709 13:18:29.704931 17396 rpcz_store.cc:276] 0709 13:18:25.199350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.127620 (+1928270us) service_pool.cc:224] Handling call
0709 13:18:29.553328 (+2425708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.661573 (+108245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.704158 (+ 42585us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b5400254250. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.704324 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5577723136}
I20260709 13:18:29.707257 19502 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:29.708748 19502 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:29.709190 19502 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:29.709295 19765 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:29.709797 19765 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:29.710199 19765 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.710352 19502 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:29.711850 19502 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.713959 17465 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:29.709318 17390 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:29.692284 19540 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:29.717324 19708 consensus_queue.cc:1059] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:18:29.724184 19708 raft_consensus.cc:3055] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:29.724656 19708 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:29.725647 19708 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:29.727130 19708 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.729382 19452 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.730136 19452 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:29.732982 19452 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:29.737013 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.737530 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.738104 17995 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:29.738735 17990 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:29.739840 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.738318 17997 raft_consensus.cc:2410] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:29.741163 17992 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:29.698421 19365 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:29.743930 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 109018us
I20260709 13:18:29.745059 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:29.746326 19505 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:29.746519 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:29.746879 19505 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.747411 19505 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.660450 17470 rpcz_store.cc:276] 0709 13:18:28.305591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.305734 (+   143us) service_pool.cc:224] Handling call
0709 13:18:29.153840 (+848106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.154206 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.154234 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.154702 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.155680 (+   978us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:29.155711 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.155782 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.157331 (+  1549us) raft_consensus.cc:1685] finished
0709 13:18:29.157347 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.565946 (+408599us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540041fad0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:29.583443 (+ 17497us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37581,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4700,"spinlock_wait_cycles":1949562624,"thread_start_us":621,"threads_started":1,"wal-append.queue_time_us":958}
I20260709 13:18:29.752595 19365 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.755932 19570 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:29.757488 19690 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:29.757932 19690 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:29.759102 19690 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:29.759828 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.760658 17990 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:29.672902 17388 rpcz_store.cc:276] 0709 13:18:28.317809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.630898 (+1313089us) service_pool.cc:224] Handling call
0709 13:18:29.632276 (+  1378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.761510 19690 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.762775 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.762411 17215 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 4 to 6, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 6 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.763950 17990 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:29.765508 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.765313 17215 catalog_manager.cc:5697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 6, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 6 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.766098 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.766474 17997 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:18:29.779506 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 133328us
I20260709 13:18:29.767124 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.768043 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:29.769088 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 197291us
I20260709 13:18:29.717931 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2410) took 1320 ms. Trace:
I20260709 13:18:29.755911 19505 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:29.784016 17391 rpcz_store.cc:276] 0709 13:18:28.362488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.666097 (+1303609us) service_pool.cc:224] Handling call
0709 13:18:29.666501 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.682732 (+ 16231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.682934 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:29.773041 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:29.773379 17389 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:29.740721 19691 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:29.779011 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:29.797083 17397 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:29.799104 17392 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:29.807471 19698 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:29.813238 19765 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:29.816100 19708 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:29.815374 17215 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 4, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 4 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:29.816846 19617 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:29.818342 19505 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:29.795812 19696 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:29.817866 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:29.833879 17465 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:29.837225 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 90921.8us
I20260709 13:18:29.846654 19690 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:29.819312 19752 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:29.823679 19617 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:29.852270 17215 catalog_manager.cc:5697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 3, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.877744 19752 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:29.923769 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:29.946332 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 173546us
I20260709 13:18:29.864471 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.856009 17314 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:29.863938 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:29.853361 19505 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 13:18:29.876502 19765 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:29.974231 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:29.874774 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 78429.8us
W20260709 13:18:29.972326 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 120834us
I20260709 13:18:29.875674 19696 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:18:29.975420 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.975718 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.851874 19698 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:29.975997 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.976572 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:29.976748 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.989830 17316 raft_consensus.cc:2410] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:29.892436 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1427) took 1574 ms. Trace:
I20260709 13:18:29.990546 17397 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:29.893744 19757 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:29.881506 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 102622us
W20260709 13:18:29.890489 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.990440 17394 rpcz_store.cc:276] 0709 13:18:28.317533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.665858 (+1348325us) service_pool.cc:224] Handling call
0709 13:18:29.666283 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:29.666773 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.666799 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:29.667433 (+   634us) log.cc:844] Serialized 52 byte log entry
0709 13:18:29.796479 (+129046us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:29.796545 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.796795 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.892063 (+ 95268us) raft_consensus.cc:1685] finished
0709 13:18:29.892088 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.892264 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5895,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":150,"thread_start_us":128521,"threads_started":1,"wal-append.queue_time_us":177939}
I20260709 13:18:29.861223 17462 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:29.961383 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.897298 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:29.881212 17463 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:18:29.942463 17391 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:29.916687 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.995136 17995 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:29.986734 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.916710 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:29.985612 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 134605us
I20260709 13:18:29.873986 19691 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:29.943513 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:29.994799 17463 pending_rounds.cc:85] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 6
I20260709 13:18:30.000950 17463 pending_rounds.cc:107] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:30.001353 17463 raft_consensus.cc:2889] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:29.922163 19676 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.003275 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:30.001276 17392 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
W20260709 13:18:30.004177 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 102063us
I20260709 13:18:30.007652 19694 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.008203 19694 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.008988 17316 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:30.009262 19757 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:30.009958 19757 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:30.010946 19757 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.012831 17435 leader_election.cc:400] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5.
I20260709 13:18:30.013190 17435 leader_election.cc:403] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.014424 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:30.011417 19694 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:29.998467 17388 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:30.023126 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:30.027232 19765 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5.
I20260709 13:18:30.030846 17470 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:29.998428 19365 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:30.031862 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:30.015568 17215 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 4, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 4 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.023741 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.037007 19698 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.038254 17467 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:30.041041 17462 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:30.042071 17469 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:30.045171 19570 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:30.046236 19570 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.047300 19540 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:30.047770 19540 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:30.050136 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:30.044397 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:30.058281 19765 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:30.051198 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:30.058813 19765 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:30.070184 19765 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:30.070979 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 47624.2us
I20260709 13:18:30.072072 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:30.026948 19691 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:30.080194 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47562.1us
W20260709 13:18:30.083863 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.084024 19596 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.084638 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.084805 19596 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.085120 18962 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:30.073155 19452 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:30.086409 19452 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:30.087412 19452 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.088457 19490 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:30.082880 17215 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 4, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 4 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.091048 19690 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:18:30.111179 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 67011.4us
I20260709 13:18:30.100001 19694 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:30.111739 17215 catalog_manager.cc:5697] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 2, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.116075 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:30.087407 19520 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:18:30.123462 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 72399.2us
I20260709 13:18:30.094707 19502 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:18:30.119485 19521 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:18:30.136049 19691 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:30.132285 19490 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:18:30.102100 19773 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 13:18:30.121181 19540 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.142753 19540 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.121832 19617 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:30.144258 19690 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.145520 19676 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:30.146386 19690 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:30.150302 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:30.153807 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:30.154575 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:30.155289 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:30.158111 19502 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:30.156823 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:30.157264 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:30.160090 19694 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:30.160696 19694 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:30.157734 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.155900 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.161778 19694 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.163362 19691 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:30.152437 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 45488.5us
I20260709 13:18:30.156610 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:30.167001 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:30.172811 17995 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:30.173206 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:30.172921 17215 catalog_manager.cc:5697] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.174929 17215 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 4, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 4 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.175092 19520 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:30.158718 19502 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:30.181356 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.183948 19774 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:30.186769 19559 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:30.187157 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.165102 19778 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:30.176067 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.178139 19698 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.169374 19617 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:30.193877 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:30.169166 19505 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:30.224012 19559 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:30.224499 19559 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:30.225234 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:30.225378 19559 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.226557 19559 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.227113 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:30.179988 19690 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:18:30.231921 19596 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:30.233629 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62726.5us
I20260709 13:18:30.194512 19710 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:30.235888 18962 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:30.192531 19521 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:30.238780 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.233669 19617 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.239889 19563 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:30.240798 19520 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:30.244119 19775 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.243142 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.235124 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:30.193442 19574 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.180730 19570 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:18:30.232787 19596 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.264899 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:30.266016 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:30.266844 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:30.261229 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:30.251012 19710 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.262562 17317 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:30.278878 17320 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
W20260709 13:18:30.270572 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 114022us
I20260709 13:18:30.249696 19521 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:30.321224 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 240003us
I20260709 13:18:30.268976 17215 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 4 to 5, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:30.290455 19779 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260709 13:18:30.281381 19777 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:30.292086 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:30.292248 17992 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:30.333461 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:30.279738 19778 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:30.336685 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:30.337538 17318 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:30.286206 19710 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.269094 19773 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.340668 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.340098 17995 raft_consensus.cc:2376] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8. Re-sending same reply.
I20260709 13:18:30.292625 19703 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:18:30.346825 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:30.290513 19617 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:30.357925 17469 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.347805 17316 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
W20260709 13:18:30.362804 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 129631us
I20260709 13:18:30.336272 19696 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:30.323307 17990 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:30.286383 19596 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.374907 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:30.375721 17462 raft_consensus.cc:2410] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:18:30.372545 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 137004us
I20260709 13:18:30.370519 17215 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 4 to 6, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 6 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.362155 19698 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.293355 19775 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.378399 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:30.322254 19574 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.366755 19617 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:30.407334 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:30.407927 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:30.418206 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 48444.5us
I20260709 13:18:30.411243 17215 catalog_manager.cc:5697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 2, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.360860 19777 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:30.413359 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45995.8us
I20260709 13:18:30.424279 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:30.429528 19781 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:30.429294 19778 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.431095 17215 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.432855 17215 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.434152 19490 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:30.434595 19490 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:30.434459 17215 catalog_manager.cc:5697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 4, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 4 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.435469 19490 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.437690 19365 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:30.438114 19365 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:30.438992 19365 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.440369 19365 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.441588 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:30.441836 17993 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:30.442554 17991 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:30.442445 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:30.443377 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:30.440721 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:30.444900 17997 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:30.445734 17435 leader_election.cc:400] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:30.446146 17435 leader_election.cc:403] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.406421 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:30.441728 17999 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:30.444304 17992 raft_consensus.cc:2410] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:30.436271 17215 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.372643 19773 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.418025 19559 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:30.462882 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:30.451649 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:30.466178 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:30.384948 19696 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:30.467167 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.456547 17993 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:30.469292 17471 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.454669 19490 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:30.472692 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 88023.8us
I20260709 13:18:30.473047 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:30.475520 19570 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:30.476898 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:30.415719 19521 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.481109 19521 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.422897 19617 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.464818 17215 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.487299 19570 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:30.488047 19782 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:30.488363 19773 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:30.488688 19789 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:30.488396 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 68198.6us
W20260709 13:18:30.491007 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.488108 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:30.493301 19502 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.493698 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:30.479658 19765 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.528358 19765 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.530511 19765 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:30.494511 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:30.501181 19570 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:30.533890 19570 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.494511 18962 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:30.464381 19559 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.535367 18962 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:30.535898 18962 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.541827 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:30.542323 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:30.542997 17389 raft_consensus.cc:2376] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6. Re-sending same reply.
I20260709 13:18:30.543710 17391 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:30.477996 19694 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:30.476447 19710 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.546111 17397 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:30.507290 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:30.549587 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 61611.3us
I20260709 13:18:30.507382 17215 catalog_manager.cc:5697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.509213 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:30.513603 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:30.516206 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:30.516633 19788 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:18:30.518332 19617 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:30.519369 17994 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:30.520131 19596 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:30.500830 19781 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:30.521746 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:30.565325 17999 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:30.523694 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:30.566603 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:30.525779 19775 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:30.527088 19574 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:30.506974 19782 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:30.535459 19559 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.498647 17471 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
W20260709 13:18:30.530627 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.555895 17996 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:30.558533 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.509204 19696 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:30.558822 17215 catalog_manager.cc:5697] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 4, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 4 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.560777 17469 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
W20260709 13:18:30.587767 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.488689 17991 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:30.565490 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:30.616750 17470 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:30.565253 17394 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:30.549357 19365 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:30.607559 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:30.608541 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:30.535385 19570 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:30.599536 19676 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:30.616745 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 100637us
I20260709 13:18:30.639950 17469 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:30.640578 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:30.562054 19789 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.615010 18962 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.643065 17318 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:30.599560 19781 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.599470 19502 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:30.611963 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.637790 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:30.644987 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.656353 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.648706 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:30.661734 17471 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
W20260709 13:18:30.662177 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 148638us
I20260709 13:18:30.657414 18962 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:30.634706 19365 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.665638 17215 catalog_manager.cc:5697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.668114 17396 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:30.637604 19691 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:30.646703 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.671188 17215 catalog_manager.cc:5697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 4, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 4 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.651939 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.668002 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:30.682447 17395 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.670478 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:30.639040 19676 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:30.665760 19694 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.674121 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:30.675241 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:30.673005 17462 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:30.655756 19781 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.671813 19365 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.671587 19691 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:30.681911 19765 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:30.717262 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 223645us
W20260709 13:18:30.727669 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 47104.5us
I20260709 13:18:30.687906 19676 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.735615 19787 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:18:30.738041 19783 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:30.738704 19783 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:30.739787 19783 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.741176 19789 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:30.741626 19536 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:30.735975 19596 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:30.742097 19536 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:30.742573 19596 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.744266 19787 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:30.744654 19787 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:30.745811 17315 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:30.745527 19787 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.746775 19540 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:30.747624 19596 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:30.747895 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:30.742803 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:30.749048 19703 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.749380 17995 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:30.750614 17995 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:30.751786 17995 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:30.713514 19791 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.753260 19791 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:30.755515 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:30.757148 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:30.725983 19776 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:30.759080 19703 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:30.759174 19776 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.761577 19776 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:30.763338 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:30.730274 19520 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:30.765195 19520 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:30.765544 19520 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:30.774515 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 120270us
I20260709 13:18:30.727310 19691 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.725589 19690 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.736590 17215 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 4, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 4 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:30.803447 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 111804us
I20260709 13:18:30.793433 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:30.809285 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:30.729748 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:30.808611 17215 catalog_manager.cc:5697] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 3, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.824510 17215 catalog_manager.cc:5697] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.834677 18962 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:30.834887 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:30.843757 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 288592us
W20260709 13:18:30.848541 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 134474us
I20260709 13:18:30.849207 18962 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:30.848599 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:30.811475 19521 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:18:30.833642 19710 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:30.804615 19703 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:18:30.887566 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:30.841413 19694 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:30.901957 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 92761.4us
I20260709 13:18:30.810791 19617 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:18:30.854107 19490 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:30.912753 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 165449us
I20260709 13:18:30.820442 19690 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.897971 17215 catalog_manager.cc:5697] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 3, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:30.905500 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 189907us
I20260709 13:18:30.888285 17993 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:30.771430 19782 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:30.926112 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:30.926918 17462 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.969298 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:30.971999 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 133982us
I20260709 13:18:30.916704 19773 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:18:30.978142 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:30.975823 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 60946.2us
I20260709 13:18:30.979699 17285 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:30.978061 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:18:30.992699 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 139143us
I20260709 13:18:30.936569 19694 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:30.991678 19558 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:31.010082 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 153857us
W20260709 13:18:31.021672 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56270.2us
I20260709 13:18:30.994076 19804 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:31.027983 19794 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:31.031349 19811 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.030383 19778 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.033903 17360 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:31.057236 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 77620.4us
I20260709 13:18:31.059253 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:31.103380 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.107753 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:31.109860 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:31.110538 17394 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:31.032476 19777 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:31.118002 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:31.117867 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:31.121625 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:31.122287 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 148118us
I20260709 13:18:31.122520 17317 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:31.138443 17321 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:31.143329 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:31.166426 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.188704 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:31.189747 17322 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
I20260709 13:18:31.199956 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:31.201545 17318 raft_consensus.cc:2410] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:31.201435 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:31.123459 19617 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:31.028947 19804 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:31.215220 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 95502.3us
I20260709 13:18:31.219434 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:31.225814 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:31.220256 17319 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:31.144423 19815 raft_consensus.cc:2764] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:31.237396 19490 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:31.241890 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 269873us
W20260709 13:18:31.233178 17362 leader_election.cc:336] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.506s (SENT)
I20260709 13:18:31.249264 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:31.231740 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:31.226575 17468 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:31.204258 19690 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:31.207320 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:31.146303 19710 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:18:31.214426 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:31.241639 19502 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.002s
I20260709 13:18:31.275906 17435 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:31.136824 19452 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
W20260709 13:18:31.288206 19797 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:18:31.283386 19690 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.288235 19793 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:18:31.312443 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 91586.8us
I20260709 13:18:31.288120 19777 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.318081 17964 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:31.317543 19690 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:31.322706 19807 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
W20260709 13:18:31.322950 19825 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:18:31.289215 17993 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 2.
W20260709 13:18:31.329239 19812 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:18:31.329787 19824 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:31.330439 19824 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:31.331593 19570 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.000s
I20260709 13:18:31.331442 19824 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.289950 17314 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:31.333889 19835 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:31.333926 19802 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
W20260709 13:18:31.336288 17395 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.000s
I20260709 13:18:31.336097 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:31.336684 19777 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.324673 19548 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:31.333590 19818 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 13:18:31.317399 19795 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:18:31.324646 19690 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:31.338577 19559 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.694s	user 0.005s	sys 0.003s
W20260709 13:18:31.338886 19520 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 13:18:31.302373 19776 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.303988 19815 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:31.340304 17462 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:31.340989 17395 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:31.350530 17998 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:31.364792 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:31.322574 19819 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:18:31.387143 19548 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:31.334255 19822 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 13:18:31.393106 19832 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.393603 19834 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.341454 19676 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.001s
I20260709 13:18:31.340538 19696 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.454638 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 118604us
W20260709 13:18:31.422914 19781 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.709s	user 0.013s	sys 0.010s
W20260709 13:18:31.412387 17465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.016s
I20260709 13:18:31.394678 19559 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:31.473225 17465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.009s	sys 0.017s
W20260709 13:18:31.481763 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 427037us
I20260709 13:18:31.511166 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2382) took 1128 ms. Trace:
I20260709 13:18:31.514391 17464 rpcz_store.cc:276] 0709 13:18:30.382886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.382996 (+   110us) service_pool.cc:224] Handling call
0709 13:18:30.414866 (+ 31870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.463205 (+ 48339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.463237 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.477959 (+ 14722us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.647086 (+169127us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:30.647124 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.647188 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.510972 (+863784us) raft_consensus.cc:1685] finished
0709 13:18:31.510991 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.511109 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3296,"raft.queue_time_us":17045,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":2360,"thread_start_us":137607,"threads_started":1,"wal-append.queue_time_us":305922}
W20260709 13:18:31.519695 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 199445us
I20260709 13:18:31.520517 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:31.520767 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.521194 17462 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:31.523521 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:31.526301 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.529675 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:31.396471 19520 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:31.533810 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 78252.1us
I20260709 13:18:31.473776 19617 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:31.454325 19676 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:31.561275 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 340508us
I20260709 13:18:31.562403 17992 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:18:31.562733 17362 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.528s (SENT)
I20260709 13:18:31.563175 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:31.563835 19691 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.742s	user 0.007s	sys 0.001s
I20260709 13:18:31.564752 19559 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:31.565641 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:31.518812 19698 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:31.459630 19696 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:31.564265 17362 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.626s (SENT)
I20260709 13:18:31.564590 19839 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:31.586400 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:31.449453 19815 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:31.506228 19781 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.564255 19691 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.461494 19834 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.449641 19832 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.583499 19502 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:31.604401 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 66582.4us
I20260709 13:18:31.608675 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:31.608686 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:31.598760 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 75260.8us
I20260709 13:18:31.611171 19842 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:31.611863 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:31.642720 17397 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:31.612340 19835 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.611176 19848 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.615024 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2386) took 1198 ms. Trace:
I20260709 13:18:31.616952 19851 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.617411 17466 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:31.617698 19830 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:31.618271 19783 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:18:31.619943 19833 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:18:31.620548 19617 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:31.622967 17996 raft_consensus.cc:2368] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6.
I20260709 13:18:31.625082 17993 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:18:31.625133 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:31.626150 19832 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:31.627274 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:31.627995 19777 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:31.628383 19765 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.609597 17394 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:18:31.645393 17469 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:31.557858 19548 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.599725 19804 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:31.650951 19502 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:31.588122 19829 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.594888 19840 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:31.737310 19828 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:18:31.651021 19835 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.752797 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:31.753368 19548 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.753548 17394 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:31.737030 19805 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.754078 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2388) took 1199 ms. Trace:
I20260709 13:18:31.755342 19502 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.754624 17470 rpcz_store.cc:276] 0709 13:18:30.554788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.745775 (+190987us) service_pool.cc:224] Handling call
0709 13:18:30.746087 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.777116 (+ 31029us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:30.931022 (+153906us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.397831 (+466809us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.422262 (+ 24431us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.422572 (+   310us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:31.422640 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.422774 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.753900 (+331126us) raft_consensus.cc:1685] finished
0709 13:18:31.753918 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.754030 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30562,"prepare.queue_time_us":115855,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":20341,"raft.queue_time_us":220306,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":24124,"thread_start_us":512251,"threads_started":3,"wal-append.queue_time_us":430878}
I20260709 13:18:31.756697 19777 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:31.755703 19765 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:31.721807 19365 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.989s	user 0.012s	sys 0.000s
I20260709 13:18:31.757649 19777 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:31.757974 19365 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:31.719026 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:31.758147 19840 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.759140 17320 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:31.755187 17390 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:31.762539 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:31.763047 17397 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:31.763191 17396 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:31.764041 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:31.764729 17397 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
W20260709 13:18:31.742700 19810 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:18:31.772429 17397 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:18:31.772553 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2431) took 1171 ms. Trace:
I20260709 13:18:31.773051 17391 rpcz_store.cc:276] 0709 13:18:30.600982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.601398 (+   416us) service_pool.cc:224] Handling call
0709 13:18:30.601816 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.617761 (+ 15945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.617805 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.658400 (+ 40595us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.914016 (+255616us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:30.914054 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.914120 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.772311 (+858191us) raft_consensus.cc:1685] finished
0709 13:18:31.772334 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.772492 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":946,"raft.queue_time_us":6791,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":9036,"thread_start_us":216258,"threads_started":1,"wal-append.queue_time_us":839206}
I20260709 13:18:31.774240 17397 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:31.742708 19536 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:31.755016 19835 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:31.771016 17993 pending_rounds.cc:85] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 5
I20260709 13:18:31.777241 17993 pending_rounds.cc:107] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:18:31.776551 17391 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:31.777535 19536 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.777603 17993 raft_consensus.cc:2889] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.776948 17397 pending_rounds.cc:85] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 5
I20260709 13:18:31.779588 17397 pending_rounds.cc:107] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:31.780045 17397 raft_consensus.cc:2889] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.757766 19765 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.763062 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:31.728538 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:31.782282 17392 raft_consensus.cc:2376] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5. Re-sending same reply.
I20260709 13:18:31.784768 19365 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:31.644212 17465 rpcz_store.cc:276] 0709 13:18:30.416728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.543117 (+126389us) service_pool.cc:224] Handling call
0709 13:18:30.543439 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.543834 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:30.872252 (+328418us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.507083 (+634831us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.510232 (+  3149us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.512790 (+  2558us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:31.512830 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.512923 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.614719 (+101796us) raft_consensus.cc:1685] finished
0709 13:18:31.614752 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.614938 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36891,"prepare.queue_time_us":310488,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":113786,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":21207,"thread_start_us":912065,"threads_started":2,"wal-append.queue_time_us":707738}
I20260709 13:18:31.788801 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2434) took 1145 ms. Trace:
I20260709 13:18:31.789238 17393 rpcz_store.cc:276] 0709 13:18:30.643631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.643941 (+   310us) service_pool.cc:224] Handling call
0709 13:18:30.666948 (+ 23007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.674087 (+  7139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.674129 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.685174 (+ 11045us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.117481 (+432307us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:31.118516 (+  1035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.118589 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.788595 (+670006us) raft_consensus.cc:1685] finished
0709 13:18:31.788619 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.788741 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14750,"raft.queue_time_us":9836,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2684,"thread_start_us":319489,"threads_started":1,"wal-append.queue_time_us":592659}
I20260709 13:18:31.791746 17395 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.755077 17394 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:31.796123 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:31.801187 19836 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:18:31.802625 19854 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:31.803262 19854 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.804466 19824 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.807475 19857 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.651140 19848 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:31.760687 19840 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:31.762532 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:31.833572 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2387) took 1379 ms. Trace:
I20260709 13:18:31.813336 19824 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:31.834038 17467 rpcz_store.cc:276] 0709 13:18:30.454714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.460562 (+  5848us) service_pool.cc:224] Handling call
0709 13:18:30.471897 (+ 11335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:30.599576 (+127679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.599613 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:30.650412 (+ 50799us) log.cc:844] Serialized 52 byte log entry
0709 13:18:30.921501 (+271089us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:30.921958 (+   457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.819266 (+897308us) spinlock_profiling.cc:243] Waited 93.9 ms on lock 0x7b5400161f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:31.819315 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.819383 (+    68us) raft_consensus.cc:1685] finished
0709 13:18:31.819398 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.833483 (+ 14085us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3999,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7591,"spinlock_wait_cycles":216041856,"thread_start_us":215972,"threads_started":1,"wal-append.queue_time_us":353412}
W20260709 13:18:32.073431 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 310969us
I20260709 13:18:32.037211 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:32.062309 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.079360 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:32.080274 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.837809 19540 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.081195 19540 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.081828 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:31.856412 19783 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.070889 17321 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:31.915886 17395 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
W20260709 13:18:32.061992 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 265951us
I20260709 13:18:32.083367 19783 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.083747 19540 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:32.021142 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:32.104501 19848 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:31.956267 17998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 699) took 1499 ms (client timeout 1700 ms). Trace:
W20260709 13:18:32.105100 17998 rpcz_store.cc:269] 0709 13:18:30.439433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.442095 (+  2662us) service_pool.cc:224] Handling call
0709 13:18:31.938803 (+1496708us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b5400687754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:31.938966 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936847104}
I20260709 13:18:31.861123 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:32.061619 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 452972us
I20260709 13:18:32.020828 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:32.111407 18962 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:32.111500 17318 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:32.111728 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:31.989995 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.090082 19452 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.091944 17393 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:32.091907 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:32.120782 17396 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.092355 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:32.121380 17395 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.080140 19824 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:32.094796 19563 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:32.095304 19860 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:32.080436 19789 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:31.973080 19698 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:31.934899 19596 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:31.989789 17313 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:32.122524 19805 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:32.103345 19783 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:32.104638 17317 raft_consensus.cc:2410] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:32.111888 18962 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.020011 17315 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:18:32.112279 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 251226us
I20260709 13:18:31.936314 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2428) took 1392 ms. Trace:
W20260709 13:18:32.077216 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 512925us
I20260709 13:18:32.126380 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:32.156526 18962 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.859961 19840 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:32.173702 19781 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:32.077560 19787 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.971396 19854 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:31.990852 19815 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:31.991973 19691 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:31.936820 19757 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:32.110877 19773 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.144560 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.182410 17997 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:32.149731 17395 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:32.150441 17322 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:32.151041 17998 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:32.151278 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:32.061043 19365 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:32.123324 19859 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:32.158301 19824 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:32.144064 19860 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.158557 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:32.143699 19563 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:32.158313 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2426) took 1615 ms. Trace:
I20260709 13:18:32.209540 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:32.160367 19520 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:32.160516 19676 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:32.162174 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.217319 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.163244 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.206061 19773 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.218235 17992 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:18:32.218765 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:32.219306 17998 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.150452 19596 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:32.220180 19773 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:32.165491 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 51532.7us
I20260709 13:18:32.221063 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:32.150323 19698 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:32.166014 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:32.167207 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2396) took 1143 ms. Trace:
I20260709 13:18:32.167831 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:32.168115 17996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 715) took 1672 ms (client timeout 1804 ms). Trace:
I20260709 13:18:32.168601 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:32.168952 17995 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:32.182016 19757 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:32.172111 17396 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:32.221988 17466 rpcz_store.cc:276] 0709 13:18:31.023766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.028660 (+  4894us) service_pool.cc:224] Handling call
0709 13:18:31.060184 (+ 31524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.758039 (+697855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.166962 (+408923us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b5400200b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:32.167147 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202223360}
W20260709 13:18:32.157486 17362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.635s (SENT) [suppressed 40 similar messages]
I20260709 13:18:32.164562 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 442) took 1137 ms. Trace:
I20260709 13:18:32.227320 19521 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:32.227747 17313 rpcz_store.cc:276] 0709 13:18:31.027145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.973704 (+946559us) service_pool.cc:224] Handling call
0709 13:18:31.989548 (+ 15844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.164305 (+174757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.164508 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.229198 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:32.232677 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:32.205410 19365 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.233918 17468 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:31.966050 19765 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.235654 19365 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:32.236296 19765 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:32.152335 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.237308 17990 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
W20260709 13:18:32.181636 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.238004 19808 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:32.186789 18962 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.197690 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1474) took 1488 ms. Trace:
I20260709 13:18:32.238819 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:32.238955 17320 rpcz_store.cc:276] 0709 13:18:30.708883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.725359 (+ 16476us) service_pool.cc:224] Handling call
0709 13:18:30.734212 (+  8853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.759587 (+1025375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.197346 (+437759us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001419d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:32.197599 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2356653824}
I20260709 13:18:32.240072 19844 raft_consensus.cc:2764] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:32.201093 19859 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.201520 19854 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:32.202570 17464 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:32.203935 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:32.159852 17991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 707) took 1666 ms (client timeout 2178 ms). Trace:
I20260709 13:18:32.145133 19789 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:32.212674 17467 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:32.212606 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:32.214246 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:32.173702 19840 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:32.217674 17993 raft_consensus.cc:2410] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:32.157351 19805 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.219187 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.128604 19452 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.156534 17389 rpcz_store.cc:276] 0709 13:18:30.543688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.549132 (+  5444us) service_pool.cc:224] Handling call
0709 13:18:30.564629 (+ 15497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.615519 (+ 50890us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:30.762072 (+146553us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b18003bffe0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf 00007f7d6280e038
0709 13:18:30.921238 (+159166us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.531365 (+610127us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.531923 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.532067 (+   144us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:31.532679 (+   612us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.533262 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.533335 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.936025 (+402690us) raft_consensus.cc:1685] finished
0709 13:18:31.936052 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.936229 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5557,"prepare.queue_time_us":406165,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":113028,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":10924,"spinlock_wait_cycles":7780608,"thread_start_us":643139,"threads_started":2,"wal-append.queue_time_us":970070}
W20260709 13:18:32.224540 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 56030.3us
W20260709 13:18:32.222476 17996 rpcz_store.cc:269] 0709 13:18:30.495900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.651495 (+155595us) service_pool.cc:224] Handling call
0709 13:18:32.167926 (+1516431us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b540049a2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:32.168058 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161011072}
I20260709 13:18:32.199034 19824 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:32.201229 19829 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:18:32.220399 19596 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.200788 19848 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:18:32.199992 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 162909us
I20260709 13:18:32.377604 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 358) took 1862 ms. Trace:
I20260709 13:18:32.381207 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:32.240213 17315 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:32.262444 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 111186us
I20260709 13:18:32.378961 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:32.382987 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:32.335384 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:32.381284 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:32.381381 17469 rpcz_store.cc:276] 0709 13:18:30.515000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.640913 (+125913us) service_pool.cc:224] Handling call
0709 13:18:30.663133 (+ 22220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.755669 (+1092536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.360287 (+604618us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54001617d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:32.377498 (+ 17211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2258367232}
I20260709 13:18:32.398011 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:32.399289 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:32.400329 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 242842us
I20260709 13:18:32.401297 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:32.400410 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 179412us
I20260709 13:18:32.404597 17998 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:32.407219 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:32.303248 19574 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:32.408141 17469 raft_consensus.cc:2410] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:32.275789 19563 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.409819 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:32.411233 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:32.411736 18962 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:32.241374 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:32.417505 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:32.418087 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:32.418993 17360 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:32.420653 17471 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:32.276073 19860 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:32.395924 19789 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.382141 19859 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:32.396493 19824 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.459721 17463 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:32.424518 17999 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:32.399760 19617 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:32.458582 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.484038 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:32.397023 19835 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:32.422703 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.423022 19694 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:32.458177 17992 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:32.513762 17435 leader_election.cc:400] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 7.
I20260709 13:18:32.424048 19596 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.521330 17435 leader_election.cc:403] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:32.425189 19540 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:32.424950 19844 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:32.523491 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 66517.1us
I20260709 13:18:32.421552 19815 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:32.531777 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:32.421897 19773 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:32.419912 19805 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.419312 19854 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.516490 17313 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:32.454289 19832 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:32.424880 19676 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
W20260709 13:18:32.396402 17991 rpcz_store.cc:269] 0709 13:18:30.493572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.679411 (+185839us) service_pool.cc:224] Handling call
0709 13:18:31.989799 (+1310388us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:32.159787 (+169988us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35379584}
I20260709 13:18:32.516326 19782 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:32.424316 19826 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:18:32.518932 19548 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:32.487406 19617 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:32.537943 19452 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:32.411366 19757 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.518658 19558 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:18:32.545317 19835 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:32.545951 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 90268.2us
I20260709 13:18:32.455765 19778 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:18:32.547585 17362 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.806s (SENT)
W20260709 13:18:32.520341 19872 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:18:32.455556 19502 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:18:32.425034 19783 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.130s
W20260709 13:18:32.582558 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 163644us
I20260709 13:18:32.534137 19844 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.527015 19694 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:32.547751 19781 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:32.593067 19829 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:32.593499 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 192233us
I20260709 13:18:32.593070 19676 consensus_queue.cc:1243] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:32.577850 19832 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.590128 19782 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.616101 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 68522.3us
W20260709 13:18:32.634248 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 84897us
I20260709 13:18:32.589689 19540 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:32.561905 19815 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:32.634703 17362 leader_election.cc:336] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.827s (SENT)
I20260709 13:18:32.592643 19703 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:32.621671 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 240515us
I20260709 13:18:32.591311 19520 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:32.534071 19773 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.635298 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:32.636866 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:32.592739 19548 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:32.628988 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:32.595144 19617 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.616683 19574 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:32.578565 19848 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.637535 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:32.621973 19844 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.642537 17389 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:32.622025 19877 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:32.628225 19781 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:32.579998 19840 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.634017 19832 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.633265 19563 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.647544 19548 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.636648 19520 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.641351 19835 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:32.641312 19773 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.636638 19782 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:32.670042 19563 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.670231 19574 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.678680 19815 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:32.666392 19781 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.686358 19878 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:32.689421 19868 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:18:32.689821 19854 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:32.210038 17388 rpcz_store.cc:276] 0709 13:18:30.543131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.557095 (+ 13964us) service_pool.cc:224] Handling call
0709 13:18:31.536903 (+979808us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfeee 0000000000375939 00007f7d677431e0 00007f7d6780c0c4 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:31.557302 (+ 20399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.572782 (+ 15480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.577443 (+  4661us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.649608 (+ 72165us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.859485 (+209877us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:31.933407 (+ 73922us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.933669 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.933814 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.155607 (+221793us) raft_consensus.cc:1685] finished
0709 13:18:32.158120 (+  2513us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.158253 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62649,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":22962,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":4735,"spinlock_wait_cycles":35237248,"thread_start_us":159954,"threads_started":1,"wal-append.queue_time_us":502318}
I20260709 13:18:32.694630 19783 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:32.696967 19703 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:32.702873 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 68194.9us
I20260709 13:18:32.638762 19778 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:18:32.661978 19877 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:32.641201 19829 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.716321 19835 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:32.713728 19520 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:32.740628 17362 leader_election.cc:336] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.860s (SENT)
I20260709 13:18:32.751071 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:32.717672 19596 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:32.754073 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 125150us
W20260709 13:18:32.745136 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 98265.4us
I20260709 13:18:32.755365 17322 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:32.743820 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 324557us
I20260709 13:18:32.756983 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:32.759742 17285 leader_election.cc:400] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6.
I20260709 13:18:32.763314 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:32.763875 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:32.744745 19877 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:32.755952 19870 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 13:18:32.773375 17362 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.966s (SENT)
I20260709 13:18:32.764816 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:32.754354 19596 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:32.786450 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:32.775014 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:32.787897 17317 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:32.789124 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:32.789284 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:32.793073 19890 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:32.793648 19890 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.796052 19890 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:32.798067 19829 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:32.798444 19882 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:32.798678 19703 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.800474 17963 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:32.801803 17322 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:32.799109 19882 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:32.803097 19698 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260709 13:18:32.803560 19698 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.803881 19882 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.750226 19540 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.804921 19835 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.787300 19887 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:32.806159 19835 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.806397 19887 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:32.806788 19890 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:32.809937 19890 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:32.754848 19778 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:32.769501 19878 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:32.730163 19694 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.837226 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:32.790179 19596 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.844528 17464 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:32.846572 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46193.6us
I20260709 13:18:32.823791 19790 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.796568 19824 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.771575 19888 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:18:32.831409 19829 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:32.841841 19548 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.861457 17471 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:32.863336 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 103782us
W20260709 13:18:32.867146 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 105038us
I20260709 13:18:32.842214 19893 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:32.882352 17362 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.865s (SENT)
I20260709 13:18:32.882949 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:32.863974 19892 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:32.899091 17394 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:32.899775 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.900589 17999 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
W20260709 13:18:32.903609 17362 leader_election.cc:336] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.900s (SENT)
I20260709 13:18:32.904214 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:32.859917 19890 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.916934 17395 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:32.850512 19878 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:18:32.932097 19081 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:32.933189 19889 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:18:32.902491 19900 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.936100 19900 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.936941 19781 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.938378 19900 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:32.939182 19781 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:32.915118 19869 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.940251 19869 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.941316 19877 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.921193 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.942443 19869 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:32.888685 19829 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.906160 19563 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:32.940441 19848 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 7.
W20260709 13:18:32.947453 17362 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.519s (SENT)
I20260709 13:18:32.919246 19815 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:32.856353 19790 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.952325 19901 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.953378 19834 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:32.953712 19790 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:32.955155 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.955596 19520 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.956974 17318 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:32.901724 19778 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:18:32.926402 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:32.941360 17994 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:32.923465 19896 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:32.932686 19081 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:32.940491 19773 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:32.959419 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:32.989223 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.001842 19548 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.002638 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:33.003135 19791 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.004788 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:33.005484 17395 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.988288 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:32.948408 19789 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.008921 19888 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:33.010751 19773 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:32.984967 19848 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.978170 19790 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:18:33.011451 19848 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.012259 19790 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:33.012619 19790 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:33.013495 19848 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.013444 19790 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.014710 19790 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.945248 19617 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.025323 17395 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:33.033239 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.042448 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 712) took 2547 ms. Trace:
I20260709 13:18:33.043368 17995 rpcz_store.cc:276] 0709 13:18:30.495019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.752370 (+257351us) service_pool.cc:224] Handling call
0709 13:18:32.168734 (+1416364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.223495 (+ 54761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.040402 (+816907us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540049a2d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:33.042381 (+  1979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3256685824}
I20260709 13:18:32.961336 19901 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.052029 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:33.056052 19897 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:33.058581 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.059207 17469 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:33.060097 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.060426 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:33.056039 19596 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.062211 19081 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.062933 19081 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.063297 19081 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.063651 19081 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.063966 19596 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.075361 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.076089 17463 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:33.079044 17463 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:33.079209 19698 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.080044 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:33.080328 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.075441 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:33.082199 19829 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.082520 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.030138 19505 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:18:33.083315 19505 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:33.083670 19505 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:33.084441 19505 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.085645 19505 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.089037 19791 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.094256 19777 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.095477 19823 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:33.096127 19826 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:33.097883 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:33.076146 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.109400 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.060608 17469 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:33.102594 19696 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:33.102336 19869 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:33.111495 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:33.124181 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:33.124539 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 73139.3us
I20260709 13:18:33.126248 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.116956 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.053632 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:33.133191 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:33.134008 17393 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:33.127131 17467 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:33.118219 19905 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:33.032879 19859 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.139369 19905 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:33.140450 19905 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.142956 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:33.105721 19880 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.155543 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44186.3us
I20260709 13:18:33.040910 19832 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.105857 19558 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.107710 19823 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:33.105518 19596 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:33.107255 19826 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:33.116554 19877 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.200503 19596 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.157229 17992 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.207932 19596 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.154976 19882 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.157660 19869 consensus_queue.cc:1243] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:33.209738 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.158344 19777 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.213238 17467 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:33.166090 19540 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.217995 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:33.225008 17469 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:33.229451 17287 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:33.232672 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.233497 17467 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:33.233623 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.234786 17470 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:33.235548 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:33.239207 17287 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:33.232086 19563 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.236874 19520 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:33.246443 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.246558 19703 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:33.247044 19703 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.247366 19703 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.249739 19596 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:33.250391 19596 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:33.252941 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.248515 17393 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:33.268561 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.269579 17469 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:33.219962 19540 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.181975 19880 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.183677 19558 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.254981 19521 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.252743 19596 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.322131 17397 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:33.309264 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:33.316370 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 77256.3us
W20260709 13:18:33.274008 19867 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:33.317785 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:33.323269 17392 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:33.323740 17393 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:33.314348 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.219360 19849 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:18:33.319576 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.280556 19540 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.329954 17467 raft_consensus.cc:2368] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4.
I20260709 13:18:33.337468 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:33.341001 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.341784 17462 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.317420 19521 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.319240 19563 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:33.346503 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:33.357335 17392 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:33.349751 17397 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:33.352819 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.359560 17470 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.370738 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.385656 17393 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:33.336791 19452 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.368361 19906 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:18:33.342892 19782 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.003s
W20260709 13:18:33.351855 19844 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.000s
I20260709 13:18:33.394250 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1480) took 1169 ms. Trace:
I20260709 13:18:33.349725 19869 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:33.392382 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:33.356333 19521 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.279891 19826 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.404307 17394 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.385324 17467 raft_consensus.cc:2376] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4. Re-sending same reply.
I20260709 13:18:33.356104 19849 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:33.399835 17392 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:33.394018 19844 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.408334 17462 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:33.387341 19563 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:33.414297 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:33.421449 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.255388 19823 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.466794 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:33.469558 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.471453 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.472258 17462 raft_consensus.cc:2410] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:33.473032 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.473723 17462 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:33.474504 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.475507 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.402711 19782 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.478920 19782 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.480311 19563 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.483067 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.401463 19869 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:33.394729 17313 rpcz_store.cc:276] 0709 13:18:32.224691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.228903 (+  4212us) service_pool.cc:224] Handling call
0709 13:18:33.394030 (+1165127us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400211e54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:33.394188 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431314176}
I20260709 13:18:33.465915 19452 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.486315 19826 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.409673 19849 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.512899 17467 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.498533 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:33.411993 19901 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.522825 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:33.509328 19914 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:18:33.523550 17392 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:33.524335 17995 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:33.498394 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:33.529697 19911 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:18:33.530582 19880 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.511801 19832 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:33.517987 19849 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.541972 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:33.549415 19920 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:18:33.550959 19913 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:18:33.555249 17470 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:33.556375 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.557768 17470 raft_consensus.cc:2410] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:33.542169 17990 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:33.602100 19805 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.013s	user 0.001s	sys 0.010s
I20260709 13:18:33.602527 17992 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:33.602593 19805 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:33.605197 19918 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:18:33.607875 19930 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:33.611717 19521 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.597110 19452 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.612941 19558 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.593683 17321 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:18:33.626597 17321 pending_rounds.cc:85] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 6
I20260709 13:18:33.626842 17321 pending_rounds.cc:107] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:33.627069 17321 raft_consensus.cc:2889] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:33.614843 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.593876 19869 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.627703 17470 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:33.620667 17998 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:33.619468 17434 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:33.633167 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:33.637274 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:33.637622 17318 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:33.638121 17322 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.639225 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 726) took 1490 ms. Trace:
I20260709 13:18:33.639665 17998 rpcz_store.cc:276] 0709 13:18:32.142134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.405633 (+263499us) service_pool.cc:224] Handling call
0709 13:18:33.620052 (+1214419us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:33.620333 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.632022 (+ 11689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.632319 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14502144}
I20260709 13:18:33.643750 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.644467 17468 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:33.604712 19805 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.648303 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.649178 17470 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:33.624907 19895 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:33.669674 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:33.652050 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:33.627235 19822 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.628618 19536 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.639043 19520 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.641700 19676 raft_consensus.cc:2764] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:33.678268 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.590399 19829 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:18:33.679557 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:33.680635 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.681144 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.647840 19452 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.701908 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:33.701632 17395 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:18:33.710825 17395 pending_rounds.cc:85] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 2
I20260709 13:18:33.707338 19703 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.708372 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.707082 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.715601 17469 raft_consensus.cc:2410] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:33.715963 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.701772 17470 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:33.719187 17470 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:33.711139 17395 pending_rounds.cc:107] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:33.721102 17395 raft_consensus.cc:2889] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:33.711352 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:33.724155 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:33.725081 19787 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:33.725134 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:33.725893 19787 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:33.714291 17322 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
W20260709 13:18:33.726708 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.726405 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:33.714493 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.673090 19869 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.742369 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:33.745992 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:33.675132 19563 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.750609 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:33.750526 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:33.751010 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 376) took 1265 ms. Trace:
I20260709 13:18:33.752255 17318 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:33.752295 17471 rpcz_store.cc:276] 0709 13:18:32.485257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.485441 (+   184us) service_pool.cc:224] Handling call
0709 13:18:32.485856 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.866318 (+380462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.750752 (+884434us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b540020f654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:33.750948 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863333632}
I20260709 13:18:33.754485 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:33.755115 17471 raft_consensus.cc:2368] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6.
I20260709 13:18:33.755956 17471 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:33.713447 19885 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.741482 19790 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.726s	user 0.013s	sys 0.000s
I20260709 13:18:33.745352 17313 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:33.680334 19536 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.761659 19809 raft_consensus.cc:2764] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:33.748325 19558 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:33.675756 19895 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.767822 19844 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.775075 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:33.769451 19935 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:18:33.768380 17313 pending_rounds.cc:85] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 6
I20260709 13:18:33.776916 17313 pending_rounds.cc:107] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:33.777313 17313 raft_consensus.cc:2889] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:33.779378 19883 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.760350 19563 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.782394 19563 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.783146 19885 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.741303 19879 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:33.789724 17467 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:33.763415 17471 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:33.772715 19081 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.709s	user 0.003s	sys 0.008s
W20260709 13:18:33.796188 19882 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.000s
I20260709 13:18:33.796870 19882 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.776945 19895 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:33.798710 17994 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:33.737519 19452 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.801070 17463 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:18:33.802338 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.802490 19452 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.793433 19901 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.788996 19849 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.751117 19832 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:33.805397 19885 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:33.807473 17319 raft_consensus.cc:2368] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:33.770486 19540 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.813550 19540 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.815230 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:33.815702 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:33.815923 17388 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
I20260709 13:18:33.816578 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:33.817137 17395 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.817036 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:33.818648 19877 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.819034 19757 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.819355 19877 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.787802 19558 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.821214 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:33.821621 19789 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:33.821974 17391 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 4: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:33.823149 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.824657 17464 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:33.808238 17998 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:33.768654 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:33.710289 19520 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.677403 19822 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.795953 19081 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:33.762490 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.831095 17395 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
W20260709 13:18:33.831604 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 64292.1us
I20260709 13:18:33.837080 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:33.839435 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:33.857889 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:33.843403 19881 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:33.845726 17321 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:33.846208 19890 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:33.846614 19936 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.169s	user 0.000s	sys 0.002s
I20260709 13:18:33.809559 19832 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:33.847323 19617 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.808713 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:33.834625 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:33.856890 17466 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:33.821321 19558 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.887926 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:33.889372 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50048.5us
I20260709 13:18:33.895267 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:33.895609 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:33.794241 19879 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.891901 17391 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 2: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:33.892078 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:33.892817 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:33.893071 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:33.894001 17397 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:33.900511 17396 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.900540 17998 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.767629 19783 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:18:33.807204 19849 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.897868 17466 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:33.899978 17393 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:33.727116 19787 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:33.896219 17317 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.898773 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:33.915241 17321 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:33.890564 19832 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:33.885910 19885 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.898640 19879 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.919492 17466 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:33.895081 19789 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:33.905257 19703 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.923528 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.932657 17464 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:33.907132 19617 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.926682 17316 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:33.928690 17998 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:33.885447 19881 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:33.912940 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:33.914527 19694 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.936782 17396 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:33.930030 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:33.940126 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:33.919829 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:33.906698 19895 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:33.944926 17996 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:18:33.925218 19882 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.941241 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.955855 17464 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 2: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:33.947393 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:33.947077 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:33.948771 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:33.964295 17468 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:34.021168 17997 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:33.954330 17314 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:33.904240 19840 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:18:34.022962 17397 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 4: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:33.938472 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:33.924880 19782 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:18:33.925025 19777 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:18:34.027354 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:34.029440 19822 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:33.947896 19676 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.039670 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:34.034397 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.116504 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:34.117674 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 383) took 1038 ms. Trace:
I20260709 13:18:34.118098 17470 rpcz_store.cc:276] 0709 13:18:33.078874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.720212 (+641338us) service_pool.cc:224] Handling call
0709 13:18:33.720523 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.737917 (+ 17394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.737947 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.751929 (+ 13982us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.921144 (+169215us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:33.921180 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.921240 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.117484 (+196244us) raft_consensus.cc:1685] finished
0709 13:18:34.117502 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.117620 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17016,"raft.queue_time_us":17344,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8304,"thread_start_us":128594,"threads_started":1,"wal-append.queue_time_us":258201}
I20260709 13:18:34.121729 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:34.122437 17321 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
W20260709 13:18:34.133764 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.138732 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:34.144790 17996 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:34.158597 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:34.158900 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:34.161278 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:34.163460 17999 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:34.165582 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.166585 17470 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:34.167349 17388 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:33.947343 19694 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:34.177356 19694 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:34.178124 19694 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:34.178933 19789 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:34.179527 19789 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.181814 19789 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.189803 17313 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:34.197613 19081 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:34.122411 19877 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:34.123499 19676 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:34.227910 19676 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.232348 17390 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:34.234417 17990 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.005s
I20260709 13:18:34.234953 17990 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:34.236330 17991 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:34.138752 19881 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.238503 19881 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.030491 19832 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.242866 19832 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.143309 19946 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:34.245450 19946 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.248312 19946 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.271559 17317 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
W20260709 13:18:34.307514 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.318082 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.325611 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.334403 17470 raft_consensus.cc:2410] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:34.332298 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:34.349256 19789 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.376065 19789 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:34.378350 19789 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:34.378898 19789 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.379333 19789 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:34.356719 19947 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:34.387887 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.346300 19840 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.348896 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:34.369745 19834 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.389520 19826 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.870s	user 0.008s	sys 0.004s
I20260709 13:18:34.406452 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:34.409318 17464 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:34.402762 19617 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:34.417613 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.348892 19844 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:34.422333 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:34.417263 19757 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.004s
I20260709 13:18:34.428406 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.429880 17470 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:34.429711 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.421271 17390 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:34.407637 19834 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.404093 19840 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.452991 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.449620 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.462533 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.464051 17468 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:34.465819 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.468669 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.470067 17463 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:34.470350 17470 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 2: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:34.471531 17465 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:34.474220 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:34.474767 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:34.475313 17391 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.473975 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.476681 17468 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:34.476805 17393 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:34.477097 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:34.477905 17396 raft_consensus.cc:2410] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:34.479457 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:34.480058 17394 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.437378 19844 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:34.482754 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:34.485447 17396 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:34.472002 19558 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 13:18:34.481467 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.486047 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.480814 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:34.487125 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:34.490374 17470 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:34.489233 17464 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:34.448119 19703 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:18:34.488130 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:34.491953 17397 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:34.471135 19521 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.494012 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:34.452714 19787 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:18:34.497905 17468 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:34.445210 19365 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:18:34.462821 19789 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:34.506062 17396 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:34.508490 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:34.520123 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:34.521956 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.522878 17468 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:18:34.524946 17464 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 2: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:34.521147 17389 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:34.508605 19536 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:34.531198 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 366328us
I20260709 13:18:34.532069 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:34.532824 17389 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.493485 19558 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:34.535682 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.537871 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.539731 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56196.4us
W20260709 13:18:34.540077 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 95693.9us
I20260709 13:18:34.540126 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.541100 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:34.541162 17464 raft_consensus.cc:2410] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:34.542426 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:34.546096 17362 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.635s (SENT)
I20260709 13:18:34.546865 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:34.550712 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.551546 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:34.554816 17320 raft_consensus.cc:2368] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5.
I20260709 13:18:34.551349 17468 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:34.541965 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 536) took 1017 ms. Trace:
I20260709 13:18:34.559666 19954 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:34.560328 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:34.573930 17389 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:34.577611 19834 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.580009 19883 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.587558 19860 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:34.588979 19824 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:34.590626 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.592099 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.642318 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.590654 19859 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.594615 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:34.549947 19703 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:34.645076 19777 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.645658 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:34.646571 19832 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.647187 19882 consensus_meta.cc:287] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.000s
I20260709 13:18:34.647433 17395 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:34.555344 19955 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:34.612253 17394 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:34.626075 17996 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:34.550230 19829 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:34.612778 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 61358.1us
I20260709 13:18:34.627256 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:34.660192 17389 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.537256 19946 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:18:34.644676 19956 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.639735 19365 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:34.644858 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50304.6us
I20260709 13:18:34.673926 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:34.645788 19834 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:34.645578 19777 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.647140 19832 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.647691 19882 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:34.648674 19844 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:34.649942 19520 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.552655 19895 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:18:34.555222 19811 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:18:34.639731 19883 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.672600 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:34.689119 17389 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:34.652935 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:34.604724 19676 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:34.696859 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.712954 17395 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:34.644189 19860 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:34.711427 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 155946us
I20260709 13:18:34.714382 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:34.691843 19954 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:18:34.694926 19877 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:34.625756 17994 rpcz_store.cc:276] 0709 13:18:33.519350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.521903 (+  2553us) service_pool.cc:224] Handling call
0709 13:18:33.529227 (+  7324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.799280 (+270053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.524160 (+724880us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54001de2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:34.536786 (+ 12626us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619049216}
I20260709 13:18:34.720348 17997 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:34.711683 19879 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.774s	user 0.008s	sys 0.003s
I20260709 13:18:34.724359 17996 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:18:34.736725 17391 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:34.724927 19777 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:34.711335 19882 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:34.726187 19676 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.726369 19832 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:34.699095 19955 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:34.730647 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:34.731603 19860 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:34.682546 19956 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.728855 19859 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:34.699483 19834 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:34.738232 19558 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.754428 19954 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:34.754454 19789 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:34.757371 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:34.791051 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:18:34.759357 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 86839.3us
I20260709 13:18:34.792214 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:34.689666 19365 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:34.728129 19934 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.020s	user 0.010s	sys 0.025s
I20260709 13:18:34.770519 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:34.797467 17316 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:34.771682 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:34.771687 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:34.798405 17317 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:34.798679 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:34.799290 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:34.728681 19953 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.773308 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:34.801030 19953 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:34.801350 17996 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:34.769836 19877 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:34.776376 17322 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:34.776255 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:34.777038 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47124.2us
I20260709 13:18:34.800535 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:34.722934 17388 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:34.781244 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:34.816794 17991 raft_consensus.cc:2410] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:34.816593 19834 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.723256 19946 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:18:34.819164 19946 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:34.819569 19946 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:34.820046 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:34.820662 17463 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.821151 19558 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:34.824095 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:34.768756 19777 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.796116 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:34.803889 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.805598 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:34.831283 17466 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.809158 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:34.832295 17471 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.807850 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:34.781934 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:34.765537 19879 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:34.834502 17463 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:34.789376 19954 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:34.795660 19844 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:34.835323 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:34.830595 17465 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:34.770380 19882 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.850239 17317 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:34.851289 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.858121 17464 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:34.852082 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:34.801434 19953 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.850698 17286 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:34.854637 17470 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.863463 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2418) took 1855 ms. Trace:
I20260709 13:18:34.810120 19860 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:34.856488 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:34.829557 19840 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.863983 17469 rpcz_store.cc:276] 0709 13:18:33.007999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.716308 (+708309us) service_pool.cc:224] Handling call
0709 13:18:33.716612 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.776069 (+ 59457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.776115 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.776172 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:33.776221 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.863256 (+1087035us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b54004213d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:34.863299 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.863410 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136184192}
I20260709 13:18:34.884665 19840 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:34.885176 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:34.862332 19966 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:34.885784 17469 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:34.886521 19879 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:34.886222 19966 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.887504 17319 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:34.888579 19823 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.901701 19882 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:34.901889 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:34.903528 19901 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:34.903983 19901 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:34.908891 19966 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:34.917219 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1208) took 1265 ms. Trace:
I20260709 13:18:34.917654 17318 rpcz_store.cc:276] 0709 13:18:33.651423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.651538 (+   115us) service_pool.cc:224] Handling call
0709 13:18:33.675048 (+ 23510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.753094 (+ 78046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.916960 (+1163866us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b54003e26d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:34.917156 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176857856}
I20260709 13:18:34.919375 19365 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.863854 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:34.938057 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 74274.5us
W20260709 13:18:34.857059 19934 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:34.801716 19815 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:18:34.795408 19789 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:34.873729 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:34.779858 19955 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.874085 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:34.877317 19960 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:34.820423 19946 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:34.980043 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.844797 19777 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.854254 19844 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.881512 19520 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:34.882310 19954 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.883579 19877 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:34.883782 19956 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:34.852869 19859 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:34.886740 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:34.999544 17469 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:34.868232 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 109777us
I20260709 13:18:34.869567 17471 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:35.001363 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:35.002122 17471 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.971706 19882 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.942780 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:34.975942 17468 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.968371 19962 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:34.861537 19536 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:34.975009 19952 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.434s	user 0.003s	sys 0.001s
I20260709 13:18:34.968396 19521 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:34.973132 19963 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:35.074744 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 276108us
I20260709 13:18:35.082826 17471 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
W20260709 13:18:35.084244 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 293244us
I20260709 13:18:35.088150 17360 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:35.103732 17360 leader_election.cc:400] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:35.104391 17360 leader_election.cc:403] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:35.107821 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:35.111517 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1483) took 1366 ms. Trace:
I20260709 13:18:35.112039 17320 rpcz_store.cc:276] 0709 13:18:33.745286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.745536 (+   250us) service_pool.cc:224] Handling call
0709 13:18:35.111296 (+1365760us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b5400212854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:35.111447 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1839853568}
I20260709 13:18:34.997021 17470 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:34.941300 17466 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
I20260709 13:18:35.006173 19954 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.992933 19844 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.971678 19879 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:18:35.005190 17395 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:35.033278 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:35.117398 17469 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:35.118665 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:35.120133 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.133214 17390 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.133316 17471 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:35.133607 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.999411 19520 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:35.029966 19832 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.009526 19859 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:35.017396 19536 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:35.145695 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.145839 17470 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:35.146481 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 370297us
I20260709 13:18:35.169413 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:35.170437 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 378277us
I20260709 13:18:35.171300 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:35.082047 19834 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.190482 17471 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:35.082638 19962 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:35.194525 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 106052us
W20260709 13:18:35.195719 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 53939.1us
I20260709 13:18:35.122623 19840 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 2. Current term is 3.
I20260709 13:18:35.201596 19840 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:35.201959 19883 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.202131 19840 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.130234 19617 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:35.122089 19521 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:35.020915 19882 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.081773 19956 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:18:35.140367 19963 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:35.165004 19757 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.192118 19536 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.229890 17316 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:35.135816 19966 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:18:35.143064 19815 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:18:35.267643 19815 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.267948 17397 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.268690 19815 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:35.269430 17397 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:35.269308 19815 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.272342 19971 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:35.272481 19859 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.273752 19869 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:35.274276 19869 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:35.265877 19840 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:35.275099 19869 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.275650 19840 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:35.275215 19520 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.276131 19869 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.278337 19081 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.278828 19081 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:35.250697 19973 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.279830 19081 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.139285 17991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4df43493289c4586a02bce2e14a38202"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:48172
I20260709 13:18:35.253235 19962 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.178786 19832 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.254644 19963 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.257390 19521 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.318519 17389 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:35.259406 17391 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:35.262378 19882 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:35.264521 19883 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:35.203200 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 451) took 2392 ms. Trace:
I20260709 13:18:35.265276 17313 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:35.266220 19976 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.234850 19789 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:35.276000 19840 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:35.247648 19617 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:35.284198 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:35.380617 17315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1215) took 1636 ms (client timeout 1850 ms). Trace:
W20260709 13:18:35.381017 17315 rpcz_store.cc:269] 0709 13:18:33.744052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.744219 (+   167us) service_pool.cc:224] Handling call
0709 13:18:35.284061 (+1539842us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfeee 0000000000375939 00007f7d677431e0 00007f7d6780c0c4 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:35.380542 (+ 96481us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3461376}
I20260709 13:18:35.285662 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 730) took 2399 ms. Trace:
I20260709 13:18:35.291237 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:35.388020 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 96912.3us
I20260709 13:18:35.317831 19694 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:35.298030 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:35.300880 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:35.301819 19777 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:35.178545 19953 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.203640 19834 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.251310 19829 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:35.310488 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 109890us
I20260709 13:18:35.311434 17390 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:35.258000 17463 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:35.415439 17463 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:35.321907 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:35.414613 17964 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:35.318730 17468 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:35.245189 19757 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.324249 19960 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:35.250452 19860 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:35.352483 19982 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:35.320497 19961 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:35.393260 17394 raft_consensus.cc:2376] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3. Re-sending same reply.
I20260709 13:18:35.358754 19081 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.393580 17388 raft_consensus.cc:2376] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6. Re-sending same reply.
W20260709 13:18:35.411230 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 235920us
I20260709 13:18:35.417448 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:35.442523 17470 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:35.399572 19365 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:35.392405 19983 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.411967 19986 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.458515 17287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.018s	sys 0.044s
I20260709 13:18:35.353518 17314 rpcz_store.cc:276] 0709 13:18:32.782152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.785622 (+  3470us) service_pool.cc:224] Handling call
0709 13:18:32.853058 (+ 67436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.022709 (+1169651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.134274 (+1111565us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400369554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:35.174714 (+ 40440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498922240}
W20260709 13:18:35.462983 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 355204us
I20260709 13:18:35.452769 17463 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.466468 17463 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.414439 19815 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:35.460578 17287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.018s	sys 0.044s
W20260709 13:18:35.468199 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 657956us
I20260709 13:18:35.451942 19966 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:35.408030 19694 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.413744 19822 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:18:35.469262 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:35.455597 19365 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:35.480803 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.441956 19960 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:35.486421 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.491858 17463 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:35.473893 19966 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.455256 19961 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.499413 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:35.484980 19978 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:18:35.502876 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:35.504412 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:35.503680 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:35.483896 19365 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.493250 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:35.538136 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 128183us
I20260709 13:18:35.453426 19982 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.494798 19815 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.503674 19966 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:35.560813 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.463708 19983 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.474948 19840 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.465902 19986 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.583139 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:35.583282 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 132935us
W20260709 13:18:35.593255 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 114522us
W20260709 13:18:35.600629 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 278807us
I20260709 13:18:35.551957 19971 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:18:35.587332 19832 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:35.602293 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:35.580276 19985 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:35.537866 19617 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:35.610736 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 404615us
W20260709 13:18:35.603372 19823 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.714s	user 0.004s	sys 0.008s
I20260709 13:18:35.598518 19860 consensus_queue.cc:1243] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:35.593030 19520 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:18:35.619225 17462 raft_consensus.cc:2410] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:18:35.620465 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 118382us
I20260709 13:18:35.623430 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:35.626148 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:35.626897 17394 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:35.629429 17394 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:35.611689 19840 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.646904 17390 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:35.597273 19787 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:18:35.587455 19989 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:18:35.633975 19676 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.646478 19823 raft_consensus.cc:2764] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:35.633056 19985 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:35.662569 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 49860.2us
I20260709 13:18:35.664594 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:35.650930 19860 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:35.667510 17394 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 2: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:35.669787 20002 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:35.670356 19834 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:35.671280 17389 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:35.674178 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 373) took 1084 ms. Trace:
I20260709 13:18:35.693992 17396 rpcz_store.cc:276] 0709 13:18:34.589380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.650279 (+ 60899us) service_pool.cc:224] Handling call
0709 13:18:34.650569 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.650746 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:34.711500 (+ 60754us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.248296 (+536796us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.673697 (+425401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:35.673764 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:35.673823 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.673905 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.674103 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5094,"prepare.queue_time_us":76405,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":183830,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":184,"thread_start_us":986211,"threads_started":4,"wal-append.queue_time_us":558812}
W20260709 13:18:35.689815 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.658409 19998 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:35.660915 19757 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:35.702157 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:35.702911 17286 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:35.701728 19997 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:35.688354 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 517090us
W20260709 13:18:35.706077 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 109807us
I20260709 13:18:35.718159 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:35.707145 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 107364us
I20260709 13:18:35.680796 19953 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:35.705376 17391 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:35.685086 19676 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.679819 19860 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:35.711289 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:35.695621 19694 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:35.690693 20002 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:35.387538 17993 rpcz_store.cc:276] 0709 13:18:32.886335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.895316 (+  8981us) service_pool.cc:224] Handling call
0709 13:18:33.740484 (+845168us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:33.744582 (+  4098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.794625 (+ 50043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.810825 (+ 16200us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.814908 (+  4083us) log.cc:844] Serialized 26 byte log entry
0709 13:18:34.025384 (+210476us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:34.031360 (+  5976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.285333 (+1253973us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b5400687754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:35.285381 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.285424 (+    43us) raft_consensus.cc:1685] finished
0709 13:18:35.285443 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.285599 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4090,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":10612,"spinlock_wait_cycles":99192960,"thread_start_us":132206,"threads_started":1,"wal-append.queue_time_us":335713,"wal-append.run_cpu_time_us":2028,"wal-append.run_wall_time_us":1004389}
I20260709 13:18:35.704180 19757 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:35.736279 17997 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:35.711555 19997 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:35.706218 19995 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:35.703261 19823 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:18:35.736768 19960 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:35.729667 19954 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.002s
I20260709 13:18:35.729287 19994 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:35.707240 19998 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.737838 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:35.803779 17998 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:35.771844 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:35.765386 17996 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:35.789712 17995 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:35.807032 17995 pending_rounds.cc:85] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 6
I20260709 13:18:35.807298 17995 pending_rounds.cc:107] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:35.807571 17995 raft_consensus.cc:2889] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.765069 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:35.738044 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:35.800037 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 59765.7us
W20260709 13:18:35.788565 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 108236us
I20260709 13:18:35.737457 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:35.816084 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.786604 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:35.833173 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 95797.9us
I20260709 13:18:35.834223 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:35.809444 17999 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
W20260709 13:18:35.853475 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 172597us
W20260709 13:18:35.855540 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.801329 19993 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.182s	user 0.001s	sys 0.001s
W20260709 13:18:35.738494 19844 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
W20260709 13:18:35.741355 19990 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:18:35.794209 20008 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.742740 19900 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:35.741179 19982 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:35.867687 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:35.887168 17998 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.758616 19989 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:35.748068 19946 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.861985 20002 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.899344 20002 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.769361 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:35.901145 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:35.901697 17999 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.880143 19987 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:35.798941 19824 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:35.859979 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:35.918578 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 132046us
W20260709 13:18:35.877329 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 67421.9us
I20260709 13:18:35.751763 19676 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:35.759426 19777 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:35.741993 19997 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.738643 19757 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:35.862319 19869 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.586s	user 0.013s	sys 0.000s
W20260709 13:18:35.879067 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 276826us
I20260709 13:18:35.937206 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:35.879204 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:35.757076 17992 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:35.774936 19961 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:35.882504 20012 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.885396 19994 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:35.749665 19983 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:35.889040 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 541) took 1122 ms. Trace:
I20260709 13:18:35.918038 19824 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:35.968125 19824 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.969244 19824 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:35.970163 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:35.970918 17469 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:35.934324 19777 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.971993 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:35.972925 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:35.973150 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:35.974062 17464 raft_consensus.cc:2410] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:18:35.974923 19976 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.000s
I20260709 13:18:35.975234 17465 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:35.975375 19976 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.976348 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:35.976619 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2493) took 1035 ms. Trace:
I20260709 13:18:35.799692 19992 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:18:35.976975 17468 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:35.879868 19900 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:35.978986 19900 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.763710 19694 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:18:35.894346 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:35.980283 19900 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.976990 17395 rpcz_store.cc:276] 0709 13:18:34.941395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.144011 (+202616us) service_pool.cc:224] Handling call
0709 13:18:35.144312 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.144596 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.144622 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.176582 (+ 31960us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.493672 (+317090us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:35.493709 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.493770 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.976417 (+482647us) raft_consensus.cc:1685] finished
0709 13:18:35.976449 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.976566 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122758,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":258130,"threads_started":1,"wal-append.queue_time_us":393474}
I20260709 13:18:35.930558 19987 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.895087 19989 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:35.985078 19989 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.985812 19777 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:35.871151 19991 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:18:35.799842 19973 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.081s
W20260709 13:18:35.918635 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 58734.5us
I20260709 13:18:35.992563 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:35.919590 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:35.756011 19955 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:35.920425 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:35.995217 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 74876.5us
I20260709 13:18:35.996307 17287 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:35.754892 19536 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:35.758952 19365 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.923452 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:35.869705 20014 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:35.880870 19956 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:35.997584 19956 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.788879 20004 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:18:35.997941 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:35.998579 17996 raft_consensus.cc:2376] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7. Re-sending same reply.
I20260709 13:18:35.742813 19860 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.945041 17998 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:35.945405 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:35.873261 19844 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:35.953843 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.918275 19986 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:36.006699 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:35.904047 19998 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:35.834621 19985 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.961347 20012 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.888237 20008 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:35.980684 17997 raft_consensus.cc:2410] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:35.989327 17466 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:35.980640 17285 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:36.017879 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:36.011768 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 92254.3us
I20260709 13:18:36.018792 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:36.003449 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 224286us
I20260709 13:18:36.004223 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:36.004684 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:36.008194 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62897.1us
I20260709 13:18:35.990209 19676 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.013833 20004 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:36.022245 19976 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.022593 20004 consensus_queue.cc:1243] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:36.022248 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:36.014413 19986 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:36.023576 19986 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.023938 19986 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:36.015249 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.015470 19971 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:35.997979 19956 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.028868 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:36.030161 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:35.965952 17994 rpcz_store.cc:276] 0709 13:18:34.767001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.768705 (+  1704us) service_pool.cc:224] Handling call
0709 13:18:34.781204 (+ 12499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:35.208149 (+426945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.228427 (+ 20278us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:35.407225 (+178798us) log.cc:844] Serialized 52 byte log entry
0709 13:18:35.597351 (+190126us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:35.867483 (+270132us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.885651 (+ 18168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.885743 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.885794 (+    51us) raft_consensus.cc:1685] finished
0709 13:18:35.885810 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.888974 (+  3164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11785,"raft.queue_time_us":148718,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":36194,"thread_start_us":770949,"threads_started":3,"wal-append.queue_time_us":236927}
I20260709 13:18:36.005214 19955 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.032742 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:36.011137 20007 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:36.031255 17995 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:36.031559 19811 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.086411 19694 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.005679 19558 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:36.087085 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 54512.2us
I20260709 13:18:36.087311 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:36.090788 17999 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:36.145682 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:36.144186 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:36.032383 19521 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:36.204173 17996 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:36.002722 19966 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:36.147053 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:36.147006 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:36.206859 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 61250.9us
W20260709 13:18:36.209283 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 149463us
I20260709 13:18:36.092593 17998 raft_consensus.cc:2376] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7. Re-sending same reply.
I20260709 13:18:36.079780 19998 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.031806 19676 raft_consensus.cc:2764] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:18:36.017294 19983 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:36.211071 17995 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:36.030458 20031 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:36.256240 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 109285us
I20260709 13:18:36.258160 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:36.191934 19869 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:36.329151 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.214794 19694 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:36.151444 17993 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:36.263960 20031 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.079771 19860 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.151566 19811 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:36.146332 20033 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.341s
W20260709 13:18:36.370154 17462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1344) took 3236 ms (client timeout 4180 ms). Trace:
I20260709 13:18:36.370416 17467 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:18:36.396284 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.396714 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 395722us
I20260709 13:18:36.081722 20014 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.146723 20010 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.211362 19558 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:36.208526 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:36.265134 19995 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:36.434512 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 421365us
W20260709 13:18:36.286422 20021 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.083s	user 0.002s	sys 0.002s
I20260709 13:18:36.026441 19757 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:36.610268 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.796790 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 538691us
I20260709 13:18:36.845702 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:36.439318 17462 rpcz_store.cc:269] 0709 13:18:33.133736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.475269 (+341533us) service_pool.cc:224] Handling call
0709 13:18:36.369800 (+2894531us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54003840d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:36.370040 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4928215424}
W20260709 13:18:36.796279 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 792055us
I20260709 13:18:36.849864 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:36.850131 17465 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:36.850962 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.361159 20004 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.393671 19895 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:36.859243 20004 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:36.863153 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:36.517028 19877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.007s	sys 0.003s
I20260709 13:18:36.418445 19694 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:36.899928 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:36.911103 17468 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:36.212659 19994 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:36.414345 20031 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.853390 20014 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:36.916116 19995 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:36.919688 19881 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:36.922037 19946 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.026s	user 0.005s	sys 0.004s
W20260709 13:18:36.922202 19987 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.939s	user 0.009s	sys 0.000s
I20260709 13:18:36.922390 19988 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.923228 19694 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:36.866842 19998 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.924611 19536 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:36.867419 20019 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.864328 19989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.005s	sys 0.030s
I20260709 13:18:36.925282 19844 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:36.846849 19811 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:36.930404 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 559) took 1025 ms. Trace:
W20260709 13:18:36.948700 19877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.009s	sys 0.004s
W20260709 13:18:36.948453 20002 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.049s	user 0.003s	sys 0.009s
I20260709 13:18:36.979369 19995 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.981148 19987 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:36.984638 20028 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.004021 19989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.005s	sys 0.031s
I20260709 13:18:36.995085 19365 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:37.023891 19822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.008s	sys 0.005s
I20260709 13:18:37.040815 19844 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:36.994545 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 750) took 1048 ms. Trace:
W20260709 13:18:37.044204 17286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.002s	sys 0.011s
W20260709 13:18:37.068570 17286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.003s	sys 0.011s
W20260709 13:18:37.069757 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 859525us
I20260709 13:18:36.486564 19901 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.025641 20008 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:37.060524 19081 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.602s	user 0.009s	sys 0.004s
W20260709 13:18:37.064975 20007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.007s	sys 0.004s
W20260709 13:18:37.075387 19822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.009s	sys 0.005s
W20260709 13:18:37.080535 19900 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.095s	user 0.012s	sys 0.000s
W20260709 13:18:37.099253 20007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.007s	sys 0.004s
I20260709 13:18:37.123943 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.127465 17996 raft_consensus.cc:2376] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5. Re-sending same reply.
I20260709 13:18:37.022377 17993 rpcz_store.cc:276] 0709 13:18:35.905499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.918637 (+ 13138us) service_pool.cc:224] Handling call
0709 13:18:35.988583 (+ 69946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.408976 (+420393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.930095 (+521119us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b5400640354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:36.930331 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91747072}
W20260709 13:18:37.131778 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 281964us
I20260709 13:18:37.136950 17362 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:37.138054 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:37.074421 17992 rpcz_store.cc:276] 0709 13:18:35.934101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.031667 (+ 97566us) service_pool.cc:224] Handling call
0709 13:18:36.982061 (+950394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:37.147861 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:37.060926 20028 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:36.858110 20010 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:37.152652 20036 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.221s	user 0.013s	sys 0.016s
I20260709 13:18:37.042734 19995 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.154359 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2506) took 1413 ms. Trace:
I20260709 13:18:37.154904 20014 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.154770 19995 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:36.998020 19988 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.157788 19988 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:37.154712 17391 rpcz_store.cc:276] 0709 13:18:35.741216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.769237 (+ 28021us) service_pool.cc:224] Handling call
0709 13:18:35.788218 (+ 18981us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:35.801902 (+ 13684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.801949 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:35.858688 (+ 56739us) log.cc:844] Serialized 78 byte log entry
0709 13:18:36.005529 (+146841us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:36.026205 (+ 20676us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.031558 (+  5353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.031638 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.154117 (+1122479us) raft_consensus.cc:1685] finished
0709 13:18:37.154136 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.154291 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29943,"prepare.queue_time_us":20717,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":11718,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":91454,"thread_start_us":87610,"threads_started":1,"wal-append.queue_time_us":888879}
I20260709 13:18:37.056047 19558 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.127166 20007 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:37.133706 20004 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:37.167981 19824 consensus_meta.cc:287] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.198s	user 0.006s	sys 0.003s
I20260709 13:18:37.159456 19987 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.170130 19966 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:37.170814 19966 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.171140 19988 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:37.171271 19966 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.171649 19988 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:37.145689 19844 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.173317 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 395) took 2317 ms. Trace:
I20260709 13:18:37.004457 20019 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.174929 17470 rpcz_store.cc:276] 0709 13:18:34.855730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.211767 (+356037us) service_pool.cc:224] Handling call
0709 13:18:35.243752 (+ 31985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.451292 (+207540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.173081 (+1721789us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400061154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:37.173259 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456562560}
I20260709 13:18:37.166042 19777 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.185460 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.174685 19988 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.186137 17390 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:37.187016 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:37.187727 17396 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:37.187760 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 324673us
I20260709 13:18:37.191650 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:37.193737 17391 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:37.182946 20014 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.199090 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:37.201328 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.202696 17389 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:37.201656 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:37.200829 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.204725 17390 raft_consensus.cc:2410] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:37.207489 17396 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
W20260709 13:18:37.194586 19956 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.113s	user 0.009s	sys 0.003s
W20260709 13:18:37.210815 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.012s	sys 0.008s
W20260709 13:18:37.211170 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.012s	sys 0.008s
I20260709 13:18:37.211256 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:37.216082 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 416291us
I20260709 13:18:37.213877 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.219805 17391 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:37.222729 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:37.211009 19967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.000s	sys 0.024s
W20260709 13:18:37.224165 17362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 4.180s (SENT) [suppressed 22 similar messages]
I20260709 13:18:37.190272 19777 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.211198 19824 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:37.213778 19877 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:37.253605 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:18:37.257747 17435 connection.cc:256] RPC call timeout handler was delayed by -1.119340204999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 13:18:37.262108 17435 connection.cc:256] RPC call timeout handler was delayed by -1.0860402050000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 13:18:37.240695 19998 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:37.238165 20010 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:37.211755 20014 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.215204 19956 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.236763 19995 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:37.267565 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.278332 17469 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:37.279203 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.279732 17469 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:37.280489 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:37.280982 17469 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:37.281111 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.281802 17468 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:37.282610 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.283320 17468 raft_consensus.cc:2410] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:37.287539 17469 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:18:37.239287 19966 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:37.253266 20037 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.486s	user 0.000s	sys 0.016s
I20260709 13:18:37.273461 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.273245 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.308034 17462 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:37.277709 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.288158 19844 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:37.271847 19824 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.259640 19877 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.290899 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 558) took 2521 ms. Trace:
I20260709 13:18:37.210650 20007 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.297408 17388 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:37.273147 19998 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.299574 19987 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:37.306854 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 441087us
I20260709 13:18:37.309063 17463 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:37.270308 20051 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.326814 20051 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.308156 17464 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:37.271765 20052 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:37.328898 20052 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.329303 20052 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.329346 20051 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.330904 19962 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:37.332423 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:37.333269 19966 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:37.333635 19966 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.334022 19966 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:37.267676 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 50623.1us
I20260709 13:18:37.316097 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.342681 17468 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
W20260709 13:18:37.352423 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.342896 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:37.355224 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 131085us
W20260709 13:18:37.355997 17362 connection.cc:256] RPC call timeout handler was delayed by -1.219556743000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:18:37.356380 17362 connection.cc:256] RPC call timeout handler was delayed by -1.208708606999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 13:18:37.359087 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.359689 17388 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:37.361800 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.365157 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.365754 17392 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:37.367746 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:37.368391 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.369393 20057 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:37.370069 20057 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:37.322587 19986 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.298s	user 0.008s	sys 0.004s
I20260709 13:18:37.313025 19895 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:37.313437 20054 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.381632 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:37.393801 17465 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.376281 17469 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:37.390254 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:37.379500 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.376027 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:37.395907 17464 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.392830 17391 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:37.400175 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:37.403118 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.403515 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.403832 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.404402 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:37.405500 17469 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:37.409548 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:37.365794 20051 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.371644 20045 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:37.413265 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:37.413975 17462 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:37.414721 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:37.407814 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.415616 17995 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:37.415788 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:18:37.406378 20037 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:37.418756 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.399160 19844 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:37.389529 19879 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:37.323658 19824 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.420631 17470 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:37.410705 19987 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:37.430910 19987 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.431339 19987 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.431111 19988 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.432614 20031 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.407346 20057 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.434288 19824 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:37.434827 19824 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:37.434980 20031 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.435307 19824 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:37.412730 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.392767 19986 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.438593 19986 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:37.367345 19998 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.371105 20055 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.441138 19998 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.393186 19694 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.425860 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.441988 19844 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:37.442284 20055 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.408808 20019 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:37.424731 20061 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.415098 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:37.446375 19877 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.446537 17992 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:37.436232 19824 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.371205 19966 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.447470 19879 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.448666 19966 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:37.404886 20054 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.449379 20014 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:37.442354 17468 raft_consensus.cc:2410] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:37.438603 17466 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:18:37.448446 19860 consensus_meta.cc:287] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.003s	user 0.006s	sys 0.002s
I20260709 13:18:37.430337 19956 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:37.430506 19960 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:37.456095 17465 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:37.410760 20053 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:37.464639 17465 pending_rounds.cc:85] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 4
I20260709 13:18:37.476445 17471 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:37.476913 17465 pending_rounds.cc:107] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 4.5
W20260709 13:18:37.456961 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 74989.5us
W20260709 13:18:37.477670 17285 leader_election.cc:336] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.662s (SENT)
I20260709 13:18:37.478098 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:37.477231 17465 raft_consensus.cc:2889] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:37.484668 17466 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:37.486805 17466 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:18:37.487376 17466 pending_rounds.cc:85] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 5
I20260709 13:18:37.487655 17466 pending_rounds.cc:107] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:18:37.487932 17466 raft_consensus.cc:2889] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:37.490852 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:37.491508 17468 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:37.457121 19997 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.510s	user 0.007s	sys 0.005s
W20260709 13:18:37.496044 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 80320us
I20260709 13:18:37.444692 20055 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.455981 19844 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.418099 20051 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.497471 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.480491 19960 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.481392 19946 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.501245 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 96913.7us
I20260709 13:18:37.509999 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2509) took 1767 ms. Trace:
I20260709 13:18:37.511967 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:37.496143 19901 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.483054 20031 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.482568 20053 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.482877 20060 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.467787 20052 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.509994 19960 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.506882 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.515101 20055 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:37.515218 19777 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:37.501737 19997 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.506264 17322 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:37.442194 19694 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.510463 17394 rpcz_store.cc:276] 0709 13:18:35.742125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.744179 (+  2054us) service_pool.cc:224] Handling call
0709 13:18:35.744454 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.758605 (+ 14151us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:35.913190 (+154585us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.147928 (+234738us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.188951 (+ 41023us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.189186 (+   235us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:36.189241 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.189326 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.509801 (+1320475us) raft_consensus.cc:1685] finished
0709 13:18:37.509824 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.509944 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13793,"prepare.queue_time_us":33526,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":14809,"raft.run_cpu_time_us":9246,"raft.run_wall_time_us":40351,"thread_start_us":354442,"threads_started":2,"wal-append.queue_time_us":400834}
I20260709 13:18:37.514194 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:37.539932 19694 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:37.540401 17464 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:37.543912 17468 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
W20260709 13:18:37.545569 17313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1493) took 2773 ms (client timeout 2135 ms). Trace:
W20260709 13:18:37.546224 17313 rpcz_store.cc:269] 0709 13:18:34.772537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.775919 (+  3382us) service_pool.cc:224] Handling call
0709 13:18:37.545277 (+2769358us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54001428d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:37.545480 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859007360}
I20260709 13:18:37.548588 17315 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:37.514631 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.517491 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.519609 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.551908 17319 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:37.506408 19844 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.553283 17964 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:37.554119 19977 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:37.554610 19977 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:37.554857 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 397) took 1585 ms. Trace:
I20260709 13:18:37.555344 17471 rpcz_store.cc:276] 0709 13:18:35.969143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.971311 (+  2168us) service_pool.cc:224] Handling call
0709 13:18:35.971601 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.476925 (+1505324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.554576 (+ 77651us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400162454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:37.554788 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3460065024}
I20260709 13:18:37.557241 20022 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:37.555434 19977 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.568756 20048 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:37.569423 20048 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.508941 19895 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.571802 20028 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.572387 20048 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:37.525192 20053 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.578703 17998 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:37.579033 19997 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:37.579778 17994 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:37.582834 20051 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.583699 19879 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.535787 20055 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:37.574275 20068 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:37.518834 20040 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:37.584880 20055 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.585170 19987 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.585280 20040 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.587311 19987 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:37.587522 20040 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:37.515018 19826 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:18:37.518534 20031 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.526041 19988 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.575263 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.514844 19985 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:18:37.589699 20031 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.576862 20054 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.519132 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:37.590435 17992 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.578744 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:37.516043 19946 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.322326 17990 rpcz_store.cc:276] 0709 13:18:34.769542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.771747 (+  2205us) service_pool.cc:224] Handling call
0709 13:18:34.805763 (+ 34016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.130566 (+324803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.141610 (+ 11044us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.258161 (+116551us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.475672 (+217511us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:35.479479 (+  3807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.290461 (+1810982us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54006d1fd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:37.290525 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.290576 (+    51us) raft_consensus.cc:1685] finished
0709 13:18:37.290592 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.290833 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18813,"raft.queue_time_us":52930,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":37573,"spinlock_wait_cycles":406247808,"thread_start_us":206739,"threads_started":1,"wal-append.queue_time_us":338492,"wal-append.run_cpu_time_us":6988,"wal-append.run_wall_time_us":1666023}
I20260709 13:18:37.585621 17993 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:18:37.594770 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 80653.1us
I20260709 13:18:37.594893 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:37.595202 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.613240 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:37.613822 17319 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:37.596243 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:37.614743 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:37.615293 17996 raft_consensus.cc:2376] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5. Re-sending same reply.
I20260709 13:18:37.616035 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:37.576144 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.616591 17996 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 1.
I20260709 13:18:37.603546 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.619014 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.619398 17999 raft_consensus.cc:2410] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:37.619532 17996 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:37.608377 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:37.620203 17962 connection.cc:256] RPC call timeout handler was delayed by -1.0546169189999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
I20260709 13:18:37.621234 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.622072 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:37.622079 19966 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:37.622640 17997 raft_consensus.cc:2376] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6. Re-sending same reply.
I20260709 13:18:37.623462 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.597046 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:37.625681 17471 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:37.626600 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:37.628692 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:37.630347 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:37.630944 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.633093 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:37.632499 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:37.634371 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.635406 17990 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:37.609865 17314 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 2.
I20260709 13:18:37.609838 19815 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:37.637552 19882 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:37.638044 19882 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:37.639430 20071 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:37.639051 19882 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.639901 20071 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.640209 19882 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.640362 20071 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.639022 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:37.641470 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.569343 20052 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:37.646996 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:37.648752 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.649456 17388 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:37.610402 20054 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:37.644402 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:37.652875 17396 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:37.591423 20053 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.641754 19987 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:37.657267 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:37.626139 19521 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.663106 17287 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:37.670284 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.672353 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:37.676626 17388 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:37.677297 17962 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:37.679172 17962 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:37.648259 19988 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:37.682137 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:37.688135 19859 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:37.654208 19787 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:37.700052 17287 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:37.701603 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.701934 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:37.655061 20060 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:37.692600 17391 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:37.662104 19997 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.655783 20054 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.707028 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.707757 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.703809 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.695067 19859 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.709052 17319 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:37.708854 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.714280 17996 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:37.680307 19985 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:37.676014 19987 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.684782 20004 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:37.671947 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.717072 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.656781 20001 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:18:37.742065 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.742333 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:37.700714 19815 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:37.690029 20040 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:37.718566 19859 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.685104 19988 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.725050 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.732654 19987 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.732867 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.689107 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:37.738196 19977 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.706699 20060 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.684335 20047 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:37.743129 17962 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 1.521s (SENT)
I20260709 13:18:37.715741 20054 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.747272 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.712101 19081 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:37.723646 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 67400.9us
I20260709 13:18:37.686748 19521 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.724721 19787 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:37.774843 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:37.718487 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.739199 20004 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:37.770752 20040 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:37.778723 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.780207 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.985047 17320 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:37.780885 20043 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:18:37.785825 20075 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:37.792994 19999 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:37.776685 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.795868 19844 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.797219 19815 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:37.798242 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:37.822513 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 79435.9us
I20260709 13:18:38.022202 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:37.809317 19988 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.948740 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:37.983170 17434 leader_election.cc:336] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 2.171s (SENT)
I20260709 13:18:38.029352 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:38.030642 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 47490.4us
I20260709 13:18:37.823611 17993 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:18:37.819821 20051 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:38.001135 20086 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.001713 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 226705us
I20260709 13:18:37.835443 19081 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.827107 20060 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.015827 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:38.060791 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.977414 20031 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.983520 17991 raft_consensus.cc:606] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:37.834518 19822 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.186s
I20260709 13:18:37.983976 20004 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:38.037521 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88872.4us
I20260709 13:18:37.992036 20040 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.833169 19977 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:37.989156 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:38.049778 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.052073 17394 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:37.832600 17990 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:38.010998 19787 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:38.156522 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:38.051440 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:38.086532 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.027043 19999 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:37.987977 20055 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:38.043138 19895 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:38.136384 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.079978 19081 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:38.113781 17992 consensus_meta.cc:287] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.001s
I20260709 13:18:38.158522 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:38.167637 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.194566 17996 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 3.
W20260709 13:18:38.194583 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53430.8us
I20260709 13:18:38.196585 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:38.197439 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.140329 20053 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:38.202670 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 151306us
I20260709 13:18:38.203578 17390 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:38.208113 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:38.208738 17464 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 3.
I20260709 13:18:38.209815 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:38.210465 17464 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:38.210978 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 188460us
I20260709 13:18:38.201613 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.164824 19694 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.061652 20051 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.205304 17392 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:38.216308 17317 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:38.203889 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:38.205531 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:38.256877 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 50199.3us
I20260709 13:18:38.257436 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:38.255438 17318 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:38.096196 20031 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.259660 17388 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:38.346454 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.553275 19757 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.554143 17397 raft_consensus.cc:2410] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:38.554437 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:38.555071 17388 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.555212 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.367463 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2433) took 4879 ms. Trace:
I20260709 13:18:38.557138 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2461) took 1177 ms. Trace:
I20260709 13:18:38.256078 20043 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:38.256515 19694 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.574816 20043 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:38.376972 17320 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:38.575369 20043 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.576133 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:38.260164 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.577836 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:38.578395 17396 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.084369 20086 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.220467 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:38.258769 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:38.593720 17392 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.205924 19824 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:38.299185 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.346279 19787 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:38.382831 19895 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.383466 20028 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.391113 19859 consensus_meta.cc:287] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.001s
I20260709 13:18:38.398402 20052 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:38.301081 20089 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:18:38.201762 20072 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:38.302158 20082 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:18:38.302953 20080 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:18:38.193903 17992 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:38.299662 20087 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.218245 19971 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.405897 19844 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:38.409122 20091 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:18:38.410560 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.630584 17394 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 2.
I20260709 13:18:38.631556 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.412791 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:38.413262 20051 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:38.413756 20093 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:18:38.414083 17360 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:38.416960 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.263067 20012 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:38.650755 20071 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.010s	user 0.007s	sys 0.005s
I20260709 13:18:38.651518 20071 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:38.653630 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.654871 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.655066 19081 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:38.655975 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.661903 20071 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:38.436316 19960 consensus_meta.cc:287] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.857s	user 0.008s	sys 0.000s
W20260709 13:18:38.667547 19987 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.834s	user 0.015s	sys 0.001s
I20260709 13:18:38.667609 19960 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:38.668208 19987 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:38.623198 20028 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:38.456101 20002 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.002s	sys 0.014s
W20260709 13:18:38.670197 20002 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.002s	sys 0.014s
I20260709 13:18:38.443439 20096 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:38.623315 19859 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:38.671144 20096 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:38.432852 20083 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
W20260709 13:18:38.440129 20079 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.421s	user 0.002s	sys 0.000s
W20260709 13:18:38.455093 19901 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.929s	user 0.009s	sys 0.002s
I20260709 13:18:38.486963 19946 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:38.622798 20102 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.307727 17464 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
W20260709 13:18:38.488384 17393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2481) took 4009 ms (client timeout 2211 ms). Trace:
W20260709 13:18:38.685535 17393 rpcz_store.cc:269] 0709 13:18:34.478538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.484214 (+  5676us) service_pool.cc:224] Handling call
0709 13:18:34.901703 (+417489us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:38.488105 (+3586402us) spinlock_profiling.cc:243] Waited 2.79 s on lock 0x7b54004128d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:38.488291 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6409738368}
I20260709 13:18:38.450708 20055 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:38.441967 19977 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:38.672537 19694 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:38.704208 19521 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:38.310595 17471 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
W20260709 13:18:38.536127 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.705761 20106 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:38.556439 17322 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:38.557024 17467 rpcz_store.cc:276] 0709 13:18:33.468235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.918279 (+450044us) service_pool.cc:224] Handling call
0709 13:18:36.370044 (+2451765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.439481 (+ 69437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.347015 (+1907534us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b54003840d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:38.347243 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5603007360}
I20260709 13:18:38.707486 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:38.708153 17467 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.710186 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 568) took 1017 ms. Trace:
I20260709 13:18:38.710572 17996 rpcz_store.cc:276] 0709 13:18:37.692859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.716707 (+ 23848us) service_pool.cc:224] Handling call
0709 13:18:38.710009 (+993302us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54006054d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:38.710127 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958697216}
I20260709 13:18:38.556433 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.713218 17397 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:38.714148 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.714778 17397 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:38.715628 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.599962 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.601516 17993 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 1.
I20260709 13:18:38.633992 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 762) took 1136 ms. Trace:
I20260709 13:18:38.716879 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 552) took 1027 ms. Trace:
I20260709 13:18:38.717032 17992 rpcz_store.cc:276] 0709 13:18:37.494229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.497479 (+  3250us) service_pool.cc:224] Handling call
0709 13:18:38.630418 (+1132939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.717399 17993 rpcz_store.cc:276] 0709 13:18:37.689961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.191348 (+501387us) service_pool.cc:224] Handling call
0709 13:18:38.716796 (+525448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.598122 19824 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:38.557718 17470 rpcz_store.cc:276] 0709 13:18:37.379897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.426408 (+ 46511us) service_pool.cc:224] Handling call
0709 13:18:37.481674 (+ 55266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.481957 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.481983 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.496472 (+ 14489us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.573452 (+ 76980us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b4800210258. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:18:37.647440 (+ 73988us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:37.757261 (+109821us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.775670 (+ 18409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.818805 (+ 43135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.438202 (+619397us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b180041c0e0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1
0709 13:18:38.553448 (+115246us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b180041c0e0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:18:38.556870 (+  3422us) raft_consensus.cc:1685] finished
0709 13:18:38.556899 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.557058 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51821,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":1346,"raft.run_cpu_time_us":1221,"raft.run_wall_time_us":84957,"spinlock_wait_cycles":98997248,"thread_start_us":191590,"threads_started":2,"wal-append.queue_time_us":229300}
I20260709 13:18:38.718564 19824 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.719162 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:38.720343 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 508027us
I20260709 13:18:38.620679 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.721041 17390 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
W20260709 13:18:38.721355 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.622174 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.721870 17320 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:38.624284 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:38.722798 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 98569.2us
I20260709 13:18:38.723526 17467 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:38.670748 20028 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:38.625897 17285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.007s	sys 0.013s
I20260709 13:18:38.726756 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:38.727181 17285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.007s	sys 0.013s
I20260709 13:18:38.636123 17317 raft_consensus.cc:2410] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:18:38.624624 19996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.004s	sys 0.016s
I20260709 13:18:38.638690 20051 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:38.638841 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 224825us
I20260709 13:18:38.626204 19995 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.666946 20054 consensus_meta.cc:287] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.693s	user 0.003s	sys 0.009s
I20260709 13:18:38.670514 19987 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:38.368251 19999 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.679646 17396 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:38.682302 17392 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
W20260709 13:18:38.652550 20060 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.000s
I20260709 13:18:38.490844 17462 pending_rounds.cc:85] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 4
I20260709 13:18:38.623008 20072 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:38.626538 20053 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.695775 17388 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:38.698276 20096 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:38.701071 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 469) took 1166 ms. Trace:
I20260709 13:18:38.750854 17315 rpcz_store.cc:276] 0709 13:18:37.534319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.534443 (+   124us) service_pool.cc:224] Handling call
0709 13:18:37.548281 (+ 13838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.549245 (+   964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.700790 (+1151545us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b54001428d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:38.701003 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30983936}
I20260709 13:18:38.701732 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:38.732376 19996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.005s	sys 0.016s
I20260709 13:18:38.752319 17393 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:38.716423 20004 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.559s	user 0.004s	sys 0.004s
I20260709 13:18:38.752347 17388 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:38.617178 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.722198 17962 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:38.624411 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:38.740705 17462 pending_rounds.cc:107] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:38.755673 17462 raft_consensus.cc:2889] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.740741 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:38.741493 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:38.757295 17469 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.626632 20052 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.730676 19877 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:38.633471 19971 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.741900 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.743206 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.744513 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:38.733295 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:38.687891 19676 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.718891 20086 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:38.732551 19995 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.620121 19895 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:38.727273 20107 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.732717 20054 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.729907 17313 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:38.747634 20060 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.793210 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:38.747738 20072 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.818539 17388 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:38.821458 17390 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:38.724578 20102 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.823321 17392 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:38.814801 17469 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:38.824220 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1507) took 1042 ms. Trace:
I20260709 13:18:38.867743 17320 rpcz_store.cc:276] 0709 13:18:37.782201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.722457 (+940256us) service_pool.cc:224] Handling call
0709 13:18:38.824162 (+101705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.763908 19877 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.765015 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:38.792692 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:38.764400 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:38.862463 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 69331us
I20260709 13:18:38.863718 17393 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
W20260709 13:18:38.794926 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 61722.3us
I20260709 13:18:38.819497 20096 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.792168 20012 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:38.873473 17388 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:38.750313 20010 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:18:38.874554 17996 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:38.821056 19676 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.876295 17285 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:38.902535 17316 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:38.902474 17315 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:38.899921 17393 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:38.900238 17468 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:38.850289 19996 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:38.875782 17317 raft_consensus.cc:2410] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:38.752244 20053 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.901108 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:38.905413 17285 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:38.906320 17393 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:38.898598 20031 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:38.911773 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:38.920377 17999 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.914666 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1497) took 1162 ms. Trace:
I20260709 13:18:38.921669 17322 rpcz_store.cc:276] 0709 13:18:37.752017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.752288 (+   271us) service_pool.cc:224] Handling call
0709 13:18:38.914475 (+1162187us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400367254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:38.914611 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333593984}
I20260709 13:18:38.915387 17397 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:38.896920 20096 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.869895 19822 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:38.864392 20044 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.874701 19081 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:38.764591 20004 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.926285 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:38.942379 17463 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:38.898075 19877 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.943318 17466 raft_consensus.cc:2410] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:38.930105 17320 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:38.807705 20099 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
W20260709 13:18:38.928099 19988 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.876s	user 0.009s	sys 0.014s
I20260709 13:18:38.825673 20103 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:18:38.945608 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:38.896350 19901 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:38.927798 20040 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.758s	user 0.005s	sys 0.010s
I20260709 13:18:38.952008 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1505) took 1170 ms. Trace:
I20260709 13:18:38.967129 17320 rpcz_store.cc:276] 0709 13:18:37.781640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.896545 (+1114905us) service_pool.cc:224] Handling call
0709 13:18:38.929923 (+ 33378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.951761 (+ 21838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.951938 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.924556 20096 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.910991 19996 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:38.917222 17993 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:38.960824 17394 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:38.961272 17999 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:38.944164 19822 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.944748 20031 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:38.940721 20014 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:38.861855 20107 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.987654 17995 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:38.917905 19999 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:18:38.946146 20044 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.968621 19815 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:38.955353 20051 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:38.986702 17999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 567) took 1300 ms (client timeout 1699 ms). Trace:
I20260709 13:18:38.994782 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:38.999169 17360 connection.cc:256] RPC call timeout handler was delayed by -1.2406598420000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
I20260709 13:18:39.004920 19987 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:39.028509 17999 rpcz_store.cc:269] 0709 13:18:37.686019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.686145 (+   126us) service_pool.cc:224] Handling call
0709 13:18:38.911629 (+1225484us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:38.986646 (+ 75017us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6389120}
I20260709 13:18:39.030560 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:39.030828 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:39.031386 17999 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.989255 17990 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:38.990018 20099 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:39.034389 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:38.996698 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:38.985723 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:39.009910 20054 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:39.014050 20060 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:39.006326 20053 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:39.025250 20104 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:18:39.030886 19987 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.990864 20103 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:38.998236 19995 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:38.995631 19895 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:38.967438 19988 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.053411 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:39.105144 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:39.057675 17999 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:39.110025 17999 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:39.111280 17999 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:39.001226 19967 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:39.025557 19859 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:38.989491 20102 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:39.015935 20031 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:39.028447 20051 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:39.020714 19822 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.119910 19967 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:38.985719 20040 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.125471 20040 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:39.016472 19901 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.127992 19901 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:39.133234 20108 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:18:39.133803 20044 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:39.134021 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:39.134774 17990 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:39.008908 20096 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.138252 17393 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:39.138504 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:39.132153 19824 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.101493 20052 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:39.101594 19987 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.139076 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:39.121194 20109 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:18:39.053720 20099 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:39.144644 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:39.148316 20004 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:39.183149 19703 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:39.149480 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:39.149315 20031 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.136691 20051 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.152412 19824 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:39.152896 17469 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:39.155476 19877 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.162359 19988 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:39.166899 20107 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:39.121791 19971 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:39.167141 17315 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:39.169355 17392 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.169448 20102 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.178978 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:39.186677 20043 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.611s	user 0.003s	sys 0.014s
I20260709 13:18:39.180204 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:39.115206 20103 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:39.160631 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:39.182211 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:39.201772 17463 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.206449 17463 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:39.206858 17317 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:39.182025 20099 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.185307 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:39.184445 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 546) took 1585 ms. Trace:
I20260709 13:18:39.186431 20101 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:39.188412 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 158671us
I20260709 13:18:39.072096 17994 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:39.209326 17998 rpcz_store.cc:276] 0709 13:18:37.599262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.599405 (+   143us) service_pool.cc:224] Handling call
0709 13:18:37.599751 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.995562 (+1395811us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:38.995595 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.995647 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:38.995679 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.184240 (+188561us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400198f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:39.184281 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.184392 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22821,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3429,"spinlock_wait_cycles":3209332096}
I20260709 13:18:39.197301 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:39.170694 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:39.208026 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:39.211251 17467 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:39.196559 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:39.211643 17360 leader_election.cc:336] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 1.850s (SENT)
I20260709 13:18:39.211676 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:39.212235 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:39.214505 17320 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:18:39.215090 17360 connection.cc:256] RPC call timeout handler was delayed by -1.1848598419999234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:18:39.030587 19815 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:39.215483 17360 connection.cc:256] RPC call timeout handler was delayed by -1.16415984199989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
I20260709 13:18:39.216167 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:39.217798 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:39.218515 17395 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
W20260709 13:18:39.217902 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47352.6us
I20260709 13:18:39.219436 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:39.224553 17392 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
W20260709 13:18:39.233758 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53702.4us
I20260709 13:18:39.235548 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:39.220458 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:39.216223 20052 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:39.216223 19824 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:39.252552 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.236775 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2522) took 1663 ms. Trace:
I20260709 13:18:39.072741 19996 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.216307 19988 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.273252 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:39.236665 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:39.274192 17391 rpcz_store.cc:276] 0709 13:18:37.573421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.586507 (+ 13086us) service_pool.cc:224] Handling call
0709 13:18:37.586801 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.702920 (+116119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.236567 (+1533647us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540038d954. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:39.236724 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242885504}
I20260709 13:18:39.216359 20107 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.232990 19859 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:39.281241 17395 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.282090 17392 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:39.233137 20014 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.262233 20055 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:39.233013 20101 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:39.237244 19703 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:39.272025 20052 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.209870 20043 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.277088 20053 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:39.300355 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 64882us
I20260709 13:18:39.277593 20099 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:39.215329 20102 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.276286 19824 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:39.310983 17320 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:39.269075 20034 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:18:39.304105 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:39.260739 19822 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.308053 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:39.319079 17319 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:39.269538 19900 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:18:39.291426 19996 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.269256 19081 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:39.292272 19859 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:39.322739 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:39.312486 17999 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:39.288973 20107 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:39.310890 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:39.313135 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:39.305979 17395 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:39.323729 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:39.313138 19824 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.299208 20052 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.340938 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:39.350375 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 129960us
I20260709 13:18:39.363936 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:39.374258 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:39.376411 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58094.9us
I20260709 13:18:39.377669 20099 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:39.378150 20099 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:39.348124 19824 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.379124 20099 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.380468 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 564) took 1696 ms. Trace:
I20260709 13:18:39.381135 19824 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:39.338810 19859 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.339453 20107 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.381008 17995 rpcz_store.cc:276] 0709 13:18:37.684459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.684637 (+   178us) service_pool.cc:224] Handling call
0709 13:18:39.380305 (+1695668us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400084154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:39.380404 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2901018368}
I20260709 13:18:39.380434 20099 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.334180 17313 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:39.379613 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48172 (request call id 0) took 4244 ms. Trace:
I20260709 13:18:39.333853 20043 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:39.337849 20014 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:39.337917 20053 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.273236 20103 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:39.387480 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 73397.8us
I20260709 13:18:39.406023 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:39.369000 20055 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:39.390264 20133 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:39.375986 19999 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:39.400307 20086 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:39.401432 20096 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:39.405217 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 103205us
W20260709 13:18:39.407968 20072 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 13:18:39.348055 19987 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.385519 19900 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:18:39.335997 20101 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.414048 19999 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:39.432536 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 68711.8us
I20260709 13:18:39.434499 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:39.410521 20060 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:18:39.410735 20053 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.391110 17991 rpcz_store.cc:276] 0709 13:18:35.138967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.139135 (+   168us) service_pool.cc:224] Handling call
0709 13:18:39.379406 (+4240271us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b5400244fd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627ee853 00007f7d677bc60a 00007f7d60d427d4 00007f7d60d42762 00007f7d60d42691 00007f7d60d4260c 00007f7d60d418c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:39.379516 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6117151616}
I20260709 13:18:39.424237 20072 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.438048 20139 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:39.457872 17396 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:39.432775 20137 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:18:39.445530 19900 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:39.471719 17471 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:39.478394 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 60938.8us
I20260709 13:18:39.479421 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:39.447678 20141 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.484210 20137 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:39.484890 20086 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.485770 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:39.475008 20140 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:39.486228 20053 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:39.489223 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:39.475028 20139 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:39.492901 19824 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.493256 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:39.493762 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:39.494388 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:39.482023 19822 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:39.511229 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:39.525583 17317 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:39.525789 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 91396.6us
I20260709 13:18:39.526396 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:39.489974 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:39.512581 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:39.513304 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:39.493686 20138 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:39.515614 17394 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 3: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:39.475629 20014 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:39.522840 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:39.522913 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:39.529498 17464 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:39.529925 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:39.552027 17465 raft_consensus.cc:2410] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:39.531651 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:39.479187 19900 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.552903 17469 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.554543 19900 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:39.502921 20086 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.556262 20139 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.557092 20086 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.551206 20014 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.536428 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:39.511255 20140 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.495288 20137 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:39.453809 20055 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.567363 19983 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:39.483444 20052 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.584769 20140 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.597438 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:39.598116 17462 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:39.571961 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:39.572973 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.603739 17317 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:39.587500 19983 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.606880 19983 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:39.607718 20137 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.546056 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:39.609366 20137 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:39.508725 19999 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.524545 19824 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:39.571007 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:39.619130 20099 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:39.583053 17469 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:39.767237 17462 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:39.793668 17990 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:39.745486 20099 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.665939 19859 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.795611 20099 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:39.790277 20051 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.003s
I20260709 13:18:39.754325 20144 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.854549 20144 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.843328 20051 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:39.850595 20052 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:39.878019 20052 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:39.878940 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:39.880079 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.807394 20072 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:39.882843 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:39.913512 17395 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:39.890810 19999 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.979821 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:39.889703 20052 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:39.969327 20143 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:39.947666 20072 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.992729 19824 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:39.994596 20051 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.009258 19859 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.009663 20144 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.015443 17397 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:40.014014 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 443062us
I20260709 13:18:39.915776 20137 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:39.980685 20107 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 13:18:40.032822 19983 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:40.069968 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.033111 20072 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.032655 20143 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.070498 20107 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:40.085307 20086 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.000s
I20260709 13:18:40.070880 20137 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:40.096220 19996 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.734s	user 0.012s	sys 0.001s
I20260709 13:18:40.088027 20052 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.094522 20086 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:40.121758 20140 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.004s
I20260709 13:18:40.132859 20140 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.233294 20143 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.234303 20107 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:40.225883 20072 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:40.246173 20140 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.247674 20137 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:40.248973 20086 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.221621 19983 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:40.324146 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.332176 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 482) took 2075 ms. Trace:
I20260709 13:18:40.332818 17313 rpcz_store.cc:276] 0709 13:18:38.257066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.918380 (+661314us) service_pool.cc:224] Handling call
0709 13:18:38.966991 (+ 48611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.398813 (+431822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.331496 (+932683us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400369a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:40.331911 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843806976}
I20260709 13:18:40.344105 17394 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:40.344775 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:40.346314 17397 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:40.365701 17316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1235) took 2664 ms (client timeout 2232 ms). Trace:
W20260709 13:18:40.366282 17316 rpcz_store.cc:269] 0709 13:18:37.701228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.701359 (+   131us) service_pool.cc:224] Handling call
0709 13:18:40.365138 (+2663779us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540043f8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:40.365427 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760004864}
I20260709 13:18:40.378324 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1474) took 1240 ms. Trace:
I20260709 13:18:40.378528 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 406) took 1076 ms. Trace:
I20260709 13:18:40.378844 17396 rpcz_store.cc:276] 0709 13:18:39.137681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.295230 (+157549us) service_pool.cc:224] Handling call
0709 13:18:40.377868 (+1082638us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540009c4d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:40.378082 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270269312}
W20260709 13:18:40.380079 17466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 414) took 2871 ms (client timeout 1524 ms). Trace:
I20260709 13:18:40.380901 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:40.382576 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:40.382670 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 398) took 1979 ms. Trace:
I20260709 13:18:40.383311 17396 raft_consensus.cc:2376] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6. Re-sending same reply.
I20260709 13:18:40.384348 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:40.385558 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1503) took 2604 ms. Trace:
W20260709 13:18:40.380573 17466 rpcz_store.cc:269] 0709 13:18:37.508914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.514280 (+  5366us) service_pool.cc:224] Handling call
0709 13:18:40.379507 (+2865227us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000514d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:40.379741 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3199797120}
I20260709 13:18:40.379046 17395 rpcz_store.cc:276] 0709 13:18:39.302332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.357068 (+ 54736us) service_pool.cc:224] Handling call
0709 13:18:40.378093 (+1021025us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400124654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:40.378332 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237496064}
I20260709 13:18:40.386888 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2538) took 1872 ms. Trace:
I20260709 13:18:40.383162 17388 rpcz_store.cc:276] 0709 13:18:38.403251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.897540 (+494289us) service_pool.cc:224] Handling call
0709 13:18:39.488947 (+591407us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:39.489367 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.489406 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:39.490101 (+   695us) log.cc:844] Serialized 52 byte log entry
0709 13:18:39.606719 (+116618us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:39.606791 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.606893 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.003095 (+396202us) raft_consensus.cc:1685] finished
0709 13:18:40.003121 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.382098 (+378977us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b5400253350. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:40.382437 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16057,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"spinlock_wait_cycles":1359183232,"thread_start_us":106702,"threads_started":1,"wal-append.queue_time_us":510776}
W20260709 13:18:40.393328 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.415134 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:40.416360 19994 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.417301 19558 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.395406 17393 rpcz_store.cc:276] 0709 13:18:38.514776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.926974 (+412198us) service_pool.cc:224] Handling call
0709 13:18:38.927271 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.138684 (+211413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.386276 (+1247592us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400015c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:40.386680 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484765568}
W20260709 13:18:40.416426 17997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 551) took 2759 ms (client timeout 2147 ms). Trace:
W20260709 13:18:40.420349 17997 rpcz_store.cc:269] 0709 13:18:37.656971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.657087 (+   116us) service_pool.cc:224] Handling call
0709 13:18:40.414531 (+2757444us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:40.416243 (+  1712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2548608}
I20260709 13:18:40.431265 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:40.433074 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:40.433955 17393 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.434826 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:40.436127 17392 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:40.430147 17396 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:40.394351 17318 rpcz_store.cc:276] 0709 13:18:37.781088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.755886 (+974798us) service_pool.cc:224] Handling call
0709 13:18:38.796034 (+ 40148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.819148 (+ 23114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.819187 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.337432 (+1518245us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b18003a1320. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a
0709 13:18:40.338198 (+   766us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b2c00014ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:18:40.339232 (+  1034us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.349357 (+ 10125us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:40.349443 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.349599 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.385164 (+ 35565us) raft_consensus.cc:1685] finished
0709 13:18:40.385185 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.385394 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22643,"raft.queue_time_us":23032,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":38475,"spinlock_wait_cycles":18246400,"thread_start_us":9589,"threads_started":1,"wal-append.queue_time_us":9688}
I20260709 13:18:40.418380 19558 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.450865 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:40.452361 17397 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:40.456010 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:40.456338 20107 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:40.457370 20107 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.458184 17395 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:40.458904 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2543) took 1318 ms. Trace:
I20260709 13:18:40.459246 17395 rpcz_store.cc:276] 0709 13:18:39.140731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.457194 (+1316463us) service_pool.cc:224] Handling call
0709 13:18:40.457729 (+   535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.458639 (+   910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.458824 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.460193 20107 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.452884 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:40.462348 20152 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.463196 19824 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:40.463580 20151 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.463970 19824 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.464290 20151 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.452669 19983 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:40.466092 19983 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.466552 20151 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.467170 20151 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:40.467949 20151 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:40.466729 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.454253 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2541) took 1312 ms. Trace:
I20260709 13:18:40.466557 19824 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:40.469660 17394 rpcz_store.cc:276] 0709 13:18:39.140163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.540080 (+399917us) service_pool.cc:224] Handling call
0709 13:18:39.547263 (+  7183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.344952 (+797689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.443108 (+ 98156us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b540038e854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:40.452050 (+  8942us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830755584}
I20260709 13:18:40.477654 17396 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:18:40.478981 17434 connection.cc:256] RPC call timeout handler was delayed by -1.4508566120002797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:18:40.487149 17434 connection.cc:256] RPC call timeout handler was delayed by -1.3229531520000819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:18:40.488088 17434 connection.cc:256] RPC call timeout handler was delayed by -1.3026008920001004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:18:40.489473 20153 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.201s	user 0.002s	sys 0.000s
I20260709 13:18:40.468663 19983 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.479902 19558 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.477711 17388 raft_consensus.cc:2410] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:18:40.488440 17434 connection.cc:256] RPC call timeout handler was delayed by -1.2762566120002248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 13:18:40.481091 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.493435 17397 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:40.493698 17434 connection.cc:256] RPC call timeout handler was delayed by -1.149356612000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 13:18:40.494024 17434 connection.cc:256] RPC call timeout handler was delayed by -1.0990490350002347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:18:40.496889 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:40.496932 17388 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:40.498188 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2550) took 1299 ms. Trace:
W20260709 13:18:40.498924 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 87156.9us
I20260709 13:18:40.500334 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:40.498615 17388 rpcz_store.cc:276] 0709 13:18:39.198832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.496011 (+1297179us) service_pool.cc:224] Handling call
0709 13:18:40.496550 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.497860 (+  1310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.498090 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.506635 17388 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:40.507330 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2551) took 1234 ms. Trace:
I20260709 13:18:40.507694 17388 rpcz_store.cc:276] 0709 13:18:39.272563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.505553 (+1232990us) service_pool.cc:224] Handling call
0709 13:18:40.506090 (+   537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.507028 (+   938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.507266 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.510377 17434 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:40.511732 19983 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.513506 17396 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:40.510210 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2546) took 1350 ms. Trace:
I20260709 13:18:40.517267 17397 rpcz_store.cc:276] 0709 13:18:39.143339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.461921 (+1318582us) service_pool.cc:224] Handling call
0709 13:18:40.493266 (+ 31345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.493883 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.494071 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:40.509230 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51737.1us
I20260709 13:18:40.518966 20161 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:40.520524 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2548) took 1350 ms. Trace:
I20260709 13:18:40.523910 17396 rpcz_store.cc:276] 0709 13:18:39.170031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.488265 (+1318234us) service_pool.cc:224] Handling call
0709 13:18:40.513284 (+ 25019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.520281 (+  6997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.520471 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:40.531260 20128 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.186s	user 0.016s	sys 0.017s
W20260709 13:18:40.539242 17963 connection.cc:256] RPC call timeout handler was delayed by -1.50058186199999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:18:40.539839 17963 connection.cc:256] RPC call timeout handler was delayed by -1.4755583159999333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 13:18:40.540412 17963 connection.cc:256] RPC call timeout handler was delayed by -1.37298971600012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:18:40.545758 17468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2466) took 2952 ms (client timeout 2602 ms). Trace:
W20260709 13:18:40.546433 17468 rpcz_store.cc:269] 0709 13:18:37.592806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.594679 (+  1873us) service_pool.cc:224] Handling call
0709 13:18:40.545174 (+2950495us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400200654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:40.545483 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2958708480}
I20260709 13:18:40.550112 20010 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:40.550798 20010 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:40.563264 20102 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:40.569149 20043 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:40.569767 20043 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:40.571414 20043 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.574285 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:40.574846 19987 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.576403 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:40.577143 17996 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.463207 20152 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:40.579658 20114 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.554s	user 0.012s	sys 0.020s
I20260709 13:18:40.580009 20152 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:40.581586 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2547) took 1438 ms. Trace:
I20260709 13:18:40.582008 17394 rpcz_store.cc:276] 0709 13:18:39.143633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.476625 (+1332992us) service_pool.cc:224] Handling call
0709 13:18:40.580925 (+104300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.581249 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.581275 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.581319 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:40.581347 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.581406 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.581507 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.584589 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:40.585340 19703 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:40.585783 19703 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:40.540788 17963 connection.cc:256] RPC call timeout handler was delayed by -1.1290089369999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 13:18:40.492043 20137 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:18:40.591750 19703 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.592674 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 405) took 1290 ms. Trace:
I20260709 13:18:40.593077 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:40.595386 17397 rpcz_store.cc:276] 0709 13:18:39.302090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.521919 (+1219829us) service_pool.cc:224] Handling call
0709 13:18:40.591942 (+ 70023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.592346 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.592371 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.592429 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:40.592458 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.592511 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.592622 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.586674 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:40.601198 17996 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 3.
W20260709 13:18:40.601464 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 101395us
I20260709 13:18:40.604269 17393 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:40.602106 20043 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.616539 17392 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:40.619912 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2542) took 1477 ms. Trace:
I20260709 13:18:40.620390 17392 rpcz_store.cc:276] 0709 13:18:39.140453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.450451 (+1309998us) service_pool.cc:224] Handling call
0709 13:18:40.516155 (+ 65704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.617129 (+100974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.617382 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.625881 17997 raft_consensus.cc:2410] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:40.627465 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:40.627692 19883 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:40.632350 19883 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:40.632762 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:40.633400 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:40.634740 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:40.635432 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:40.636341 17314 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:40.637166 20052 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.637511 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:40.638006 20052 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:40.638423 17313 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:40.638513 20052 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.638986 20052 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:40.641044 19703 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.640805 19883 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.644982 17391 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:40.645655 17318 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:40.646924 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:40.599666 19994 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:40.624286 20140 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:40.664769 17964 leader_election.cc:336] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.524s (SENT)
I20260709 13:18:40.665373 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:40.666869 17397 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:40.667333 20057 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:40.668215 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:40.670007 17397 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:40.670992 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:40.671691 17397 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:40.671569 17360 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:40.673154 20140 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.673319 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:40.673657 17395 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:40.673763 20140 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.674525 17994 raft_consensus.cc:2410] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:40.674469 20014 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.674396 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2545) took 1533 ms. Trace:
I20260709 13:18:40.677134 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:40.611301 20010 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.677469 17395 rpcz_store.cc:276] 0709 13:18:39.141356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.460083 (+1318727us) service_pool.cc:224] Handling call
0709 13:18:40.460536 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.673472 (+212936us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b54003c6020. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d6276bdc0 00007f7d627f61c0 00007f7d627f7231 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c
0709 13:18:40.674147 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.674347 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111119232}
I20260709 13:18:40.685544 17396 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:40.690730 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 408) took 1387 ms. Trace:
I20260709 13:18:40.691040 17396 rpcz_store.cc:276] 0709 13:18:39.302872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.595053 (+1292181us) service_pool.cc:224] Handling call
0709 13:18:40.621525 (+ 26472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.690541 (+ 69016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.690689 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.692408 17393 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:40.695101 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:40.697901 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88011.1us
I20260709 13:18:40.671499 19676 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.700054 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:40.640978 20143 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:40.700395 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:40.626317 20161 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:40.715201 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 138933us
I20260709 13:18:40.716214 17397 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:40.714111 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 99124.3us
I20260709 13:18:40.718273 17392 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:40.718693 17392 pending_rounds.cc:85] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 2
I20260709 13:18:40.718922 17392 pending_rounds.cc:107] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:40.724454 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:40.726243 20086 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:40.726974 20086 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:40.726995 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55725.9us
I20260709 13:18:40.728999 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 775) took 1668 ms. Trace:
I20260709 13:18:40.729382 17991 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:18:40.730975 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 144481us
I20260709 13:18:40.729698 17993 rpcz_store.cc:276] 0709 13:18:39.017802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.136185 (+118383us) service_pool.cc:224] Handling call
0709 13:18:39.163000 (+ 26815us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:39.163488 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.163522 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:39.164195 (+   673us) log.cc:844] Serialized 52 byte log entry
0709 13:18:39.274648 (+110453us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:39.431380 (+156732us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.441582 (+ 10202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.449258 (+  7676us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.529793 (+1080535us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:40.621809 (+ 92016us) raft_consensus.cc:1685] finished
0709 13:18:40.628179 (+  6370us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.685892 (+ 57713us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51016,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":6493,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":8592,"spinlock_wait_cycles":18199424,"thread_start_us":240044,"threads_started":2,"wal-append.queue_time_us":180717}
I20260709 13:18:40.732077 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:40.732915 17316 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:40.733136 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2536) took 2390 ms. Trace:
I20260709 13:18:40.733947 19956 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:40.734561 19956 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.735064 19956 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.736346 20002 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:40.736795 20002 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.737175 20002 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.737812 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:40.741014 17468 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:40.741762 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:40.742619 19900 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:40.744393 17466 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:40.745165 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:40.745703 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:40.745833 19822 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:40.746362 19822 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:40.746639 17319 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:40.747627 19822 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.749322 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:40.750168 19676 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.728334 20086 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.750916 19676 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.753036 20055 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:40.753737 20055 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:40.754998 20055 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:40.756925 17962 connection.cc:256] RPC call timeout handler was delayed by -1.6081830460000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 13:18:40.733549 17390 rpcz_store.cc:276] 0709 13:18:38.342681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.865202 (+522521us) service_pool.cc:224] Handling call
0709 13:18:38.865554 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.865797 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:38.871031 (+  5234us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.376857 (+1505826us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b180039f2e0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:18:40.718069 (+341212us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.732500 (+ 14431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.732569 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:40.732644 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.732719 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.732975 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85364,"prepare.queue_time_us":221622,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":17259,"raft.run_cpu_time_us":470,"raft.run_wall_time_us":42212,"spinlock_wait_cycles":6595456,"thread_start_us":220754,"threads_started":2,"wal-append.queue_time_us":1624266}
I20260709 13:18:40.734421 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:40.761713 20041 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.761907 20151 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:40.762400 20041 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:40.763857 20041 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.766113 20161 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:40.757704 20103 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.721628 19877 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:40.775514 20160 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:40.757539 20143 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.724992 17392 raft_consensus.cc:2889] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:40.732184 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:40.757886 17215 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49270 (request call id 325) took 17453 ms (client timeout 15000 ms). Trace:
W20260709 13:18:40.757383 17962 connection.cc:256] RPC call timeout handler was delayed by -1.5595830459999434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 13:18:40.797673 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:40.758276 17389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2526) took 3090 ms (client timeout 1915 ms). Trace:
W20260709 13:18:40.795840 17471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1417) took 1522 ms (client timeout 1657 ms). Trace:
W20260709 13:18:40.800019 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.796154 17316 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:40.797590 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:40.801625 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.741007 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:40.798870 17389 rpcz_store.cc:269] 0709 13:18:37.632711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.632872 (+   161us) service_pool.cc:224] Handling call
0709 13:18:40.701531 (+3068659us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540038ed54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:40.723299 (+ 21768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2828669696}
I20260709 13:18:40.806775 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:40.808144 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 95463.8us
I20260709 13:18:40.809235 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:40.809981 17434 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:40.811276 17469 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:40.811550 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:40.810062 17466 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
W20260709 13:18:40.813539 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.800417 17471 rpcz_store.cc:269] 0709 13:18:39.177268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.177449 (+   181us) service_pool.cc:224] Handling call
0709 13:18:40.687709 (+1510260us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54001f7a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:40.699907 (+ 12198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603056000}
I20260709 13:18:40.812481 20163 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:40.821215 17393 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:40.822650 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:40.823041 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:40.802829 20010 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:40.758062 20162 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 13:18:40.823438 17465 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:40.837560 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 167788us
W20260709 13:18:40.830176 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.830097 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 98120us
I20260709 13:18:40.840360 17395 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:40.843181 17468 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:40.844573 17321 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:40.824198 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:40.834491 19999 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.822s	user 0.018s	sys 0.000s
W20260709 13:18:40.848796 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.806138 19703 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.829473 20162 consensus_queue.cc:1243] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:40.832543 19822 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.824084 20152 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:40.854223 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:40.854980 20140 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.855650 19960 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:40.856062 17220 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:18:40.825062 20167 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.853261 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:40.860080 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:40.860783 19994 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.862211 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50772.7us
I20260709 13:18:40.865227 17471 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:40.866361 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1476) took 1728 ms (client timeout 2050 ms). Trace:
W20260709 13:18:40.900336 17391 rpcz_store.cc:269] 0709 13:18:39.138268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.299247 (+160979us) service_pool.cc:224] Handling call
0709 13:18:40.866100 (+1566853us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540023dcd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:40.866292 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2872810240}
I20260709 13:18:40.900981 20169 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:40.867121 17462 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:40.901603 20169 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.903503 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2552) took 1623 ms. Trace:
I20260709 13:18:40.867234 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1265) took 1324 ms. Trace:
I20260709 13:18:40.904078 17320 rpcz_store.cc:276] 0709 13:18:39.521376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.550726 (+ 29350us) service_pool.cc:224] Handling call
0709 13:18:39.881711 (+330985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.881992 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:40.471818 (+589826us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.725562 (+253744us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.796832 (+ 71270us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:40.805897 (+  9065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.816087 (+ 10190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.845469 (+ 29382us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":528789,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":5675,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":75459,"thread_start_us":688629,"threads_started":2,"wal-append.queue_time_us":301825}
I20260709 13:18:40.833623 20171 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:18:40.832137 20151 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.870527 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:40.871584 17466 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:40.824817 20143 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:40.832054 20002 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.853034 19676 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.876717 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:40.875190 20086 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.927722 20086 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.930342 20086 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:40.881124 19877 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:40.882679 20014 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:40.932891 17470 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.934284 20171 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:40.934788 20171 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:40.935803 20171 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.937461 17464 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:40.937594 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:40.938074 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:40.938495 17463 raft_consensus.cc:2410] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:40.939091 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:40.939514 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:40.940161 17463 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.938506 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:40.942448 17464 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:40.942498 20002 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.903911 20169 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:40.893759 20111 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.969s	user 0.026s	sys 0.043s
W20260709 13:18:40.894003 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.944495 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.894543 17465 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
W20260709 13:18:40.895025 17962 connection.cc:256] RPC call timeout handler was delayed by -1.3929195209998397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:18:40.948030 17962 connection.cc:256] RPC call timeout handler was delayed by -1.3758195209998121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 13:18:40.948400 17962 connection.cc:256] RPC call timeout handler was delayed by -1.3291830460000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 13:18:40.905923 20072 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.867115 17467 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:40.906589 17469 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:40.908579 19832 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:40.913048 19574 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:40.903949 17388 rpcz_store.cc:276] 0709 13:18:39.280047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.518107 (+1238060us) service_pool.cc:224] Handling call
0709 13:18:40.867465 (+349358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.867686 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.867711 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.867753 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:40.867781 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.867831 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.903297 (+ 35466us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b540023dcd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:40.903412 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696314624}
I20260709 13:18:40.915035 19815 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:40.915665 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:40.915277 17220 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 4 to 5, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 5 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.915341 19956 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.904965 19703 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.917200 19967 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:40.927119 17315 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
W20260709 13:18:40.850353 20087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.361s	user 0.019s	sys 0.019s
I20260709 13:18:40.885798 20152 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:40.951874 20152 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.952530 19703 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.954527 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:40.955252 17999 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:40.956475 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:40.957048 20087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.623s	user 0.020s	sys 0.020s
W20260709 13:18:40.959092 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 157977us
I20260709 13:18:40.962052 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:40.965832 19832 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:40.966308 19832 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:40.967386 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:40.969702 19832 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.969694 17996 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:40.795869 17215 rpcz_store.cc:269] 0709 13:18:23.241848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.242035 (+   187us) service_pool.cc:224] Handling call
0709 13:18:25.201712 (+1959677us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275e090 00007f7d627fcf3a 00007f7d685b31cc 00007f7d686b137e 00007f7d66b722a4 00007f7d66b72232 00007f7d66b72161 00007f7d66b720dc 00007f7d66b71392 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:40.690060 (+15488348us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:31.911958 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:31.912554 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:31.912604 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:18:31.912616 (+    12us) tablet.cc:662] Decoding operations
0709 13:18:31.965412 (+ 52796us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:31.965498 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:31.965529 (+    31us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:18:31.969142 (+  3613us) tablet.cc:701] Row locks acquired
0709 13:18:31.969210 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:18:31.969435 (+   225us) write_op.cc:270] Start()
0709 13:18:31.969657 (+   222us) write_op.cc:276] Timestamp: P: 1783603111969355 usec, L: 0
0709 13:18:31.969683 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:18:32.012718 (+ 43035us) log.cc:844] Serialized 9782 byte log entry
0709 13:18:32.109737 (+ 97019us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627efe28 00007f7d6622a581 00007f7d66229d58 00007f7d6622e9f1 00007f7d6622e9a9 00007f7d6622e939 00007f7d6622e901 00007f7d6622db2d 000000000038f354 000000000038f199
0709 13:18:32.170914 (+ 61177us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b180033c880. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d62769dbe 00007f7d62774930 00007f7d627748d8
0709 13:18:32.172239 (+  1325us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b540011f1a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d62769dbe 00007f7d62774930 00007f7d627748d8 00007f7d62774858 00007f7d62774813 00007f7d62773a9c 00007f7d6865f626 00007f7d68659dd8 00007f7d627b07cb 00007f7d627b32c0
0709 13:18:32.241876 (+ 69637us) op_driver.cc:464] REPLICATION: finished
0709 13:18:32.595927 (+354051us) write_op.cc:301] APPLY: starting
0709 13:18:32.617805 (+ 21878us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:32.697114 (+ 79309us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:32.697159 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:33.064021 (+366862us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:33.064442 (+   421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 13:18:33.064488 (+    46us) write_op.cc:312] APPLY: finished
0709 13:18:33.186144 (+121656us) log.cc:844] Serialized 170 byte log entry
0709 13:18:33.219530 (+ 33386us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.263861 (+ 44331us) write_op.cc:454] Released schema lock
0709 13:18:33.310178 (+ 46317us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:33.357154 (+ 46976us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.363510 (+  6356us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46892,"reported_tablets":38,"spinlock_wait_cycles":1334952320,"child_traces":[["op",{"apply.queue_time_us":305564,"apply.run_cpu_time_us":11943,"apply.run_wall_time_us":751039,"num_ops":25,"prepare.queue_time_us":661203,"prepare.run_cpu_time_us":16713,"prepare.run_wall_time_us":198024,"raft.queue_time_us":68861,"raft.run_cpu_time_us":22679,"raft.run_wall_time_us":180280,"replication_time_us":272015,"spinlock_wait_cycles":51223296,"thread_start_us":393219,"threads_started":4,"wal-append.queue_time_us":64731,"wal-append.run_cpu_time_us":12921,"wal-append.run_wall_time_us":2268313}]]}
I20260709 13:18:40.973388 17470 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
W20260709 13:18:40.976444 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 138860us
I20260709 13:18:40.982126 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:40.959542 20161 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.968451 19983 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:40.982978 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:40.989692 17997 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:40.982697 20002 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:40.995463 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 142747us
I20260709 13:18:40.949162 20052 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:40.992308 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:40.985795 20107 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:40.985613 19960 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:40.926367 19994 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:40.985796 19815 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.991856 19900 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:40.987700 20171 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:40.990609 19983 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:41.008977 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.998749 17468 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:41.014065 19676 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.016137 20052 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:40.997370 19877 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:41.022316 17996 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:41.003901 20107 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:18:41.030647 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 115074us
I20260709 13:18:41.025413 19676 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.033071 17997 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:41.033248 19676 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.003090 19967 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:41.034219 17220 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 3 to 4, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 4 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.027698 20002 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:41.037827 20002 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.031553 19960 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:41.011400 19900 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.989931 20072 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.040812 17463 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:41.041646 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.058971 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.059095 19999 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.041810 19960 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.042126 19900 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.061937 17468 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:41.064489 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 76175.9us
I20260709 13:18:41.065172 17465 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:41.066071 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:41.067953 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:41.064388 17469 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:41.055720 20107 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.069082 20103 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.069425 20001 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:41.070005 20103 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.070689 20001 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:41.071074 20001 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:41.071899 17315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1262) took 1578 ms (client timeout 1708 ms). Trace:
W20260709 13:18:41.072386 17315 rpcz_store.cc:269] 0709 13:18:39.493902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.522580 (+ 28678us) service_pool.cc:224] Handling call
0709 13:18:41.071692 (+1549112us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540043f3d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:41.071831 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3163212672}
I20260709 13:18:41.071988 20001 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.025852 19983 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.075842 20001 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.079044 19994 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:41.045796 17998 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:41.036300 17220 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 2 to 3, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 3 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:41.054932 20072 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:41.081302 20150 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.954s	user 0.014s	sys 0.000s
I20260709 13:18:41.081526 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.082806 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.083997 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.084084 20031 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.084918 20031 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.087175 20031 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:41.082844 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 562) took 1574 ms. Trace:
I20260709 13:18:41.089099 19994 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.995071 20161 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.088975 17995 rpcz_store.cc:276] 0709 13:18:39.508009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.508196 (+   187us) service_pool.cc:224] Handling call
0709 13:18:39.510537 (+  2341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.517859 (+  7322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.517889 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.524629 (+  6740us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.083349 (+558720us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:40.083406 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.083480 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.080444 (+996964us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:41.082436 (+  1992us) raft_consensus.cc:1685] finished
0709 13:18:41.082457 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.082688 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":17144,"spinlock_wait_cycles":9877888,"thread_start_us":466394,"threads_started":1,"wal-append.queue_time_us":530282}
I20260709 13:18:41.091166 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:41.091712 20161 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:41.092226 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:41.056504 19877 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.094527 19877 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:41.093921 17220 catalog_manager.cc:5697] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 5, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:18:41.095878 17220 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 4 to 7, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 7 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:18:41.097280 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 52463.3us
W20260709 13:18:41.099560 17962 leader_election.cc:336] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 1.651s (SENT)
I20260709 13:18:41.031786 19832 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.103705 19900 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.106176 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:41.107120 17470 raft_consensus.cc:2410] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:41.108446 17467 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:41.089934 19994 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.110146 20107 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.110476 19994 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:41.060191 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:41.111479 17997 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:41.112214 20107 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:41.112910 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 80592.1us
I20260709 13:18:41.043081 19676 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.115010 19676 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:41.115613 19676 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:41.116385 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:41.117247 20052 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:41.117647 20052 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.118007 20052 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.118443 17434 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:41.118767 17469 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:41.119208 17469 pending_rounds.cc:85] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 5
I20260709 13:18:41.119462 17469 pending_rounds.cc:107] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:18:41.119695 17469 raft_consensus.cc:2889] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.122073 20152 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:41.124449 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 56638.3us
I20260709 13:18:41.126336 19994 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.127367 19520 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:41.128393 19999 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:41.128819 19999 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:41.129679 19999 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.130064 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:41.130721 19999 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:41.130916 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 128137us
I20260709 13:18:41.128388 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:41.126639 20031 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:41.127063 19822 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:41.133971 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:41.134153 17999 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:41.142235 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:41.157764 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.171526 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:41.173590 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:41.174571 20152 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:41.173872 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 141160us
I20260709 13:18:41.180006 17463 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:41.181164 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.181834 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.182387 17994 raft_consensus.cc:2410] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:18:41.174893 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 56536.4us
I20260709 13:18:41.183092 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:41.183735 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:41.184146 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:41.181910 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:41.188716 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:41.198875 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.185843 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.174018 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:41.174086 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:41.174815 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 44848.5us
I20260709 13:18:41.220086 17995 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 3: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:41.189193 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:41.173651 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.161551 20161 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:41.185128 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:41.221702 17315 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:41.221735 17319 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.178472 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:41.178973 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:41.223290 17998 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:41.222271 17318 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:41.226089 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:41.184772 17994 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:41.165457 20010 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:41.228539 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46731.9us
I20260709 13:18:41.185595 20152 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.231305 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:41.231951 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:41.162603 20087 raft_consensus.cc:2764] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:41.240423 17317 raft_consensus.cc:2368] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9.
I20260709 13:18:41.192180 20162 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:41.229944 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:41.231176 17997 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:41.191162 19956 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:41.237200 17318 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:41.187803 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:41.235599 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:41.247018 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:41.171270 20072 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.246944 17321 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:41.244654 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:41.169158 19520 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:18:41.253093 17999 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.178218 19983 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.253201 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:41.256155 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:41.257236 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:41.260241 17471 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:41.262428 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:41.242713 20162 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:41.251211 20107 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:41.264408 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:41.268625 17220 catalog_manager.cc:5697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 2 to 3, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 3 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:41.268043 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.265172 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:41.237673 20152 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:41.265461 17315 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:41.242731 20161 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:41.266307 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:41.303936 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62992.4us
I20260709 13:18:41.222301 20173 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:18:41.268886 17462 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:41.242653 20010 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:41.270135 17468 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:41.256816 20139 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.270617 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 85599.8us
I20260709 13:18:41.256765 20171 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:41.275032 20162 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.276065 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:41.268203 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:41.303217 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:41.303891 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:41.267168 19900 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:41.304514 20096 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:41.305783 19574 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:41.309332 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 52880.5us
I20260709 13:18:41.276888 17466 pending_rounds.cc:85] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 3
I20260709 13:18:41.338442 17466 pending_rounds.cc:107] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:41.338730 17466 raft_consensus.cc:2889] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.281230 17997 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:41.310149 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:41.310691 17465 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:41.251102 19676 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:41.329363 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.333045 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 67953us
I20260709 13:18:41.333974 17469 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:41.277207 20107 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:41.337343 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:41.325925 20128 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:41.316653 20152 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.343573 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:41.333562 20183 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:18:41.318507 19994 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.339705 17317 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:41.349323 17470 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:41.345278 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:41.375416 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 72291.1us
I20260709 13:18:41.355381 17315 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:41.358152 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:41.358713 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.359261 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:41.359547 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:41.359867 19960 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.360721 17997 pending_rounds.cc:85] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 6
I20260709 13:18:41.335793 20096 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.339319 20072 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.365451 20010 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.366825 19983 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:41.392450 17319 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:41.366765 20161 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.339857 20171 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:41.369146 19967 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.338835 20139 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.374733 19994 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:41.374094 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 46152.4us
I20260709 13:18:41.353225 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:41.377772 17997 pending_rounds.cc:107] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:41.409597 17997 raft_consensus.cc:2889] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.373602 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.341615 17992 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.391292 17394 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.338131 19574 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:41.412914 19574 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.414769 19574 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.352119 20107 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.396016 17395 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:41.330271 19883 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:18:41.356367 17991 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:41.395208 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:41.420885 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:41.422716 20132 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.329981 20031 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:18:41.400060 17388 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.397125 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.425938 17392 raft_consensus.cc:2393] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:41.402700 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.402832 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.428052 17393 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:41.346130 20052 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.430876 20052 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:41.407128 17389 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:41.391343 20096 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.373484 19676 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:41.432678 20087 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:41.433728 19676 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.451735 17992 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:41.457333 17360 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:41.408777 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.471321 17471 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:41.466863 19994 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.473523 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.476786 17389 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:41.477136 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.477751 17396 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:41.549418 17390 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:41.565024 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88960.9us
W20260709 13:18:41.567237 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 208039us
I20260709 13:18:41.474210 20132 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:41.400480 19999 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 13:18:41.473928 20163 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:41.589742 17998 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:41.549510 20162 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.469578 20043 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.146s
I20260709 13:18:41.601083 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:41.472510 20103 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:18:41.561836 19815 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.616302 17390 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:41.591001 20132 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.628103 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:41.632474 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 66518.7us
W20260709 13:18:41.638512 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 88477.5us
I20260709 13:18:41.606144 20163 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:41.599776 19900 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:18:41.634792 20132 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.650957 17394 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
W20260709 13:18:41.654031 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 182510us
I20260709 13:18:41.638128 19983 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.632055 20052 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:41.667917 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.672075 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:41.676299 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:41.676671 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.681596 17396 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:41.675745 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:41.650825 20103 consensus_queue.cc:1243] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:41.652544 19960 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:18:41.685626 20101 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.686771 17315 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:41.633834 19815 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:41.689042 20189 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:18:41.693523 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.667441 19900 consensus_queue.cc:1243] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:41.721953 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:41.636051 20171 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.675521 20052 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:41.727344 17395 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:18:41.676195 20072 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.731987 20072 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.732385 20072 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.733019 17468 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:41.734244 20152 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.735373 17463 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:41.736678 20163 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.738108 19815 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:41.738262 17396 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:41.670264 19676 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:18:41.689752 20151 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:18:41.692780 19822 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:18:41.787043 20152 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:41.744352 20052 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:41.794824 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49510.1us
I20260709 13:18:41.792197 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:41.800813 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 80134.8us
I20260709 13:18:41.799985 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:41.718118 20101 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:41.822526 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 132243us
I20260709 13:18:41.771497 19883 consensus_queue.cc:1243] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:41.825222 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:41.826022 17471 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.772920 20139 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:41.841495 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:41.849783 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 119297us
W20260709 13:18:41.857092 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 65015.8us
I20260709 13:18:41.857579 17468 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:41.843721 20152 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:41.868701 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:41.887919 17999 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.001s
I20260709 13:18:41.888427 17999 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:41.828955 19960 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.890491 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:41.892123 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48575.8us
I20260709 13:18:41.811388 20096 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:41.902953 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 44859.6us
I20260709 13:18:41.857467 20010 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.868458 20139 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.839725 20041 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 13:18:41.919164 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 95841.9us
I20260709 13:18:41.920171 17467 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:41.916639 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:41.921609 17391 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:18:41.884541 20152 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:41.910480 19960 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.870005 20200 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.926807 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:41.906987 19703 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.902783 20193 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:41.935587 17388 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.002s
I20260709 13:18:41.935940 17388 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:41.903927 20202 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.939109 17467 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:41.938402 19815 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:18:41.925688 19999 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:18:41.943241 20087 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.943688 20087 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.944511 20002 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:41.921862 20161 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:41.944967 20002 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:41.945422 20201 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:41.945921 20002 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.946524 20202 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:41.947373 20002 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.915923 20198 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:18:41.951622 20152 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:41.953190 20152 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:41.957266 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 681220us
I20260709 13:18:41.975253 17471 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:41.931668 20137 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:41.992493 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 88344.3us
W20260709 13:18:41.995589 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 79043.9us
I20260709 13:18:41.941565 20103 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:41.999085 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 78913.2us
I20260709 13:18:42.002588 17287 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:41.985913 20176 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:42.011613 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:42.001854 20161 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:41.998034 20202 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:42.018242 17360 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:42.018069 17471 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:42.006102 20103 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:42.018687 17467 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:42.010296 20043 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.038985 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:42.002501 20169 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:18:42.042016 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45998.3us
I20260709 13:18:42.004688 19999 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:42.009382 20198 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:18:42.028810 20194 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:18:42.060364 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:42.047725 17467 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:42.060034 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:41.937588 20200 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.088316 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:42.073452 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:42.012851 20171 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:42.104446 17471 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:42.030467 20103 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.100919 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:42.039865 20043 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.015452 19877 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:18:42.061883 20204 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:18:42.037791 20161 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:42.100106 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:42.116964 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 722531us
I20260709 13:18:42.060791 20221 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:42.097416 19994 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:18:42.063632 20218 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.122812 17464 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:42.126591 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:42.128458 17467 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:42.060286 19983 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:18:42.133575 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:42.119030 20043 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.060570 20210 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:42.118309 20176 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:42.068657 20072 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.151419 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:42.152173 17467 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:42.152705 17464 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:42.156666 20057 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:42.162745 20227 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.162098 20133 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:42.129091 20221 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:42.140945 20096 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:42.100442 20132 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:42.217137 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 143155us
I20260709 13:18:42.136993 19994 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.178117 19960 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:42.218617 19574 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.007s
I20260709 13:18:42.308933 20203 raft_consensus.cc:2764] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:42.262591 19877 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.182910 20057 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:42.216739 20221 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:42.309223 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 248932us
I20260709 13:18:42.266147 20133 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.261188 20169 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:18:42.317554 20132 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:42.319036 20226 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:18:42.215586 20227 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.351388 20228 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.352042 20057 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:42.354097 20222 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:18:42.355633 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:42.309149 20225 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:18:42.324484 20096 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:42.368078 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:42.199100 20210 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.384792 17394 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:42.404800 17394 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:42.405349 19815 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:42.407310 20052 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.586s	user 0.005s	sys 0.005s
I20260709 13:18:42.407369 17394 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:42.408002 20052 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:42.387420 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44508.8us
I20260709 13:18:42.410355 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 784) took 1465 ms. Trace:
I20260709 13:18:42.410557 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:42.410809 17991 rpcz_store.cc:276] 0709 13:18:40.945180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.963186 (+ 18006us) service_pool.cc:224] Handling call
0709 13:18:40.997624 (+ 34438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.419825 (+422201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.410098 (+990273us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54006d1354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:42.410290 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717480192}
W20260709 13:18:42.390560 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.413832 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.357424 20161 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.418525 17463 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:42.422796 20227 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:42.423444 20227 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:42.424088 20193 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:42.424623 20193 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.425478 20072 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:42.428704 20107 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.010s	user 0.014s	sys 0.004s
I20260709 13:18:42.429158 20107 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.430291 17465 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:42.412569 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:42.431558 20107 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:42.432209 20203 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:42.433231 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:42.364640 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 242232us
I20260709 13:18:42.157397 20218 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.370116 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:42.346094 19877 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.381007 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:42.382475 17471 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:42.395614 17397 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:42.402860 17396 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:42.390314 17393 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:42.436673 17467 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:42.443252 20107 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.396437 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 797) took 1113 ms. Trace:
I20260709 13:18:42.357681 20200 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:42.445919 17464 raft_consensus.cc:2410] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:18:42.447870 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 268570us
I20260709 13:18:42.443902 17998 rpcz_store.cc:276] 0709 13:18:41.283036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.352665 (+ 69629us) service_pool.cc:224] Handling call
0709 13:18:41.373199 (+ 20534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.590204 (+217005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.396127 (+805923us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540049a2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:42.396362 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414963968}
I20260709 13:18:42.385234 20057 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.481789 17463 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:42.432753 20203 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:42.481806 17469 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:42.480264 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:42.484678 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 265470us
W20260709 13:18:42.445494 20087 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
W20260709 13:18:42.485765 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 51380.6us
I20260709 13:18:42.482512 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:42.395022 20210 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:42.444537 19877 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.401446 19994 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:42.442283 20162 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.831s	user 0.011s	sys 0.000s
I20260709 13:18:42.443856 20107 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.446768 20137 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:42.497001 19956 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.499716 20218 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:42.501199 20203 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.504361 20133 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:42.484553 20001 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:42.447614 19832 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.401777 20132 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:18:42.449605 20200 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:18:42.516162 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:42.516227 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:42.518455 20236 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:42.519230 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:42.515236 20103 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.529284 20193 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.530022 17393 raft_consensus.cc:1217] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 3.2->[5.3-5.3]
I20260709 13:18:42.405974 19815 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.531495 17466 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:42.543901 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:42.547098 17962 leader_election.cc:400] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9.
I20260709 13:18:42.550410 17391 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:42.571954 17962 leader_election.cc:403] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:18:42.504616 20043 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.549116 17464 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:42.553323 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:42.574790 17393 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:18:42.574836 17470 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.544940 20001 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:42.583738 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:42.584779 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:42.507369 20087 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.398649 20176 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.587350 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:42.596238 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:42.541399 19956 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:42.597833 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 164724us
I20260709 13:18:42.599107 17464 raft_consensus.cc:2368] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9.
I20260709 13:18:42.580556 20236 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:42.551914 19832 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.590154 19822 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.603653 17470 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:42.580015 20162 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:42.612015 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:42.599504 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:42.552222 20238 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:18:42.590325 19883 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:42.583612 20133 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:18:42.633157 17470 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:42.627801 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:42.613586 19822 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.614005 20096 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:42.642473 17466 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:42.639186 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 95377.1us
I20260709 13:18:42.616946 20235 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9.
I20260709 13:18:42.618368 20236 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:42.642552 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:42.634470 19994 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:42.620074 20242 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.646219 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1272) took 1468 ms. Trace:
I20260709 13:18:42.648415 17470 raft_consensus.cc:2376] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5. Re-sending same reply.
I20260709 13:18:42.641278 19822 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.653390 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:42.639967 19883 consensus_queue.cc:1243] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:18:42.647830 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 131976us
I20260709 13:18:42.652597 17322 rpcz_store.cc:276] 0709 13:18:41.177945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.178663 (+   718us) service_pool.cc:224] Handling call
0709 13:18:42.646013 (+1467350us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b540036a454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:42.646152 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365098368}
I20260709 13:18:42.657680 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:42.659395 17466 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:42.663713 20248 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:42.639303 20001 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.642313 20002 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:18:42.665381 20001 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.666107 20169 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:42.650048 20241 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:42.667068 20241 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.669545 19815 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:42.671934 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:42.674536 20247 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:42.674274 20096 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.675720 20236 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:42.675812 19815 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:42.674274 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:42.679136 20010 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:42.679533 20010 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:42.679625 20248 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.680218 20248 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:42.680743 20248 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.681381 20163 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:42.681777 20163 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:42.682524 19832 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:42.683668 20247 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:42.654960 20242 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.684548 20242 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.684333 20247 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.701619 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:42.702991 20231 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:42.703594 20087 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:42.703611 20231 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.680465 20010 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.705217 20043 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:42.705390 20010 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.706225 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:42.706349 20103 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:42.706771 17466 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.701748 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:42.701954 19883 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.713533 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:42.714395 17392 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:42.708398 19883 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.715304 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:42.715463 20192 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.032s	user 0.002s	sys 0.003s
I20260709 13:18:42.716231 19883 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:42.817341 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 81532.3us
I20260709 13:18:42.748786 17962 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:42.770706 17396 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:18:42.774852 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.767237 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:42.855087 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:42.855393 17392 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:42.855963 17391 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.852690 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:42.860819 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:42.656744 19994 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:42.864604 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:42.868018 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:42.845022 20228 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:42.876418 17396 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:42.817111 20103 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.877655 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:42.851131 20193 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:42.848260 20101 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:42.870358 19883 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:42.867527 20002 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:42.887233 20199 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:18:42.885537 19520 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:42.892010 20221 consensus_meta.cc:287] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 13:18:42.872130 20233 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:42.893473 17468 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
W20260709 13:18:42.894425 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 404371us
W20260709 13:18:42.894968 17434 connection.cc:256] RPC call timeout handler was delayed by -2.2606713259999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2277s for a response
I20260709 13:18:42.867724 20043 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:18:42.900586 17434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.535s (SENT) [suppressed 38 similar messages]
I20260709 13:18:42.903421 17396 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:42.904683 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:42.909713 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 246918us
I20260709 13:18:42.909523 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:42.910321 17992 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.896884 20199 consensus_queue.cc:1243] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:42.913496 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:42.916792 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:42.896747 19520 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:42.919678 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:42.919896 19520 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.920557 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:42.899675 20241 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:42.925194 20241 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:42.925776 20241 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.926241 20052 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:42.927881 20241 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:42.906143 20247 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:42.928930 20247 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.929450 20231 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:42.929405 20247 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.930284 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:42.930371 19877 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:42.931458 20247 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:42.932606 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:42.933236 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:42.933439 20250 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:18:42.898315 19883 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:42.935045 17320 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:42.918982 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:42.936631 17998 raft_consensus.cc:2410] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:42.902403 20002 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:42.937445 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:42.940066 17318 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:42.940446 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:42.941201 17321 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:42.883515 20103 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.943804 17391 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:42.945657 17466 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:42.900955 19956 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:42.940272 17991 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:42.948988 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:42.949275 17315 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:42.949609 17396 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.950276 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:42.952401 17962 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:42.953266 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:42.953284 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:42.903045 20221 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:42.955948 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.009400 17391 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:18:43.063360 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 162782us
I20260709 13:18:42.957957 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:42.979570 17992 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
W20260709 13:18:42.958231 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.092059 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.094612 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:43.069787 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 123495us
I20260709 13:18:43.092959 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.108248 17316 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:43.108268 17992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "622554a5186d4910b8476a653411c85d"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:48172
I20260709 13:18:43.109230 17992 raft_consensus.cc:606] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.109426 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.109620 17992 raft_consensus.cc:614] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:43.111646 17316 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:43.099769 17396 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:43.086495 17318 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:43.092897 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:42.953761 20233 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:43.009972 20236 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:43.005251 20041 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.118800 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:43.120473 17391 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:43.069221 19877 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:43.094208 20043 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.122327 17395 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:42.992100 19983 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.130033 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.073132 20257 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:43.154641 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.156272 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:43.113298 19574 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.101147 19520 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.953883 19822 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:43.168592 17434 connection.cc:256] RPC call timeout handler was delayed by -1.6540713259998938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29510000000000003s for a response
W20260709 13:18:43.169145 17434 connection.cc:256] RPC call timeout handler was delayed by -1.3273713259998203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33140000000000003s for a response
I20260709 13:18:43.169523 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:43.115216 20233 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:43.175922 17396 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:43.176450 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.183590 17313 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.125389 20107 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:43.170027 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:43.066148 20002 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.189754 17394 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:18:43.190933 17392 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.164950 17316 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:18:43.119324 20236 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:43.173869 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.098428 19883 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.222065 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:43.170856 20252 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:43.223313 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:43.223663 20252 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.224296 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:43.225147 17390 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.225589 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1442) took 1132 ms. Trace:
I20260709 13:18:43.226153 20252 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:43.225960 17465 rpcz_store.cc:276] 0709 13:18:42.101959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.109411 (+  7452us) service_pool.cc:224] Handling call
0709 13:18:42.122339 (+ 12928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.430641 (+308302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.225398 (+794757us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400331dd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:43.225536 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707781888}
I20260709 13:18:43.181205 20255 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.224385 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:43.227859 17998 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:43.228706 20236 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:43.230012 20236 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:43.231860 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.213742 20248 consensus_meta.cc:287] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.532s	user 0.005s	sys 0.009s
I20260709 13:18:43.078948 20163 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.170612 19574 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:43.244302 19574 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:43.245858 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.246635 17322 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:43.247339 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.248298 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.184423 20233 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.253980 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:43.254539 17388 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:43.255524 17388 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.256280 17360 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:43.110673 20162 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:43.191812 17315 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:43.192257 20242 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.000s
I20260709 13:18:43.193262 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.193552 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.119910 20210 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:43.193938 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.195497 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.296476 17996 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:43.196568 19967 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:43.197299 20173 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:43.130945 20041 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:43.189242 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:43.167490 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1277) took 1920 ms. Trace:
I20260709 13:18:43.175312 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.307268 20263 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:18:43.173303 20257 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:43.177361 20171 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:43.209117 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 48451.2us
I20260709 13:18:43.316118 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:43.298656 20251 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.629s	user 0.004s	sys 0.001s
I20260709 13:18:43.169396 19983 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.211454 20151 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:43.212023 20001 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.006s
I20260709 13:18:43.214448 20161 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:43.215742 20221 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:43.328171 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:43.303259 20096 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:43.165997 20043 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.335322 17319 raft_consensus.cc:2410] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:43.216722 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.218631 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.335809 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:43.220525 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1447) took 1065 ms. Trace:
I20260709 13:18:43.227645 20255 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.227782 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:43.260022 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.178139 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:43.266677 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.264619 17998 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 4.
I20260709 13:18:43.337435 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:43.338595 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.275022 17313 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:43.289757 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.233604 20248 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:43.291703 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:43.342007 17465 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:43.295037 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:43.336678 17469 rpcz_store.cc:276] 0709 13:18:42.155980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.171200 (+ 15220us) service_pool.cc:224] Handling call
0709 13:18:42.357792 (+186592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.483531 (+125739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.220232 (+736701us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540020fb54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:43.220442 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284391808}
I20260709 13:18:43.293933 19956 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.306370 20231 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.307603 17999 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:43.007638 19994 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:43.309387 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.309365 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 393702us
I20260709 13:18:43.310746 17997 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:43.317797 17464 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:43.209206 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:43.295704 20242 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:43.320485 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 204217us
I20260709 13:18:43.301069 19967 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:43.365186 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:43.365568 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:43.333531 17390 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:43.338641 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.367539 17394 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:43.303637 20173 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:43.292892 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 91782.7us
I20260709 13:18:43.370901 17434 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.334949 17287 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:43.345232 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.290761 20162 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:43.350905 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 84350.6us
I20260709 13:18:43.351960 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.335150 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:43.353063 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.356101 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.319507 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:43.355547 17990 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:43.327520 20139 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:18:43.368466 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:43.369186 17964 leader_election.cc:336] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.578s (SENT)
W20260709 13:18:43.387782 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.389082 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:43.390133 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:43.390611 17996 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.372462 17318 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:43.369369 20231 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.393476 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.394472 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.372692 17317 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:43.395380 20231 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:43.396034 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.397114 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:43.397600 17317 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.397222 19967 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.399622 20043 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:43.372804 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:43.401647 20041 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:43.402262 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:43.402915 17463 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.362759 17991 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:43.376158 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.381702 17471 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:43.380713 17462 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:43.342319 20161 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:43.357446 20096 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:43.308825 20257 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.360226 20252 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:43.417491 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:43.383885 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49017.2us
I20260709 13:18:43.385987 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:43.395916 20231 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:43.309523 19676 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:18:43.423513 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.424266 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:43.406235 17321 raft_consensus.cc:2410] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:43.423554 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:43.359946 19956 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.319458 20171 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.408739 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:43.402215 20041 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:43.403163 20107 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:43.449752 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 78914.9us
I20260709 13:18:43.412897 17317 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
W20260709 13:18:43.414140 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.383219 20087 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.407584 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.429819 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:43.452881 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:43.448534 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:43.411657 17313 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:43.466024 17317 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:43.385346 20228 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:18:43.454767 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:43.454473 17993 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:18:43.495951 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 110043us
W20260709 13:18:43.498369 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 43686.1us
I20260709 13:18:43.499388 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.499810 17313 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:43.403528 19558 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:18:43.480087 17463 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:43.425626 19960 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:18:43.403779 20176 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:18:43.512079 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.512889 17990 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:43.514063 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.495671 20041 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:43.403733 20235 consensus_queue.cc:1175] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c23a664ebf3347a4934dee377c8b5101" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 7 index: 7 } }
I20260709 13:18:43.501003 17321 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:43.500830 17318 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:18:43.501253 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 134022us
I20260709 13:18:43.459410 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.433172 20151 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:18:43.456255 19822 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:43.538800 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 146151us
I20260709 13:18:43.539350 17999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
 from {username='slave'} at 127.0.0.1:48172
I20260709 13:18:43.540067 17999 raft_consensus.cc:606] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Received request to transfer leadership to TS 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:43.493957 20107 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:18:43.545403 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:43.508971 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:43.487771 20252 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:18:43.524329 17316 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:43.469839 17996 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:43.554212 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:43.555799 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:43.557948 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 98627.5us
I20260709 13:18:43.559878 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:43.498005 20087 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.575502 17996 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:43.542775 20228 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:43.492947 20173 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:43.555444 20235 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:43.578382 20280 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:43.526716 20278 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:18:43.580852 20255 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:43.581377 20248 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:43.581574 17991 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:43.581301 20002 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:43.518975 20161 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:43.656708 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59679.1us
I20260709 13:18:43.657003 20297 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:43.657783 20297 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:43.658807 20297 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:43.659722 17315 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
W20260709 13:18:43.600345 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 99768.1us
I20260709 13:18:43.662583 17313 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:43.652994 20002 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.663704 20002 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:43.611024 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 162557us
W20260709 13:18:43.612197 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 112908us
I20260709 13:18:43.581473 19883 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:43.306850 17314 rpcz_store.cc:276] 0709 13:18:41.238984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.273210 (+ 34226us) service_pool.cc:224] Handling call
0709 13:18:41.273601 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:41.337996 (+ 64395us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:41.372886 (+ 34890us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.905368 (+532482us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:42.017421 (+112053us) log.cc:844] Serialized 52 byte log entry
0709 13:18:42.039636 (+ 22215us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:42.042228 (+  2592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.067202 (+ 24974us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.715009 (+647807us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b2400170ca8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f58d9c4 00007f7d5f58bacb 00007f7d5f746dc9 00007f7d5f746a55 00007f7d5f74609d 00007f7d6237810e 00007f7d6238f88c 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221
0709 13:18:43.117930 (+402921us) raft_consensus.cc:1685] finished
0709 13:18:43.126073 (+  8143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.159284 (+ 33211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115375,"prepare.queue_time_us":16048,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":39,"raft.queue_time_us":145263,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":9500,"spinlock_wait_cycles":16408832,"thread_start_us":393395,"threads_started":2,"wal-append.queue_time_us":265773}
I20260709 13:18:43.633913 17996 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:43.565548 19983 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:43.584369 20107 raft_consensus.cc:2764] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:43.549892 20210 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
W20260709 13:18:43.681942 20276 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:18:43.546645 19676 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:43.526163 20096 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.659624 20297 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:43.666327 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.628647 17990 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:43.631637 20235 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:43.664729 17313 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:43.665577 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:43.676254 17315 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:43.786562 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 121096us
I20260709 13:18:43.575254 20279 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:18:43.598482 20228 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.795272 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:18:43.683383 20277 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:43.653673 20255 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:43.653340 20162 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:43.652954 20242 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:43.651041 20280 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:43.633646 19822 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:18:43.689121 17996 pending_rounds.cc:85] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 5
I20260709 13:18:43.821336 17996 pending_rounds.cc:107] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:43.821645 17996 raft_consensus.cc:2889] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:43.723703 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.780859 19676 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:43.685706 20274 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:18:43.826900 20282 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 13:18:43.791680 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 125419us
I20260709 13:18:43.828703 20219 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:43.673815 20286 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 13:18:43.829777 20286 consensus_queue.cc:1243] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:43.706081 19956 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:43.817143 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:43.829020 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.793823 17317 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:43.795290 20137 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.800940 19983 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:43.800405 20228 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.835255 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:43.655233 20041 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:43.792598 20107 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:43.839895 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:43.840567 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.841820 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 182437us
I20260709 13:18:43.803859 20255 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:43.822712 20176 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:43.850240 20176 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:43.836670 20248 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:43.841238 20087 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:43.842901 19822 consensus_queue.cc:1243] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:43.784806 20235 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.846191 20242 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:43.873796 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1503) took 1163 ms. Trace:
I20260709 13:18:43.875741 17397 rpcz_store.cc:276] 0709 13:18:42.710749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.710876 (+   127us) service_pool.cc:224] Handling call
0709 13:18:43.222973 (+512097us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:43.223200 (+   227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.300265 (+ 77065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.300295 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.302336 (+  2041us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.462428 (+160092us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:43.462484 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.462590 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.869036 (+406446us) raft_consensus.cc:1685] finished
0709 13:18:43.869057 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.873705 (+  4648us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79619,"raft.queue_time_us":79085,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":102,"spinlock_wait_cycles":5756032,"thread_start_us":156816,"threads_started":1,"wal-append.queue_time_us":221062}
I20260709 13:18:43.854954 20255 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:43.882843 17964 leader_election.cc:400] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9.
I20260709 13:18:43.883263 20291 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:43.875182 20087 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:43.856596 19983 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:43.878995 20233 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.004s
I20260709 13:18:43.875546 20242 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:43.843043 20221 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:18:43.841607 20238 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:43.877278 20292 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:43.844063 20297 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:18:43.859253 19960 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:43.842742 20137 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.826998 19676 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:43.886739 20203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.036s	sys 0.045s
I20260709 13:18:43.885107 20171 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:43.896003 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 336182us
I20260709 13:18:43.938738 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.941172 17962 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.904088 20235 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.902662 19960 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:43.937753 20203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.037s	sys 0.046s
I20260709 13:18:43.937121 20287 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:43.896710 20233 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:43.940292 20292 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:43.969841 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.961424 19960 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.964128 20287 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:43.982100 17962 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.966616 20176 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:44.011698 20298 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:43.901108 20280 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.013021 20132 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:44.018186 20151 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:44.001187 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62534us
I20260709 13:18:44.040014 17964 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:43.974752 19883 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.974625 20297 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:43.974817 20171 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:44.004673 20010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.008s	sys 0.018s
W20260709 13:18:44.026644 19520 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.856s	user 0.012s	sys 0.001s
W20260709 13:18:44.044335 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 215385us
I20260709 13:18:43.955819 19983 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.052585 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.036159 19956 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.968647 20300 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:18:44.055230 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:44.038797 20152 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:44.042595 20132 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:44.052632 20010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.009s	sys 0.018s
W20260709 13:18:44.053050 20236 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.823s	user 0.006s	sys 0.006s
I20260709 13:18:44.042459 20151 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:44.056484 19676 raft_consensus.cc:2764] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:44.067484 20176 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.068367 20152 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.070456 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:43.975155 20242 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.059101 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:44.071580 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.076274 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1508) took 1258 ms. Trace:
I20260709 13:18:44.076566 17389 rpcz_store.cc:276] 0709 13:18:42.818259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.818775 (+   516us) service_pool.cc:224] Handling call
0709 13:18:44.071430 (+1252655us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:18:44.076230 (+  4800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4030208}
I20260709 13:18:44.079666 19676 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:44.081897 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.084390 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.086262 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:44.045433 19883 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.073328 20161 raft_consensus.cc:2764] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:44.103044 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.104454 17434 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:44.086714 20301 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:18:44.078583 20297 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:44.072017 20200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.391s	user 0.010s	sys 0.014s
I20260709 13:18:44.062387 19956 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.086428 19676 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:44.089181 20310 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:44.089447 20107 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:44.137313 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 46589.3us
W20260709 13:18:44.138671 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 298846us
I20260709 13:18:44.141515 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:44.107450 20254 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:44.135288 20200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.454s	user 0.010s	sys 0.014s
I20260709 13:18:44.143337 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:44.107245 20236 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.135898 20152 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:44.156416 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:44.144449 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:44.073889 20287 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.159994 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:44.142127 20137 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:44.173436 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 133483us
I20260709 13:18:44.071059 20292 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.176381 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:44.176529 19676 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.178073 19956 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:44.178158 20002 consensus_meta.cc:287] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:18:44.160929 20238 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:44.178592 20289 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:44.160377 20107 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:44.185537 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:44.164307 20200 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.194185 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.195523 17992 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:44.195595 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.199141 20308 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.199513 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.200086 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.200357 17990 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:44.175175 20287 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.141038 20151 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.179464 20233 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:44.140898 20132 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:44.221211 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 47609.8us
W20260709 13:18:44.204387 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 100016us
I20260709 13:18:44.203771 17992 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:18:44.208029 20311 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:18:44.208696 20309 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:44.188438 20230 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.205685 20289 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:44.213994 17990 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:44.214159 20243 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:44.214059 20316 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:44.221261 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.223742 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.239293 17992 raft_consensus.cc:2410] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:44.224649 17434 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.202837 20010 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:44.242009 17434 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.190842 20238 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:44.217491 20228 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.203076 19520 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.201332 19956 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.227545 20162 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.205391 20280 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.241719 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1283) took 1312 ms. Trace:
I20260709 13:18:44.258210 17320 rpcz_store.cc:276] 0709 13:18:42.929009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.931352 (+  2343us) service_pool.cc:224] Handling call
0709 13:18:42.931651 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.935437 (+  3786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.241434 (+1305997us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b54000c9ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:44.241645 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7026560}
I20260709 13:18:44.161115 20203 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:18:44.190330 20002 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.247475 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.247540 20238 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.243826 20137 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 13:18:44.243270 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 261231us
I20260709 13:18:44.228549 20103 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:44.253700 20310 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:18:44.206700 19994 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:18:44.263291 20258 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:44.264300 20315 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:18:44.246531 20107 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:44.269052 20293 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
I20260709 13:18:44.253858 20152 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:44.301293 20321 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.222283 19558 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:18:44.301908 20152 consensus_queue.cc:1243] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:44.302493 20152 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:44.302704 20314 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:18:44.302898 20152 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:44.269711 17991 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:44.253985 19520 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.243853 20308 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.280475 17962 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:44.244607 20200 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:44.271920 20151 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.269685 20323 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:44.290817 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 62219.2us
I20260709 13:18:44.270697 20132 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.293246 20255 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.298446 20228 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:44.378769 20200 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:44.381390 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 100989us
I20260709 13:18:44.383138 20233 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:44.383704 20233 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:44.361359 20258 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:44.384660 20233 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.264323 20280 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.261953 20162 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.250238 20230 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:18:44.360577 20103 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.357966 19558 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.367355 20041 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:44.395246 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:44.395882 17317 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.368419 20255 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:44.261710 19956 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.288937 19983 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.390329 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:44.385486 20258 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:44.357785 19520 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.393414 20103 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.393817 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:44.394027 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:44.394232 19558 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.385192 20320 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:44.407043 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:44.412494 17320 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:44.364297 19883 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:44.406739 17321 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:44.303766 20152 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.415126 20152 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.416615 20103 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:44.408041 20288 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:18:44.362128 20289 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:44.412309 20290 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.446s	user 0.004s	sys 0.000s
I20260709 13:18:44.430214 19960 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.438725 19558 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:44.441419 20258 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.443406 20258 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:44.443707 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.445986 20281 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:44.446410 20281 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:44.446607 20162 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:44.447268 20281 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.448431 19956 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:44.422025 20280 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:44.449817 20002 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:44.450311 20252 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:44.450768 20252 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:44.451438 20238 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.451639 20252 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.454123 20087 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:44.454562 20087 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:44.455466 20087 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.448503 20281 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:44.466005 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 229885us
I20260709 13:18:44.483726 20132 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:44.485980 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 238573us
I20260709 13:18:44.487201 20292 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:44.488467 17315 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:44.489614 17990 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:44.484175 17317 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:44.495857 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:44.496212 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:44.432678 19960 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:44.500494 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 124856us
I20260709 13:18:44.496922 17317 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:44.505285 20318 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:44.506186 20137 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:44.470008 20087 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.507020 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:44.498803 20252 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.536168 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:44.510430 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:44.511528 20203 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.511760 20176 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.513459 19967 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.515528 17315 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:44.516403 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.517539 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:44.518929 17993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 581) took 1600 ms (client timeout 1948 ms). Trace:
I20260709 13:18:44.551007 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.551458 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:44.551839 17390 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:44.521273 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 418) took 1268 ms. Trace:
I20260709 13:18:44.552222 17466 raft_consensus.cc:2410] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:44.521155 20057 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:18:44.523990 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.556432 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.525943 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:44.556769 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:44.527647 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:44.529770 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:44.557369 17470 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:44.532979 20291 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:44.534025 20287 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:44.534633 20151 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.581139 20151 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.582520 20057 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:44.582927 20057 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:44.583551 20151 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:44.541635 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:44.583690 20057 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.584645 17468 raft_consensus.cc:2410] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:18:44.539309 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.585963 17396 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:44.542434 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:44.539311 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:44.552189 17394 rpcz_store.cc:276] 0709 13:18:43.253214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.255367 (+  2153us) service_pool.cc:224] Handling call
0709 13:18:43.367278 (+111911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.367907 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.521094 (+1153187us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001397d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:44.521218 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256670080}
I20260709 13:18:44.550865 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:44.586876 17463 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:44.587795 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:44.545727 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:44.534813 20173 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.567840 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:44.557838 17317 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:44.570068 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:44.558629 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:44.569406 17320 raft_consensus.cc:2368] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:44.558362 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.558823 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:44.537681 20132 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:44.569885 20291 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:44.567811 20152 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.597232 20152 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.597563 20291 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.598829 20291 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.600283 20152 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:44.577975 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:44.581724 17315 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:44.559075 20235 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:44.543164 20176 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.553428 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:44.538007 20243 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.588934 17467 raft_consensus.cc:2410] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:44.589823 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:44.508229 20137 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.620352 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:44.590288 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.587291 17469 raft_consensus.cc:2376] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5. Re-sending same reply.
I20260709 13:18:44.620546 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.542953 19960 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:44.548749 20133 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:44.552923 20248 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.595674 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:44.601733 17463 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:44.585430 17466 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:44.603698 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:44.650120 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 46451.6us
I20260709 13:18:44.651119 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:44.568552 20002 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.600930 19983 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.606642 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:44.601035 19558 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:44.588261 20287 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.615195 17389 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 6: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:44.591060 20321 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.620322 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.621106 17467 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:18:44.665944 17470 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:44.621230 17396 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
W20260709 13:18:44.587308 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 48044.7us
I20260709 13:18:44.667644 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:44.551169 17993 rpcz_store.cc:269] 0709 13:18:42.918231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.919429 (+  1198us) service_pool.cc:224] Handling call
0709 13:18:44.518710 (+1599281us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54004443d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:44.518847 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070428544}
W20260709 13:18:44.622339 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.671679 17466 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:44.622967 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.623293 20329 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:44.623817 20297 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:44.550330 20203 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.628270 20137 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:44.630208 20270 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:44.610839 20057 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.630818 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.632560 17320 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:44.619900 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.682238 17394 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:44.653381 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.605139 20151 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:44.615024 20176 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.585438 19520 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.663019 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:44.668641 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:44.620298 20238 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:44.668804 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:44.669049 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:44.707068 17315 raft_consensus.cc:2410] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:44.707468 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:44.710404 19520 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:44.636920 20243 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.667569 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:44.712577 20257 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:44.660938 19558 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:44.712877 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45353.7us
I20260709 13:18:44.713794 17434 leader_election.cc:400] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:44.714112 17434 leader_election.cc:403] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.714058 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:44.714550 19558 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:44.715546 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.715809 20151 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.716274 20151 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.716621 20151 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.717103 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.718084 17993 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:44.718982 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.720239 20287 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:44.721376 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 52658.8us
I20260709 13:18:44.675869 20297 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:44.622792 20242 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.664364 20248 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.673282 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.734041 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:44.734328 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:44.659493 19676 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.675721 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.738531 17999 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:44.678689 17286 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:44.739315 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60677.8us
I20260709 13:18:44.661113 20152 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.637307 20133 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.680696 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.742770 17389 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:44.673130 20280 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:18:44.688537 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.740267 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.689356 17470 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:44.744791 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:44.690673 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:44.673890 20139 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:44.699036 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.699591 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.699774 17391 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:18:44.653488 19960 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.701479 17316 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:44.711963 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:44.605129 20132 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.722626 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.723805 17390 raft_consensus.cc:2410] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:44.668460 17997 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:44.716667 17318 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:44.725960 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.771912 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:44.619515 20235 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:44.731875 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:44.729445 20087 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.729545 19967 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:44.721771 20137 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.735170 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:44.735172 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:44.747825 17393 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.748966 17994 raft_consensus.cc:2410] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:44.723273 20287 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:44.750880 20133 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:44.823352 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.733337 20328 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:18:44.754006 20333 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:44.754106 20248 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:44.690745 20329 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.751698 17389 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:44.756983 20203 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:44.761027 20173 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:44.699612 20270 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.765759 17990 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:44.743664 17395 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
W20260709 13:18:44.769542 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 57689.9us
I20260709 13:18:44.713012 20257 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:44.818073 19967 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:44.816082 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:44.814987 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.824158 20233 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.716704 19983 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.772202 19558 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.773528 19877 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.773391 20231 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:44.826082 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 100176us
I20260709 13:18:44.828073 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:44.737788 20318 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:18:44.773128 20230 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.831656 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.818032 20252 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:44.833751 17360 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:44.813254 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 90703.3us
I20260709 13:18:44.838495 20248 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:44.857823 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.842983 20163 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.862047 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:44.863934 17393 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
W20260709 13:18:44.834929 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 114316us
I20260709 13:18:44.819360 17396 raft_consensus.cc:2410] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:44.840426 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:44.866142 17389 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.839672 19967 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:44.834924 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 103161us
I20260709 13:18:44.874521 17964 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.846838 19877 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.843981 19558 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.867777 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:44.885288 17996 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.869920 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.885932 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:44.890787 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:44.892102 17999 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:44.908119 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:44.859311 20137 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.859804 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.875591 20324 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:44.860357 20248 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:44.867549 20323 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:44.890132 19558 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.916376 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.867770 20152 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.867509 20280 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:44.884775 19877 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.867923 20238 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.927172 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.876852 20328 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:18:44.860538 20230 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:44.956174 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:44.958269 17996 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:44.962278 20231 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.916203 20252 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.966635 20291 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:44.853974 20235 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:44.970933 17995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:48172
I20260709 13:18:44.971858 20255 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.975734 17389 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:44.917588 20243 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:44.991243 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.018970 17999 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:18:45.044062 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.994215 20318 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:45.050006 17395 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:18:44.955662 20323 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:45.050382 17395 pending_rounds.cc:85] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 4
I20260709 13:18:45.050654 17395 pending_rounds.cc:107] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:45.050875 17395 raft_consensus.cc:2889] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:45.049057 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.007453 20231 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.903541 20257 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.066217 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.067056 17463 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:45.068542 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.069190 17463 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:44.993420 17993 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:45.031757 20291 consensus_queue.cc:1243] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:45.032902 20137 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.073304 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 155647us
I20260709 13:18:44.990024 20238 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:45.093776 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.039227 20132 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:45.077144 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:44.993412 20280 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:45.117419 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.117280 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:45.073346 19822 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:45.119112 17468 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:45.042968 20255 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.045125 19967 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.046279 20151 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.130101 17316 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:45.094110 20289 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:45.130033 17462 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:18:45.100796 19960 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:45.137950 17468 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:45.142997 17462 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:45.150718 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:45.157370 17463 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:45.159289 17319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1286) took 2229 ms (client timeout 2303 ms). Trace:
I20260709 13:18:45.159842 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.098659 20137 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:45.133612 20132 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:45.159688 17319 rpcz_store.cc:269] 0709 13:18:42.929876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.933024 (+  3148us) service_pool.cc:224] Handling call
0709 13:18:45.159087 (+2226063us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54001423d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:45.159231 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922711808}
W20260709 13:18:45.165943 20349 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:18:45.169538 17320 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:45.169970 17320 pending_rounds.cc:85] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 1
I20260709 13:18:45.170179 17320 pending_rounds.cc:107] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:45.170418 17320 raft_consensus.cc:2889] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:45.172619 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.160475 17462 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:45.079303 20248 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.138728 20270 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:45.110357 19520 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:18:45.174446 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.181646 17389 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:45.182531 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:45.188872 17462 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:45.189190 20351 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:18:45.190999 20347 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:18:45.191061 17462 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:18:45.191486 17462 pending_rounds.cc:85] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 6
I20260709 13:18:45.191702 17462 pending_rounds.cc:107] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:18:45.191928 17462 raft_consensus.cc:2889] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:45.195293 20321 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.000s
I20260709 13:18:45.195864 20321 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:45.171355 20057 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:45.201840 20248 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.203460 20329 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:45.176465 20346 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:18:45.208418 20270 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:45.209007 20270 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.209436 20270 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.210767 20137 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:45.133739 19822 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.218829 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:45.244951 17388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.028s	sys 0.043s
W20260709 13:18:45.245445 17388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.028s	sys 0.043s
W20260709 13:18:45.252473 20242 consensus_meta.cc:287] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.000s
I20260709 13:18:45.234155 20057 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:18:45.287075 20252 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:45.287720 20252 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:45.288040 20356 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:18:45.289963 20252 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:45.290669 20358 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:18:45.294780 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.300038 20270 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:45.302251 20252 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:45.302917 20252 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.306007 20252 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:45.307950 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:45.308524 17999 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.315438 17999 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:45.316810 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:45.325551 17462 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:18:45.326131 17462 pending_rounds.cc:85] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 6
I20260709 13:18:45.326398 17462 pending_rounds.cc:107] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:45.326761 17462 raft_consensus.cc:2889] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:45.333039 20242 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:45.265750 20173 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:45.336941 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:45.339684 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:45.342648 20361 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:45.343302 19558 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.357316 20255 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:45.357666 19558 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:45.344169 20151 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:45.359000 20176 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.002s
I20260709 13:18:45.343349 20361 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:45.354523 19983 consensus_meta.cc:287] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 13:18:45.359488 20176 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.345745 20270 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:45.359903 19983 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:45.364604 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:45.323261 20352 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:18:45.356529 19822 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:45.366130 17999 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:45.366631 17994 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:18:45.365207 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 214804us
I20260709 13:18:45.370011 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:45.379163 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.380651 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.381425 17393 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:45.382288 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.382898 17393 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:45.383724 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:45.364748 20288 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.386663 17396 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:45.387975 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.384341 17393 raft_consensus.cc:2368] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:45.371956 20280 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:45.347899 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:45.400290 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 185333us
I20260709 13:18:45.307147 20252 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:45.405405 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:45.405594 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:45.411124 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.413775 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:45.414088 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:45.416152 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.404877 20199 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.468933 20231 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.469118 20199 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.444600 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.471939 17396 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:45.472800 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.455610 19558 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:45.456259 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.457741 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.473372 17396 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:45.462328 20289 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.411231 20252 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.373555 19877 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:45.468006 20163 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:18:45.412735 19822 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:45.406661 20288 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.487562 17464 raft_consensus.cc:2410] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:45.488178 20292 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.488648 20292 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.489368 20288 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:45.473879 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60192.7us
I20260709 13:18:45.474532 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:45.491305 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:45.482246 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.487390 19822 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.487540 17388 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:45.476992 17396 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:45.496070 17396 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:45.478312 19558 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.501838 17286 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:45.505688 17393 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:45.516407 17395 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:45.517062 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:45.518150 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.495893 20288 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:45.495779 19822 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.477753 20248 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:18:45.502306 20270 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:45.528416 17394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.013s	sys 0.024s
I20260709 13:18:45.519508 19558 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:45.529770 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 310999us
W20260709 13:18:45.534332 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.536046 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:45.491225 20289 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:45.531778 17394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.014s	sys 0.024s
I20260709 13:18:45.516125 20242 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.501652 20255 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:18:45.540977 17393 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:45.526170 20288 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:45.501528 19574 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:18:45.547890 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:45.557590 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:45.532541 20231 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:45.502063 20324 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:18:45.573447 17435 leader_election.cc:400] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:45.582492 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:45.561189 20052 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.585992 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:45.546553 20199 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:45.584772 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:45.554358 20270 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:45.561591 20132 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.575261 19574 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:45.560094 20288 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:45.595973 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 282075us
I20260709 13:18:45.583760 20161 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:45.543861 20242 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:45.610085 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.659379 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:45.595745 20151 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:45.590984 19960 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:45.583833 20359 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:18:45.598764 20270 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.598459 20193 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:18:45.660966 20161 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:45.662376 19574 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:45.599465 20361 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:18:45.672293 20329 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.715171 17992 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:45.715885 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 591) took 1180 ms. Trace:
I20260709 13:18:45.717175 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:45.723171 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.721412 17992 rpcz_store.cc:276] 0709 13:18:44.535388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.691083 (+1155695us) service_pool.cc:224] Handling call
0709 13:18:45.715007 (+ 23924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.715632 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.715828 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:45.623871 20132 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.723984 17462 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:45.741680 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.686446 20270 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.753312 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.726830 20151 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.716342 20252 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:45.716590 20161 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.756014 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2539) took 1059 ms. Trace:
I20260709 13:18:45.762646 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.760963 17463 rpcz_store.cc:276] 0709 13:18:44.691235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.076803 (+385568us) service_pool.cc:224] Handling call
0709 13:18:45.750001 (+673198us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b5400281c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:45.750187 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133165952}
I20260709 13:18:45.765802 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.766978 17463 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 5: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:45.767964 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:45.771791 17463 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:45.784322 17463 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:18:45.817836 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 227180us
I20260709 13:18:45.820799 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:45.781607 20368 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:18:45.823253 17462 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:45.824120 17393 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:45.846122 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 327461us
W20260709 13:18:45.846609 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 225700us
I20260709 13:18:45.765316 20151 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.741772 20329 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:45.837095 20367 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.090s	user 0.003s	sys 0.003s
I20260709 13:18:45.859244 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:45.842665 20366 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.100s	user 0.006s	sys 0.000s
I20260709 13:18:45.825096 20359 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.863596 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:45.832330 20289 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:45.865046 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:45.867343 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:45.840314 20193 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:45.871271 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 829) took 1333 ms. Trace:
I20260709 13:18:45.903942 17315 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:18:45.911460 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:45.912218 17314 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:45.843472 19960 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:18:45.924592 20379 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:45.927385 17320 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:45.899325 20359 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.929350 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:45.931350 20359 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:45.932181 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:45.933154 17322 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:45.915462 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:45.933534 20372 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:18:45.917806 20329 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:45.923251 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 824) took 1391 ms. Trace:
W20260709 13:18:45.934824 20382 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:18:45.934684 17998 rpcz_store.cc:276] 0709 13:18:44.532050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.367567 (+835517us) service_pool.cc:224] Handling call
0709 13:18:45.367881 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.373119 (+  5238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.373151 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.386365 (+ 13214us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.713964 (+327599us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:45.714012 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.714087 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.922971 (+208884us) raft_consensus.cc:1685] finished
0709 13:18:45.922994 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.923164 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9808,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":10251,"thread_start_us":314486,"threads_started":1,"wal-append.queue_time_us":499990}
I20260709 13:18:45.936738 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:45.937425 17998 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:45.938766 17998 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:45.939421 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 607) took 1390 ms. Trace:
I20260709 13:18:45.939811 17998 rpcz_store.cc:276] 0709 13:18:44.549217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.938224 (+1389007us) service_pool.cc:224] Handling call
0709 13:18:45.938533 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.939177 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.939371 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:45.940419 20288 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:45.940709 20391 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:45.943002 20288 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:45.938913 19822 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:45.787737 19574 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:45.944716 17321 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:45.945844 19822 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:45.953788 20132 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:45.956547 20302 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.999s	user 0.002s	sys 0.003s
I20260709 13:18:45.961594 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2595) took 1422 ms. Trace:
I20260709 13:18:45.962117 17392 rpcz_store.cc:276] 0709 13:18:44.539607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.610744 (+ 71137us) service_pool.cc:224] Handling call
0709 13:18:44.622123 (+ 11379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.752742 (+130619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.752890 (+   148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.752969 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:44.753009 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.961243 (+1208234us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540036f6d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:45.961311 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.961496 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298649856}
I20260709 13:18:45.967797 20238 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:45.969198 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2532) took 1330 ms. Trace:
I20260709 13:18:45.970280 20219 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:45.970870 20219 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.973428 20270 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:45.923573 20378 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:45.975325 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 424) took 1438 ms. Trace:
I20260709 13:18:45.975502 17317 raft_consensus.cc:2368] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:18:45.983008 17391 rpcz_store.cc:276] 0709 13:18:44.537092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.537203 (+   111us) service_pool.cc:224] Handling call
0709 13:18:44.537622 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:44.768413 (+230791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.975018 (+1206605us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400014354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:45.975260 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372342016}
I20260709 13:18:45.969661 17467 rpcz_store.cc:276] 0709 13:18:44.638517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.666509 (+ 27992us) service_pool.cc:224] Handling call
0709 13:18:44.666766 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.674622 (+  7856us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:44.832516 (+157894us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.009232 (+176716us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.009297 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:45.009356 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.968938 (+959582us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b54001f0c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:45.968991 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.969131 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10603,"prepare.queue_time_us":165688,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":3353,"raft.queue_time_us":213928,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":17430784,"thread_start_us":310031,"threads_started":2,"wal-append.queue_time_us":270644}
I20260709 13:18:45.987600 20193 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.990712 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 454695us
W20260709 13:18:45.994786 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 146548us
W20260709 13:18:45.989740 20367 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:45.986232 20242 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:45.999184 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:46.005220 17464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1464) took 2603 ms (client timeout 1675 ms). Trace:
W20260709 13:18:46.005963 17464 rpcz_store.cc:269] 0709 13:18:43.401475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.404679 (+  3204us) service_pool.cc:224] Handling call
0709 13:18:46.004814 (+2600135us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54001617d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:46.005105 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4742682880}
I20260709 13:18:46.008270 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1296) took 2726 ms. Trace:
I20260709 13:18:46.009126 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:46.008730 17318 rpcz_store.cc:276] 0709 13:18:43.281962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.536735 (+254773us) service_pool.cc:224] Handling call
0709 13:18:43.537018 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.772085 (+1235067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.007948 (+1235863us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003e26d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:46.008175 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2712046464}
I20260709 13:18:45.900414 20096 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:18:45.994259 20193 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:46.017913 20371 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:18:46.019140 20193 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:46.009128 20392 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:46.020085 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 821) took 1489 ms. Trace:
I20260709 13:18:46.021319 20270 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.020592 17996 rpcz_store.cc:276] 0709 13:18:44.530940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.992828 (+461888us) service_pool.cc:224] Handling call
0709 13:18:44.993261 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:44.993698 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:45.100973 (+107275us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.860581 (+759608us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.861958 (+  1377us) log.cc:844] Serialized 52 byte log entry
0709 13:18:45.862093 (+   135us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:45.862323 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.868853 (+  6530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.868922 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.019825 (+150903us) raft_consensus.cc:1685] finished
0709 13:18:46.019849 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.020018 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":247298,"prepare.run_cpu_time_us":4476,"prepare.run_wall_time_us":40231,"raft.queue_time_us":65370,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":19526,"thread_start_us":788191,"threads_started":3,"wal-append.queue_time_us":627360}
W20260709 13:18:46.022640 20377 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:18:46.023509 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.024490 17996 raft_consensus.cc:2410] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:46.026739 17314 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:46.027159 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 830) took 1374 ms. Trace:
I20260709 13:18:46.016611 20393 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.028134 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2603) took 1484 ms. Trace:
I20260709 13:18:46.028344 20393 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:46.029474 20052 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:46.031298 20151 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.028587 20219 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.033571 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 589) took 1540 ms. Trace:
I20260709 13:18:46.033951 17990 rpcz_store.cc:276] 0709 13:18:44.493276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.493440 (+   164us) service_pool.cc:224] Handling call
0709 13:18:44.497257 (+  3817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.832983 (+335726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.033316 (+1200333us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540045e7d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:46.033511 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616580352}
I20260709 13:18:46.042034 17990 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:46.028590 17394 rpcz_store.cc:276] 0709 13:18:44.543826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.855870 (+312044us) service_pool.cc:224] Handling call
0709 13:18:44.867464 (+ 11594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.872113 (+  4649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.872142 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.917112 (+ 44970us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.360938 (+443826us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4800002958. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:18:45.540111 (+179173us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:45.540150 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.540227 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.015394 (+475167us) raft_consensus.cc:1685] finished
0709 13:18:46.015413 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.028076 (+ 12663us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21952,"raft.queue_time_us":4771,"raft.run_cpu_time_us":3548,"raft.run_wall_time_us":484418,"spinlock_wait_cycles":44056448,"thread_start_us":566954,"threads_started":1,"wal-append.queue_time_us":667596}
I20260709 13:18:46.022868 19558 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:46.013017 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:46.043241 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 831) took 1374 ms. Trace:
I20260709 13:18:46.044152 17990 rpcz_store.cc:276] 0709 13:18:44.668473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.041511 (+1373038us) service_pool.cc:224] Handling call
0709 13:18:46.041847 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.042934 (+  1087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.043182 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:46.046758 20389 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.047288 20389 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:46.048244 20353 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.900s	user 0.003s	sys 0.000s
I20260709 13:18:46.049521 20389 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.050414 20389 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:46.051227 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1304) took 1328 ms. Trace:
I20260709 13:18:46.051414 20132 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:46.051589 17313 rpcz_store.cc:276] 0709 13:18:44.723201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.823010 (+ 99809us) service_pool.cc:224] Handling call
0709 13:18:44.831752 (+  8742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.832086 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.832116 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.832525 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.977106 (+144581us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:45.039641 (+ 62535us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.039916 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.040009 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.047680 (+1007671us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:46.050937 (+  3257us) raft_consensus.cc:1685] finished
0709 13:18:46.051049 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.051173 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54244,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":6559,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":13248,"spinlock_wait_cycles":16540544,"thread_start_us":126322,"threads_started":1,"wal-append.queue_time_us":253523}
I20260709 13:18:46.032131 20393 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:46.054443 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:46.056469 20132 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:46.058845 20132 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.060483 19967 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.061686 20297 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.034533 20238 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:46.063757 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:46.034164 20219 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.067090 20132 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:46.067598 20381 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:18:45.873466 17992 rpcz_store.cc:276] 0709 13:18:44.537550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.744536 (+1206986us) service_pool.cc:224] Handling call
0709 13:18:45.744896 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.745171 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:45.745494 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.870595 (+125101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.870680 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:45.870787 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.871060 (+   273us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.871203 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":868,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":4073,"raft.queue_time_us":122,"thread_start_us":124585,"threads_started":1}
W20260709 13:18:46.075464 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.083060 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.083248 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1568) took 1418 ms. Trace:
I20260709 13:18:46.083688 17320 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:46.083817 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 609) took 1468 ms. Trace:
I20260709 13:18:46.043190 17996 rpcz_store.cc:276] 0709 13:18:44.652735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.026237 (+1373502us) service_pool.cc:224] Handling call
0709 13:18:46.026581 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.026797 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.026828 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:46.026879 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:46.026929 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.026993 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.027102 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:46.085657 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.121769 17316 rpcz_store.cc:276] 0709 13:18:44.665332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.778827 (+113495us) service_pool.cc:224] Handling call
0709 13:18:44.779206 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.134075 (+354869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.072009 (+937934us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54003e30d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:46.083169 (+ 11160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806164736}
I20260709 13:18:46.107075 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:46.123205 17396 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:46.121996 17994 rpcz_store.cc:276] 0709 13:18:44.615590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.849783 (+234193us) service_pool.cc:224] Handling call
0709 13:18:46.072789 (+1223006us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54005f0354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:46.083776 (+ 10987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023172352}
I20260709 13:18:46.095681 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:46.119143 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:46.119262 17315 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:46.121397 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.124706 17992 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:46.125757 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:46.126490 17992 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.123550 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:46.125149 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:46.128163 17392 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:46.132774 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.133118 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:46.133783 17394 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:46.134853 20297 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.136829 17464 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:46.137113 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:46.137735 17321 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.133347 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.084079 19520 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:46.133410 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:46.121747 20392 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.138341 17994 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:46.088482 20238 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.146050 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:46.147686 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 105129us
W20260709 13:18:46.153637 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.139802 19520 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:46.155524 17994 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:46.157616 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 596) took 1043 ms. Trace:
I20260709 13:18:46.158164 17994 rpcz_store.cc:276] 0709 13:18:45.114020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.145706 (+1031686us) service_pool.cc:224] Handling call
0709 13:18:46.154783 (+  9077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.157275 (+  2492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.157548 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:46.150233 20238 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.161747 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:46.161237 17992 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:46.163391 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.147651 20161 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:46.169952 19520 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:46.171128 19520 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.174762 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:46.178530 17434 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:46.179105 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:46.164218 17992 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:46.177305 17321 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:46.180802 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 597) took 1064 ms. Trace:
I20260709 13:18:46.181535 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.181774 17992 rpcz_store.cc:276] 0709 13:18:45.116707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.163817 (+1047110us) service_pool.cc:224] Handling call
0709 13:18:46.164073 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.180556 (+ 16483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.180749 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:46.182168 17322 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:46.182044 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:46.187634 17994 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:46.187832 17992 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:46.187665 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:46.182067 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.179934 20320 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.195768 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.211501 17994 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:18:46.212055 17994 pending_rounds.cc:85] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 4
I20260709 13:18:46.212352 17994 pending_rounds.cc:107] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:46.212733 17994 raft_consensus.cc:2889] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.213155 17994 pending_rounds.cc:107] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:46.213420 17994 raft_consensus.cc:2889] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.215476 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:46.215600 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.214666 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 808) took 2806 ms. Trace:
I20260709 13:18:46.214712 20320 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.218591 17991 rpcz_store.cc:276] 0709 13:18:43.390488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.661709 (+271221us) service_pool.cc:224] Handling call
0709 13:18:43.662072 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.303803 (+641731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.183208 (+1879405us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54006d1354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:46.196675 (+ 13467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380862848}
I20260709 13:18:46.220500 20320 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.187083 20052 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.183637 20392 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.223623 17992 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:46.184701 20402 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.220649 17991 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:18:46.197080 20161 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:46.227195 17992 pending_rounds.cc:85] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 5
I20260709 13:18:46.232103 17992 pending_rounds.cc:107] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:46.232424 17992 raft_consensus.cc:2889] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.239537 20405 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:46.231069 17991 pending_rounds.cc:85] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 7
I20260709 13:18:46.222723 20403 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.257367 20403 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:46.257833 20403 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:46.258831 20403 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:46.260259 17991 pending_rounds.cc:107] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:18:46.261060 19558 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.215104 20355 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 13:18:46.287791 20404 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:18:46.232376 20397 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:18:46.191215 20193 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:18:46.215018 20398 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:18:46.250651 20402 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.260708 17991 raft_consensus.cc:2889] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.313035 20394 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:18:46.305637 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 119957us
W20260709 13:18:46.337728 17997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 815) took 2147 ms (client timeout 2366 ms). Trace:
W20260709 13:18:46.338299 17997 rpcz_store.cc:269] 0709 13:18:44.190481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.190620 (+   139us) service_pool.cc:224] Handling call
0709 13:18:46.337507 (+2146887us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400244fd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:46.337649 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075644288}
W20260709 13:18:46.339983 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2596) took 1800 ms (client timeout 1584 ms). Trace:
W20260709 13:18:46.340572 17390 rpcz_store.cc:269] 0709 13:18:44.540047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.579047 (+ 39000us) service_pool.cc:224] Handling call
0709 13:18:46.339687 (+1760640us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b540038d454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:46.339876 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173132160}
I20260709 13:18:46.342232 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 448) took 1788 ms. Trace:
I20260709 13:18:46.347957 17471 rpcz_store.cc:276] 0709 13:18:44.553497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.553624 (+   127us) service_pool.cc:224] Handling call
0709 13:18:44.553929 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.845089 (+291160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.845117 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.845156 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:44.845185 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.342007 (+1496822us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540027fbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:46.342057 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.342173 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669178752}
I20260709 13:18:46.329523 20390 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.361033 20408 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:46.373287 20408 consensus_queue.cc:1243] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:46.363623 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:46.363641 20238 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:46.331560 20287 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:46.381532 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:46.381286 20287 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.383464 20389 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.386101 20230 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.387434 17394 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:46.391088 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:46.395536 20374 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.524s	user 0.003s	sys 0.000s
I20260709 13:18:46.397166 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:46.402956 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:46.397320 20176 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.404580 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:46.409523 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:46.305523 20402 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:46.415843 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:46.407037 20052 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:46.419754 20312 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 2.230s	user 0.007s	sys 0.000s
I20260709 13:18:46.417218 19676 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:46.420508 20193 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:46.421021 20402 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.380602 20390 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:46.432439 20193 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.433053 20193 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.433465 20257 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.434711 20390 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:46.431766 19676 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:46.436611 19676 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.437289 20323 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:46.439276 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 828) took 1906 ms. Trace:
I20260709 13:18:46.441298 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2527) took 1885 ms. Trace:
I20260709 13:18:46.441665 17465 rpcz_store.cc:276] 0709 13:18:44.556305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.629511 (+ 73206us) service_pool.cc:224] Handling call
0709 13:18:44.629847 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.822322 (+192475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.822353 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.822393 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:44.822434 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.441086 (+1618652us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54003840d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:46.441130 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.441246 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442209536}
I20260709 13:18:46.403323 20408 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:46.421298 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:46.425274 20052 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.428216 17990 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 13:18:46.428817 20406 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:18:46.430301 20238 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.411267 20161 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:46.450143 17990 pending_rounds.cc:85] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 7
I20260709 13:18:46.456364 17990 pending_rounds.cc:107] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:46.456811 17990 raft_consensus.cc:2889] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.455892 20278 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:18:46.472776 20278 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:46.473925 19983 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.474488 19983 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.478893 20389 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.457345 20390 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:18:46.482488 20359 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:46.482911 20359 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:46.483726 20359 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:46.452257 20323 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:46.491568 17470 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:46.456261 20161 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.439658 17993 rpcz_store.cc:276] 0709 13:18:44.533361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.467140 (+933779us) service_pool.cc:224] Handling call
0709 13:18:45.467418 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.520525 (+ 53107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.522744 (+  2219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.525977 (+  3233us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:45.529294 (+  3317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.439047 (+909753us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b5400583ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:46.439093 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.439221 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82825088}
I20260709 13:18:46.456447 20151 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:46.484795 20359 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.456002 20355 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:46.457031 20052 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.497380 20161 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.496436 20291 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:46.499073 20323 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:46.511229 20392 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.527206 19983 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.517366 20291 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:46.630975 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.659760 20392 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:46.660193 19877 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:46.660540 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.660995 20052 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.533419 20323 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.670958 17995 raft_consensus.cc:606] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:46.676602 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2548) took 1925 ms. Trace:
I20260709 13:18:46.678027 20389 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:46.678229 19983 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:46.682345 17468 rpcz_store.cc:276] 0709 13:18:44.750981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.140529 (+389548us) service_pool.cc:224] Handling call
0709 13:18:45.140829 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.141045 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:45.177229 (+ 36184us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.320821 (+1143592us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b1800381a00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:18:46.676248 (+355427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:46.676297 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:46.676336 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.676451 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.676552 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36259,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":2880,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"spinlock_wait_cycles":97629568,"thread_start_us":355162,"threads_started":2,"wal-append.queue_time_us":1253774}
W20260709 13:18:46.679075 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.682301 17995 raft_consensus.cc:614] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:46.683838 20235 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.691874 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.691982 20235 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.693225 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:46.680192 20151 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.694449 20235 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:46.680114 19960 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:46.684077 20286 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.688243 19983 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.695338 20286 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.688325 20389 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.698819 20389 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.680109 20258 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:46.699594 20258 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.701524 19983 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.702687 20258 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.694767 20151 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.705863 20151 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.707013 20403 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.684015 20193 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.709479 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2535) took 2042 ms. Trace:
I20260709 13:18:46.709941 17469 rpcz_store.cc:276] 0709 13:18:44.667524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.689233 (+ 21709us) service_pool.cc:224] Handling call
0709 13:18:44.689520 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.814287 (+124767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.814318 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.814359 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:44.814389 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.709171 (+1894782us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001c02d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:46.709221 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.709393 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286489344}
I20260709 13:18:46.711093 20193 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.711570 20399 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:46.712049 20399 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:46.712455 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 612) took 2004 ms. Trace:
I20260709 13:18:46.713037 20399 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.689838 20257 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:46.716739 20043 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:46.717381 20043 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.717792 20043 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.716889 20257 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.712865 17990 rpcz_store.cc:276] 0709 13:18:44.707822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.045298 (+1337476us) service_pool.cc:224] Handling call
0709 13:18:46.045610 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.460569 (+414959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.712182 (+251613us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400601b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:46.712373 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879120256}
W20260709 13:18:46.725293 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.725627 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.694485 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.741370 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:46.741701 20373 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:46.742115 17396 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:46.731434 20193 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:46.746315 17389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2619) took 1682 ms (client timeout 1789 ms). Trace:
W20260709 13:18:46.746815 17389 rpcz_store.cc:269] 0709 13:18:45.063770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.063918 (+   148us) service_pool.cc:224] Handling call
0709 13:18:46.746158 (+1682240us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b540036fbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:46.746259 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196976384}
I20260709 13:18:46.690320 20357 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.749745 20357 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.761129 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:46.761994 17990 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:46.767201 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.772177 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1307) took 2048 ms. Trace:
I20260709 13:18:46.772722 17319 rpcz_store.cc:276] 0709 13:18:44.724030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.166607 (+442577us) service_pool.cc:224] Handling call
0709 13:18:45.166890 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.167126 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:45.167427 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.765828 (+598401us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.716479 (+950651us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b18002fed80. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d666c858f 00007f7d5f707571 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd
0709 13:18:46.771751 (+ 55272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:46.771808 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:46.771857 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.771952 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.772100 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1021118,"prepare.queue_time_us":885,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":1504,"raft.queue_time_us":122933,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":13947,"spinlock_wait_cycles":57393280,"thread_start_us":593281,"threads_started":2,"wal-append.queue_time_us":507255}
I20260709 13:18:46.778627 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:46.664736 19676 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.686228 20392 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.742115 20373 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:46.768914 19967 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.791304 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:46.792645 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 945824us
I20260709 13:18:46.795321 17992 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
W20260709 13:18:46.796730 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 803031us
I20260709 13:18:46.770848 20286 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.801116 19967 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.804092 19967 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.805362 20373 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:46.806906 20373 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.768823 20422 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:18:46.813328 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.813472 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:46.813699 20357 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:46.746336 20193 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.816231 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.814635 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.821379 17360 leader_election.cc:400] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:18:46.823902 17360 leader_election.cc:403] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:18:46.814675 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:46.831844 17315 pending_rounds.cc:85] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 2
I20260709 13:18:46.831216 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:46.833890 17315 pending_rounds.cc:107] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:46.838028 17469 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:46.837997 17315 raft_consensus.cc:2889] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.839758 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.840505 17319 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:46.844210 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.845031 17992 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:46.846365 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:46.846683 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:46.847323 17388 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:46.847774 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:46.848359 17317 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.825718 19520 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.852267 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 56531.4us
I20260709 13:18:46.847031 17468 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:18:46.855719 17468 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:46.857376 19676 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.860585 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.861366 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:46.861891 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:46.862478 17994 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.862568 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.863230 17993 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:46.828455 20422 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:46.867333 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 69950.4us
I20260709 13:18:46.869786 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:46.872463 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 1.21309e+06us
I20260709 13:18:46.843386 20391 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.870154 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:46.877616 17471 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:46.878113 17471 pending_rounds.cc:85] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 6
I20260709 13:18:46.878376 17471 pending_rounds.cc:107] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:46.878657 17471 raft_consensus.cc:2889] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.870391 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.880703 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.871212 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:46.871337 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.881632 17465 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.881736 17321 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:46.882670 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:46.842859 20230 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.874732 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.886569 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:46.839905 20219 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:46.839969 20357 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.890988 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.865947 20193 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.843122 20394 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.876303 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:46.873018 17469 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:46.884187 17317 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:46.884750 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:46.886649 17316 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
W20260709 13:18:46.903642 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.888988 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:46.868605 17990 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:18:46.902025 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:46.905054 17467 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:46.890087 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:46.887338 17471 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:46.844669 20280 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:46.865751 20161 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.888790 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:46.896526 20392 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.897363 20376 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:46.854745 20233 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:18:46.905529 17990 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 13:18:46.846088 20278 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:18:46.910033 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:46.876757 20384 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:46.918885 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:46.899748 17465 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:46.885993 20422 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:46.921218 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:46.866945 19520 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.876555 20279 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:18:46.922927 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:46.926792 17471 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:46.930368 17994 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:46.920665 19822 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:46.911628 20280 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.966167 17964 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:46.894675 20230 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.912223 19558 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:18:46.970506 17434 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:46.902015 20357 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.933992 20291 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:46.974288 20359 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:46.976595 20392 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:46.915668 20394 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.982107 20161 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.983071 20422 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:46.984143 20435 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:46.987403 17319 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:46.987785 19520 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.987895 20230 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:46.970244 20280 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.970307 20286 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:47.113963 20286 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:47.114562 20286 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:47.061020 20359 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.125576 20359 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.066669 20392 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.131623 20392 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:47.002142 20369 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:18:46.993263 20173 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.994630 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 825) took 2462 ms. Trace:
I20260709 13:18:47.145898 17999 rpcz_store.cc:276] 0709 13:18:44.532340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.409951 (+877611us) service_pool.cc:224] Handling call
0709 13:18:45.424145 (+ 14194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.485369 (+1061224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.485411 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.495543 (+ 10132us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.790275 (+294732us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:46.790329 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.994220 (+203891us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54006cedd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:46.994273 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.994324 (+    51us) raft_consensus.cc:1685] finished
0709 13:18:46.994339 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.994572 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10327,"spinlock_wait_cycles":2439697792,"thread_start_us":273763,"threads_started":1,"wal-append.queue_time_us":282312}
I20260709 13:18:46.997637 17998 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:46.973384 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:47.149189 20163 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:47.149339 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 176023us
I20260709 13:18:47.150527 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:47.151923 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:46.998236 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 74024.2us
I20260709 13:18:46.961850 20384 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:46.963658 20278 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.969185 19822 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:46.925392 20385 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 13:18:47.070092 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 153052us
I20260709 13:18:47.063966 19967 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.105208 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.106673 20357 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:47.110477 20394 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:47.111893 20375 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.352s	user 0.004s	sys 0.008s
I20260709 13:18:47.248627 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:47.134974 17470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2545) took 2384 ms (client timeout 1508 ms). Trace:
W20260709 13:18:47.250180 17470 rpcz_store.cc:269] 0709 13:18:44.750115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.856341 (+106226us) service_pool.cc:224] Handling call
0709 13:18:47.134798 (+2278457us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400061654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:47.134907 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3660726528}
W20260709 13:18:47.250553 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 376955us
I20260709 13:18:47.142583 20286 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.061690 20389 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:18:47.185438 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.244289 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:47.241029 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:47.242529 17287 connection.cc:256] RPC call timeout handler was delayed by -1.4156324969999332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:18:47.243858 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:47.253559 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:47.254897 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:47.256038 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:47.157440 20354 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:47.347090 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 380965us
I20260709 13:18:47.348973 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:47.350056 17964 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:47.334076 20161 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:47.170924 20163 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:47.319922 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:47.321791 17462 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.335642 19676 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:47.233069 20405 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.357033 20291 raft_consensus.cc:2764] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:47.357425 19676 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.357524 20405 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:47.353556 17471 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:47.359628 20405 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:47.171350 19822 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.172739 20203 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.361217 20203 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.362079 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:47.363211 20203 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:47.364019 19558 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:47.364975 17318 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:47.365147 20001 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.364907 19558 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:47.342787 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 89398.2us
I20260709 13:18:47.366917 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:47.367492 17471 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:18:47.363267 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:47.334394 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:47.329473 17465 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.331252 20392 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:47.354547 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:47.375458 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:47.352476 20394 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:18:47.365648 20001 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.384498 17465 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:47.385564 20001 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:47.342864 17469 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:47.233731 20278 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:47.380188 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.390306 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.377712 19558 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.381151 20392 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:47.383527 20287 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:47.244403 19967 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.386938 20354 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:47.376577 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:47.435547 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59034.6us
I20260709 13:18:47.385624 20291 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:47.418975 17462 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:47.370241 20357 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:47.352890 20163 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.437580 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 429) took 2365 ms. Trace:
I20260709 13:18:47.450666 17395 rpcz_store.cc:276] 0709 13:18:45.047543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.060553 (+ 13010us) service_pool.cc:224] Handling call
0709 13:18:45.080451 (+ 19898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.522279 (+441828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.412510 (+1890231us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54003020d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:47.412743 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941242240}
I20260709 13:18:47.369334 20439 raft_consensus.cc:2764] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:47.343999 20389 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:47.435839 20403 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.004s
I20260709 13:18:47.392179 20297 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:47.370886 20161 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:47.436939 20057 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:18:47.448256 20228 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:47.449579 20291 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:47.447458 20357 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:47.453131 20163 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.472427 17990 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:47.390763 20230 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:18:47.479694 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:47.480770 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:47.482221 17315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.037s	sys 0.076s
W20260709 13:18:47.484764 17315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.037s	sys 0.076s
W20260709 13:18:47.476588 20391 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.000s
I20260709 13:18:47.470505 20228 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.476429 20291 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:47.477818 20043 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.004s
I20260709 13:18:47.477677 20233 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:47.477989 20357 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.474381 20297 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:47.413040 20384 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:47.508901 20437 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:18:47.509629 20391 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:18:47.510814 20228 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.524142 20287 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.509737 20280 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:47.528271 20233 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:47.552069 20440 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:18:47.525451 20043 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.553563 20287 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:47.557361 20286 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:47.575105 17322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.010s	sys 0.019s
W20260709 13:18:47.582875 17322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.011s	sys 0.019s
I20260709 13:18:47.565721 20392 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:47.552186 20297 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.575488 20278 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:47.627862 20445 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:47.622900 19967 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:47.637570 20057 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:47.638043 20057 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:47.638942 20057 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.640281 20057 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.646301 20287 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:47.647193 20389 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:47.651592 20280 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:47.656157 20359 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.000s
I20260709 13:18:47.657864 20233 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:47.659677 20043 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:47.614698 20235 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:47.667575 17317 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:47.667658 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:47.665402 20444 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:18:47.677783 20287 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:47.679136 17316 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:47.700829 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.679795 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:47.702287 17321 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:47.680882 20152 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:47.681161 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.704160 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.682137 17313 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:47.682351 20328 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.687079 17469 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:47.687515 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:47.692721 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.695510 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1572) took 1783 ms. Trace:
I20260709 13:18:47.719789 17465 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.719883 17320 rpcz_store.cc:276] 0709 13:18:45.911816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.928439 (+ 16623us) service_pool.cc:224] Handling call
0709 13:18:46.083441 (+155002us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.121945 (+ 38504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.695244 (+1573299us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400369050. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:47.695432 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355384576}
I20260709 13:18:47.721345 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:47.729907 17465 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:47.747298 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.748237 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:47.749267 17363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.034s	sys 0.073s
W20260709 13:18:47.749605 17363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.034s	sys 0.073s
W20260709 13:18:47.750324 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.751235 17287 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:47.751655 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.752802 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:47.753234 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:47.753433 17391 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.754113 17395 raft_consensus.cc:2410] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:47.754920 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.755693 17321 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:47.758221 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.759557 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:47.675786 20280 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:47.763427 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:47.747412 20438 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:47.765817 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:47.766007 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:47.806380 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.794727 17391 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:47.808548 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.809468 17317 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:47.811975 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:47.813669 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.812147 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:47.821493 17396 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.759160 20161 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:47.656679 20359 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:47.825557 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:47.826536 17388 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:18:47.824651 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 455494us
I20260709 13:18:47.827469 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:47.827863 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 411576us
I20260709 13:18:47.850621 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:47.830523 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:47.830206 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:47.854166 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:47.857978 17465 raft_consensus.cc:2376] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7. Re-sending same reply.
I20260709 13:18:47.757565 20386 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:47.846264 17318 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:47.857064 17994 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.763271 19574 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:47.860131 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:47.864741 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:47.813529 20376 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:47.833935 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.874703 17467 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 4. Current term is 6. Ops: []
I20260709 13:18:47.873750 17321 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:47.748695 20152 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:47.747156 20287 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:47.875645 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:47.882952 17990 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:47.883908 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:47.813966 20233 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.885215 17389 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:47.811635 20279 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:47.872262 17396 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:18:47.879659 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.880889 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1587) took 1012 ms. Trace:
I20260709 13:18:47.856076 20001 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:47.874449 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 192796us
I20260709 13:18:47.806526 20057 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:18:47.895710 17314 rpcz_store.cc:276] 0709 13:18:46.868730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.869034 (+   304us) service_pool.cc:224] Handling call
0709 13:18:46.872315 (+  3281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.991313 (+118998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.991357 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.991919 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.370985 (+379066us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:47.371081 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.694833 (+323752us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400211954. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:47.694908 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.861398 (+166490us) raft_consensus.cc:1685] finished
0709 13:18:47.861422 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.880808 (+ 19386us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1029,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"spinlock_wait_cycles":272753536,"thread_start_us":378673,"threads_started":1,"wal-append.queue_time_us":539380}
I20260709 13:18:47.868861 19574 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.926259 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:47.926836 17435 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.876s (SENT) [suppressed 23 similar messages]
I20260709 13:18:47.927326 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:47.750872 20328 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:47.925446 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48010.2us
I20260709 13:18:47.815503 20280 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:47.813165 20385 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:18:47.927506 17994 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:47.935057 17469 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:47.935452 17465 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:18:47.943392 17994 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:47.933521 20228 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.944671 20328 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:47.945017 17997 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:47.945290 20286 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:47.945544 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1586) took 1077 ms. Trace:
I20260709 13:18:47.945439 20320 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:47.946130 20286 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:47.946321 20320 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:47.946707 20286 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:47.945938 17322 rpcz_store.cc:276] 0709 13:18:46.868253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.868398 (+   145us) service_pool.cc:224] Handling call
0709 13:18:46.887678 (+ 19280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.888060 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.888091 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.893546 (+  5455us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.583425 (+689879us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:47.583481 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.583581 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.945358 (+361777us) raft_consensus.cc:1685] finished
0709 13:18:47.945376 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.945492 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1358,"raft.queue_time_us":814,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":9054,"thread_start_us":658466,"threads_started":1,"wal-append.queue_time_us":942008}
W20260709 13:18:47.939551 20396 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.006s	sys 0.022s
W20260709 13:18:47.949236 20451 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:18:47.950145 19967 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:47.881084 20161 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:47.952570 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:47.964010 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:47.946022 20228 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:47.877717 20373 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:47.930460 20386 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:47.936302 19574 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.971241 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:47.963399 19822 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.000s
W20260709 13:18:47.951324 20396 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.007s	sys 0.022s
I20260709 13:18:47.965353 20376 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:47.979346 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1321) took 1167 ms. Trace:
I20260709 13:18:47.946821 20320 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:47.980362 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:47.929527 20233 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.947772 20286 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:47.967918 20161 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:47.996317 20394 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.419340 20454 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:18:48.361341 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 397762us
W20260709 13:18:48.077978 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 106797us
W20260709 13:18:48.113334 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.463152 20163 consensus_meta.cc:287] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.973s	user 0.009s	sys 0.003s
I20260709 13:18:48.464147 20235 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:48.073004 20373 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:48.471469 20474 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.473745 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 493479us
I20260709 13:18:48.492375 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:48.493213 17393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.006s	sys 0.006s
W20260709 13:18:48.493588 17393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.006s	sys 0.006s
I20260709 13:18:47.972188 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 631) took 1290 ms. Trace:
W20260709 13:18:48.483461 17397 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.022s	sys 0.022s
I20260709 13:18:48.481881 20373 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:48.495833 17992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.006s
W20260709 13:18:48.615854 17992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.004s	sys 0.006s
I20260709 13:18:48.487829 20359 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:48.187369 20228 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:48.022897 20442 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:47.972628 20001 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:48.476917 17285 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:48.130445 20460 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:18:48.118252 20453 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:18:47.998549 19967 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:48.129511 20461 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:18:48.477869 20235 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:48.491298 17395 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.007s	sys 0.010s
W20260709 13:18:48.676184 17395 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.008s	sys 0.010s
W20260709 13:18:48.608553 17397 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.022s	sys 0.022s
I20260709 13:18:48.113124 20457 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.996994 20385 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:48.237569 20422 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:48.476168 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:48.122720 20287 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:48.615746 20286 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:48.500094 20161 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:48.500622 20231 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:18:48.610714 20297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.000s	sys 0.015s
I20260709 13:18:48.592352 20459 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.075383 20043 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.589s
I20260709 13:18:48.121755 20152 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:48.023977 20386 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:48.473168 20394 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:48.477650 20163 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:48.477061 19822 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:48.800604 19822 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:48.475394 17315 rpcz_store.cc:276] 0709 13:18:46.810198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.826809 (+ 16611us) service_pool.cc:224] Handling call
0709 13:18:46.831550 (+  4741us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:46.918585 (+ 87035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.918645 (+    60us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:46.920713 (+  2068us) log.cc:844] Serialized 52 byte log entry
0709 13:18:47.485368 (+564655us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:47.806146 (+320778us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.853676 (+ 47530us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.977583 (+123907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.977658 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.977692 (+    34us) raft_consensus.cc:1685] finished
0709 13:18:47.977703 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.977884 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156966,"prepare.queue_time_us":444310,"raft.queue_time_us":134416,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":25106,"spinlock_wait_cycles":13449344,"thread_start_us":897189,"threads_started":3,"wal-append.queue_time_us":642816}
W20260709 13:18:48.686159 17436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.007s	sys 0.019s
W20260709 13:18:48.801612 20460 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:18:48.801903 17436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.008s	sys 0.019s
W20260709 13:18:48.802706 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.684777 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 207920us
I20260709 13:18:48.617276 20280 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:48.689213 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 213108us
I20260709 13:18:48.805773 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:48.663489 20467 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:18:48.482445 20474 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:48.788771 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:48.808570 17469 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:48.787825 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:48.809134 17462 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
W20260709 13:18:48.809350 20469 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.542s	user 0.001s	sys 0.000s
I20260709 13:18:48.810158 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:48.810752 17462 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:48.811575 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:48.812150 17462 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:48.813161 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2631) took 1056 ms. Trace:
W20260709 13:18:48.813730 20480 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:18:48.813907 20287 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:48.814452 20287 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:48.814849 20453 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:18:48.674518 19967 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.794214 20459 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:48.816550 20235 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:48.816184 20001 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:48.817204 20235 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:48.788983 20231 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:48.656239 20442 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:48.792332 20291 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.264s	user 0.008s	sys 0.004s
I20260709 13:18:48.797380 17466 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:48.798327 20163 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:48.790589 20373 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:48.795746 20386 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:48.813570 17394 rpcz_store.cc:276] 0709 13:18:47.756862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.756977 (+   115us) service_pool.cc:224] Handling call
0709 13:18:47.757287 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.757649 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.757679 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.758128 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.970931 (+212803us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:47.970998 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.971089 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.812901 (+841812us) raft_consensus.cc:1685] finished
0709 13:18:48.812920 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.813040 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":51153,"thread_start_us":113913,"threads_started":1,"wal-append.queue_time_us":554927}
I20260709 13:18:48.851174 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:48.852038 17462 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:48.816211 17469 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:48.853720 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:48.855075 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:48.855724 17469 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:18:48.671645 20233 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:48.655666 20228 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:48.698544 20289 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:48.793113 20297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.000s	sys 0.023s
I20260709 13:18:48.858249 17469 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:48.816718 20287 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:48.817833 20459 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:48.696230 20385 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:48.696465 20422 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:48.695756 20359 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.154s
I20260709 13:18:48.789883 20468 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:48.817970 20235 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:48.829887 19967 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.894152 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:48.900234 17964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.019s	sys 0.037s
W20260709 13:18:48.901747 17964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.019s	sys 0.037s
I20260709 13:18:48.692755 20320 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:48.916671 17994 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:48.818740 20361 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:48.866941 20043 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:18:48.864533 20289 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.870962 20228 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:48.885185 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:48.920547 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:48.921986 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:48.849341 20291 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:48.932615 20289 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:48.910976 19574 consensus_meta.cc:287] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.852s	user 0.007s	sys 0.003s
I20260709 13:18:48.824674 20376 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:48.938252 20231 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:48.895035 20384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.013s	sys 0.052s
I20260709 13:18:48.939338 20419 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.939810 20257 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:48.887959 20373 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.887853 20386 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:48.626096 17993 rpcz_store.cc:276] 0709 13:18:46.681826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.863827 (+182001us) service_pool.cc:224] Handling call
0709 13:18:46.864123 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.902231 (+ 38108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.914409 (+ 12178us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.068306 (+153897us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.576792 (+508486us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:47.582757 (+  5965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.613722 (+ 30965us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.951261 (+337539us) raft_consensus.cc:1685] finished
0709 13:18:47.962864 (+ 11603us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.969402 (+  6538us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31915,"raft.run_cpu_time_us":44,"raft.run_wall_time_us":43,"thread_start_us":210574,"threads_started":2,"wal-append.queue_time_us":420863}
I20260709 13:18:48.891129 20468 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.934602 20057 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:48.989781 17994 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:48.988183 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 495896us
I20260709 13:18:48.996821 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:48.986851 20384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.013s	sys 0.052s
I20260709 13:18:48.947788 20369 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:49.005467 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 198358us
I20260709 13:18:49.005930 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:49.013868 17994 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:48.944695 20459 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:48.945015 20361 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:48.977128 20320 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.016109 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:49.029927 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:49.036939 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:48.973119 19574 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:49.041352 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2633) took 1281 ms. Trace:
I20260709 13:18:48.971822 19822 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:18:49.038800 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2634) took 1251 ms. Trace:
I20260709 13:18:49.075204 20228 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:49.042065 17395 rpcz_store.cc:276] 0709 13:18:47.759658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.853801 (+ 94143us) service_pool.cc:224] Handling call
0709 13:18:47.882050 (+ 28249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.882250 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:48.676701 (+794451us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.041021 (+364320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.041079 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:49.041124 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.041186 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.041295 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8666,"prepare.queue_time_us":583927,"prepare.run_cpu_time_us":3726,"prepare.run_wall_time_us":18562,"thread_start_us":1093020,"threads_started":2}
W20260709 13:18:49.069753 20484 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:49.042341 17389 rpcz_store.cc:276] 0709 13:18:47.759922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.890483 (+130561us) service_pool.cc:224] Handling call
0709 13:18:47.890840 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.891114 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:48.295315 (+404201us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.674815 (+379500us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.011084 (+336269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.011135 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:49.011199 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.011291 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.011446 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48609,"prepare.queue_time_us":598594,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":528617,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"thread_start_us":1070020,"threads_started":3,"wal-append.queue_time_us":613907}
I20260709 13:18:48.996129 20468 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:49.035681 20482 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:18:49.085028 20458 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:49.012730 20257 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:49.030954 20133 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:49.115729 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:49.041569 20485 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:49.022706 20474 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:49.014410 20471 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:18:49.099632 17465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.012s	sys 0.008s
W20260709 13:18:49.126717 17465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.012s	sys 0.009s
I20260709 13:18:49.092828 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:48.998036 20386 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:48.994388 20419 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:49.113682 20487 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:18:49.123548 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2628) took 1367 ms. Trace:
I20260709 13:18:49.107254 20228 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.132661 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:49.115312 20257 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.133803 20228 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:49.133919 20257 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:49.134819 20289 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:49.110402 20278 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:49.088457 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:49.146291 17462 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:18:49.149156 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 60789.7us
I20260709 13:18:49.150811 20474 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:49.151517 20474 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:49.152709 20474 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:49.154843 20357 consensus_meta.cc:287] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.615s	user 0.011s	sys 0.000s
W20260709 13:18:49.126271 20219 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.011s	sys 0.011s
I20260709 13:18:49.158977 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:49.161195 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:49.133085 17397 rpcz_store.cc:276] 0709 13:18:47.755682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.755814 (+   132us) service_pool.cc:224] Handling call
0709 13:18:47.762609 (+  6795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.762939 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.762979 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.814900 (+ 51921us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.967991 (+153091us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.684555 (+716564us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.123100 (+438545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.123194 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.123254 (+    60us) raft_consensus.cc:1685] finished
0709 13:18:49.123275 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.123456 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":508865,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":254575,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":22147,"thread_start_us":1251510,"threads_started":3,"wal-append.queue_time_us":163887}
I20260709 13:18:49.130460 20485 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:49.181079 20289 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:49.180403 20493 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:49.183794 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 474) took 1249 ms. Trace:
W20260709 13:18:49.155900 20396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.011s	sys 0.013s
I20260709 13:18:49.139371 20442 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:49.206676 17465 rpcz_store.cc:276] 0709 13:18:47.934206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.942588 (+  8382us) service_pool.cc:224] Handling call
0709 13:18:47.942876 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.950856 (+  7980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.950884 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.962849 (+ 11965us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.127323 (+1164474us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:49.149076 (+ 21753us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.149429 (+   353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.149554 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.183592 (+ 34038us) raft_consensus.cc:1685] finished
0709 13:18:49.183611 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.183737 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11127,"prepare.queue_time_us":21523,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":20209,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":3918,"thread_start_us":661590,"threads_started":1,"wal-append.queue_time_us":1208090}
W20260709 13:18:49.159547 20219 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.011s	sys 0.012s
W20260709 13:18:49.211170 17965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.010s	sys 0.016s
W20260709 13:18:49.246294 17965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.010s	sys 0.017s
W20260709 13:18:49.214771 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 53682.8us
I20260709 13:18:49.126998 20133 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:49.160913 20495 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.231225 20096 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:49.233107 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 311196us
I20260709 13:18:50.077622 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:50.078048 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:49.237859 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:49.212292 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.155284 20357 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:49.248449 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:49.689956 20161 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.040s	sys 0.065s
I20260709 13:18:49.125276 20458 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:49.465636 20480 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:18:49.837571 19558 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.291368 17993 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: [6.6-8.7]
W20260709 13:18:49.327711 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.067166 20442 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:49.382790 20291 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:49.465868 20409 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:49.237079 20485 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:49.216748 20493 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:49.843050 17464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.013s	sys 0.033s
W20260709 13:18:50.182797 17464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.013s	sys 0.037s
I20260709 13:18:49.241811 20385 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:49.236922 20396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.012s	sys 0.013s
I20260709 13:18:49.224133 20361 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:49.158977 20278 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:49.225962 20422 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:49.441329 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.233088 20289 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:49.679613 17992 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.012s	sys 0.029s
I20260709 13:18:50.065557 20419 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.100200 20096 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:50.087008 17362 connection.cc:256] RPC call timeout handler was delayed by -1.2332186850001108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 13:18:50.217542 17362 connection.cc:256] RPC call timeout handler was delayed by -1.1990351910001209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:18:50.217921 17362 connection.cc:256] RPC call timeout handler was delayed by -1.1792351910000889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:18:50.218263 17362 connection.cc:256] RPC call timeout handler was delayed by -1.1702351910000743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:18:50.218685 17362 connection.cc:256] RPC call timeout handler was delayed by -1.0703186850000748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:18:50.082342 20286 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.387s	user 0.003s	sys 0.029s
I20260709 13:18:50.074676 20490 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.103578 20161 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.052s	sys 0.114s
I20260709 13:18:50.071357 20496 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.145546 17996 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:50.180527 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 115613us
W20260709 13:18:50.203282 17992 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.262s	user 0.019s	sys 0.031s
I20260709 13:18:50.063894 20386 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:50.242017 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.221997 17389 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:50.228788 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:50.243052 17396 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:50.230425 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:50.207234 20132 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:50.187394 20280 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:50.083830 20495 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:50.240221 17393 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:50.210734 20385 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:50.120949 19558 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:50.202832 20485 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.261888 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:50.262455 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:50.232296 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 476) took 1146 ms. Trace:
I20260709 13:18:50.271299 20503 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.216754 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 852) took 1117 ms. Trace:
I20260709 13:18:50.273728 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:50.320441 17393 raft_consensus.cc:2410] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:50.202029 20289 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:50.250365 20490 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.271957 20496 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:50.283934 20411 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:50.223035 20419 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:50.285646 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1490) took 1594 ms. Trace:
I20260709 13:18:50.286561 20506 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:50.288867 20396 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.290812 20509 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:50.291033 20193 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:50.295502 20231 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:50.178566 20442 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.306071 17462 rpcz_store.cc:276] 0709 13:18:49.085832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.085952 (+   120us) service_pool.cc:224] Handling call
0709 13:18:50.232102 (+1146150us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b54002e2a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:50.232241 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53949312}
I20260709 13:18:50.313633 17396 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:50.187206 20409 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:50.336943 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:50.325227 20289 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.337607 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:50.360188 17393 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:50.332545 17464 rpcz_store.cc:276] 0709 13:18:48.691566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.692293 (+   727us) service_pool.cc:224] Handling call
0709 13:18:48.792179 (+ 99886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.030350 (+238171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.030381 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.038578 (+  8197us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.183275 (+1144697us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:50.183331 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.183424 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.285366 (+101942us) raft_consensus.cc:1685] finished
0709 13:18:50.285393 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.285571 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37394,"raft.queue_time_us":67012,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3605,"thread_start_us":1312491,"threads_started":2,"wal-append.queue_time_us":1189686}
I20260709 13:18:50.316933 17993 rpcz_store.cc:276] 0709 13:18:49.090618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.113114 (+ 22496us) service_pool.cc:224] Handling call
0709 13:18:49.216031 (+102917us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:50.122650 (+906619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.208234 (+ 85584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:50.272576 20132 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:50.370231 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48172 (request call id 3) took 5852 ms. Trace:
I20260709 13:18:50.381197 17995 rpcz_store.cc:276] 0709 13:18:44.504327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.970780 (+466453us) service_pool.cc:224] Handling call
0709 13:18:50.356780 (+5386000us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540057a8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627ee853 00007f7d677bc60a 00007f7d60d427d4 00007f7d60d42762 00007f7d60d42691 00007f7d60d4260c 00007f7d60d418c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:50.356925 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3802396032}
I20260709 13:18:50.369303 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:50.366348 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:50.338754 20506 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:50.383116 17990 raft_consensus.cc:2393] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:50.390568 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:50.404055 17395 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:50.353914 20193 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:50.357103 20231 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:50.298156 20280 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.410507 17389 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
W20260709 13:18:50.403885 20373 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.409s	user 0.011s	sys 0.014s
I20260709 13:18:50.345916 20419 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.331632 20503 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:50.415004 20228 consensus_meta.cc:287] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.280s	user 0.010s	sys 0.011s
I20260709 13:18:50.424330 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:50.467082 20505 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
W20260709 13:18:50.421562 20257 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.280s	user 0.014s	sys 0.011s
W20260709 13:18:50.421018 19967 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.489s	user 0.017s	sys 0.010s
W20260709 13:18:50.414551 20468 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.297s	user 0.017s	sys 0.011s
W20260709 13:18:50.437283 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 278576us
I20260709 13:18:50.387449 17393 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:50.361829 20517 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 13:18:50.426739 20320 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.394s	user 0.017s	sys 0.005s
I20260709 13:18:50.425318 20133 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:50.423182 20518 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.443948 17391 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:50.489612 20518 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:50.489799 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 608) took 5895 ms. Trace:
I20260709 13:18:50.490016 20518 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:50.490201 17998 rpcz_store.cc:276] 0709 13:18:44.593946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.940537 (+1346591us) service_pool.cc:224] Handling call
0709 13:18:46.997392 (+1056855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.148462 (+151070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.489565 (+3341103us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54006cedd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:50.489721 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429814528}
I20260709 13:18:50.490782 17393 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:50.491145 20517 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.491631 17997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 839) took 3021 ms (client timeout 2783 ms). Trace:
I20260709 13:18:50.486037 19967 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:50.492084 17997 rpcz_store.cc:269] 0709 13:18:47.470700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.470863 (+   163us) service_pool.cc:224] Handling call
0709 13:18:50.491435 (+3020572us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400661054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:50.491572 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062421248}
I20260709 13:18:50.493759 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2554) took 3253 ms. Trace:
I20260709 13:18:50.421989 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:50.427727 20357 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:50.356755 20509 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.494174 20233 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.442175 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:50.462108 20231 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.473886 20292 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.443351 20193 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:50.474325 17963 leader_election.cc:336] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.563s (SENT)
I20260709 13:18:50.475908 19558 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:50.428239 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 197922us
I20260709 13:18:50.424520 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:50.447093 20506 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.463521 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 848) took 1558 ms. Trace:
I20260709 13:18:50.481570 17395 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:50.466856 20516 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:50.480121 20228 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.488745 20133 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:50.493846 19967 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:50.354626 20396 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.468611 20096 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.502086 17467 rpcz_store.cc:276] 0709 13:18:47.240275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.240953 (+   678us) service_pool.cc:224] Handling call
0709 13:18:47.335093 (+ 94140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.875729 (+540636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.493520 (+2617791us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b5400280854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:50.493676 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240520960}
I20260709 13:18:50.503327 20496 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:50.503496 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 1.25506e+06us
I20260709 13:18:50.490869 20518 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:50.509117 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.521365 20233 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:50.521584 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47299.1us
I20260709 13:18:50.524151 17995 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:50.480278 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:50.483249 20493 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:50.525871 17992 rpcz_store.cc:276] 0709 13:18:48.905029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.905173 (+   144us) service_pool.cc:224] Handling call
0709 13:18:48.941227 (+ 36054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.941437 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:50.241701 (+1300264us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.463237 (+221536us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.463296 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:50.463333 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.463379 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.463475 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1463361,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":115,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2922,"thread_start_us":1517018,"threads_started":2}
I20260709 13:18:50.486249 20257 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.486150 20468 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.521539 20458 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.528071 20193 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.527894 20231 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.491669 20517 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.524170 20495 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:50.511598 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.565388 17994 raft_consensus.cc:2410] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:50.538739 20490 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.548637 20506 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.548429 20409 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:50.537592 20133 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.561724 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:50.579715 17467 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.552242 20132 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:50.566830 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:50.560089 19676 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.563247 19558 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:18:50.570025 17993 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:50.571692 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:50.585541 17464 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:50.575531 17990 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 10. Ops: []
I20260709 13:18:50.561518 17462 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:50.529922 20516 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.581359 17393 raft_consensus.cc:2410] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:50.577577 20518 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.578280 20419 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:50.566857 17964 connection.cc:256] RPC call timeout handler was delayed by -1.0891756739999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:18:50.562356 20442 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:50.584959 20519 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:18:50.609921 17464 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:50.604700 20435 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.607060 20279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.629s	user 0.011s	sys 0.046s
I20260709 13:18:50.613442 20442 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.618676 20279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.647s	user 0.011s	sys 0.046s
I20260709 13:18:50.739575 20442 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.742705 20133 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.620071 20435 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.742048 20442 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:50.747565 20435 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:50.748507 20435 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:50.749033 20435 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.738453 20279 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:50.752705 20279 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.757874 20435 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:50.619392 20525 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.761649 20289 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.761837 20525 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.773756 20396 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.776505 20517 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.789883 20525 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:50.792701 20289 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.839895 20233 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:50.889242 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 320483us
I20260709 13:18:50.894848 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:50.898837 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:50.917654 17397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.007s	sys 0.011s
W20260709 13:18:50.933416 17397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.008s	sys 0.012s
W20260709 13:18:50.918493 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.919108 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.920600 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.017s	sys 0.020s
W20260709 13:18:50.936472 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.017s	sys 0.020s
W20260709 13:18:50.937350 17360 connection.cc:256] RPC call timeout handler was delayed by -3.0160380000002078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 13:18:50.938309 17360 connection.cc:256] RPC call timeout handler was delayed by -2.5678627980000783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:18:50.938984 17360 connection.cc:256] RPC call timeout handler was delayed by -2.2673864450000565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:18:50.939354 17360 connection.cc:256] RPC call timeout handler was delayed by -2.0543618640001569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 13:18:50.922299 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 308086us
W20260709 13:18:50.941998 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.943501 19877 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.944015 20231 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:50.944609 20231 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:50.945142 20231 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.945248 20219 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.944720 19877 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:50.946197 20219 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.948426 19877 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:50.949090 19877 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.949802 19877 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:50.952024 19877 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:50.939715 17360 connection.cc:256] RPC call timeout handler was delayed by -2.0256665380002232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:18:50.954249 17360 connection.cc:256] RPC call timeout handler was delayed by -2.0253058910002437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:18:50.954607 17360 connection.cc:256] RPC call timeout handler was delayed by -1.9142447700000957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.255s for a response
W20260709 13:18:50.958992 17360 connection.cc:256] RPC call timeout handler was delayed by -1.8985047639998811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 13:18:50.959841 17360 connection.cc:256] RPC call timeout handler was delayed by -1.8985047639998811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 13:18:50.967445 20270 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:50.969851 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:50.952244 20219 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:50.962461 20376 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:18:50.975911 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:50.977283 20396 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:50.982856 17319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1594) took 4107 ms (client timeout 2336 ms). Trace:
W20260709 13:18:50.983350 17319 rpcz_store.cc:269] 0709 13:18:46.875697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.884490 (+  8793us) service_pool.cc:224] Handling call
0709 13:18:50.982339 (+4097849us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b54003e1cd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:50.982551 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192543488}
I20260709 13:18:50.984067 20376 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:50.981278 20396 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.974090 20270 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:50.985503 20396 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.986690 17464 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:50.980288 17462 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:50.984457 20523 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.983970 20386 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:50.995297 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:50.995932 17468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 466) took 4106 ms (client timeout 1843 ms). Trace:
W20260709 13:18:50.996429 17468 rpcz_store.cc:269] 0709 13:18:46.889758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.889877 (+   119us) service_pool.cc:224] Handling call
0709 13:18:50.995433 (+4105556us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b5400281c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:50.995693 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193064320}
I20260709 13:18:50.997222 20523 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:50.992449 20386 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.002856 20386 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.008225 20233 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:50.990478 20376 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.013521 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.014576 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.015760 19574 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:51.016516 17963 leader_election.cc:336] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.973s (SENT)
I20260709 13:18:51.018958 17322 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:51.019115 17316 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:51.020955 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.022625 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.023890 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.028580 17317 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:51.029345 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:51.030405 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:51.030740 20525 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.031615 17995 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:51.024463 20289 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:18:51.032791 20280 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.035145 20439 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:51.035704 20439 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:51.037096 20439 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.040266 17318 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:51.041052 20468 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.042692 20439 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:51.044039 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 453123us
I20260709 13:18:51.044641 20399 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.045554 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:51.046547 17999 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:51.046941 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:51.048939 20233 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.049429 20289 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:51.050297 20289 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:51.033998 17314 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:51.033459 17319 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:51.055336 20509 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.019143 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.056557 20258 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.000661 20523 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.061345 20258 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.064922 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.067900 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.070447 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:51.071923 17995 raft_consensus.cc:2410] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:51.072152 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.063334 20233 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.076736 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.077651 17319 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:51.079324 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:51.079972 17319 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.081831 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 849) took 2176 ms. Trace:
W20260709 13:18:51.082603 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.067139 20258 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.086911 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:51.084267 17360 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:51.082276 17996 rpcz_store.cc:276] 0709 13:18:48.905382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.935108 (+ 29726us) service_pool.cc:224] Handling call
0709 13:18:48.935483 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.241227 (+1305744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.081348 (+840121us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400583ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:51.081638 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2782332672}
I20260709 13:18:51.095222 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.096581 17999 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:51.098886 17316 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:51.105554 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.106258 20525 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:51.106611 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.107919 17314 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:51.108166 20523 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.109056 20523 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.111841 20523 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.116891 20279 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:51.119341 20376 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.119609 20503 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.095749 20289 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.123225 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:51.123689 20278 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.124354 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:51.125144 17995 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:51.125276 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:51.127887 17320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 522) took 3447 ms (client timeout 3046 ms). Trace:
I20260709 13:18:51.129068 20495 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.147559 17462 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
W20260709 13:18:51.129313 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 135961us
I20260709 13:18:51.132992 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:51.134093 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.134400 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:51.132411 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.137490 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.138341 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.138578 20257 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:51.141554 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:51.141763 17466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2556) took 3900 ms (client timeout 1510 ms). Trace:
W20260709 13:18:51.152585 17320 rpcz_store.cc:269] 0709 13:18:47.680230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.806046 (+125816us) service_pool.cc:224] Handling call
0709 13:18:51.127550 (+3321504us) spinlock_profiling.cc:243] Waited 3.09 s on lock 0x7b5400211e54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:51.127711 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7113282304}
I20260709 13:18:51.142684 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.142760 17471 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:51.143671 17319 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:18:51.076582 20270 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.154492 17313 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:51.177863 17999 raft_consensus.cc:2410] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:51.179863 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.181599 17469 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
W20260709 13:18:51.155759 17466 rpcz_store.cc:269] 0709 13:18:47.240854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.242531 (+  1677us) service_pool.cc:224] Handling call
0709 13:18:51.141360 (+3898829us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54001694d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:51.141605 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3404110208}
W20260709 13:18:51.184885 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 117135us
I20260709 13:18:51.186959 17322 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.187640 17319 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:51.192400 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.189975 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:51.149144 20231 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.192188 17464 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:51.202565 17318 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:51.201278 20495 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.215387 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:51.216989 17287 connection.cc:256] RPC call timeout handler was delayed by -2.4831515820001187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:18:51.217655 17315 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:51.221068 17467 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.612s	user 0.002s	sys 0.018s
I20260709 13:18:51.220949 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:51.221654 20474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.004s	sys 0.025s
W20260709 13:18:51.222087 17994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 641) took 2168 ms (client timeout 2180 ms). Trace:
I20260709 13:18:51.223942 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:51.224793 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.230057 17317 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:18:51.233716 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 48618.6us
I20260709 13:18:51.230511 17314 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
W20260709 13:18:51.233728 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.232281 17994 rpcz_store.cc:269] 0709 13:18:49.015740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.015865 (+   125us) service_pool.cc:224] Handling call
0709 13:18:51.145887 (+2130022us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54006d1fd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:51.183653 (+ 37766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3550019968}
I20260709 13:18:51.232601 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:51.232091 20474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.004s	sys 0.026s
I20260709 13:18:51.236451 17467 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:51.227349 20495 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.240273 17317 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:51.240221 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.240947 17320 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:51.240849 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:51.241144 20279 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:51.257848 20279 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.258931 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:51.260099 20173 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.260222 20279 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.260679 20173 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.262838 20173 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.263747 20258 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.264926 20399 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:51.265349 19558 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:51.265779 19558 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:51.266196 19558 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.264393 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:51.267237 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.268699 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2639) took 1020 ms. Trace:
I20260709 13:18:51.269047 20509 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:51.269642 20509 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:51.270177 20509 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.255335 20442 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:51.273308 17993 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:51.248111 17469 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:51.242223 20394 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:51.253597 17390 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:18:51.254148 17467 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:18:51.254904 17462 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:51.255302 20495 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.270812 20279 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:51.253674 17394 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:51.268721 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.234221 20289 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.283748 20279 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.301239 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.302532 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.302855 20279 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.303217 20457 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:51.274094 20442 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:51.284427 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:51.283540 17465 raft_consensus.cc:2410] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:51.304958 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 106669us
I20260709 13:18:51.284961 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.283480 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.289559 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.275712 19877 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.297389 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:51.271332 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.303957 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.269189 17391 rpcz_store.cc:276] 0709 13:18:50.248300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.490145 (+241845us) service_pool.cc:224] Handling call
0709 13:18:51.179349 (+689204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.236921 (+ 57572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.236953 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:51.236997 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:51.237030 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.249267 (+ 12237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.268408 (+ 19141us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540023c3d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:51.268511 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504707200}
I20260709 13:18:51.307049 17322 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:51.296797 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 473) took 3363 ms. Trace:
I20260709 13:18:51.298173 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.298916 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.312086 17319 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:51.303692 20457 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:51.298431 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:51.303143 17313 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:51.297745 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2565) took 4050 ms. Trace:
I20260709 13:18:51.287935 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.315395 17318 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:51.293579 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2572) took 3466 ms. Trace:
I20260709 13:18:51.311383 17471 rpcz_store.cc:276] 0709 13:18:47.933488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.933588 (+   100us) service_pool.cc:224] Handling call
0709 13:18:51.142210 (+3208622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.181409 (+ 39199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.296576 (+115167us) spinlock_profiling.cc:243] Waited 3.21 s on lock 0x7b54001694d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:51.296736 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7378235648}
I20260709 13:18:51.287451 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:51.288628 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.296753 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.335412 17389 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.316382 17317 raft_consensus.cc:2376] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9. Re-sending same reply.
I20260709 13:18:51.323786 17470 rpcz_store.cc:276] 0709 13:18:47.827130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.828325 (+  1195us) service_pool.cc:224] Handling call
0709 13:18:47.828601 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.064303 (+2235702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.064495 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.064882 (+   387us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:50.065151 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.293077 (+1227926us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54001f3454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:51.293141 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.293379 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3569609472}
I20260709 13:18:51.338287 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.345428 17469 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
W20260709 13:18:51.342191 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44934.6us
I20260709 13:18:51.291635 20137 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:51.344447 17322 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:18:51.292452 20516 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.348033 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.349375 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.352095 17322 pending_rounds.cc:85] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 6
I20260709 13:18:51.354064 17395 raft_consensus.cc:2410] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:51.353462 17320 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:18:51.355868 17995 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:51.356774 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:51.358050 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.358630 17314 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:51.360272 20394 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.360764 20394 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.361147 20394 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.352355 17322 pending_rounds.cc:107] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:18:51.370261 17322 raft_consensus.cc:2889] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:51.365743 17392 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:51.368218 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:51.375145 17471 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:51.350231 20137 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:51.382144 17464 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:18:51.381767 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:51.380025 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.383483 17314 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:51.327167 19877 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.386317 17462 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:51.383668 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.391412 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:51.393985 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.395023 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 136213us
I20260709 13:18:51.398840 20503 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.399338 20503 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.399737 20503 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.316874 17463 rpcz_store.cc:276] 0709 13:18:47.247360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.332966 (+ 85606us) service_pool.cc:224] Handling call
0709 13:18:47.333392 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.387135 (+ 53743us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:47.387463 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.615309 (+227846us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.624590 (+  9281us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.624780 (+   190us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:47.624819 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.232888 (+1608069us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b180042b500. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f707522 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:18:51.140693 (+1907805us) spinlock_profiling.cc:243] Waited 929 us on lock 0x7b180042b500. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419
0709 13:18:51.297141 (+156448us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b540041f5d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:51.297213 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.297305 (+    92us) raft_consensus.cc:1685] finished
0709 13:18:51.297317 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.297576 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4179,"prepare.queue_time_us":2690,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":29838,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":8920,"spinlock_wait_cycles":129188864,"thread_start_us":227206,"threads_started":1,"wal-append.queue_time_us":482230,"wal-append.run_cpu_time_us":47503,"wal-append.run_wall_time_us":2191359}
I20260709 13:18:51.401010 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:51.403704 20457 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.404937 20457 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.405107 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:51.406993 20468 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:51.408926 20468 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:51.409363 20468 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:51.409519 20396 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.410076 20468 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.408285 20503 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.411717 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.411888 20396 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.412053 20495 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.384277 20137 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.413852 17316 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:51.401059 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.416899 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1545) took 1195 ms. Trace:
I20260709 13:18:51.417342 17394 rpcz_store.cc:276] 0709 13:18:50.220596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.221110 (+   514us) service_pool.cc:224] Handling call
0709 13:18:51.131662 (+910552us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfeee 0000000000375939 00007f7d677431e0 00007f7d6780c0c4 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:51.131848 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.279152 (+147304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.413980 (+134828us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b54001397d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:51.415450 (+  1470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130912256}
I20260709 13:18:51.418565 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:51.418931 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:51.419293 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 76165.1us
I20260709 13:18:51.418612 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:51.420898 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.420806 20442 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.421808 17394 raft_consensus.cc:2410] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:51.422250 19877 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.422672 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.423285 17394 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:51.424255 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.419572 17322 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:51.425345 17391 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:51.437669 20503 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.438393 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.439106 17313 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:51.439764 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:51.440403 17394 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.442375 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:51.443200 17322 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:51.443979 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:51.446594 17395 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:51.451074 20270 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.432183 20231 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.455899 17394 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
W20260709 13:18:51.453627 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 97720.5us
I20260709 13:18:51.463940 17320 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:51.424691 20228 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.467741 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.474201 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:51.474727 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:51.476879 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.474866 17314 raft_consensus.cc:2376] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6. Re-sending same reply.
W20260709 13:18:51.480280 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 123219us
I20260709 13:18:51.480974 20231 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.486891 20231 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:51.487337 20231 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.488904 20258 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.485616 17463 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:51.477563 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:51.493225 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.493281 20550 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:51.494313 20550 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:51.494742 20550 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:51.496214 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.486451 17434 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:51.490715 20257 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:51.507596 20373 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:51.508607 20228 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:51.510128 20233 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:51.510531 20233 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:51.512015 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 176214us
I20260709 13:18:51.511620 20233 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:51.512493 17962 connection.cc:256] RPC call timeout handler was delayed by -1.7640457029999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 13:18:51.512854 17962 connection.cc:256] RPC call timeout handler was delayed by -1.6506457030000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 13:18:51.513540 17962 connection.cc:256] RPC call timeout handler was delayed by -1.5393132489998607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3046s for a response
W20260709 13:18:51.513895 17962 connection.cc:256] RPC call timeout handler was delayed by -1.4904457029999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:18:51.513098 20233 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.514451 17321 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:51.515424 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46913.3us
I20260709 13:18:51.516141 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:18:51.504781 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 442) took 4782 ms (client timeout 3241 ms). Trace:
I20260709 13:18:51.520280 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:51.517853 17390 rpcz_store.cc:269] 0709 13:18:46.720325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.750967 (+ 30642us) service_pool.cc:224] Handling call
0709 13:18:51.490664 (+4739697us) spinlock_profiling.cc:243] Waited 4.47 s on lock 0x7b540013a6d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:51.502464 (+ 11800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10278830976}
I20260709 13:18:51.518637 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:51.524323 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.477039 20509 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.525928 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.530268 17394 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:51.532541 17318 raft_consensus.cc:2410] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:51.529548 17315 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:51.525751 20031 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:51.534145 20503 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:51.534284 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.534440 20031 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.534868 20503 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:51.535656 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.535918 20503 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.526408 20474 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:51.536692 20278 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:51.534914 20031 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.537110 20474 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:51.543972 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:51.556466 17990 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:51.557511 20509 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.563948 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:51.565325 17396 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:51.528676 20257 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:51.588012 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.550458 20474 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.568221 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:51.593529 17995 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:51.595798 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.606753 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:51.614056 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.602077 20506 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:51.622308 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:51.625252 17390 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:51.597402 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.626928 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.630447 17395 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:51.628717 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:51.630515 17434 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:51.634712 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46457.3us
I20260709 13:18:51.638124 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.593068 20394 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.620414 20495 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.647974 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:51.597227 20173 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:51.634374 20228 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.623230 20442 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.655676 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.636536 20506 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:51.660655 17990 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:51.664361 17315 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:51.666100 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.650020 20509 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.671294 17316 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.672107 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.667583 17321 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:51.656123 20473 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.670820 20509 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.673341 20289 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.724278 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.677631 20473 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.700487 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.727885 17389 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:51.709242 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:51.709618 20556 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:51.717260 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:51.717623 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.718789 20278 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:51.719677 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.720382 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.721139 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.723066 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:51.700177 20257 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.700330 20495 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:18:51.670259 20228 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:51.841511 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.792198 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:51.740667 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:51.843451 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.781641 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.761950 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.829634 17998 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:51.781145 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.779201 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:51.723801 20509 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.781798 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.861423 17388 raft_consensus.cc:2410] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:51.740679 17468 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:51.762590 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.741016 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.778429 17395 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:51.791544 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:51.863277 17466 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:51.762267 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:51.778403 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 125018us
I20260709 13:18:51.869976 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:51.728493 20289 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:51.741292 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.880283 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:51.872800 17391 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
W20260709 13:18:51.874677 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 198125us
W20260709 13:18:51.842407 20557 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:51.882997 20173 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:51.883435 20173 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:51.883947 20173 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.866139 20506 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.876307 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:51.789901 20561 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:18:51.891232 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.891928 17389 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:18:51.675539 20531 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.730082 20473 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.878990 17462 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:18:51.776644 19558 consensus_meta.cc:287] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.003s
I20260709 13:18:51.889772 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:51.793610 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:51.905870 17463 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:51.892197 17394 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:51.894454 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 103009us
I20260709 13:18:51.874184 17465 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:51.877318 17318 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
W20260709 13:18:51.911304 17962 leader_election.cc:336] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 1.515s (SENT)
I20260709 13:18:51.791127 20394 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.914459 17992 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:51.915426 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:51.887861 20289 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.920157 17962 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:51.921494 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.921908 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.846771 20474 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.925040 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:51.930248 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:51.930356 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:51.932045 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.672706 20442 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.936405 20474 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:51.790289 20031 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.936637 20550 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.937695 17389 raft_consensus.cc:2410] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:51.938622 20031 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:51.941403 20565 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:51.942093 20565 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:51.943059 20231 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.943328 20565 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:51.945048 20279 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:51.945175 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.945933 17388 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:18:51.778687 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:51.946720 17991 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:51.947618 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:51.948313 20233 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:51.948496 17395 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.913066 19558 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:51.950518 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.950796 19558 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:51.952600 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:51.947731 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:51.955075 17316 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:18:51.898264 20531 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:51.956254 17391 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:51.927667 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:51.957096 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.958352 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:51.962119 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.964015 17360 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:51.967001 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60122.5us
I20260709 13:18:51.896818 20373 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:18:51.969763 17389 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
W20260709 13:18:51.969144 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55401.7us
I20260709 13:18:51.969635 17395 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
W20260709 13:18:51.967986 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.991786 17393 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.931826 20278 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:52.005138 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.993984 20474 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.994093 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.994949 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:51.997144 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.006484 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:51.997857 20228 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:51.998085 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:51.998795 20231 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:52.013118 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:51.999071 17464 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:52.014551 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.015166 17464 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.999423 17991 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:51.999683 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:51.999938 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:51.996750 20473 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.001199 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:52.002926 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 101856us
I20260709 13:18:51.967478 20531 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.004180 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:52.007570 17395 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:18:52.008473 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:51.983242 20468 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
W20260709 13:18:51.992434 20270 consensus_meta.cc:287] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:18:51.965683 20550 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:52.019287 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.036151 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.039323 17990 raft_consensus.cc:2368] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:52.032612 17466 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:52.043345 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.016168 20495 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:52.044494 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:52.047291 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49286.8us
I20260709 13:18:52.050051 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:52.016780 20474 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:52.051699 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:52.051967 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.056107 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.057228 17391 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:52.033353 20231 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:52.059588 17998 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:52.061573 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.062634 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:52.063205 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.063614 20287 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:18:52.065402 17470 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:52.041020 19877 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.068147 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:52.080305 17466 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:18:52.082975 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.084273 17393 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:52.088595 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.053807 20474 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:52.097246 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 96135.2us
I20260709 13:18:52.065912 20270 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:52.032399 20468 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.118957 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.110466 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.120393 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:52.124174 17470 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:52.122504 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.131825 17464 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:52.139416 20577 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:52.139963 20577 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:52.140336 20577 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.142045 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.144721 17998 raft_consensus.cc:2368] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
W20260709 13:18:52.149261 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 155835us
I20260709 13:18:52.151057 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.154961 17466 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:52.155786 17962 leader_election.cc:336] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 2.017s (SENT)
I20260709 13:18:52.165323 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.168280 17389 raft_consensus.cc:2368] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
W20260709 13:18:52.166536 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 98513.4us
I20260709 13:18:52.161604 17391 raft_consensus.cc:2376] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8. Re-sending same reply.
I20260709 13:18:52.120023 20270 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.194237 20270 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:52.197427 20137 consensus_meta.cc:287] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.002s
I20260709 13:18:52.198028 20137 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.119320 20523 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:52.165156 20031 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.183773 20581 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.184285 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:52.185379 20219 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:52.189600 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:52.190166 17990 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:52.190286 17395 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
W20260709 13:18:52.192023 20568 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:18:52.193578 17994 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:52.083539 20173 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.119838 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.201434 17397 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:52.226734 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:52.256111 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 66609.3us
I20260709 13:18:52.262291 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.263142 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:52.234256 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.267658 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:52.163053 20373 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.268199 17391 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:52.274860 17990 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:52.200788 20137 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:52.279736 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:52.255206 20278 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:52.206642 20509 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.201896 20442 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:52.273295 20280 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:52.268158 20523 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:52.286190 17391 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:18:52.284130 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 101400us
I20260709 13:18:52.294456 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:52.287393 20578 raft_consensus.cc:2764] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:52.287933 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.289019 20173 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:52.291854 17466 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:52.286502 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:52.297976 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 153640us
I20260709 13:18:52.298404 17393 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:52.234570 20031 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.295256 20473 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:52.296317 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:52.278749 20550 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.295851 20287 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:52.292177 19877 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:52.311467 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.313457 17467 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:52.312191 20258 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:52.255358 20581 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.315675 20287 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:52.296339 20280 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.319896 17394 raft_consensus.cc:2368] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10.
I20260709 13:18:52.322441 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.323367 17321 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:52.327670 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.328359 17389 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:52.331053 17391 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:52.294724 20373 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.333454 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.333698 20373 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:52.334137 17395 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.336411 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.325106 20280 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.349627 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:52.347035 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:52.350579 17315 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:52.319896 20258 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:52.354702 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.356019 17388 raft_consensus.cc:2368] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:52.358992 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:52.370384 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:52.371708 20233 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:52.372133 20233 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:52.372560 20233 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.374749 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:52.375684 19877 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.376436 19877 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:52.359254 17388 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:52.376818 19877 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:52.377276 19877 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.360160 20439 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:52.361065 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 447) took 1090 ms. Trace:
I20260709 13:18:52.382164 17396 rpcz_store.cc:276] 0709 13:18:51.270517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.283002 (+ 12485us) service_pool.cc:224] Handling call
0709 13:18:52.360748 (+1077746us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54004132d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:52.360975 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587950976}
I20260709 13:18:52.385612 17464 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:52.385231 20278 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.386211 20233 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.354912 20258 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.389323 20258 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.361663 17392 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:52.361794 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 448) took 1058 ms. Trace:
I20260709 13:18:52.361207 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.363831 17463 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:52.353441 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:52.369284 17220 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49294 (request call id 329) took 21861 ms (client timeout 15000 ms). Trace:
I20260709 13:18:52.392204 17462 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.366791 20287 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:52.390441 20564 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.456s	user 0.002s	sys 0.000s
I20260709 13:18:52.365953 20581 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:52.369800 20031 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:52.393471 17467 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:52.391799 17397 rpcz_store.cc:276] 0709 13:18:51.303567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.443404 (+139837us) service_pool.cc:224] Handling call
0709 13:18:51.443663 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.266158 (+822495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.361569 (+ 95411us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400253354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:52.361735 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741969152}
I20260709 13:18:52.348587 20523 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:52.419627 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.422307 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.429306 17395 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:52.433804 17463 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:52.461509 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:52.436132 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 64849.4us
W20260709 13:18:52.437546 20576 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:52.437904 20584 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:18:52.438333 20394 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:52.438985 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:52.470533 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:52.470991 17465 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:52.439757 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.471776 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:52.440303 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.443143 20574 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:18:52.443665 20474 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.424533 20468 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:52.446069 17999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:48172
W20260709 13:18:52.446938 20580 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.307s	user 0.003s	sys 0.001s
I20260709 13:18:52.449283 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.450181 17394 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:52.505874 17999 raft_consensus.cc:606] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:52.506284 17999 raft_consensus.cc:614] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:52.458964 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.463143 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.475049 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.482100 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:52.484426 20509 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:52.485355 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:52.513633 17995 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.489059 20448 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.489219 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:52.489569 20376 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:52.546902 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.490399 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.491070 20270 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.494555 20386 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:52.495347 20231 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:52.496860 17214 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 5 to 8, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 8 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.481161 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:52.551752 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 69746.8us
I20260709 13:18:52.552285 17397 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:52.451427 20233 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:52.514010 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44999.7us
I20260709 13:18:52.500689 20396 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.532232 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.548791 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.561267 17468 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.551997 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:52.550312 17462 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:52.457013 20581 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.572068 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.549350 17465 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:52.564998 17286 leader_election.cc:400] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10.
I20260709 13:18:52.565037 17396 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:52.574316 17286 leader_election.cc:403] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:52.583508 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.586105 17315 raft_consensus.cc:2368] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7.
I20260709 13:18:52.587504 17464 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:52.588805 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 80569.4us
I20260709 13:18:52.590780 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:52.557631 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:52.594455 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.597167 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.598984 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:52.609144 17396 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:52.600539 17993 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.571596 20386 consensus_queue.cc:1243] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:52.587749 20584 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.552774 20577 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.598083 20279 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.635792 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:52.579973 20031 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:18:52.557077 20448 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.638830 17998 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:52.631146 17360 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:52.579686 20257 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:18:52.579778 20509 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:18:52.640017 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 132381us
I20260709 13:18:52.605333 20468 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:52.644644 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53972.6us
W20260709 13:18:52.649796 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 60348.5us
I20260709 13:18:52.572345 20396 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.612075 20550 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.573787 20280 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.658373 17466 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:52.659262 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:52.611677 20581 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.672668 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:52.662310 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:52.665975 20442 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:52.674041 17468 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:52.678136 20442 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:18:52.677606 20531 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.002s
I20260709 13:18:52.679008 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:52.679138 20442 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.679615 20531 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.680861 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.682133 20531 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:52.682152 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.686398 17471 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:52.686683 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:52.688390 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 81887.1us
W20260709 13:18:52.392449 17220 rpcz_store.cc:269] 0709 13:18:30.507816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.507994 (+   178us) service_pool.cc:224] Handling call
0709 13:18:52.368970 (+21860976us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:41.855464 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:42.002231 (+146767us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:42.010832 (+  8601us) write_op.cc:435] Acquired schema lock
0709 13:18:42.012871 (+  2039us) tablet.cc:662] Decoding operations
0709 13:18:42.322119 (+309248us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:42.322241 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:42.322298 (+    57us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:18:42.323337 (+  1039us) tablet.cc:701] Row locks acquired
0709 13:18:42.323393 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:18:42.323641 (+   248us) write_op.cc:270] Start()
0709 13:18:42.323795 (+   154us) write_op.cc:276] Timestamp: P: 1783603122323531 usec, L: 0
0709 13:18:42.323818 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:42.432339 (+108521us) log.cc:844] Serialized 2824 byte log entry
0709 13:18:42.889572 (+457233us) op_driver.cc:464] REPLICATION: finished
0709 13:18:43.238814 (+349242us) write_op.cc:301] APPLY: starting
0709 13:18:43.238908 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:43.239105 (+   197us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:43.239227 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:43.240249 (+  1022us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:43.240624 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:18:43.240685 (+    61us) write_op.cc:312] APPLY: finished
0709 13:18:43.241049 (+   364us) log.cc:844] Serialized 59 byte log entry
0709 13:18:43.241243 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:43.241359 (+   116us) write_op.cc:454] Released schema lock
0709 13:18:43.241418 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:43.241793 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:43.241826 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8936,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":300751,"apply.run_cpu_time_us":2969,"apply.run_wall_time_us":2968,"num_ops":7,"prepare.queue_time_us":315472,"prepare.run_cpu_time_us":22104,"prepare.run_wall_time_us":796502,"raft.queue_time_us":209439,"raft.run_cpu_time_us":34731,"raft.run_wall_time_us":179408,"replication_time_us":565587,"spinlock_wait_cycles":72448,"thread_start_us":655974,"threads_started":4,"wal-append.queue_time_us":206798,"wal-append.run_cpu_time_us":52935,"wal-append.run_wall_time_us":1608426}]]}
I20260709 13:18:52.694388 17470 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:52.711148 17465 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:52.712729 17471 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:52.689529 17214 catalog_manager.cc:5697] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 4, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 4 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.721472 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:52.674216 20468 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:52.739724 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.768390 17963 leader_election.cc:336] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.550s (SENT)
W20260709 13:18:52.756280 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55868.9us
W20260709 13:18:52.784330 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 128894us
I20260709 13:18:52.785326 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:52.715230 19558 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:52.787933 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 156907us
I20260709 13:18:52.728822 20495 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:52.752401 20278 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:52.795836 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:52.728461 20473 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
W20260709 13:18:52.805657 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 150732us
I20260709 13:18:52.730122 19877 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.809046 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:52.813563 20219 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:18:52.818670 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 152063us
I20260709 13:18:52.819144 20219 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:52.819598 20219 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:52.820515 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:52.821915 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.823300 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.823714 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.824143 17995 raft_consensus.cc:2410] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:52.824791 20257 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:52.825227 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.810906 20394 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:52.799983 20270 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:52.824615 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.826694 17317 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:52.828403 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.830929 17322 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:52.813937 17214 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 3 to 4, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 4 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.833554 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.834657 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:52.835357 20593 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:52.838827 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.840279 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.841287 20608 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.841372 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:52.839113 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.815654 20509 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:52.850606 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.851428 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.858553 17999 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:18:52.834668 20585 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:18:52.831209 20495 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:52.832931 20394 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.860240 17397 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:52.863785 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:52.870126 20589 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260709 13:18:52.866501 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:52.872964 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:52.867183 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.873512 17321 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.869587 20394 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.863806 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:52.873926 17395 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:52.867532 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:52.877736 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.879599 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.879952 17320 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 5.
I20260709 13:18:52.880291 17317 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:18:52.859673 20509 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:52.882887 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:52.865492 20468 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.883882 20448 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:52.904057 17314 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:52.892190 17395 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:52.905190 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:52.887431 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.901816 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.914359 17315 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:52.914350 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.915796 17994 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:52.887884 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.890560 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:52.918143 17320 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:52.889012 20257 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:52.919862 20257 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:52.920986 20495 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:52.920782 20257 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.922411 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.890231 20509 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.921530 19877 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:52.889375 20609 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:18:52.882845 20270 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:52.923063 17990 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:52.884402 17214 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 3 to 5, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 5 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:52.893455 20597 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:52.932773 17994 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:52.887665 20611 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:52.961928 20611 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:52.962524 20611 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.935672 20582 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:52.935977 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:52.936136 17993 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:52.889147 20506 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:52.887214 20581 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:52.937604 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:52.935712 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:52.921401 20495 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:52.941285 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:52.965044 20516 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:52.975346 20495 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.975543 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:52.976565 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:52.977044 20289 consensus_meta.cc:287] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.010s	user 0.002s	sys 0.010s
I20260709 13:18:52.977633 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:52.977808 20614 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:52.941946 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:52.942205 20609 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:52.978463 19877 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:52.978792 20609 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:52.978911 19877 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.979187 20596 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:52.979355 19877 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.979835 20596 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:52.979773 20609 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.941267 20509 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:52.968680 20270 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.980958 20596 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.970798 20506 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:52.983218 20270 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:52.983886 20506 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:52.882846 20577 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:52.949476 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 59008.7us
W20260709 13:18:52.952718 20557 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:18:52.955305 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:52.967795 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:52.902693 20280 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:52.896879 20474 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:52.970717 17997 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:52.970834 20233 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.977504 20289 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:52.975575 20516 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:52.898262 20396 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:52.988387 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:52.987991 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:52.985463 20609 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.984889 20506 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.051298 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:52.985400 20614 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:52.993214 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:53.027841 20525 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.014153 17318 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:53.012149 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:53.058775 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2658) took 1759 ms. Trace:
I20260709 13:18:53.006325 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1511) took 1008 ms. Trace:
I20260709 13:18:53.059641 17466 rpcz_store.cc:276] 0709 13:18:51.998000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.298267 (+300267us) service_pool.cc:224] Handling call
0709 13:18:52.298460 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.660823 (+362363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.006046 (+345223us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b5400161f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:53.006258 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827239168}
I20260709 13:18:53.010555 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1519) took 1010 ms. Trace:
W20260709 13:18:52.389742 20137 consensus_queue.cc:1175] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7241e45fbfca4b46b6df9be8cebcd863" responder_term: 8 status { last_received { term: 6 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:52.972023 20582 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:18:52.988734 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.989914 20439 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.993361 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:52.978873 17315 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:53.017555 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 82443.6us
I20260709 13:18:52.974983 17321 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:53.030656 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:53.048018 17322 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:53.048537 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:53.058100 20614 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:53.078353 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 85055.1us
I20260709 13:18:53.079110 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:53.048754 17317 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:53.052502 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:53.054316 17462 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:52.977538 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:53.054203 17395 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:53.061656 17470 rpcz_store.cc:276] 0709 13:18:52.000257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.287684 (+287427us) service_pool.cc:224] Handling call
0709 13:18:53.010356 (+722672us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54002e2f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:53.010493 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915174656}
I20260709 13:18:53.062407 17469 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:53.053725 17214 catalog_manager.cc:5697] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:18:53.059211 17392 rpcz_store.cc:276] 0709 13:18:51.299488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.441766 (+142278us) service_pool.cc:224] Handling call
0709 13:18:52.361470 (+919704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.391405 (+ 29935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.058576 (+667171us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54004132d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:53.058720 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114338560}
I20260709 13:18:53.044576 20516 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.064347 17466 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:53.068614 17318 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:53.103269 17395 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:53.055284 20279 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10.
I20260709 13:18:53.102633 17396 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:18:53.080811 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 103377us
I20260709 13:18:53.104826 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:53.106914 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:53.107362 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:53.108285 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:53.108955 17322 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:53.104387 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:53.110328 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:53.111281 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:53.113206 17214 catalog_manager.cc:5697] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:18:53.104326 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:53.071053 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:53.120899 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:53.122376 17317 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:53.070065 20582 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.128083 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:53.128880 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:53.103338 20231 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:53.142204 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 71241us
I20260709 13:18:53.143772 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:53.144721 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:53.147598 17287 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:53.105446 20509 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:53.151924 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:53.105683 20550 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:53.118162 20258 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:53.153540 17395 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:53.165746 17395 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.118343 20173 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:53.156095 17214 catalog_manager.cc:5697] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:18:53.167589 17318 raft_consensus.cc:2410] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:18:53.169449 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 139813us
I20260709 13:18:53.178507 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:53.142894 20231 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.081046 20439 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:53.145622 20607 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:53.184651 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56372.5us
W20260709 13:18:53.180250 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 110170us
W20260709 13:18:53.181502 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.066604 20495 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:53.182876 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:53.081894 20394 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:53.081351 20525 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:53.154237 20509 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.134003 19558 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:18:53.173586 20173 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:53.208995 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 61395.6us
I20260709 13:18:53.195626 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:53.163856 17317 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
W20260709 13:18:53.221554 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.224295 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:53.186600 20231 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.183979 20596 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:18:53.152456 20523 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:18:53.193907 20607 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:53.172664 20550 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:53.213820 20509 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.254685 20173 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.287276 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:53.287463 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 91955us
I20260709 13:18:53.295084 17395 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:53.308276 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.339816 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 196077us
I20260709 13:18:53.341296 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1518) took 1341 ms. Trace:
I20260709 13:18:53.341404 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:53.343577 17394 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:53.342309 17397 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:53.351254 17995 raft_consensus.cc:1217] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Deduplicated request from leader. Original: 3.6->[4.7-6.8]   Dedup: 4.7->[6.8-6.8]
I20260709 13:18:53.352134 17995 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:18:53.353952 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:53.348114 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62424.7us
I20260709 13:18:53.341792 17469 rpcz_store.cc:276] 0709 13:18:51.999977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.307873 (+307896us) service_pool.cc:224] Handling call
0709 13:18:52.312360 (+  4487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.112369 (+800009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.340964 (+228595us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54004204d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:53.341205 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715131136}
W20260709 13:18:53.356635 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 100578us
I20260709 13:18:53.358265 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:53.273912 20287 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.269479 20607 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:53.365615 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.376041 20600 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:53.377278 20622 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:18:53.338524 20596 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.393188 20626 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:53.393792 20626 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:53.394021 20442 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:53.395893 20617 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:18:53.395972 20623 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.396688 20623 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:53.398047 20619 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:18:53.399763 20615 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:18:53.402235 20507 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:53.410612 20624 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:53.411140 20624 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:53.411550 20624 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.413439 20600 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:53.414542 20600 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:53.417098 20287 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:53.418123 20623 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:53.413597 20628 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:53.343029 19877 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:53.422183 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:53.559013 17962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.004s	sys 0.003s
W20260709 13:18:53.584477 17962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.004s	sys 0.003s
I20260709 13:18:53.534999 17996 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:53.441262 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:53.509125 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 220457us
I20260709 13:18:53.370595 20386 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:53.521572 17321 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:53.564329 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:53.362936 20289 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:53.597457 17388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.001s	sys 0.006s
I20260709 13:18:53.527347 17315 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
W20260709 13:18:53.604636 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 182565us
I20260709 13:18:53.581986 20394 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:53.393795 20618 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 13:18:53.382861 20601 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.607247 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:53.394780 20626 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:53.607609 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 249423us
W20260709 13:18:54.008630 17388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.011s	sys 0.007s
I20260709 13:18:53.963425 20627 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.010457 20627 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.011057 17962 leader_election.cc:400] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7.
I20260709 13:18:54.012279 20637 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:53.746932 17288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.000s	sys 0.012s
W20260709 13:18:54.013621 17288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.000s	sys 0.019s
W20260709 13:18:54.014213 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.607677 17994 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:18:53.998404 20634 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:18:53.799312 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.002s	sys 0.011s
W20260709 13:18:54.018354 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.005s	sys 0.013s
I20260709 13:18:53.568800 20439 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.020260 17998 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:53.535526 20596 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.023376 17992 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:53.603870 17990 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:53.600288 20258 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:54.014314 20582 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.000s
I20260709 13:18:53.829049 17999 raft_consensus.cc:2368] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
W20260709 13:18:53.880889 17396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.026s
W20260709 13:18:54.028010 17396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.003s	sys 0.034s
I20260709 13:18:54.031698 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:54.019097 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 840601us
I20260709 13:18:53.567548 20525 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:54.027738 20607 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.000s
I20260709 13:18:54.036825 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:54.009243 20506 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.955s	user 0.011s	sys 0.001s
I20260709 13:18:54.037688 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 877) took 1497 ms. Trace:
W20260709 13:18:53.746546 20257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.005s	sys 0.018s
I20260709 13:18:54.115841 17992 rpcz_store.cc:276] 0709 13:18:52.530161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.530531 (+   370us) service_pool.cc:224] Handling call
0709 13:18:54.022993 (+1492462us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:54.023196 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.027356 (+  4160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.027571 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45549440}
W20260709 13:18:54.023420 20516 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.000s
I20260709 13:18:54.040426 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:53.601984 20386 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:54.140739 17392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.017s	sys 0.052s
W20260709 13:18:53.664256 20608 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.822s	user 0.000s	sys 0.009s
W20260709 13:18:53.652501 20625 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:18:54.144151 17214 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.020s	sys 0.042s
W20260709 13:18:54.144544 17214 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.020s	sys 0.042s
I20260709 13:18:54.036832 20627 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:53.650218 20614 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 13:18:54.035981 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1351) took 1159 ms. Trace:
I20260709 13:18:54.107402 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:53.651396 20629 raft_consensus.cc:2764] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:53.683540 20507 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:54.126896 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 537796us
I20260709 13:18:53.657526 20550 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.039949 20394 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:54.130240 20596 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:54.129021 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 88671.7us
I20260709 13:18:54.169163 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:54.129667 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 88558.9us
W20260709 13:18:54.129901 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 93157.6us
W20260709 13:18:54.141268 17392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.017s	sys 0.052s
W20260709 13:18:54.117435 20257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.006s	sys 0.036s
W20260709 13:18:54.143215 17362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.010s
W20260709 13:18:54.172281 17362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.000s	sys 0.010s
W20260709 13:18:54.171732 17361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.024s	sys 0.071s
W20260709 13:18:54.173383 17361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.025s	sys 0.071s
W20260709 13:18:54.036705 20231 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.764s	user 0.001s	sys 0.015s
I20260709 13:18:54.151693 17315 rpcz_store.cc:276] 0709 13:18:52.849563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.941698 (+ 92135us) service_pool.cc:224] Handling call
0709 13:18:54.008507 (+1066809us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.174507 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:54.164763 20628 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:54.178344 20628 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.167626 20627 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.181290 20627 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.181891 20219 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.183053 20219 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:54.185186 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:53.578864 20495 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.038393 20582 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.129357 19877 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.130087 20506 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:54.142858 20525 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:53.798341 20611 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.835s	user 0.008s	sys 0.005s
I20260709 13:18:54.123456 20607 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.186084 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:54.180666 20628 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.154361 20608 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.129743 20516 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.196785 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:54.196943 20506 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.201925 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:54.202783 20640 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.203213 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:54.199666 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:54.205032 17998 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:18:54.184990 20629 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:54.204641 17360 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:54.196614 20394 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.209506 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:54.205650 17998 pending_rounds.cc:85] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 6
I20260709 13:18:54.245234 17998 pending_rounds.cc:107] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:54.245594 17998 raft_consensus.cc:2889] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:54.214176 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 555) took 1146 ms. Trace:
I20260709 13:18:54.247020 17318 rpcz_store.cc:276] 0709 13:18:53.067880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.103832 (+ 35952us) service_pool.cc:224] Handling call
0709 13:18:54.213961 (+1110129us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b5400274a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:54.214115 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108293504}
I20260709 13:18:54.193758 20257 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:54.242825 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 81036.4us
I20260709 13:18:54.221843 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:54.162791 20614 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.245009 17992 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:54.253830 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2614) took 1266 ms. Trace:
I20260709 13:18:54.255482 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:54.254274 17467 rpcz_store.cc:276] 0709 13:18:52.987015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.017314 (+ 30299us) service_pool.cc:224] Handling call
0709 13:18:53.030292 (+ 12978us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:53.045203 (+ 14911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.045236 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:53.045820 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 13:18:53.184141 (+138321us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:53.184181 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.184248 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.253591 (+1069343us) raft_consensus.cc:1685] finished
0709 13:18:54.253611 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.253754 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1425,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5944,"thread_start_us":101460,"threads_started":1,"wal-append.queue_time_us":280159}
W20260709 13:18:54.255659 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 52522.2us
I20260709 13:18:54.256053 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:54.256613 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:54.256829 17315 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:54.206270 20495 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:54.256132 17318 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:54.187992 20231 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:54.257679 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 54608.2us
I20260709 13:18:54.258455 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:54.259120 17313 raft_consensus.cc:2410] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:54.174316 20258 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.263748 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:54.248507 20173 consensus_meta.cc:287] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.905s	user 0.012s	sys 0.000s
I20260709 13:18:54.248770 20608 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:54.210983 20644 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:54.250192 20394 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:54.208652 20632 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.249737 20525 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:54.277866 17962 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.294384 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:54.279072 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.270591 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.257648 20506 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.196554 20642 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:18:54.257617 20563 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.291121 17435 leader_election.cc:400] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:54.292230 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:54.311821 17321 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:54.266571 20645 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.293069 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:54.313090 17318 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
W20260709 13:18:54.272181 20609 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.215s	user 0.011s	sys 0.002s
I20260709 13:18:54.299252 17317 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:54.299391 17434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.570s (SENT) [suppressed 44 similar messages]
I20260709 13:18:54.282214 17315 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:54.300486 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:54.196554 20611 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.303144 17313 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:54.303790 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:54.321507 17319 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.305976 17962 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.272431 20628 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.290112 19877 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.318480 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:54.286514 20654 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.293519 20394 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:54.334046 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 55077.3us
I20260709 13:18:54.334604 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:54.340633 17315 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 5: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:54.308874 20507 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.337106 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:54.244997 20629 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.335721 17319 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:54.311312 20652 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:54.339926 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49038.1us
I20260709 13:18:54.342406 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:54.345392 17467 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:54.341807 17390 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:54.279062 20173 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.352154 17321 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:54.384233 17315 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:54.337124 20640 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:54.385290 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 66888us
W20260709 13:18:54.386422 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.388579 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:54.388501 17962 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:54.351481 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:54.389580 17992 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:54.339118 20628 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.394171 20628 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.261960 20386 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.341043 20582 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:54.384925 20649 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.413751 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 114398us
W20260709 13:18:54.414742 17434 leader_election.cc:336] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.610s (SENT)
I20260709 13:18:54.415244 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:54.423770 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:54.347414 20657 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:54.310758 20563 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.418123 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:54.431983 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:54.433471 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:54.338519 20648 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:18:54.422685 20289 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:54.417804 20645 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.421391 20644 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:54.462944 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 111542us
I20260709 13:18:54.417513 20652 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:54.429164 20582 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:54.478526 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 51008.1us
I20260709 13:18:54.478816 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.479748 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:18:54.440968 20509 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.086s	user 0.007s	sys 0.006s
I20260709 13:18:54.426131 20608 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:54.492579 20509 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.493266 20608 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.481541 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:54.481915 20644 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.482759 20173 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.463208 20663 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:54.503648 17467 raft_consensus.cc:2410] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:18:54.484688 20646 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:18:54.489837 20645 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.490578 20658 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.491902 20611 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.493854 17360 leader_election.cc:400] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:18:54.471422 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:54.515918 17315 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:54.465191 20506 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.505601 20663 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:54.505949 20231 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.421290 20649 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.469368 20516 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.470577 20607 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.519944 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:54.528473 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:54.572270 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 223456us
W20260709 13:18:54.570118 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 227758us
I20260709 13:18:54.496747 20257 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:54.494830 20228 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:54.529145 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.518097 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:54.562539 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:54.510447 20582 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.583540 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:54.583714 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 134718us
I20260709 13:18:54.568037 20550 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.587466 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:54.590955 17315 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.567415 20614 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:54.593950 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 123678us
W20260709 13:18:54.586760 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 283879us
I20260709 13:18:54.588300 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:54.494830 20652 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.578053 20257 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:54.578194 20228 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.579270 20629 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:54.615239 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 226800us
I20260709 13:18:54.615635 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:54.627223 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 116419us
I20260709 13:18:54.550094 20506 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.589031 20509 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.592231 20578 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:54.629871 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:54.630051 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:54.592768 20648 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:54.597831 20219 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:54.597373 20642 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:54.637827 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.632283 17992 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:54.641360 20664 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.642287 20648 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:54.651643 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.628796 20563 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.631403 20257 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.631420 20228 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.657781 17315 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:18:54.655086 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:54.631342 20661 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.639271 20578 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:54.677017 20373 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.677556 20578 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.678453 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 560) took 1559 ms. Trace:
I20260709 13:18:54.678764 20578 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.678861 17322 rpcz_store.cc:276] 0709 13:18:53.119128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.119230 (+   102us) service_pool.cc:224] Handling call
0709 13:18:53.119530 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.144090 (+ 24560us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:54.202783 (+1058693us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b1800442f00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf 00007f7d6280e038
0709 13:18:54.313732 (+110949us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.529701 (+215969us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.565002 (+ 35301us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.565205 (+   203us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:54.565509 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.565726 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.565826 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.678209 (+112383us) raft_consensus.cc:1685] finished
0709 13:18:54.678232 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.678371 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7252,"prepare.queue_time_us":1108019,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":28721,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":25141,"spinlock_wait_cycles":34702464,"thread_start_us":288392,"threads_started":2,"wal-append.queue_time_us":307628}
I20260709 13:18:54.662575 20219 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:54.684227 20624 consensus_meta.cc:287] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.272s	user 0.008s	sys 0.005s
I20260709 13:18:54.683833 20394 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.685741 20649 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:54.645221 20031 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:54.686641 20031 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.687685 20652 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.613348 20550 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.649681 20516 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:54.667502 20648 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.653627 20668 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:18:54.670751 20629 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:18:54.671339 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 65228.1us
I20260709 13:18:54.674067 20614 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:54.700932 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 286190us
I20260709 13:18:54.702117 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:54.702445 17322 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:54.703683 17285 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:54.704628 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:54.691205 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:54.703685 20661 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.708177 17435 leader_election.cc:400] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:54.708525 17435 leader_election.cc:403] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:54.709977 20661 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.705750 17315 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:54.705502 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:54.715823 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2600) took 2320 ms. Trace:
W20260709 13:18:54.715075 17434 connection.cc:256] RPC call timeout handler was delayed by -1.4256830159999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:18:54.717799 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:54.718519 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:54.719714 17321 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.716238 17464 rpcz_store.cc:276] 0709 13:18:52.395582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.395813 (+   231us) service_pool.cc:224] Handling call
0709 13:18:52.587341 (+191528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.587877 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.713560 (+2125683us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b5400200b50. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:54.715754 (+  2194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439746304}
I20260709 13:18:54.689157 20394 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.688769 20031 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.748732 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:54.749466 20665 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:54.714171 20516 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:54.749979 20665 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.750458 20665 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:54.750926 20516 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.751559 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:54.752321 17991 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:54.753053 20231 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:54.754287 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 48893.8us
I20260709 13:18:54.754439 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:54.755005 20396 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:54.755435 20396 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:54.755477 20671 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:54.718595 17322 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:54.755923 20396 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:54.758922 17322 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:54.757265 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49269.3us
I20260709 13:18:54.759325 17315 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:54.762404 17992 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
W20260709 13:18:54.762833 17434 leader_election.cc:336] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.781s (SENT)
I20260709 13:18:54.763350 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.763373 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:54.760089 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:54.773378 17321 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:54.756894 20394 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:54.716737 20507 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.768887 20582 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:54.774066 20627 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.710561 20506 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.782747 17285 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:54.717041 20637 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:54.786948 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.756865 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:54.795943 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.715262 20289 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:54.763782 20649 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:54.808655 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:54.653514 20642 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.711369 20614 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.714196 20629 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.807392 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:54.782169 20652 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:54.793489 20668 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:54.684754 20624 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.756696 20228 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.809227 17999 raft_consensus.cc:2376] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6. Re-sending same reply.
I20260709 13:18:54.788126 20394 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:54.721096 20648 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:18:54.688984 20257 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.847455 20677 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:54.847666 20550 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.848055 20677 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.847810 20648 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:54.849115 20648 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:54.849905 20648 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.851186 20648 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.851315 20677 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.765583 20219 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:54.785429 20137 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:54.852042 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:54.852386 20137 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.816932 20640 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:54.854591 20137 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.816697 17396 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:54.814602 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:54.856300 17997 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:54.856997 19574 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.857719 19574 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.860059 19574 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.817250 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:54.816993 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:54.857933 20219 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.861158 17391 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.861377 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:54.862079 19574 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.826118 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1583) took 2380 ms. Trace:
I20260709 13:18:54.863209 20219 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.805286 20627 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.801945 20637 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:54.834817 20614 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.799554 20278 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:18:54.836373 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:54.836794 17395 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:54.838641 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:54.809183 20506 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:54.842852 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:54.862694 17388 rpcz_store.cc:276] 0709 13:18:52.446036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.450569 (+  4533us) service_pool.cc:224] Handling call
0709 13:18:52.450905 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:52.451327 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.451356 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:52.483714 (+ 32358us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.025294 (+541580us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b18004460e0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:18:54.009695 (+984401us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:54.198852 (+189157us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.203969 (+  5117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.204061 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.758868 (+554807us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b18004460e0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:18:54.825788 (+ 66920us) raft_consensus.cc:1685] finished
0709 13:18:54.825824 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.826005 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4820,"prepare.queue_time_us":235866,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":9864,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":19790,"spinlock_wait_cycles":137189248,"thread_start_us":1172676,"threads_started":2,"wal-append.queue_time_us":1720400}
I20260709 13:18:54.837604 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:54.857172 17396 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:54.861075 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 43892.6us
I20260709 13:18:54.818310 20676 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:54.818718 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 55912.1us
I20260709 13:18:54.856626 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:54.883586 17434 connection.cc:256] RPC call timeout handler was delayed by -1.2483830159999343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
I20260709 13:18:54.819167 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:54.818545 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:54.884002 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.870740 17997 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:54.873308 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:54.873917 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:54.875445 17391 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
W20260709 13:18:54.875880 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 65787.3us
I20260709 13:18:54.885036 17463 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:54.876098 20637 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.830287 20642 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:54.884057 17434 connection.cc:256] RPC call timeout handler was delayed by -1.1154509339999095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
I20260709 13:18:54.885063 17468 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:54.835665 20668 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:54.876482 20627 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.885607 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:54.872110 20624 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:54.933007 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:54.934023 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2689) took 1947 ms. Trace:
I20260709 13:18:54.934448 17390 rpcz_store.cc:276] 0709 13:18:52.986593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.986749 (+   156us) service_pool.cc:224] Handling call
0709 13:18:52.987081 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.389551 (+1402470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.933777 (+544226us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400254254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:54.933959 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3115200768}
I20260709 13:18:54.892346 20506 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:54.891718 20531 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:54.944008 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58541.6us
I20260709 13:18:54.943104 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:54.943248 20582 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:18:54.943507 20506 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.942853 20531 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:54.952198 20278 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.958315 17388 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:54.958154 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:54.958952 17991 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:54.943009 19877 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:54.959430 19877 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:54.953603 20531 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:54.960255 19877 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:54.961344 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 548) took 2506 ms. Trace:
I20260709 13:18:54.961585 19877 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.961925 17314 rpcz_store.cc:276] 0709 13:18:52.455035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.455728 (+   693us) service_pool.cc:224] Handling call
0709 13:18:52.903874 (+448146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.904463 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.961079 (+2056616us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400212850. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:54.961248 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988632448}
I20260709 13:18:54.965215 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:54.976958 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:54.970011 17464 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:54.982722 17464 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:54.924706 20649 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.986425 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:54.991012 17464 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.991089 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:54.887956 20640 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:54.991999 17463 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.994021 17466 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:18:54.891094 20668 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.998486 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:54.999821 17467 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:55.001003 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:55.001660 17467 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.936544 20219 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.946106 20676 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:55.008467 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.009694 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:55.010491 17319 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.891294 20626 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:54.966719 20627 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:54.968326 20578 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:55.030818 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:54.882023 20657 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:18:55.034771 17467 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:55.037357 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:54.883311 20396 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.031773 17319 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
W20260709 13:18:55.054831 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.977181 20624 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:18:55.104444 17962 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:55.105818 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.042146 20676 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.030191 20219 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:55.082633 20683 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:18:55.083065 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.117911 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.083221 20228 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.007246 20649 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.085256 20550 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.015426 20640 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.105666 17464 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:55.128566 17471 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.937345 20289 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.125742 17999 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:55.131783 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.128507 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:55.029175 20257 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.136722 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:55.137552 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.138758 20396 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:55.138895 20649 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:55.139456 17465 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.139988 20629 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.146170 20676 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:55.148203 20219 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:55.149118 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:55.150640 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.152316 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.201256 17467 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:55.202360 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.203610 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.204234 17467 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:55.153334 20228 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:55.155193 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:55.200752 17466 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:55.156193 17388 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:55.166994 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.206398 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:55.206928 17466 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.160667 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:55.165761 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:55.171011 17471 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:55.173794 17390 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:18:55.197897 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.208699 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.209303 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.209865 17464 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 6: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:55.160452 17393 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:18:55.210191 17393 pending_rounds.cc:85] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 3
I20260709 13:18:55.210345 17393 pending_rounds.cc:107] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:18:55.210480 17393 raft_consensus.cc:2889] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:55.214061 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:55.221372 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.219806 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:18:55.221403 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 278356us
I20260709 13:18:55.223182 17434 leader_election.cc:400] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:55.223480 17434 leader_election.cc:403] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:55.223865 17396 raft_consensus.cc:2368] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6.
I20260709 13:18:55.223711 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:55.092660 20665 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.225507 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:55.195199 20600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.625s	user 0.023s	sys 0.080s
I20260709 13:18:55.226850 17463 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:55.225217 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:55.238983 17999 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.179556 20664 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:55.237071 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:55.239521 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.240350 17388 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:55.240474 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:55.241255 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.242056 17394 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:55.242734 20231 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:55.243712 20373 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:55.244338 20373 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.244704 20373 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:55.241426 20602 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 2.384s	user 0.015s	sys 0.018s
I20260709 13:18:55.247958 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:55.169965 20609 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:18:55.135087 20550 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.213692 20228 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:55.257490 17466 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
W20260709 13:18:55.238540 20600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.668s	user 0.023s	sys 0.081s
I20260709 13:18:55.235311 20525 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:55.233045 20396 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:55.284884 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:55.251147 20219 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:55.261458 20231 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:55.263074 20664 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:55.252822 20565 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:55.275514 20649 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:18:55.321389 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.278752 20396 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.332502 17394 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:55.263428 20637 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.243772 20394 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.325601 20278 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:55.366176 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.331826 20565 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.334735 20396 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.314442 20270 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:18:55.324851 20228 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.398186 20278 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:18:55.409356 17465 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:18:55.376474 20565 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.284041 20676 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.167s
W20260709 13:18:55.448922 20688 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:18:55.438580 20664 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.459403 17388 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:55.461616 20637 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.468909 20270 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.469578 20270 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.471648 20665 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.472122 20270 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.423134 19877 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:55.430061 20629 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:18:55.475095 20386 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.430753 20609 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:18:55.475132 20629 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:55.478731 20629 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:55.479730 20652 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.000s
I20260709 13:18:55.479693 20629 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.480396 20652 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:55.482884 20629 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:55.483244 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1586) took 2276 ms. Trace:
I20260709 13:18:55.489123 20228 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:55.497195 20596 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.497925 20596 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.397523 20394 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:55.521318 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.483610 17392 rpcz_store.cc:276] 0709 13:18:53.206434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.206563 (+   129us) service_pool.cc:224] Handling call
0709 13:18:53.260926 (+ 54363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.623596 (+362670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.623633 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.624227 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.171363 (+547136us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:54.273629 (+102266us) log.cc:844] Serialized 14 byte log entry
0709 13:18:55.482713 (+1209084us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b180044f800. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287
0709 13:18:55.482836 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.482918 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.482974 (+    56us) raft_consensus.cc:1685] finished
0709 13:18:55.483062 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.483191 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34563,"prepare.queue_time_us":74549,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":323939,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":54322,"spinlock_wait_cycles":4060544,"thread_start_us":1041581,"threads_started":4,"wal-append.queue_time_us":618551}
W20260709 13:18:55.526927 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 89533.6us
I20260709 13:18:55.528602 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:55.543953 20473 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:55.545948 20439 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:55.548470 20439 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.549145 20439 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.553376 20648 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:55.555572 20648 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:55.556054 20648 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:18:55.556569 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.567816 17468 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:55.559753 20609 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.473520 19877 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.566211 17397 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:18:55.442260 20531 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:55.576109 20624 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:55.577181 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 881) took 2739 ms. Trace:
I20260709 13:18:55.579551 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.583652 17392 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:55.581341 17995 rpcz_store.cc:276] 0709 13:18:52.837454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.845796 (+  8342us) service_pool.cc:224] Handling call
0709 13:18:52.846111 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:53.352555 (+506444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.576928 (+2224373us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54006d1fd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:55.577119 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161000192}
W20260709 13:18:55.585886 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 57369.6us
I20260709 13:18:55.586576 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:18:55.588115 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 260200us
I20260709 13:18:55.588511 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:55.560696 20648 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.548650 20607 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:55.591804 17999 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:55.606858 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.611440 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:55.600265 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 251244us
I20260709 13:18:55.613845 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.617965 17320 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:55.580221 20531 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:55.620467 17321 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:18:55.621589 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.622728 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:55.587713 20656 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.628530 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.581180 20624 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:55.623378 17314 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:18:55.631554 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:55.595968 20607 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:55.578534 20609 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.607800 20640 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:55.635056 17320 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:55.586856 20596 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.640033 20656 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.665195 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:55.620519 20614 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:55.673519 17397 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:55.674638 20609 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.675279 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.676112 17397 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:55.676589 20640 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:55.677240 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:55.677690 20640 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:55.677930 17992 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:18:55.678313 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.678881 17395 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:55.679499 19877 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.639401 20632 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:18:55.648317 20696 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:18:55.683921 20665 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:55.689623 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.690405 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.691787 17992 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:55.694793 20645 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:55.695386 20645 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:55.695792 20668 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.000s
I20260709 13:18:55.701263 20648 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:55.705175 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.705760 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.696379 20645 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.707531 20645 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.585726 20626 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:55.711151 20626 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.622740 20550 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.653013 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:55.711979 20439 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:55.668494 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:55.658764 20448 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.677875 17397 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.651224 20607 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.712502 17392 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.652606 20624 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.664535 20656 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:55.616622 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:55.732510 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:55.714197 17962 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:55.729974 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 61586.9us
W20260709 13:18:55.815054 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 80177.8us
W20260709 13:18:55.809293 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.769709 17995 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:55.819626 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 458354us
I20260709 13:18:55.696310 20668 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.730301 20640 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:55.846748 20640 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.850723 20640 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:55.730720 20596 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:55.821866 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:55.731112 20614 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:55.763051 20696 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.763163 20632 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:55.762908 20525 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:55.870476 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.753666 20665 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:55.814646 19877 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:55.762804 20439 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:55.763037 20233 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:18:55.839797 20607 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.734786 20448 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.832127 20231 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:55.870441 20624 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.911165 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:55.912202 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.870572 20279 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:18:55.887833 20596 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:55.922030 20596 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.892524 20696 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.907548 20665 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:55.925724 20696 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:55.926348 20696 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:55.926878 20696 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.925890 20665 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.938990 17397 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:55.943082 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:55.943981 17319 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:55.948753 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:18:55.893019 19574 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:55.951514 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:55.951737 17388 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:55.953881 20668 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:55.894981 20525 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:55.957507 20525 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.959453 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.960284 17470 raft_consensus.cc:2410] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:55.961014 20675 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.961628 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.961555 20675 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:55.962321 17466 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:55.962906 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.963548 17463 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:55.964097 20675 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:55.966498 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:55.967119 17467 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
W20260709 13:18:55.968206 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 351648us
I20260709 13:18:55.969740 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:55.972141 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:55.973320 20707 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:55.973511 20699 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.304s	user 0.000s	sys 0.000s
I20260709 13:18:55.975003 20682 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:55.975531 20682 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:55.975683 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.976055 20708 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:55.976466 20682 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:55.977298 20448 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:55.978111 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:55.982805 17434 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:55.983879 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:55.984220 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:55.984525 17992 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.984901 17999 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:55.989066 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:55.991421 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 402939us
I20260709 13:18:55.992566 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:55.999965 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.016603 17992 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:55.929699 20626 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:56.031378 17360 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:56.002382 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:56.064679 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.064990 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62761.9us
I20260709 13:18:56.065973 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:18:56.040704 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 218898us
I20260709 13:18:56.068964 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:56.069602 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:56.011031 20656 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:56.072808 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:18:56.074563 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 91912.4us
I20260709 13:18:55.903944 20632 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:56.063813 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 107914us
I20260709 13:18:55.990620 20708 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:56.021168 20495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.714s	user 0.011s	sys 0.013s
W20260709 13:18:56.075726 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 44433.1us
I20260709 13:18:56.021241 20278 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:56.026952 20439 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:56.089936 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:56.099571 17360 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:56.101006 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:56.073607 20695 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:56.079775 20609 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:56.108345 17396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.007s	sys 0.030s
W20260709 13:18:56.141976 17396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.007s	sys 0.031s
W20260709 13:18:56.142437 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53583.7us
W20260709 13:18:56.108935 20684 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:18:56.089072 20495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.799s	user 0.012s	sys 0.013s
W20260709 13:18:56.107329 17469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.024s	sys 0.043s
I20260709 13:18:56.087781 20696 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:56.145454 17361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.066s	sys 0.093s
I20260709 13:18:56.146247 17360 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:56.100286 20626 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:56.162511 17998 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.008s	sys 0.042s
W20260709 13:18:56.163429 17469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.026s	sys 0.044s
I20260709 13:18:56.091333 20386 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:56.165064 17361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.067s	sys 0.093s
W20260709 13:18:56.135346 20228 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.645s	user 0.013s	sys 0.000s
W20260709 13:18:56.166510 17998 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.009s	sys 0.042s
I20260709 13:18:56.171145 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:56.143309 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:56.134735 20695 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:18:56.171830 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.105154 20706 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:56.204238 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56426.3us
I20260709 13:18:56.138446 19877 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:56.248359 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 105164us
I20260709 13:18:56.249261 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:56.250595 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:56.086719 20692 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:56.142118 20649 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:56.094766 20278 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:56.133173 20656 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:56.059118 20614 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:56.167868 20637 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.099359 20668 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:18:56.167166 20626 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:56.141812 20609 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.167618 20495 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:56.169023 20386 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.284492 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:18:56.093950 20231 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.210327 20695 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:56.125190 20708 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 13:18:56.282217 20448 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:56.300503 20373 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.055s	user 0.008s	sys 0.007s
I20260709 13:18:56.256767 20696 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.261029 20506 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:56.299593 20629 consensus_meta.cc:287] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.816s	user 0.008s	sys 0.008s
I20260709 13:18:56.266760 20692 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.328298 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:56.386051 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 57818.8us
I20260709 13:18:56.391714 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:56.349370 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 96895.3us
W20260709 13:18:56.329743 17392 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.000s
I20260709 13:18:56.294170 20639 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:56.306237 20656 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:56.323422 20394 consensus_meta.cc:287] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.788s	user 0.003s	sys 0.007s
I20260709 13:18:56.393234 17392 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
W20260709 13:18:56.338351 20396 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.935s	user 0.006s	sys 0.006s
W20260709 13:18:56.396322 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.305166 20719 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:56.409878 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.327023 20626 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:56.330159 20609 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:56.330453 20645 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.003s
I20260709 13:18:56.259123 20706 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:56.398975 17394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.005s	sys 0.017s
W20260709 13:18:56.422948 17394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.006s	sys 0.017s
I20260709 13:18:56.394138 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:56.423843 17388 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:56.408744 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:56.396941 17390 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:56.316766 20607 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.330325 20386 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.305833 20717 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:18:56.399817 20639 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:56.481725 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.485337 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:56.523388 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2695) took 1036 ms. Trace:
I20260709 13:18:56.397862 20692 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:56.486160 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.401964 20279 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:56.407424 20473 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.267838 20439 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:56.547500 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 61047.1us
I20260709 13:18:56.548435 17287 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:56.422294 20719 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:18:56.424715 20648 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.723s	user 0.004s	sys 0.008s
I20260709 13:18:56.486826 19574 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.340299 20637 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.385890 20373 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.524181 17392 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:56.422492 20725 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:56.484732 20563 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:56.544576 20376 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:56.398388 20696 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.487754 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1604) took 1130 ms. Trace:
W20260709 13:18:56.588778 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.523818 20394 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.414484 20396 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:56.546640 20691 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:18:56.523568 19877 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:56.552918 20525 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.003s
I20260709 13:18:56.520092 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:56.546446 20639 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:56.628890 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 80549.4us
W20260709 13:18:56.630596 17997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.007s	sys 0.018s
I20260709 13:18:56.627558 17394 rpcz_store.cc:276] 0709 13:18:55.357788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.368429 (+ 10641us) service_pool.cc:224] Handling call
0709 13:18:55.396972 (+ 28543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.397269 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:55.732977 (+335708us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.487341 (+754364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.487409 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:56.487471 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.487538 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.487682 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63744,"prepare.queue_time_us":506199,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":1996,"raft.queue_time_us":66870,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":27598,"thread_start_us":998046,"threads_started":2}
I20260709 13:18:56.635363 17317 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:56.622282 20565 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.098s	user 0.011s	sys 0.002s
W20260709 13:18:56.625207 17964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.016s
I20260709 13:18:56.625447 20563 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:56.649643 17964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.009s	sys 0.017s
W20260709 13:18:56.650177 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.627442 17389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.007s	sys 0.017s
W20260709 13:18:56.636106 17434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.001s	sys 0.024s
I20260709 13:18:56.640192 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:56.651492 17389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.008s	sys 0.017s
I20260709 13:18:56.572538 20632 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:56.414932 20278 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:56.642940 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 155841us
W20260709 13:18:56.645949 17997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.007s	sys 0.018s
I20260709 13:18:56.636610 20648 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:56.652963 17434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.001s	sys 0.024s
W20260709 13:18:56.666320 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 590604us
I20260709 13:18:56.658296 20563 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.690333 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:56.491576 20495 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:56.649246 19574 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:56.644102 20665 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:56.714540 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.037s	sys 0.086s
W20260709 13:18:56.716012 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.037s	sys 0.086s
W20260709 13:18:56.717367 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 647808us
I20260709 13:18:56.718675 17435 leader_election.cc:400] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6.
I20260709 13:18:56.719102 17435 leader_election.cc:403] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:56.629787 20725 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.638304 20394 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.684090 20648 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.775210 17469 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:56.714283 20233 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.781244 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:56.652179 20525 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.687150 20600 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.667469 20632 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.820740 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2698) took 1332 ms. Trace:
I20260709 13:18:56.821173 17390 rpcz_store.cc:276] 0709 13:18:55.488142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.506826 (+ 18684us) service_pool.cc:224] Handling call
0709 13:18:56.820533 (+1313707us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400012f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:56.820676 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807300608}
W20260709 13:18:56.742273 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.017s	sys 0.028s
W20260709 13:18:56.742506 17962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.000s	sys 0.024s
W20260709 13:18:56.822386 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.017s	sys 0.029s
W20260709 13:18:56.822479 17962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.001s	sys 0.025s
W20260709 13:18:56.822889 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 877375us
W20260709 13:18:56.822990 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 651890us
W20260709 13:18:56.824469 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.686508 20506 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.844125 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:56.844338 17996 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:18:56.746287 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:56.845002 17991 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:56.845323 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:56.846107 17997 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:56.846058 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:56.750298 17465 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:56.846926 17998 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:56.842818 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:56.847661 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:56.848382 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:56.750561 20720 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:18:56.723654 20665 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.849633 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:56.850230 17997 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:56.850056 20531 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.851023 20665 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:56.751627 20664 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:56.851796 20664 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:56.852676 17991 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: [6.6-9.7]
I20260709 13:18:56.852722 20664 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.754606 20675 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:56.756234 20715 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:18:56.760231 20376 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:56.855629 20376 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.856361 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2696) took 1368 ms. Trace:
I20260709 13:18:56.857473 17993 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:56.856772 17396 rpcz_store.cc:276] 0709 13:18:55.487559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.493564 (+  6005us) service_pool.cc:224] Handling call
0709 13:18:55.493895 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.494248 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.494273 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.494772 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.142735 (+647963us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:56.142776 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.142842 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.856162 (+713320us) raft_consensus.cc:1685] finished
0709 13:18:56.856181 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.856303 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10956,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":18507,"thread_start_us":622537,"threads_started":1,"wal-append.queue_time_us":879496}
W20260709 13:18:56.859292 20737 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:18:56.860383 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 576) took 1144 ms. Trace:
I20260709 13:18:56.860916 17996 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:56.860719 17320 rpcz_store.cc:276] 0709 13:18:55.715772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.716743 (+   971us) service_pool.cc:224] Handling call
0709 13:18:55.717176 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.717589 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.717628 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.718196 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.094294 (+376098us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b180035b6c0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:18:56.499900 (+405606us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:56.499952 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.500056 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.860102 (+360046us) raft_consensus.cc:1685] finished
0709 13:18:56.860122 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.860327 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1064,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":12805,"spinlock_wait_cycles":28086528,"thread_start_us":405371,"threads_started":1,"wal-append.queue_time_us":946760}
I20260709 13:18:56.858799 17396 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:18:56.865947 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:56.844694 17390 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.764214 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:56.871071 17392 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:56.873842 17466 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:56.875026 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:56.876264 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:56.877278 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:56.878762 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:56.879897 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:56.729017 19574 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:56.806921 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:56.808247 17462 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:56.884861 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 156995us
W20260709 13:18:56.656018 20624 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.004s
I20260709 13:18:56.659291 20565 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.824394 17360 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:18:56.903810 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 79489.7us
I20260709 13:18:56.775135 20648 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.762679 20682 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.840500 17319 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:56.840632 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:56.841084 17469 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:56.905009 17360 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:56.842391 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:56.730691 20578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.016s	sys 0.023s
I20260709 13:18:56.855120 17991 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:56.775722 20707 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6.
W20260709 13:18:56.882808 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.888720 17466 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:56.928757 17466 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:56.929932 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 265860us
I20260709 13:18:56.651829 20706 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:56.899698 17392 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:56.938910 17392 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:56.939247 17392 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:18:56.716099 20719 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:56.910826 17990 raft_consensus.cc:2368] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:56.907243 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:56.902127 17361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.019s	sys 0.036s
W20260709 13:18:56.894418 20614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.007s	sys 0.035s
I20260709 13:18:56.944113 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:56.944495 20614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.007s	sys 0.036s
I20260709 13:18:56.944926 17990 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:56.945693 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:56.946801 17990 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:56.947692 17469 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:56.948024 17469 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:56.948762 17469 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.949868 17469 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:56.953254 20728 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.302s	user 0.003s	sys 0.000s
I20260709 13:18:56.953085 20031 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:56.954702 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 575) took 1239 ms. Trace:
W20260709 13:18:56.955107 20448 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.001s
W20260709 13:18:56.955804 20726 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:18:56.914654 20596 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.929453 20682 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.959261 20682 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:56.919087 20578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.017s	sys 0.024s
I20260709 13:18:56.918416 20718 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:56.961246 20718 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:56.961738 20718 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:56.962040 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:56.964694 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2715) took 1011 ms. Trace:
I20260709 13:18:56.965090 17388 rpcz_store.cc:276] 0709 13:18:55.952978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.977842 (+ 24864us) service_pool.cc:224] Handling call
0709 13:18:56.964548 (+986706us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54002be154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:56.964641 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023633152}
I20260709 13:18:56.942257 20665 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:18:56.912916 17998 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:56.891577 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:56.968693 20628 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:56.969237 20628 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:18:56.970115 17465 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:18:56.971741 20637 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:56.908994 20289 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:18:56.976526 20729 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:18:56.977020 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2710) took 1350 ms. Trace:
I20260709 13:18:56.976816 20289 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:56.977669 20565 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:56.978758 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2718) took 1024 ms. Trace:
I20260709 13:18:56.978812 20563 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:56.979278 17397 rpcz_store.cc:276] 0709 13:18:55.953925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.990489 (+ 36564us) service_pool.cc:224] Handling call
0709 13:18:56.033257 (+ 42768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.063904 (+ 30647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.063935 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.078142 (+ 14207us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.632103 (+553961us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:56.632149 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.632221 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.978545 (+346324us) raft_consensus.cc:1685] finished
0709 13:18:56.978578 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.978705 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24732,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":4177,"thread_start_us":490962,"threads_started":1,"wal-append.queue_time_us":809494}
I20260709 13:18:56.823488 20600 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:56.982100 20396 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:56.984311 20525 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:56.940016 17392 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.992937 17392 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.935609 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:56.907876 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:56.999349 17470 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.819015 20233 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:56.941982 17996 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:56.929795 17466 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:56.943698 17361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.019s	sys 0.036s
I20260709 13:18:56.977409 17395 rpcz_store.cc:276] 0709 13:18:55.627088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.680577 (+ 53489us) service_pool.cc:224] Handling call
0709 13:18:55.710366 (+ 29789us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:56.201831 (+491465us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:56.268243 (+ 66412us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.743058 (+474815us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:56.743670 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 13:18:56.743825 (+   155us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:56.743857 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.743930 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.976772 (+232842us) raft_consensus.cc:1685] finished
0709 13:18:56.976790 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.976961 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20570,"prepare.queue_time_us":66314,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":217784,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":187,"thread_start_us":880825,"threads_started":2,"wal-append.queue_time_us":621217}
I20260709 13:18:56.955026 17321 rpcz_store.cc:276] 0709 13:18:55.715413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.719121 (+  3708us) service_pool.cc:224] Handling call
0709 13:18:55.763916 (+ 44795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.833165 (+ 69249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.833212 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.833789 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.271931 (+438142us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:56.271983 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.272074 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.868791 (+596717us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:18:56.954438 (+ 85647us) raft_consensus.cc:1685] finished
0709 13:18:56.954458 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.954650 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51157,"raft.queue_time_us":68997,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":12387,"spinlock_wait_cycles":279807232,"thread_start_us":364256,"threads_started":1,"wal-append.queue_time_us":672830}
I20260709 13:18:56.838533 20632 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:57.007570 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 80407.9us
W20260709 13:18:56.999624 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 64107.9us
W20260709 13:18:57.038496 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.005797 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 242342us
I20260709 13:18:57.043047 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:57.070596 17390 raft_consensus.cc:2410] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:57.038518 20228 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:56.955845 20448 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.890944 20506 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.009465 20278 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.074476 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 496) took 1059 ms. Trace:
I20260709 13:18:57.103457 17390 rpcz_store.cc:276] 0709 13:18:56.015396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.843902 (+828506us) service_pool.cc:224] Handling call
0709 13:18:57.074406 (+230504us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:57.088299 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.089267 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 46296.3us
I20260709 13:18:57.038335 20525 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:56.952622 20376 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.101953 17998 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:57.106542 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:57.042399 20373 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:57.108747 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:57.112231 17994 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:57.068998 20563 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:57.116148 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 152450us
I20260709 13:18:57.069124 20665 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:57.122026 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 206415us
I20260709 13:18:57.124315 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:57.127206 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:57.128741 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.128912 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:57.132467 17392 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:18:57.133343 17392 pending_rounds.cc:85] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 7
I20260709 13:18:57.133876 17392 pending_rounds.cc:107] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:57.134222 17392 raft_consensus.cc:2889] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:57.134923 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 497) took 1119 ms. Trace:
I20260709 13:18:57.135143 17469 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:57.135268 17392 rpcz_store.cc:276] 0709 13:18:56.015659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.938511 (+922852us) service_pool.cc:224] Handling call
0709 13:18:56.938800 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.134691 (+195891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.134873 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.136169 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.136868 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:57.138659 17468 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:57.139851 17468 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:57.141129 17468 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:57.146183 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.074507 20656 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.152957 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:57.153972 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 194499us
W20260709 13:18:57.158241 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.104560 20289 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:57.166302 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.160722 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.088042 20637 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:18:57.108675 20629 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:57.106310 20614 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:57.193117 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:57.101410 20228 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.162429 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.159471 20439 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.161461 17463 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:57.153312 20596 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.152432 20624 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:56.970160 20628 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.117036 20696 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:57.207202 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:57.046281 20707 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:18:57.151266 20721 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:18:57.211458 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 73207.4us
I20260709 13:18:57.212476 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:57.254415 17390 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:57.189129 20649 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:57.199810 20289 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:18:57.217370 20614 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:57.225591 20731 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:18:57.227442 20738 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.228025 20730 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.228303 20376 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:57.228577 20749 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:18:57.229378 20743 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.230237 20734 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:57.231513 20736 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:18:57.237181 20632 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:57.156507 20665 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:57.200603 20386 consensus_meta.cc:287] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.651s	user 0.004s	sys 0.013s
I20260709 13:18:57.254797 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:18:57.266625 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.280129 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:57.280599 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:57.165055 20656 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.258667 20725 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:57.207710 20745 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:57.145687 19574 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.288563 17434 leader_election.cc:400] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:18:57.245097 20624 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:57.265513 20649 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.165869 20733 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:18:57.208180 20565 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:18:57.302801 20745 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.310953 20745 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:57.311470 20746 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:18:57.272127 20721 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.304949 17434 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:57.314455 20692 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.001s
I20260709 13:18:57.314894 20692 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.315366 20721 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:57.317202 20763 raft_consensus.cc:2764] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:57.319192 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:57.305137 20707 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:57.319517 20614 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:57.319774 20707 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:57.320487 20767 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:57.217880 20629 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.320773 20707 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.322382 20707 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.323073 20629 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:57.319957 17990 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:57.323618 20733 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:57.294010 20743 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.319574 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:57.325963 20743 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:57.326885 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.327488 17463 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:57.328142 20649 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.328270 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.329212 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:57.329545 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.330191 17471 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:18:57.330428 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.330912 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.331480 17471 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:57.332592 17392 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:57.332677 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:57.243256 20439 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.304092 20600 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:57.355921 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 162909us
I20260709 13:18:57.286227 20394 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:57.332799 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:57.329246 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:57.321460 20233 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:57.309180 20664 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.523864 17393 rpcz_store.cc:276] 0709 13:18:55.487255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.492495 (+  5240us) service_pool.cc:224] Handling call
0709 13:18:55.492820 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.493065 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:55.897742 (+404677us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.486989 (+589247us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.522983 (+ 35994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.523046 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:56.523090 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.523189 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.523327 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90894,"prepare.queue_time_us":507395,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":93,"raft.queue_time_us":136519,"spinlock_wait_cycles":15698432,"thread_start_us":891253,"threads_started":2}
I20260709 13:18:57.342815 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:57.366765 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:57.253453 20596 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.336724 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:57.283304 20648 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.370586 17390 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
W20260709 13:18:57.305006 20754 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:18:57.332093 20624 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:57.362062 20639 consensus_meta.cc:287] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.003s
I20260709 13:18:57.299431 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:57.355679 20725 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.357591 20745 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:57.418990 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 915) took 1496 ms. Trace:
I20260709 13:18:57.293816 20675 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
W20260709 13:18:57.386078 20626 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.960s	user 0.009s	sys 0.003s
W20260709 13:18:57.369354 20695 consensus_meta.cc:287] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.018s	user 0.002s	sys 0.010s
I20260709 13:18:57.362388 20721 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:57.417541 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 80909.7us
I20260709 13:18:57.424731 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:57.427362 17995 rpcz_store.cc:276] 0709 13:18:55.922626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.922775 (+   149us) service_pool.cc:224] Handling call
0709 13:18:55.923129 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.928919 (+  5790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.928962 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.929470 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.385227 (+455757us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:56.385285 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.757793 (+372508us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b5400590454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:56.757861 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.392358 (+634497us) raft_consensus.cc:1685] finished
0709 13:18:57.392392 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.418911 (+ 26519us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27165,"raft.queue_time_us":1088,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10369,"spinlock_wait_cycles":12417920,"thread_start_us":455356,"threads_started":1,"wal-append.queue_time_us":811503}
I20260709 13:18:57.354887 20733 raft_consensus.cc:2764] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:57.360751 20289 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:57.412912 20743 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:18:57.441386 20718 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.390671 20582 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:57.427184 20745 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.444418 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2717) took 1490 ms. Trace:
I20260709 13:18:57.445695 20228 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:57.447554 20665 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:57.385917 20629 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:57.297523 20386 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.483736 17999 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:18:57.499789 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:57.500428 17995 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:18:57.495271 17389 rpcz_store.cc:276] 0709 13:18:55.953672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.977178 (+ 23506us) service_pool.cc:224] Handling call
0709 13:18:55.977649 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.980938 (+  3289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.980986 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.981809 (+   823us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.652001 (+670192us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:56.684498 (+ 32497us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.684740 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.684818 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.444205 (+759387us) raft_consensus.cc:1685] finished
0709 13:18:57.444224 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.444363 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11289,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":9704,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":12785,"thread_start_us":614069,"threads_started":1,"wal-append.queue_time_us":822393}
I20260709 13:18:57.483892 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:57.413678 20614 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:57.486533 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:57.287259 20730 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.425649 20632 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.493541 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:18:57.498970 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.503968 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:57.520388 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:57.497502 20745 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.491242 20607 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:18:57.491616 20582 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:57.421553 20639 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.536280 17389 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:57.505491 20609 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.078s	user 0.009s	sys 0.003s
I20260709 13:18:57.519462 20228 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:57.538129 20770 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:57.538833 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:57.540014 17998 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.495465 20767 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:57.496099 20692 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:57.497794 20763 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:57.501341 19877 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.486954 20626 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.502105 20506 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:57.490100 20721 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.491485 20289 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.487172 20695 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.508579 20629 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.510159 20614 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.613269 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:57.759423 17470 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.747s	user 0.022s	sys 0.002s
W20260709 13:18:57.699968 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 190321us
I20260709 13:18:57.519587 20665 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:57.637308 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:57.759953 17394 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:57.776979 20228 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:57.566401 20640 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.715s	user 0.015s	sys 0.000s
I20260709 13:18:57.820044 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:57.826171 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.818837 17470 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:18:57.687269 20639 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:57.784891 20727 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.060s	user 0.007s	sys 0.007s
I20260709 13:18:57.837764 17396 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:57.839250 17993 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:57.726243 20682 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:57.837021 20632 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.609092 20607 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.822892 20228 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.850891 17992 raft_consensus.cc:2410] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:57.864401 17389 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:57.899300 17320 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:57.681071 20751 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.472s
I20260709 13:18:57.865429 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:18:57.849612 20769 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:18:57.908780 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.613525 20649 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.870265 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.875205 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:57.917042 17393 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
W20260709 13:18:57.835184 20278 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.002s
I20260709 13:18:57.849498 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:57.918088 17390 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.826758 20665 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.903479 17320 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:57.834578 20600 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.904855 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.868429 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.923606 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.906332 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.925340 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.926608 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.927507 17315 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:57.822587 20718 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:57.869241 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.913981 20735 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:57.914281 17466 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.779553 19877 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.773459 20609 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.919449 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.897547 20648 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:57.835726 20767 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.844415 20692 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:18:57.875202 20396 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.921475 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:57.921916 17318 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:57.838726 20763 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.874410 20682 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:57.824851 20582 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:57.928905 17392 pending_rounds.cc:85] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 3
I20260709 13:18:58.209830 20632 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:58.663803 17392 pending_rounds.cc:107] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:58.175096 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1542) took 1046 ms. Trace:
I20260709 13:18:58.664217 17392 raft_consensus.cc:2889] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:58.667958 17464 rpcz_store.cc:276] 0709 13:18:57.128820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.129009 (+   189us) service_pool.cc:224] Handling call
0709 13:18:57.129310 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.129645 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:57.129687 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.130107 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.255620 (+125513us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:57.255674 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.255766 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.174760 (+918994us) raft_consensus.cc:1685] finished
0709 13:18:58.174793 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.175011 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60090,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7749,"thread_start_us":57190,"threads_started":1,"wal-append.queue_time_us":258588}
I20260709 13:18:58.066313 17390 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:58.683142 17316 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:18:58.692754 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2732) took 1548 ms. Trace:
I20260709 13:18:58.695869 17390 rpcz_store.cc:276] 0709 13:18:57.143997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.834616 (+690619us) service_pool.cc:224] Handling call
0709 13:18:58.692678 (+858062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.685405 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2729) took 1542 ms. Trace:
I20260709 13:18:57.902957 20738 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.933202 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:58.100589 17998 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:18:58.689998 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:58.709460 20396 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:58.746599 20396 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:57.907025 20668 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.898487 20706 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:58.747948 20668 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.246517 20640 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:58.749338 20640 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.750413 20668 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:58.751173 20706 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:58.752205 20640 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:58.711285 20695 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:58.664235 20632 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:58.754793 20745 consensus_meta.cc:287] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.145s	user 0.009s	sys 0.001s
I20260709 13:18:58.755380 17318 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:58.755242 20745 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.755961 20632 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:58.757342 17319 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:58.756678 17320 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:58.762475 20396 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:58.763126 20396 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.765148 20396 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:58.762820 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 680) took 1904 ms. Trace:
I20260709 13:18:58.769688 17993 rpcz_store.cc:276] 0709 13:18:56.857987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.858200 (+   213us) service_pool.cc:224] Handling call
0709 13:18:56.858468 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.839821 (+981353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.762589 (+922768us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b5400604854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:58.762765 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254987648}
W20260709 13:18:58.770164 20732 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 2.072s	user 0.000s	sys 0.009s
I20260709 13:18:58.771416 17993 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:58.773455 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:18:58.304767 20624 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.877s	user 0.007s	sys 0.000s
I20260709 13:18:58.794839 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:58.775923 20664 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.371s	user 0.009s	sys 0.000s
W20260709 13:18:58.778539 20779 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.347s	user 0.000s	sys 0.008s
I20260709 13:18:58.780084 17995 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:18:58.796576 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 685) took 1373 ms. Trace:
I20260709 13:18:58.796875 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 499) took 2766 ms. Trace:
I20260709 13:18:58.797122 17995 rpcz_store.cc:276] 0709 13:18:57.422830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.779213 (+1356383us) service_pool.cc:224] Handling call
0709 13:18:58.779698 (+   485us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:58.796214 (+ 16516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.796507 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.798790 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:58.799938 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:58.800915 17319 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:58.801002 17995 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:58.801810 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:58.102344 20439 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:58.802498 17319 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.945788 20600 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:18:58.399096 19574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.016s	sys 0.015s
W20260709 13:18:58.804167 19574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.025s	sys 0.015s
I20260709 13:18:58.805114 20600 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:18:58.208288 20762 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.568s	user 0.000s	sys 0.001s
I20260709 13:18:58.709034 17393 rpcz_store.cc:276] 0709 13:18:57.143022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.917724 (+774702us) service_pool.cc:224] Handling call
0709 13:18:58.684741 (+767017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.684994 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.685031 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.685082 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:58.685125 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.685193 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.685334 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:58.824973 17992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 667) took 1965 ms (client timeout 1570 ms). Trace:
I20260709 13:18:58.784885 20767 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:58.147449 20675 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:58.785830 17313 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:57.928395 20665 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.786773 17390 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:58.836370 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1606) took 1669 ms. Trace:
W20260709 13:18:58.789104 20707 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.466s	user 0.014s	sys 0.000s
I20260709 13:18:58.787639 20738 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.794620 20624 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.797315 17388 rpcz_store.cc:276] 0709 13:18:56.030423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.966035 (+935612us) service_pool.cc:224] Handling call
0709 13:18:56.966338 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.966626 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.966652 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.242381 (+275729us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b2c0005c228. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:18:57.242778 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.481500 (+238722us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:57.481555 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.481653 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.796565 (+1314912us) raft_consensus.cc:1685] finished
0709 13:18:58.796587 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.796780 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6729,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":177015168,"thread_start_us":238304,"threads_started":1,"wal-append.queue_time_us":396295}
I20260709 13:18:58.781075 17315 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.805974 20640 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.847184 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 220656us
I20260709 13:18:58.805225 17316 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:58.077510 20778 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:18:58.053980 20289 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:58.806350 17320 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.806979 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:58.807291 17389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.047s	sys 0.131s
W20260709 13:18:58.854710 17389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.048s	sys 0.131s
I20260709 13:18:58.848300 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:58.855476 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2727) took 1713 ms. Trace:
I20260709 13:18:58.774204 20763 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:58.814667 17466 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:58.822371 17434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.194s	sys 0.278s
W20260709 13:18:58.824226 17314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.009s	sys 0.009s
W20260709 13:18:58.858532 17434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.195s	sys 0.279s
W20260709 13:18:58.825513 17992 rpcz_store.cc:269] 0709 13:18:56.840944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.841088 (+   144us) service_pool.cc:224] Handling call
0709 13:18:58.789937 (+1948849us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54007611d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:58.805773 (+ 15836us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304756608}
W20260709 13:18:58.858641 17314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.009s	sys 0.009s
W20260709 13:18:58.316723 20773 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.358s	user 0.002s	sys 0.000s
W20260709 13:18:58.297173 20715 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
W20260709 13:18:58.485450 20725 consensus_meta.cc:287] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.059s	user 0.007s	sys 0.005s
I20260709 13:18:58.836827 17319 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:58.836759 17390 rpcz_store.cc:276] 0709 13:18:57.166698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.786274 (+1619576us) service_pool.cc:224] Handling call
0709 13:18:58.786602 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.836064 (+ 49462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.836302 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.876564 17390 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:58.877377 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 506) took 1633 ms. Trace:
I20260709 13:18:58.787150 20708 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:58.877971 20723 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 2.306s	user 0.022s	sys 0.005s
I20260709 13:18:58.878264 20708 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:58.836488 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:58.879379 17993 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:58.780654 20706 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:58.207551 20782 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 13:18:58.298664 20614 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:58.278308 20649 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:58.180944 20278 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:58.690198 20607 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:58.802667 17436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.053s	sys 0.167s
I20260709 13:18:58.856087 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:18:58.916266 17436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.053s	sys 0.167s
W20260709 13:18:58.917032 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.855818 17389 rpcz_store.cc:276] 0709 13:18:57.142343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.900498 (+758155us) service_pool.cc:224] Handling call
0709 13:18:57.900808 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.901148 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.901177 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.901639 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.855161 (+953522us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:58.855197 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.855262 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.855301 (+    39us) raft_consensus.cc:1685] finished
0709 13:18:58.855311 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.855428 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":953153,"threads_started":1,"wal-append.queue_time_us":895253}
W20260709 13:18:58.858896 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 1.15602e+06us
I20260709 13:18:58.858673 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 523) took 1989 ms. Trace:
I20260709 13:18:58.859290 17393 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:58.919348 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 63325.8us
I20260709 13:18:58.919693 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1607) took 1752 ms. Trace:
I20260709 13:18:58.920044 17393 rpcz_store.cc:276] 0709 13:18:57.166945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.840896 (+1673951us) service_pool.cc:224] Handling call
0709 13:18:58.856722 (+ 15826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.919437 (+ 62715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.919640 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.918740 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:58.843554 20582 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.873147 17995 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:58.877799 17390 rpcz_store.cc:276] 0709 13:18:57.243960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.875642 (+1631682us) service_pool.cc:224] Handling call
0709 13:18:58.876122 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.877062 (+   940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.877300 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.884061 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1608) took 1716 ms. Trace:
I20260709 13:18:58.853749 20664 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.915244 17315 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:18:58.925859 20289 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:58.883955 20725 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:58.924192 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:58.845531 20675 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:58.925042 17388 rpcz_store.cc:276] 0709 13:18:57.167205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.883021 (+1715816us) service_pool.cc:224] Handling call
0709 13:18:58.883426 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.883646 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.883683 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.883738 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:58.883783 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.883854 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.883991 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.859061 20640 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.918843 17466 rpcz_store.cc:276] 0709 13:18:56.888035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.888227 (+   192us) service_pool.cc:224] Handling call
0709 13:18:56.888582 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.913823 (+1025241us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b58001382d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627500aa 00007f7d627d2447 00007f7d627eafe7 00007f7d627ec7de 00007f7d627f6b49 00007f7d627f7416 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4
0709 13:18:58.858429 (+944606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.858620 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463700864}
I20260709 13:18:58.928304 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 675) took 2077 ms. Trace:
I20260709 13:18:58.922034 20632 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:58.929381 20289 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.934527 17997 rpcz_store.cc:276] 0709 13:18:56.851083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.851192 (+   109us) service_pool.cc:224] Handling call
0709 13:18:56.851481 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.898237 (+ 46756us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:56.898265 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.907542 (+  9277us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.102994 (+195452us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:57.103033 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.103117 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.928075 (+1824958us) raft_consensus.cc:1685] finished
0709 13:18:58.928098 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.928234 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46338,"raft.queue_time_us":46898,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11436,"thread_start_us":117587,"threads_started":1,"wal-append.queue_time_us":545175}
I20260709 13:18:58.937958 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 534) took 1609 ms. Trace:
W20260709 13:18:58.939080 17435 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.029s	sys 0.084s
W20260709 13:18:58.939548 17435 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.029s	sys 0.084s
W20260709 13:18:58.940100 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 826171us
I20260709 13:18:58.939289 17469 rpcz_store.cc:276] 0709 13:18:57.328353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.331295 (+  2942us) service_pool.cc:224] Handling call
0709 13:18:57.331595 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.331945 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.331992 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.332451 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.488681 (+156230us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:57.488734 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.488828 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.937646 (+1448818us) raft_consensus.cc:1685] finished
0709 13:18:58.937678 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.937869 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30138,"raft.queue_time_us":91,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":3970,"thread_start_us":123842,"threads_started":1,"wal-append.queue_time_us":461239}
W20260709 13:18:58.931664 20228 consensus_meta.cc:287] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.016s	user 0.006s	sys 0.006s
I20260709 13:18:58.926107 20787 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.922495 20708 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.945967 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 569) took 3333 ms. Trace:
W20260709 13:18:58.946748 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.946857 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:58.947393 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:58.921065 20278 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.948293 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:58.940738 20289 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.952206 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:58.953177 17992 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:58.950579 17317 rpcz_store.cc:276] 0709 13:18:55.612628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.612852 (+   224us) service_pool.cc:224] Handling call
0709 13:18:55.613216 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.644813 (+1031597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.945751 (+2300938us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540010ca54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:58.945914 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350270848}
I20260709 13:18:58.953234 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:58.954217 17993 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:58.957443 17315 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
W20260709 13:18:58.949082 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.955469 17313 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:18:58.940956 20767 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:58.930279 20664 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.927376 20763 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:18:58.965363 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2725) took 2306 ms. Trace:
I20260709 13:18:58.965658 17397 rpcz_store.cc:276] 0709 13:18:56.659155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.980726 (+321571us) service_pool.cc:224] Handling call
0709 13:18:56.995441 (+ 14715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.079281 (+ 83840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.079313 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.113945 (+ 34632us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.479282 (+365337us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:57.506335 (+ 27053us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.817213 (+310878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.817329 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.960166 (+1142837us) raft_consensus.cc:1685] finished
0709 13:18:58.965231 (+  5065us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.965321 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81910,"prepare.queue_time_us":30631,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":530576,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":67526,"thread_start_us":596790,"threads_started":2,"wal-append.queue_time_us":716329}
I20260709 13:18:58.959474 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:58.967038 17997 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.957965 20790 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.955425 20707 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.946626 20745 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:58.977901 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:58.963779 20682 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:58.987959 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.948139 20228 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.985205 20738 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:58.985330 20768 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:58.951244 20787 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:58.976238 20695 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:18:58.973418 20767 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.956202 20789 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:18:58.984692 20793 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:18:58.992005 17997 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:18:58.996711 20767 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.992731 20682 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:18:58.998062 20788 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:58.998014 20682 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:58.998997 20767 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.000193 20682 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.057482 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2733) took 1913 ms. Trace:
W20260709 13:18:59.057790 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.057956 17392 rpcz_store.cc:276] 0709 13:18:57.144316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.924355 (+780039us) service_pool.cc:224] Handling call
0709 13:18:57.924720 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.665389 (+740669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.665419 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.665878 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.939569 (+273691us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.939603 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.939667 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.057256 (+117589us) raft_consensus.cc:1685] finished
0709 13:18:59.057275 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.057414 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":273372,"threads_started":1,"wal-append.queue_time_us":323464}
I20260709 13:18:59.059944 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:59.061717 17317 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.063179 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.064487 17317 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:59.065531 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.066762 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:58.976547 20707 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:58.996081 20664 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:59.107532 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.108091 20439 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.110222 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1377) took 1206 ms. Trace:
I20260709 13:18:58.990859 20768 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:59.138322 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 167110us
I20260709 13:18:59.011797 20624 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:59.095350 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 140640us
I20260709 13:18:59.221482 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.220821 17320 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:59.159145 17322 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:59.225464 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.220463 17314 rpcz_store.cc:276] 0709 13:18:57.904091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.904209 (+   118us) service_pool.cc:224] Handling call
0709 13:18:57.911504 (+  7295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:57.914972 (+  3468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.915005 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:57.922264 (+  7259us) log.cc:844] Serialized 52 byte log entry
0709 13:18:58.859297 (+937033us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.859337 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.859415 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.109996 (+250581us) raft_consensus.cc:1685] finished
0709 13:18:59.110018 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.110160 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3068,"raft.queue_time_us":3172,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":101110,"thread_start_us":781032,"threads_started":1,"wal-append.queue_time_us":824439}
I20260709 13:18:59.229602 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1652) took 1322 ms. Trace:
I20260709 13:18:59.230005 17322 rpcz_store.cc:276] 0709 13:18:57.907355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.945374 (+ 38019us) service_pool.cc:224] Handling call
0709 13:18:59.114419 (+1169045us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:18:59.158882 (+ 44463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.229378 (+ 70496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.229546 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4130560}
I20260709 13:18:59.015758 20682 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:59.232278 17467 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.265286 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.266086 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.222513 17318 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:18:58.974938 20790 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.270416 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.271154 17462 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.275815 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.280819 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.285743 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:59.287811 17322 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:59.287647 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.288295 17468 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:18:59.228989 20801 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.299631 17469 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.303740 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.304462 17319 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:18:59.227723 20439 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.317734 20787 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:59.320298 20439 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:59.321136 20799 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:59.322016 20799 consensus_queue.cc:1243] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:59.298434 20768 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.323127 17469 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:59.323311 20768 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.334621 20707 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:59.312690 17462 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:59.344201 20787 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.344755 20787 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.277325 20682 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.351392 20682 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:59.352280 17470 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:59.353590 20790 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.354219 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.356379 17463 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:59.272800 20664 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:18:59.369334 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:18:59.374991 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.398404 17963 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.947s (SENT) [suppressed 24 similar messages]
I20260709 13:18:59.423934 17467 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:59.303800 20675 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:18:59.511790 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 282527us
I20260709 13:18:59.514364 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.306504 20767 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.205s
W20260709 13:18:59.517400 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.514139 17434 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:59.501626 20707 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.502053 20278 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.523307 17434 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:59.513705 20664 consensus_queue.cc:1243] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:59.527292 20707 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.529040 20228 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:59.529372 20707 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.529937 20707 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:59.530249 20707 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:59.530966 20707 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.303996 20801 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.532382 17470 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:18:59.533422 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2723) took 3578 ms. Trace:
I20260709 13:18:59.533977 17396 rpcz_store.cc:276] 0709 13:18:55.955268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.872172 (+916904us) service_pool.cc:224] Handling call
0709 13:18:56.872483 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.838402 (+965919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.533135 (+1694733us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54004114d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:59.533364 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211324800}
W20260709 13:18:59.536581 20289 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.571s	user 0.005s	sys 0.005s
I20260709 13:18:59.526957 20278 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.533528 20801 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:59.522559 20675 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.564527 20708 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.564898 20675 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.525395 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.538426 20609 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:59.539326 20730 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:59.541520 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.572398 17463 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.542924 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1660) took 1622 ms. Trace:
I20260709 13:18:59.543524 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.573375 17471 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.546171 20596 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:59.546622 20582 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.001s
I20260709 13:18:59.546686 17999 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.547940 19877 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:59.558264 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:59.559471 20808 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:59.570536 17462 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:59.573210 17316 rpcz_store.cc:276] 0709 13:18:57.920098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.758183 (+838085us) service_pool.cc:224] Handling call
0709 13:18:58.758448 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.848049 (+ 89601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.542669 (+694620us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b54003fbbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:59.542841 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107089280}
I20260709 13:18:59.600172 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.600747 17462 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
W20260709 13:18:59.586922 20665 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.739s	user 0.007s	sys 0.004s
I20260709 13:18:59.594738 17471 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:59.567693 20675 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.601150 20707 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:59.609110 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50925.8us
I20260709 13:18:59.609838 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:59.611104 20278 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:59.604242 20665 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.611507 20278 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:59.611902 20278 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.613147 20665 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:59.613935 17992 raft_consensus.cc:2368] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:18:59.614547 20656 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:59.611920 17994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 671) took 2769 ms (client timeout 2180 ms). Trace:
W20260709 13:18:59.615566 17994 rpcz_store.cc:269] 0709 13:18:56.842389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.842531 (+   142us) service_pool.cc:224] Handling call
0709 13:18:59.611726 (+2769195us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54006de554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:59.611841 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608124672}
I20260709 13:18:59.615760 20676 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:59.616937 20582 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:59.617306 20582 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:59.615585 20810 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:59.618149 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.618396 20810 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:59.618846 20810 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.601935 20801 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.618079 20582 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.620151 20801 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.622458 20640 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:59.624466 20278 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.626519 20278 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:59.629925 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.633332 20531 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.638257 17463 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:59.603777 20767 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:59.639020 20767 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:59.639575 17463 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:59.639977 17463 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:59.639909 20767 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.569264 20289 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:59.643738 17285 connection.cc:256] RPC call timeout handler was delayed by -1.0070413009998447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 13:18:59.641250 20448 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:59.601971 20808 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.646185 17468 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:59.640873 17463 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.642081 20798 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:59.647114 17463 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:59.649267 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 98302us
I20260709 13:18:59.653537 20289 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.653815 20808 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.649055 20448 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.648942 20798 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.655284 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 927) took 2342 ms. Trace:
I20260709 13:18:59.656105 20448 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.656800 20798 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:18:59.660321 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 683) took 2238 ms. Trace:
I20260709 13:18:59.660705 17999 rpcz_store.cc:276] 0709 13:18:57.422311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.504792 (+ 82481us) service_pool.cc:224] Handling call
0709 13:18:57.685696 (+180904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.597549 (+1911853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.660068 (+ 62519us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b5400640354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:59.660261 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4279429888}
I20260709 13:18:59.655632 17996 rpcz_store.cc:276] 0709 13:18:57.312941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.313124 (+   183us) service_pool.cc:224] Handling call
0709 13:18:57.313543 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:57.355883 (+ 42340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.355916 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:57.414177 (+ 58261us) log.cc:844] Serialized 52 byte log entry
0709 13:18:57.502816 (+ 88639us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:57.539864 (+ 37048us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.613141 (+ 73277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.654895 (+2041754us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54006d1354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:18:59.654942 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.654984 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:59.655068 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.655231 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94342,"prepare.queue_time_us":37081,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":91550,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":80515,"spinlock_wait_cycles":55254272,"thread_start_us":20103,"threads_started":1,"wal-append.queue_time_us":656167,"wal-append.run_cpu_time_us":2672,"wal-append.run_wall_time_us":1214676}
I20260709 13:18:59.680985 20448 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.681704 20448 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.683948 20448 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.685297 20721 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.665947 20810 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.687520 17462 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
W20260709 13:18:59.686659 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 76017.8us
I20260709 13:18:59.689284 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.689851 17465 raft_consensus.cc:2376] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9. Re-sending same reply.
I20260709 13:18:59.690451 20386 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.691416 17996 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:59.692543 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.693178 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.693547 20789 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:59.693883 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.694257 20789 consensus_queue.cc:1243] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:59.694484 17999 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:59.694767 20789 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:59.695182 20789 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:18:59.695937 20789 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.692623 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.697543 17313 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:59.697733 20789 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.697556 17464 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [5.8-7.9]
I20260709 13:18:59.702715 17469 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:18:59.704408 20810 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.708024 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.709203 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:59.709858 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.710352 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.711328 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.711825 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:59.712468 17464 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:59.713002 20607 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:59.713523 20614 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.713472 20607 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.714118 20614 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.716315 20614 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:59.716751 20607 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:18:59.717653 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2737) took 2350 ms. Trace:
I20260709 13:18:59.718032 17393 rpcz_store.cc:276] 0709 13:18:57.367407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.920684 (+1553277us) service_pool.cc:224] Handling call
0709 13:18:58.930581 (+  9897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.930752 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:59.269888 (+339136us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.717276 (+447388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.717354 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:59.717397 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.717487 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.717599 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257681,"prepare.queue_time_us":375632,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":53,"raft.queue_time_us":257957,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":472348,"threads_started":2,"wal-append.queue_time_us":182960}
W20260709 13:18:59.719741 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1600) took 4505 ms (client timeout 2210 ms). Trace:
W20260709 13:18:59.720121 17391 rpcz_store.cc:269] 0709 13:18:55.214711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.214840 (+   129us) service_pool.cc:224] Handling call
0709 13:18:59.719552 (+4504712us) spinlock_profiling.cc:243] Waited 4.07 s on lock 0x7b5400124b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:18:59.719673 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9355378944}
I20260709 13:18:59.720459 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.722244 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:59.722420 20656 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.716984 20751 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.722828 17992 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.722991 20656 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.725136 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.725936 17316 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:18:59.726025 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.726707 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.727361 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.727643 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.727986 17996 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:18:59.728202 17316 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:18:59.728758 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.722237 20639 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.729290 17994 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:59.725298 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.728284 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.730132 17995 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:18:59.730463 17317 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:59.731277 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.731842 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.733026 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.729583 20639 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.735921 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:59.736343 20763 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:59.736624 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:59.737427 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:59.738106 17396 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.740067 17992 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:18:59.742192 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.743165 17397 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:59.743820 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:59.744253 20721 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.744997 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.745571 20771 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.745796 17319 raft_consensus.cc:2393] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:59.746210 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.746107 20771 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.746660 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.746971 17314 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:59.747390 17319 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:18:59.748278 20771 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:18:59.722539 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.749233 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.751454 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.751839 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.752331 17392 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:59.752461 17466 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:59.752596 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.753253 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.753536 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.737993 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:59.754155 17466 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:18:59.754433 17995 raft_consensus.cc:2368] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:18:59.755052 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.755867 17466 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:59.744894 20721 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.753263 17465 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:59.774267 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:18:59.783906 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 72157.9us
I20260709 13:18:59.785161 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:59.785357 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.786748 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:59.780364 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:18:59.787456 17992 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.786950 17465 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:18:59.770025 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.789139 17313 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:18:59.790398 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:18:59.791240 17360 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:59.792160 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.788259 17463 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:59.806262 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.800207 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:18:59.806960 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.807188 17995 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:59.799820 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.806425 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.793062 17465 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
W20260709 13:18:59.808125 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58359.3us
I20260709 13:18:59.809015 17993 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:59.800629 17360 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:18:59.808946 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.812229 17465 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:18:59.813740 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.815151 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:18:59.811199 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 54171.9us
I20260709 13:18:59.807222 17469 raft_consensus.cc:2376] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9. Re-sending same reply.
I20260709 13:18:59.818989 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.817191 17464 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:59.820524 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.809311 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:18:59.736773 17434 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:59.821903 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:18:59.822705 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.825258 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.825594 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.826308 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:59.826879 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.827375 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.828034 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:18:59.828399 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.828606 17397 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.826398 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.832685 17390 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:18:59.820808 17388 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:18:59.826323 17395 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
W20260709 13:18:59.830538 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 93830.9us
W20260709 13:18:59.833070 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 81882.6us
I20260709 13:18:59.834605 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:59.837749 17316 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:18:59.838373 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:18:59.838948 17463 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:18:59.839283 17320 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:18:59.792508 20753 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:59.788532 20637 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.820374 19877 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:59.840337 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.853791 17999 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:59.758831 20495 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:59.841984 17992 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:59.807840 20751 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:59.811167 20717 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:59.843173 17362 connection.cc:256] RPC call timeout handler was delayed by -2.1956401970001025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 13:18:59.789541 19574 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:18:59.793401 20718 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:59.689860 20652 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:59.760084 20771 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:59.845052 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.793567 20439 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.796559 20531 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.850136 17993 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:59.716812 20614 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
I20260709 13:18:59.736796 20763 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:18:59.865935 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 56702.7us
I20260709 13:18:59.888345 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.867697 17468 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:59.889487 17468 pending_rounds.cc:85] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 4
I20260709 13:18:59.889938 17468 pending_rounds.cc:107] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:18:59.890254 17468 raft_consensus.cc:2889] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.891110 17320 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:59.891537 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2728) took 2748 ms. Trace:
I20260709 13:18:59.849753 20753 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.829912 20386 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:59.793823 20810 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:59.840391 20656 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:18:59.840158 20741 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:59.881563 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.885414 17999 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.887102 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.888975 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:18:59.892526 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.873908 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.856925 20816 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:59.900130 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 66011.3us
I20260709 13:18:59.905855 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:18:59.905928 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:18:59.865324 20751 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.892131 17394 rpcz_store.cc:276] 0709 13:18:57.142691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.912529 (+769838us) service_pool.cc:224] Handling call
0709 13:18:57.912938 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.913209 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:57.913589 (+   380us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.707846 (+1794257us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b1800478360. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:18:59.891138 (+183292us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.891212 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:59.891285 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.891365 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.891482 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21469,"prepare.queue_time_us":194,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":1786073,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"spinlock_wait_cycles":22047104,"thread_start_us":183009,"threads_started":1,"wal-append.queue_time_us":8841}
I20260709 13:18:59.856753 20665 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:18:59.879019 20652 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:18:59.878224 20495 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:18:59.924422 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.918159 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.900830 20448 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.985483 17316 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:18:59.986649 17994 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:18:59.988508 17396 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:18:59.989627 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.866225 20709 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:18:59.865516 20637 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:18:59.990841 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.899590 20725 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:59.992053 17996 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:18:59.907675 20753 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.966230 20656 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.948066 20741 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:00.001515 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.899029 20439 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.005754 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:18:59.916690 20810 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:00.036459 20810 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:00.014694 20600 raft_consensus.cc:2764] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:59.875275 17397 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:18:59.985785 20816 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:19:00.020229 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 178850us
W20260709 13:18:59.995981 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 105037us
I20260709 13:18:59.893186 20531 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:18:59.987251 20743 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:59.975917 19877 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:00.032537 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.889333 19574 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.032996 20772 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:18:59.984071 20596 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:18:59.892977 20771 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.060565 17317 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:00.002449 20763 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.038683 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:00.061501 17397 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:00.015734 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 126872us
I20260709 13:19:00.062985 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:00.017755 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:18:59.993433 20607 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:00.045226 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:18:59.991389 20751 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.037763 20637 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.065053 17394 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:00.034792 20741 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:00.067277 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49615.8us
I20260709 13:19:00.070375 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.077562 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.030604 20725 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:00.087783 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.089354 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.085620 17362 connection.cc:256] RPC call timeout handler was delayed by -1.7168401970000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
W20260709 13:19:00.091209 17362 connection.cc:256] RPC call timeout handler was delayed by -1.715940197000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
I20260709 13:19:00.092272 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:00.055780 20717 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:00.095230 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:00.086024 17396 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:19:00.057740 20816 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.082093 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.063316 20609 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:00.093855 17471 raft_consensus.cc:2410] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:19:00.097332 17397 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:00.097214 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:00.034394 20656 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.094348 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.085410 20582 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.087491 20031 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:19:00.037789 20810 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.112185 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:00.085697 20808 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:00.099820 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.117877 17964 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:00.099208 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:00.118253 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.107776 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:00.127588 17465 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:00.127993 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.128664 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:00.059702 20652 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.060746 20743 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.073580 20596 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.107384 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:00.067807 20772 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.121780 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.108115 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:00.126609 17996 raft_consensus.cc:2368] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:19:00.085898 20708 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:00.108547 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:00.141073 17464 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.079402 20668 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:00.083897 20749 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.094678 20721 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.129106 17287 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.137892 17469 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
W20260709 13:19:00.129858 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 124172us
I20260709 13:19:00.093842 20718 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:00.121727 20709 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:00.116510 20735 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.080295 20607 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.164543 20828 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.165468 20828 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:00.145421 20665 consensus_queue.cc:1175] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7108577e5754060b7e468a43dfdcdeb" responder_term: 8 status { last_received { term: 4 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [5.8-7.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:00.165970 20607 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.166190 20828 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:00.166539 20607 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.161777 20819 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:00.167809 20819 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.134224 20808 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:00.169963 20819 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.169689 20808 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.173105 20829 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.100302 20645 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:00.135253 20600 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:00.135031 20396 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:00.154485 20708 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:00.161935 20531 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.126029 20637 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:00.162313 20386 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:00.142108 19877 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.163327 20735 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.154775 20668 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:00.186086 17464 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:00.157248 17360 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:00.108987 20609 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.145411 20749 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.173732 20771 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.158313 20709 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.156152 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:19:00.231312 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 74118.3us
W20260709 13:19:00.205825 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 149803us
I20260709 13:19:00.201951 20600 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:00.172937 20495 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.158464 20640 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:00.173691 20829 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:00.188900 20821 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:19:00.232888 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 115075us
W20260709 13:19:00.235436 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 79375.5us
I20260709 13:19:00.199851 20637 consensus_queue.cc:1243] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:00.244786 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:00.148896 20717 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.253571 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:00.254607 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.204694 20396 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:00.235509 20830 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.157362 20652 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.233793 20749 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.249830 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:00.166744 20828 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.233657 20709 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.174801 20718 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.239316 20531 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:00.251432 20640 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:00.263402 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.266541 17995 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:00.240425 20596 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.271220 20695 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.271817 20695 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.273119 20640 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.274236 20695 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.274950 20695 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:00.276003 20219 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:19:00.277762 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 213675us
I20260709 13:19:00.278391 20718 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.260362 20830 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.258445 20645 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.292255 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:00.290138 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.287355 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 510) took 2952 ms. Trace:
I20260709 13:19:00.289935 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.302099 17434 leader_election.cc:400] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:19:00.303989 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:00.248667 20495 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:00.262123 20808 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:00.300184 17389 rpcz_store.cc:276] 0709 13:18:57.335378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.918630 (+1583252us) service_pool.cc:224] Handling call
0709 13:18:58.928954 (+ 10324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.713086 (+784132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.713118 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.713561 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.005089 (+291528us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:00.005130 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.005201 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.287157 (+281956us) raft_consensus.cc:1685] finished
0709 13:19:00.287175 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.287299 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":783822,"raft.queue_time_us":787987,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":28852,"thread_start_us":291234,"threads_started":1,"wal-append.queue_time_us":365512}
I20260709 13:19:00.305961 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.305217 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:00.300309 17994 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:19:00.306233 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.310249 17995 raft_consensus.cc:2393] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:00.269327 20439 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.315117 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:00.309535 17999 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:00.268977 19574 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.314667 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:00.316425 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.322225 17434 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.254437 20771 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:00.310878 20596 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.284832 20632 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:00.324262 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:00.299688 20645 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:00.364974 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.299484 20830 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.370291 20718 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:00.356755 20289 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:00.377677 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 265577us
W20260709 13:19:00.414796 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.320695 20772 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.324819 20768 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:00.269786 20708 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.352281 20596 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:00.353166 20822 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:19:00.371167 20614 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:00.313545 20578 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:19:00.366189 20656 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.318275 20789 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:00.455332 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.368647 20743 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.369412 20645 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.314186 20219 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:00.463815 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 214047us
I20260709 13:19:00.483184 17964 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:00.411414 20718 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.320372 20808 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:00.480060 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 231175us
I20260709 13:19:00.307367 20668 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.464143 20772 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:00.443487 20596 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:00.489733 17998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 924) took 3283 ms (client timeout 1582 ms). Trace:
I20260709 13:19:00.490536 17991 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:00.490393 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:00.468735 20614 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:00.468329 20531 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:00.422937 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:00.510244 17998 rpcz_store.cc:269] 0709 13:18:57.206795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.206942 (+   147us) service_pool.cc:224] Handling call
0709 13:19:00.489529 (+3282587us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400084154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:00.489644 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679388416}
I20260709 13:19:00.473896 20789 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:00.515082 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.371246 20396 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.516793 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:00.518687 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 196520us
I20260709 13:19:00.519994 20632 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:00.520830 20632 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:00.521006 20789 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.521282 20632 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.521762 20632 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.512533 20772 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.525210 20839 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:00.525566 20836 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:00.525305 20772 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.489040 20718 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.313252 20600 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:00.515692 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 92860.4us
I20260709 13:19:00.527478 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.491926 20219 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:00.526180 20836 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:00.537779 20838 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:00.538249 20841 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:00.542959 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:00.543301 20801 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.557861 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:00.588308 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.525923 20839 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:00.603788 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46042.9us
I20260709 13:19:00.512194 20735 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:00.545509 20829 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.598482 20031 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:00.607182 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:00.613996 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:00.615057 17464 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:00.615597 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:00.616178 17470 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:19:00.602274 20578 raft_consensus.cc:2764] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:00.618054 20031 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.618180 20219 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:00.621320 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 78472.4us
I20260709 13:19:00.607893 20439 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:00.607532 20841 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.625528 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:00.628490 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 110308us
W20260709 13:19:00.629868 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 376313us
I20260709 13:19:00.630954 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:00.630543 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:00.639707 20692 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:00.640460 20692 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:00.641604 20692 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.653604 20842 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.654184 20842 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:00.654676 20842 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.668908 20842 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.624855 20031 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:00.705685 20850 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:19:00.711057 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 85657.2us
W20260709 13:19:00.712960 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 87393.9us
I20260709 13:19:00.714322 17434 leader_election.cc:400] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:19:00.715837 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:00.712235 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 81258.5us
I20260709 13:19:00.602473 20614 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.626720 20439 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:00.717855 17434 leader_election.cc:400] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
I20260709 13:19:00.628939 20386 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:00.719205 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:00.720698 20834 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:00.723533 20842 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:00.724614 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 446105us
W20260709 13:19:00.725925 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 95502.3us
I20260709 13:19:00.733721 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.734472 17994 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:00.726342 20837 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:00.727484 17434 leader_election.cc:403] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:00.628405 20841 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:00.608536 20531 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.717334 20835 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.747547 20787 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:00.748970 20578 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.749536 20578 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.750955 20839 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.751719 20808 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.752104 20763 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.752274 20578 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.753075 20439 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.754359 20439 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:00.755051 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2690) took 1004 ms. Trace:
I20260709 13:19:00.755451 17468 rpcz_store.cc:276] 0709 13:18:59.750584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.757808 (+  7224us) service_pool.cc:224] Handling call
0709 13:18:59.758080 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.899668 (+141588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.754779 (+855111us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001f0c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:00.754981 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250870656}
I20260709 13:19:00.757313 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2686) took 1215 ms. Trace:
I20260709 13:19:00.757733 17462 rpcz_store.cc:276] 0709 13:18:59.542333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.606252 (+ 63919us) service_pool.cc:224] Handling call
0709 13:19:00.757133 (+1150881us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b5400061154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:00.757253 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157869824}
I20260709 13:19:00.733702 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:00.736330 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:00.740078 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.760438 17993 raft_consensus.cc:2376] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11. Re-sending same reply.
I20260709 13:19:00.741007 20841 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.766477 20749 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.741392 20676 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7.
W20260709 13:19:00.758177 20816 consensus_meta.cc:287] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.649s	user 0.006s	sys 0.008s
I20260709 13:19:00.761883 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:00.775329 17469 raft_consensus.cc:2410] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:00.763705 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:00.726472 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:00.765343 20851 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:00.766106 20448 raft_consensus.cc:2764] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:19:00.768828 20751 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
I20260709 13:19:00.778013 20626 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.778642 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:00.778884 20753 consensus_meta.cc:287] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.000s
I20260709 13:19:00.737998 20637 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.770035 20289 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:00.779119 20845 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:00.779830 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:00.858579 17462 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:19:00.780586 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 684) took 3358 ms. Trace:
I20260709 13:19:00.635138 20836 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.782289 20645 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.782552 20840 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:00.710675 20632 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.784011 17471 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
W20260709 13:19:00.786613 20582 consensus_meta.cc:287] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.666s	user 0.013s	sys 0.000s
W20260709 13:19:00.787822 20741 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.009s
I20260709 13:19:00.744706 20596 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.791616 20609 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.792059 20386 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.794035 20777 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:00.795873 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 69500.6us
I20260709 13:19:00.906368 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.796792 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:00.907121 17997 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:00.825389 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2744) took 1074 ms. Trace:
I20260709 13:19:00.907862 17388 rpcz_store.cc:276] 0709 13:18:59.750831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.753038 (+  2207us) service_pool.cc:224] Handling call
0709 13:19:00.825197 (+1072159us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b5400254254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:00.825325 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153684352}
I20260709 13:19:00.768661 20749 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:00.827162 17321 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:00.909813 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1655) took 2993 ms. Trace:
I20260709 13:19:00.910264 17321 rpcz_store.cc:276] 0709 13:18:57.916026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.946144 (+ 30118us) service_pool.cc:224] Handling call
0709 13:19:00.826772 (+2880628us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:19:00.826981 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.909378 (+ 82397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.909737 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4138880}
W20260709 13:19:00.827816 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.852375 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 117348us
I20260709 13:19:00.859599 17991 rpcz_store.cc:276] 0709 13:18:57.422560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.537014 (+114454us) service_pool.cc:224] Handling call
0709 13:19:00.490343 (+2953329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.510527 (+ 20184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.780364 (+269837us) spinlock_profiling.cc:243] Waited 2.67 s on lock 0x7b5400084150. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:00.780523 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6146497280}
I20260709 13:19:00.829739 20837 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.847575 20695 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.829125 20629 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.885020 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.759904 20709 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.858444 20843 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.900246 20820 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.857816 20637 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:00.823354 20816 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.932466 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.934520 17990 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:00.896307 20652 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:00.862106 20031 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:00.860033 20753 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:00.919139 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 181971us
W20260709 13:19:00.928649 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 393218us
I20260709 13:19:00.939097 17468 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:19:00.939114 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:00.906069 20777 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:00.929745 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:00.857986 20289 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:00.849929 20751 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:00.938737 20753 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.965705 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:00.914222 20837 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:00.916700 20695 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.923480 20640 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:00.977190 17470 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:00.942067 20582 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.979683 20751 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:00.981747 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:01.001133 17998 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.900943 20741 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:01.027580 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.034154 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:01.034984 17317 raft_consensus.cc:2376] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9. Re-sending same reply.
I20260709 13:19:01.051625 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:00.932883 20637 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.997088 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:01.063396 20862 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:19:01.064181 20709 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:01.026253 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:01.068382 17998 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
W20260709 13:19:01.071379 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.105965 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 109589us
I20260709 13:19:01.114009 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:00.976497 20837 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.120791 20632 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:01.121109 20834 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.074646 20626 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:01.125726 20855 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:19:01.120472 20289 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:01.129808 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 188637us
W20260709 13:19:01.131001 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.134821 20853 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 13:19:01.137490 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.209772 17315 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:00.976673 20609 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:00.983089 20695 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:01.159961 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51621.6us
I20260709 13:19:01.255119 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:01.171944 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.118116 20031 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:01.191536 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:01.210631 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.273815 17318 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:01.212743 17319 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:19:01.214378 17314 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:01.182328 20629 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:01.246939 17320 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:00.939885 20820 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:01.276214 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:01.249588 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:01.103050 20640 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:00.966776 20749 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 13:19:01.259524 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:01.299260 20858 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:19:01.260102 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:01.261001 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:01.301570 20859 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:19:01.303460 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:01.304201 17314 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.304885 20820 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:01.308821 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.210870 20626 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:01.286309 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.321002 17318 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:01.322099 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.322678 17318 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:19:01.323429 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.323962 17318 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:01.275070 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.325884 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.297921 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:01.297639 20640 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.341502 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.342572 17319 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:01.343742 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.345516 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.346922 17319 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
W20260709 13:19:01.278168 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 86741us
I20260709 13:19:01.158214 20777 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:01.317485 20749 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:01.318140 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:00.932415 20843 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.247905 20609 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.104003 20582 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:01.327404 17462 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:01.324769 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.139238 20751 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.149s
W20260709 13:19:01.292891 20830 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.870s	user 0.011s	sys 0.005s
I20260709 13:19:01.305485 20820 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:01.356649 20741 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:01.361347 17435 leader_election.cc:336] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.694s (SENT)
I20260709 13:19:01.366436 20835 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:01.368707 20789 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.847s	user 0.011s	sys 0.000s
I20260709 13:19:01.294054 20289 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:01.320037 20855 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:19:01.384975 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.385516 20596 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:01.308815 20816 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:01.376405 20645 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:01.315975 17314 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
W20260709 13:19:01.401906 20772 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.851s	user 0.009s	sys 0.002s
I20260709 13:19:01.331902 20626 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:01.408150 20439 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.000s
W20260709 13:19:01.411026 20841 consensus_meta.cc:287] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.000s
W20260709 13:19:01.418135 20718 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.004s
I20260709 13:19:01.428787 20837 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.535986 20837 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:01.466970 20749 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:01.538038 20749 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:01.468245 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.541270 17320 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:01.542898 17320 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:01.544297 17320 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:01.466773 20777 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.547964 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2685) took 2005 ms. Trace:
I20260709 13:19:01.470836 20843 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:01.471334 20609 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:01.550364 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.476052 20830 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:01.552084 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.553176 20816 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.553488 20830 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:01.553802 20816 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:01.477274 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:01.555348 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 194028us
I20260709 13:19:01.556291 20816 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:01.474388 20582 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:01.556792 20816 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:01.557633 20816 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.558221 20816 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.482342 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.478096 20789 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.494109 20718 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.478428 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.563772 20789 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:01.482638 20772 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.566694 20718 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:01.567059 20772 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:01.464452 17285 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:01.568722 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 104348us
I20260709 13:19:01.570032 17285 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:01.570784 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:01.572121 20396 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:01.572288 20823 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:01.572649 20396 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.572930 20823 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:01.573271 20396 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:01.573886 20823 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.477793 20835 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:01.501215 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 208629us
W20260709 13:19:01.560827 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.593436 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:19:01.593940 17435 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.770s (SENT)
I20260709 13:19:01.594537 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:01.594574 20851 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:01.596493 20851 raft_consensus.cc:2764] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:01.463456 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:01.695577 17319 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:01.617959 20668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.001s	sys 0.001s
I20260709 13:19:01.493767 20841 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.601063 20772 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:01.598445 17435 leader_election.cc:336] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.733s (SENT)
W20260709 13:19:01.644032 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.052s	sys 0.065s
W20260709 13:19:01.738507 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.053s	sys 0.065s
W20260709 13:19:01.738711 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 140301us
W20260709 13:19:01.738864 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 942121us
I20260709 13:19:01.548463 17467 rpcz_store.cc:276] 0709 13:18:59.542089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.629690 (+ 87601us) service_pool.cc:224] Handling call
0709 13:19:01.547723 (+1918033us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400281754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:01.547878 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518597888}
I20260709 13:19:01.611963 20609 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:01.607007 20639 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:01.657161 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59614us
W20260709 13:19:01.662096 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.768711 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:01.603134 20849 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.003s	user 0.004s	sys 0.009s
W20260709 13:19:01.644479 20692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.032s	sys 0.085s
W20260709 13:19:01.781024 20692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.032s	sys 0.085s
I20260709 13:19:01.781309 20695 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.765300 20396 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.786296 20396 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:01.775569 17467 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:19:01.777698 17435 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.210s (SENT)
I20260709 13:19:01.787910 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:01.765540 20609 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:01.788801 20289 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:01.780402 20846 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:01.734130 20668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.005s	sys 0.006s
I20260709 13:19:01.560737 20816 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:01.794548 17313 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:01.796399 17319 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:01.734099 20830 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:01.526300 20637 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:01.830461 17464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.012s	sys 0.068s
W20260709 13:19:01.830942 17464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.012s	sys 0.068s
I20260709 13:19:01.831900 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 546) took 1070 ms. Trace:
I20260709 13:19:01.832348 17464 rpcz_store.cc:276] 0709 13:19:00.761263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.761387 (+   124us) service_pool.cc:224] Handling call
0709 13:19:00.769480 (+  8093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.769741 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:00.945173 (+175432us) log.cc:844] Serialized 14 byte log entry
0709 13:19:01.831424 (+886251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:01.831492 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:01.831549 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.831636 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.831809 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165814,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":1060905,"threads_started":2}
I20260709 13:19:01.792547 20626 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:01.844906 20695 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:01.827951 20830 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:01.851922 20841 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:01.856984 17964 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.009s	sys 0.034s
W20260709 13:19:01.857438 17962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.042s	sys 0.059s
W20260709 13:19:01.861670 17964 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.009s	sys 0.035s
W20260709 13:19:01.861836 17962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.042s	sys 0.059s
W20260709 13:19:01.862185 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 537434us
I20260709 13:19:01.875834 20835 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:01.926656 17286 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.011s	sys 0.003s
W20260709 13:19:01.927680 17286 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.012s	sys 0.003s
W20260709 13:19:01.928232 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 951186us
W20260709 13:19:01.945015 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.004s	sys 0.008s
W20260709 13:19:01.945592 17316 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.025s	sys 0.010s
W20260709 13:19:01.946223 17316 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.025s	sys 0.010s
W20260709 13:19:01.957165 17362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.003s	sys 0.016s
W20260709 13:19:01.957722 17362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.003s	sys 0.016s
I20260709 13:19:01.962841 17467 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:01.964144 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:01.945612 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.004s	sys 0.009s
W20260709 13:19:01.965631 17469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.003s	sys 0.010s
W20260709 13:19:01.966120 17469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.003s	sys 0.010s
I20260709 13:19:01.965299 17465 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:01.971716 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:01.974308 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:01.975446 17320 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:19:01.978169 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 723057us
I20260709 13:19:01.978055 17962 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:01.984205 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:01.984704 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:01.988303 20626 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:01.988679 20843 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:01.990227 20386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.004s	sys 0.014s
I20260709 13:19:02.022722 17997 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:02.038305 20845 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:02.042025 20830 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:01.879792 20836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.008s	sys 0.023s
W20260709 13:19:02.043488 20836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.009s	sys 0.023s
I20260709 13:19:02.044730 17992 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:02.048522 20386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.004s	sys 0.014s
W20260709 13:19:02.072502 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46918.8us
I20260709 13:19:02.073665 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:02.074066 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:02.075026 17997 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:02.076045 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:02.078797 20835 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:02.080121 20873 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:19:02.082331 20877 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.083163 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 526) took 1791 ms. Trace:
I20260709 13:19:02.084311 17389 rpcz_store.cc:276] 0709 13:19:00.291135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.355214 (+ 64079us) service_pool.cc:224] Handling call
0709 13:19:00.410849 (+ 55635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.417284 (+  6435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.417335 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.417945 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:19:01.601854 (+1183909us) spinlock_profiling.cc:243] Waited 991 us on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:02.082196 (+480342us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b18003d8b80. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1
0709 13:19:02.082583 (+   387us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:02.082635 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.082747 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:02.082802 (+    55us) raft_consensus.cc:1685] finished
0709 13:19:02.082813 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.082966 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7319,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":19430,"spinlock_wait_cycles":18506368,"thread_start_us":41059,"threads_started":1,"wal-append.queue_time_us":101628}
I20260709 13:19:02.086809 17316 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:02.083127 20719 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.083482 17998 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:02.083423 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:02.137332 17996 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:02.138288 20772 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.138469 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:02.138896 17315 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.014s	sys 0.023s
W20260709 13:19:02.139400 17315 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.014s	sys 0.023s
I20260709 13:19:02.139544 17996 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:02.139238 20772 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.141033 19877 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:02.142232 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 164710us
I20260709 13:19:02.143342 17998 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:02.143468 17962 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:02.144428 20877 raft_consensus.cc:2764] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:19:02.145581 20886 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:02.146514 20886 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.149964 20886 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:02.148705 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.151289 20637 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:02.151903 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:02.152832 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.153321 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.153470 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.142328 20772 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:02.156651 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.156801 20887 raft_consensus.cc:2764] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:19:02.157444 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.159024 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:02.189807 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:02.219328 20875 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.281s	user 0.001s	sys 0.001s
I20260709 13:19:02.219636 17390 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:02.225445 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 71202.6us
I20260709 13:19:02.229277 20887 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.230163 20887 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:02.153963 20843 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.240384 20843 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:02.243284 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.243477 20887 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:02.243940 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 100688us
W20260709 13:19:02.250741 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 174918us
I20260709 13:19:02.296603 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:02.303115 20897 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.304292 20897 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.307204 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.308208 17395 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.307943 20900 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:02.308389 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.309443 17389 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.311230 17388 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:02.311791 20886 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:02.304596 20396 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 13:19:02.311260 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.312657 20886 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.327607 20897 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:02.304286 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 77340.9us
I20260709 13:19:02.333393 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.334481 17396 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:02.314107 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:02.339617 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:02.346788 17998 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:02.348013 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:02.346796 17962 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:02.350041 17392 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:19:02.313525 20668 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.351029 20668 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.353614 17996 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:02.354869 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.355804 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.356264 17397 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.357704 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.358784 17396 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.348776 17998 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:02.355819 17388 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:02.438407 17466 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:02.441962 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.454141 17394 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:02.470738 20448 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:02.468920 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 59370.4us
I20260709 13:19:02.472494 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:02.478569 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:02.483618 17992 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:02.475306 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.487927 17392 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:02.489321 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 106485us
W20260709 13:19:02.494335 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 130869us
I20260709 13:19:02.486302 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.496212 17388 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:02.486042 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.500088 17394 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.497808 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.492568 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:02.502838 17996 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:02.508239 20892 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.516412 19877 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:02.511757 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 596) took 1482 ms. Trace:
I20260709 13:19:02.523150 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.523891 20887 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:02.524832 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.526149 17391 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.527098 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.528481 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.529912 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.509876 20835 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:02.531252 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.538090 20600 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:02.538614 17391 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:02.539846 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.541244 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.541607 17360 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:02.543283 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.546196 17391 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.550311 17392 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:02.550652 20886 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:02.551680 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.553296 17996 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:02.554857 20810 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:02.556412 17996 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:02.557060 20887 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:02.557507 20887 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.557916 20887 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.558055 19877 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:02.560725 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.565115 20893 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.488s	user 0.008s	sys 0.004s
I20260709 13:19:02.567320 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:02.569044 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 225707us
I20260709 13:19:02.569402 17998 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:02.570801 17395 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:02.571540 17962 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:02.572073 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.572450 19877 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:02.499115 20900 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:19:02.572866 20892 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.573793 17396 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:02.574262 20668 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:02.574013 20830 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:02.593248 20886 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:02.593695 20886 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:02.594703 20886 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:02.595225 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:02.596150 17316 raft_consensus.cc:2368] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:19:02.596202 20886 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:02.521471 17322 rpcz_store.cc:276] 0709 13:19:01.029345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.029507 (+   162us) service_pool.cc:224] Handling call
0709 13:19:01.029952 (+   445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:01.102543 (+ 72591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:01.102588 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:01.103331 (+   743us) log.cc:844] Serialized 52 byte log entry
0709 13:19:02.047347 (+944016us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b180041ea80. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:19:02.449791 (+402444us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:02.449872 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.450007 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:02.509699 (+ 59692us) raft_consensus.cc:1685] finished
0709 13:19:02.509717 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.511563 (+  1846us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71994,"raft.queue_time_us":86936,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":201,"spinlock_wait_cycles":21357440,"thread_start_us":252250,"threads_started":1,"wal-append.queue_time_us":1352208}
I20260709 13:19:02.575613 20396 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:02.575738 17287 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:02.575874 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 83502.9us
I20260709 13:19:02.550685 20772 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.552676 17392 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.545253 17992 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:19:02.602495 17397 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:02.586452 17388 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:02.600749 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:02.585701 17394 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:02.589074 19877 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:02.592344 20892 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:02.587518 17389 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:02.606015 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.600061 17992 pending_rounds.cc:85] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 8
I20260709 13:19:02.608489 20900 consensus_queue.cc:1243] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 7.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:02.607625 17395 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:02.609086 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.610021 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.610440 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.610582 17394 raft_consensus.cc:2376] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10. Re-sending same reply.
I20260709 13:19:02.609468 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:02.611847 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:02.614923 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.615682 17395 raft_consensus.cc:2376] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10. Re-sending same reply.
I20260709 13:19:02.623029 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:02.624122 17996 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:02.622848 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.625202 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.619272 17992 pending_rounds.cc:107] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:19:02.629293 17992 raft_consensus.cc:2889] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:02.627689 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 52060.1us
I20260709 13:19:02.630234 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.628667 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:02.635792 20772 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.638159 20772 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:02.633637 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.645037 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.645988 17394 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.646364 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.648378 17469 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:19:02.649334 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 78006.7us
I20260709 13:19:02.650851 17465 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:02.651213 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:02.651788 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:02.653110 20877 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:02.653211 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:02.653517 20877 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.653867 20877 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.657061 20836 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:02.658377 20836 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:02.659065 20836 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:02.659384 20836 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:02.660939 20867 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:02.661417 20867 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.661815 20867 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.666728 17391 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:19:02.646541 17319 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:02.664207 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:02.668699 17996 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:02.669577 19877 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.673967 20840 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.674674 20840 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:02.675971 17396 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:02.676966 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.677147 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.677675 17396 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:02.678411 17285 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:02.651279 17465 pending_rounds.cc:85] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 8
I20260709 13:19:02.678488 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.679304 17394 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
W20260709 13:19:02.680783 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 84776.5us
I20260709 13:19:02.682866 17465 pending_rounds.cc:107] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:02.683267 17465 raft_consensus.cc:2889] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:02.686297 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.692727 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.693800 17395 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.697984 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.699432 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.700196 17394 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:02.703045 17391 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.704427 17389 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:02.706240 17360 leader_election.cc:400] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:19:02.706642 17360 leader_election.cc:403] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:19:02.712945 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.701508 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.723603 17397 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:19:02.629122 20668 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:19:02.723275 17396 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:02.725859 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.728673 17389 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:02.724761 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.731083 17395 raft_consensus.cc:2376] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10. Re-sending same reply.
I20260709 13:19:02.737679 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.738837 17394 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:19:02.740806 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.741707 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.664124 20836 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:02.731913 20745 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.461s	user 0.014s	sys 0.029s
I20260709 13:19:02.729080 20886 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:19:02.742892 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.745587 17395 raft_consensus.cc:2368] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:19:02.746923 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.752378 17396 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:02.755112 17394 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.741778 20897 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:02.751669 20745 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.550s	user 0.014s	sys 0.029s
I20260709 13:19:02.767652 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.732437 20835 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:19:02.769768 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1392) took 1558 ms. Trace:
W20260709 13:19:02.774209 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 96649.2us
I20260709 13:19:02.774381 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:02.777406 17394 raft_consensus.cc:2368] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
W20260709 13:19:02.779350 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 128261us
I20260709 13:19:02.757077 20840 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:02.745756 20887 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:02.785949 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.786355 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.787232 17394 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
W20260709 13:19:02.788077 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.789312 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.767454 20772 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.794108 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:02.796084 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:02.794313 17389 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:18:56.305148 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:02.775697 17315 rpcz_store.cc:276] 0709 13:19:01.211514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.217820 (+  6306us) service_pool.cc:224] Handling call
0709 13:19:01.272645 (+ 54825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.272926 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:02.140050 (+867124us) log.cc:844] Serialized 14 byte log entry
0709 13:19:02.665497 (+525447us) log.cc:844] Serialized 14 byte log entry
0709 13:19:02.698173 (+ 32676us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:02.704174 (+  6001us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:02.732065 (+ 27891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.736809 (+  4744us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.769690 (+ 32881us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88340,"prepare.queue_time_us":644558,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":190195,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":33771,"thread_start_us":1114571,"threads_started":3,"wal-append.queue_time_us":168893}
I20260709 13:19:02.806528 17394 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.806770 20031 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:02.807476 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.808389 17394 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:02.809353 20810 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.810000 20906 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:19:02.815121 20665 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:02.815582 20665 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.815914 20665 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.779006 20894 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 13:19:02.819648 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.801118 20637 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:02.820330 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 128420us
I20260709 13:19:02.823187 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:02.824672 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 597) took 1793 ms. Trace:
I20260709 13:19:02.825022 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:02.825196 17313 rpcz_store.cc:276] 0709 13:19:01.030755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.031049 (+   294us) service_pool.cc:224] Handling call
0709 13:19:01.031411 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.797716 (+766305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.824110 (+1026394us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b540035b1d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:02.824457 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754511744}
I20260709 13:19:02.826506 20652 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:02.826798 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:02.827582 20908 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:19:02.828490 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.829336 17389 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:02.827085 20652 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:02.809394 20836 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:02.840407 20396 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:02.818948 20772 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.841665 20835 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:02.842020 17464 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:02.851153 20749 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:02.851336 20877 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.854786 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:02.849849 17393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2738) took 3114 ms (client timeout 2398 ms). Trace:
I20260709 13:19:02.835482 20900 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:02.861052 17393 rpcz_store.cc:269] 0709 13:18:59.735576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.756306 (+ 20730us) service_pool.cc:224] Handling call
0709 13:19:02.849389 (+3093083us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b5400015c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:02.849588 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112128384}
I20260709 13:19:02.863317 17389 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:02.863540 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.810020 20810 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.867956 20877 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:02.869298 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:02.869482 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.872133 17390 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:02.869112 20867 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.878839 17464 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:02.880352 20725 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:02.880605 20652 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.880539 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.885457 17393 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:02.886576 20600 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:02.887042 20600 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:02.888028 20600 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.889729 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.890120 20507 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:02.891490 20840 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:02.892382 20810 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:02.890326 17396 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:02.881003 20864 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:02.863965 20900 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.902204 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.880043 20665 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.904870 20867 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:02.908545 17394 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:19:02.910836 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.911607 17389 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
W20260709 13:19:02.913467 20708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.206s	user 0.009s	sys 0.037s
W20260709 13:19:02.913959 20708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.207s	user 0.010s	sys 0.038s
I20260709 13:19:02.909847 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:02.928416 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.929315 17390 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:19:02.886616 20772 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:02.925830 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:02.908011 20900 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:02.930787 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.932201 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:02.931950 17464 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
W20260709 13:19:02.942456 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 146528us
I20260709 13:19:02.952870 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:02.953430 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:02.954068 17463 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:02.954698 20745 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:02.955335 20745 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.955757 20745 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:02.959395 20665 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:02.960595 20841 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:02.965337 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 123875us
I20260709 13:19:02.967629 20745 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:02.970626 20745 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:02.965131 20396 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:02.989359 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:02.927682 20637 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:02.997469 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.017590 20637 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.018883 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:03.019523 17393 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.005841 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2708) took 1050 ms. Trace:
I20260709 13:19:03.006910 20828 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:03.007234 20818 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 3.002s	user 0.008s	sys 0.017s
I20260709 13:19:03.009584 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 549) took 2247 ms. Trace:
I20260709 13:19:03.015663 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 548) took 2253 ms. Trace:
I20260709 13:19:02.949802 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:03.025894 17462 rpcz_store.cc:276] 0709 13:19:01.955726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.960661 (+  4935us) service_pool.cc:224] Handling call
0709 13:19:03.004635 (+1043974us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:19:03.004930 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.005316 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.005351 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.005422 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:03.005474 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.005540 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.005669 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7379200}
I20260709 13:19:03.060758 17996 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 5. Current term is 7. Ops: []
I20260709 13:19:03.061300 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:03.061694 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:03.067996 17393 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:03.068074 17467 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
W20260709 13:19:03.083523 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.074195 17470 rpcz_store.cc:276] 0709 13:19:00.762130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.762355 (+   225us) service_pool.cc:224] Handling call
0709 13:19:00.762733 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.995092 (+232359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.008922 (+2013830us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54000bfed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:03.009317 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492994176}
I20260709 13:19:03.074642 17468 rpcz_store.cc:276] 0709 13:19:00.761813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.762180 (+   367us) service_pool.cc:224] Handling call
0709 13:19:00.762609 (+   429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:00.939539 (+176930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.015029 (+2075490us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54001694d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:03.015459 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405179136}
W20260709 13:19:03.086978 20896 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:19:03.101361 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.103770 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:03.122247 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 195871us
W20260709 13:19:03.122936 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.102842 20600 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.105518 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:03.124547 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:03.125520 17397 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:03.028115 20864 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:19:03.134438 17393 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:03.137974 20823 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:03.140528 17462 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:03.141402 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.139580 20842 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:03.148416 20842 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:03.153779 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:03.153616 20842 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.159092 20614 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.163475 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:03.139845 20864 consensus_queue.cc:1243] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:03.165014 20901 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:03.166501 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:03.167307 17992 raft_consensus.cc:2368] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8.
I20260709 13:19:03.168593 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:03.169404 17995 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:03.170378 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.171039 17994 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:19:03.171921 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.172353 17393 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:03.172578 17997 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:03.173442 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.173779 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.174422 17996 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:03.174409 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.175069 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.173691 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.175554 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.175658 17995 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:03.179033 17992 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:03.180421 17393 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:03.181546 17393 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:03.179440 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:03.187602 17393 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:03.193791 17286 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:03.195046 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:03.195797 17462 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:03.191016 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:03.204655 17388 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:03.190963 20925 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.210469 20925 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.211308 20856 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:03.209429 20892 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:03.208679 20709 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:19:03.212182 17464 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:03.220378 20864 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:03.220854 20856 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:03.227883 20864 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:03.230413 20856 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.230561 20864 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:03.232234 20856 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.234200 20925 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:03.237658 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:03.238390 17991 raft_consensus.cc:2376] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10. Re-sending same reply.
I20260709 13:19:03.239130 20867 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:03.239599 20867 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:03.302845 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.335292 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 158973us
I20260709 13:19:03.343166 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.349821 17464 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.350780 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:03.361176 17435 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.534s (SENT)
I20260709 13:19:03.240797 20867 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.366798 20867 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.367007 20031 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:03.367863 20031 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:03.369522 20932 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:19:03.380962 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.382129 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:03.381007 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:03.384025 20719 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:03.384208 17435 leader_election.cc:336] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.593s (SENT)
I20260709 13:19:03.384542 20719 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.384994 20719 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.385331 20810 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.385987 17471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 539) took 3287 ms (client timeout 1584 ms). Trace:
I20260709 13:19:03.385875 20810 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:03.386439 17471 rpcz_store.cc:269] 0709 13:19:00.098717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.098930 (+   213us) service_pool.cc:224] Handling call
0709 13:19:03.385565 (+3286635us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54002e3454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:03.385764 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496749824}
I20260709 13:19:03.387949 20925 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.388222 20810 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:03.388602 20925 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.391485 20767 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.386440 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.381827 20900 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.393769 17467 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.392930 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:03.396400 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.390923 20925 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:03.405263 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:03.404111 17313 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:03.363324 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:03.405172 17470 raft_consensus.cc:2376] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7. Re-sending same reply.
I20260709 13:19:03.409225 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.411314 17469 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:03.400950 20810 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:03.417552 17317 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.417696 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:03.430666 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:03.431499 17315 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:03.432657 17313 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:03.433825 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:03.437783 17319 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:03.438246 17318 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:03.439054 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:03.439198 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:03.439842 17319 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:03.440317 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:03.440965 17320 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:03.441277 17319 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:03.441762 17469 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:03.442739 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:03.439811 17318 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:03.460455 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 49517.2us
I20260709 13:19:03.462662 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:03.463600 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:03.467231 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88693.8us
I20260709 13:19:03.445139 20386 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:03.456535 20600 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.477280 17315 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:19:03.482028 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 97886.5us
I20260709 13:19:03.478863 17434 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:03.488453 20892 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.490238 17469 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:03.490032 20892 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.488749 20386 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:03.494994 20386 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:03.495762 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.496680 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 141008us
I20260709 13:19:03.458130 20810 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.506307 20031 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:03.514596 20900 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:03.515692 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:03.517495 17466 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.526965 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.511153 20031 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:03.517935 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.528784 17469 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:03.511565 20916 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.716s	user 0.000s	sys 0.002s
I20260709 13:19:03.530426 20887 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:03.533030 20718 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.533578 20718 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:03.535049 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 56270.6us
I20260709 13:19:03.536145 20925 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:03.536580 20925 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.537055 20925 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:03.536865 20767 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:03.538677 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.539630 17470 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:03.545680 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.546660 17470 raft_consensus.cc:2368] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:19:03.547624 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.548883 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:03.549039 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:03.562865 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.518842 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.553164 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:03.563565 17999 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:03.564023 17470 raft_consensus.cc:2410] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:03.555841 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:03.564560 17992 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.483034 20600 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:03.557824 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.523741 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:03.562723 17468 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:19:03.551501 17318 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:03.544727 17469 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:03.566972 17464 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:03.571030 17467 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:03.573968 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:03.593554 17435 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.656s (SENT)
I20260709 13:19:03.602650 17317 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:19:03.605144 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 102236us
I20260709 13:19:03.606217 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:03.608806 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:03.601329 17999 raft_consensus.cc:1217] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[4.7-8.9]   Dedup: 4.7->[6.8-8.9]
I20260709 13:19:03.610854 17999 pending_rounds.cc:85] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 7
I20260709 13:19:03.611157 17999 pending_rounds.cc:107] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:19:03.613552 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:03.614382 17994 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:03.611414 17999 raft_consensus.cc:2889] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.620236 20790 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:19:03.621507 20600 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:03.633512 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:03.635195 20767 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:03.635603 20767 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.635972 20767 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:03.639817 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.642925 20718 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:03.644564 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:03.646015 20828 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.647724 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:03.666177 20810 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:03.666893 20810 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:03.667637 20810 consensus_queue.cc:1243] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:03.668118 20810 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:03.668761 20810 consensus_queue.cc:1243] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:03.671847 20892 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:03.615288 20856 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:03.672978 20856 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.673480 17216 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 5, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 5 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.675125 20767 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:03.675719 17216 catalog_manager.cc:5697] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.673519 20856 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.677772 20719 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:03.700093 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 91418.8us
I20260709 13:19:03.704622 17466 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:19:03.708593 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 60927.9us
I20260709 13:19:03.722606 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:03.724982 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 142358us
I20260709 13:19:03.680812 20719 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:03.693570 20718 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:03.734056 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 98665.9us
I20260709 13:19:03.735826 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:03.736876 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:03.734392 17992 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:03.741616 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:03.741988 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.743006 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 135332us
I20260709 13:19:03.689766 20790 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:03.730638 20749 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:03.747087 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:03.748138 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:03.749194 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.751253 17317 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:03.737238 20725 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.752339 17319 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:19:03.757665 17465 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:19:03.760599 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:03.739612 20767 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:03.762840 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 156728us
I20260709 13:19:03.763634 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:03.767598 20639 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:03.768110 20639 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.768527 20639 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:03.766412 17216 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 3 to 6, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 6 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.774808 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:03.775471 17322 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.748862 20887 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:03.786722 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:03.766661 20614 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.790913 17319 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:03.765458 20749 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:03.795994 20829 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:03.797500 20834 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.805539 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:03.751904 20719 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:19:03.811403 17318 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
W20260709 13:19:03.812629 17214 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49282 (request call id 326) took 33699 ms (client timeout 15000 ms). Trace:
I20260709 13:19:03.813035 20695 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:03.813906 20695 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.820068 20856 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:03.823038 20856 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:03.828044 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 91285.3us
I20260709 13:19:03.789824 20767 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:03.846191 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 82629.9us
I20260709 13:19:03.766847 20925 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:03.848456 20829 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:03.851866 20829 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:03.852388 20829 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.851780 17216 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.853367 20925 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:03.853930 20925 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:03.854415 20925 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.854096 17216 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 4 to 5, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 5 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.856997 20719 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.857435 20719 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:03.859004 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:03.859243 20719 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:03.859730 20719 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:03.861378 20749 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:03.861920 20626 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:03.865453 20948 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:19:03.865746 17317 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:19:03.866111 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 94734.7us
I20260709 13:19:03.866793 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:03.867887 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:03.869903 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:03.870623 20829 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.871147 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:03.873131 20719 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:03.813261 17214 rpcz_store.cc:269] 0709 13:18:30.125218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.158931 (+ 33713us) service_pool.cc:224] Handling call
0709 13:19:03.794097 (+33635166us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:54.279343 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:54.529250 (+249907us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:54.561434 (+ 32184us) write_op.cc:435] Acquired schema lock
0709 13:18:54.567081 (+  5647us) tablet.cc:662] Decoding operations
0709 13:18:54.643214 (+ 76133us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:54.643303 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:54.643332 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:18:54.644071 (+   739us) tablet.cc:701] Row locks acquired
0709 13:18:54.644130 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:18:54.644320 (+   190us) write_op.cc:270] Start()
0709 13:18:54.644478 (+   158us) write_op.cc:276] Timestamp: P: 1783603134644256 usec, L: 0
0709 13:18:54.644504 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:18:54.645235 (+   731us) log.cc:844] Serialized 2840 byte log entry
0709 13:18:54.835394 (+190159us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d5f6ea0ac 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b
0709 13:18:55.447663 (+612269us) op_driver.cc:464] REPLICATION: finished
0709 13:18:56.092503 (+644840us) write_op.cc:301] APPLY: starting
0709 13:18:56.113445 (+ 20942us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:56.209189 (+ 95744us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:56.258981 (+ 49792us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:56.276405 (+ 17424us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:56.276820 (+   415us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:18:56.276927 (+   107us) write_op.cc:312] APPLY: finished
0709 13:18:56.277310 (+   383us) log.cc:844] Serialized 59 byte log entry
0709 13:18:56.277547 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:56.277720 (+   173us) write_op.cc:454] Released schema lock
0709 13:18:56.277807 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:56.348702 (+ 70895us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:56.352532 (+  3830us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38111,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":577371,"apply.run_cpu_time_us":5768,"apply.run_wall_time_us":306700,"num_ops":7,"prepare.queue_time_us":802035,"prepare.run_cpu_time_us":21988,"prepare.run_wall_time_us":856014,"raft.queue_time_us":215232,"raft.run_cpu_time_us":14534,"raft.run_wall_time_us":471401,"replication_time_us":781426,"spinlock_wait_cycles":2507648,"thread_start_us":1648232,"threads_started":4,"wal-append.queue_time_us":482727,"wal-append.run_cpu_time_us":29362,"wal-append.run_wall_time_us":2124940}]]}
I20260709 13:19:03.875758 17466 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:03.860534 17360 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:03.880611 17322 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
W20260709 13:19:03.882063 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 144960us
I20260709 13:19:03.882711 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.883330 17464 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.856483 17216 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 2 to 7, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 7 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:03.885691 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:03.885885 17994 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:03.888429 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:03.889272 17994 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:03.794466 20386 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.890533 17322 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:03.873556 20719 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:03.897698 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:03.897884 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:03.856598 20925 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:03.885241 17216 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 4, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 4 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.899533 17362 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:03.872678 20829 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:03.898252 17995 raft_consensus.cc:2376] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9. Re-sending same reply.
I20260709 13:19:03.902509 17388 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:03.928985 17997 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:03.929162 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:03.845542 20695 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:03.932711 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:03.932487 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:03.850898 20767 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:03.849483 20725 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:03.902190 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 50919.7us
I20260709 13:19:03.897202 20719 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.938593 17319 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:03.940140 17317 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:03.942996 17996 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:03.941962 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:03.943647 17964 leader_election.cc:336] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.584s (SENT)
I20260709 13:19:03.943689 17993 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:03.944236 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:03.898559 20827 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.895421 20834 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:03.898708 20614 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:03.950237 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 52752us
I20260709 13:19:03.953907 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:03.956590 20767 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:03.956933 20639 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:03.957695 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:03.977012 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 85722.2us
I20260709 13:19:03.973677 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:03.945201 20959 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:03.952983 20829 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:04.006752 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:03.935490 20828 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:19:04.014744 17464 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:03.976696 20767 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.017861 20639 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:03.971385 20957 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.021512 20957 raft_consensus.cc:2764] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:04.022045 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:03.976055 20954 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:04.070981 17314 raft_consensus.cc:2368] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
W20260709 13:19:04.070765 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 54748us
I20260709 13:19:03.971974 20695 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.999536 20614 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:04.078810 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 105250us
W20260709 13:19:04.084183 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 149543us
W20260709 13:19:04.079656 20955 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:04.006366 20959 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.966367 20926 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:19:04.079327 17216 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 4 to 5, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 5 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.093736 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:03.979089 20834 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:04.110749 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 233902us
I20260709 13:19:04.077093 20954 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:04.111990 17216 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.125969 17393 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:04.128661 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:04.129499 17393 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:04.122920 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:04.139140 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:04.132294 17216 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 4 to 5, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 5 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:04.140635 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 47017us
W20260709 13:19:04.144574 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 140588us
I20260709 13:19:04.146715 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:04.106981 20718 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:04.106606 20892 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:04.155320 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.178231 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:04.107507 20959 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.147677 17391 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:19:04.111434 20957 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:04.182300 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:19:04.182889 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 59616.7us
I20260709 13:19:04.184500 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:04.191190 17216 catalog_manager.cc:5697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 5, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:04.107192 20709 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:19:04.134773 20887 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.178171 20725 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:04.210886 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:04.211926 17393 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
W20260709 13:19:04.213806 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 121705us
I20260709 13:19:04.217754 17990 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:04.135102 20894 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:19:04.229987 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:04.231017 17469 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
W20260709 13:19:04.246537 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.247205 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:04.234102 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:04.213058 20725 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.216354 20718 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:04.263350 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.195700 20957 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:04.275467 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:04.257400 20725 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:04.261330 20718 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:19:04.278679 20951 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:19:04.248673 20810 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:19:04.242949 20614 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:04.276368 20954 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:04.307801 20949 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:19:04.309585 20957 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:04.315632 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:04.316280 17990 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:04.316048 20719 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:04.317270 20834 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:04.286545 20827 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:04.325282 20626 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:04.326041 20626 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:04.327446 20626 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:04.288296 20718 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:04.332417 20950 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.459s	user 0.000s	sys 0.002s
I20260709 13:19:04.333292 17990 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:04.338250 17360 leader_election.cc:400] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:04.348429 17360 leader_election.cc:403] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:19:04.349538 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 74183.3us
I20260709 13:19:04.350657 17434 leader_election.cc:400] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8.
I20260709 13:19:04.351027 17434 leader_election.cc:403] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:04.352970 17388 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:04.356999 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.359288 17287 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:04.369882 20966 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.374233 20626 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.369318 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:04.379998 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 197827us
I20260709 13:19:04.351981 20767 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:04.360957 20864 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.355304 20957 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:04.361142 20834 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:04.365801 20969 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:04.376408 20967 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:04.382292 20810 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.351727 20959 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:04.393503 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:04.403061 17388 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:04.413586 17396 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:04.426476 17389 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:04.425398 17392 pending_rounds.cc:85] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 3
I20260709 13:19:04.427897 17392 pending_rounds.cc:107] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:04.428139 17392 raft_consensus.cc:2889] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:04.411935 20810 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.396262 20827 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:19:04.395766 20767 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:04.418538 20531 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:04.434520 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1580) took 1230 ms. Trace:
I20260709 13:19:04.423878 20834 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:04.403676 20864 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:04.445487 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.430673 20810 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.476181 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:04.430295 20856 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:04.480424 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:04.482646 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 58594.5us
I20260709 13:19:04.396325 17319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "036c02de798949eeb02d27e9dd520825"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:04.484701 17319 raft_consensus.cc:606] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:04.486263 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:04.486073 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 238920us
I20260709 13:19:04.487370 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:04.487965 17463 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.484181 20531 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:04.499836 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:04.499608 20531 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:04.501520 20926 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:04.501969 20926 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:04.502830 20926 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:04.496244 20719 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:04.429272 20709 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:19:04.506053 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 421204us
I20260709 13:19:04.508594 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:04.438983 17462 rpcz_store.cc:276] 0709 13:19:03.204463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.204622 (+   159us) service_pool.cc:224] Handling call
0709 13:19:03.228221 (+ 23599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.346797 (+118576us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:03.364600 (+ 17803us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.433704 (+1069104us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.434172 (+   468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.434223 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:04.434266 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.434325 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.434444 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16598,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":44875,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":988469,"threads_started":3,"wal-append.queue_time_us":326053}
I20260709 13:19:04.510025 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:04.507054 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:04.513188 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:04.514113 17314 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:04.512470 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:04.523319 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:04.529873 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:04.481892 20856 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:04.531876 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:04.532608 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 242199us
W20260709 13:19:04.534503 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 119925us
I20260709 13:19:04.532768 17464 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:04.497154 20967 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:04.537901 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 147329us
W20260709 13:19:04.539682 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 137615us
W20260709 13:19:04.523010 20948 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:04.540374 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:04.531298 20790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.006s	sys 0.009s
W20260709 13:19:04.535482 17964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.043s (SENT) [suppressed 41 similar messages]
I20260709 13:19:04.543447 17287 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:04.540759 20825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.011s	sys 0.020s
I20260709 13:19:04.512547 20835 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 13:19:04.556203 20790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.006s	sys 0.010s
I20260709 13:19:04.604765 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:04.592482 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:04.612882 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 69537.6us
I20260709 13:19:04.613440 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:04.613670 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:04.615510 20448 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:04.615315 20961 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:04.616066 20448 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:04.616255 20990 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.616731 20990 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.617085 20990 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.617293 20448 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:04.617785 20725 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:04.619947 20725 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:04.587926 20825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.012s	sys 0.020s
I20260709 13:19:04.541405 20924 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:19:04.653189 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:04.660014 17396 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:04.661218 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:04.663890 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:04.664746 17462 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
I20260709 13:19:04.543331 20892 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:19:04.543215 20842 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:19:04.605628 20981 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.653175 20719 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:04.653175 20827 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:04.589428 20865 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.672978 20790 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.657147 20767 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:04.593288 20973 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:04.673239 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 134932us
I20260709 13:19:04.550437 20967 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:04.704057 20976 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:19:04.703773 20959 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:04.722807 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 119481us
I20260709 13:19:04.665102 20856 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:04.687095 17396 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:04.743441 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:04.744719 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:04.746163 17396 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:04.712267 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 87949us
I20260709 13:19:04.749864 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:04.751605 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:04.712419 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:04.691745 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:04.700990 20790 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:04.753899 17464 raft_consensus.cc:2376] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8. Re-sending same reply.
I20260709 13:19:04.761199 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:04.762097 17464 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
W20260709 13:19:04.767158 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.702237 20827 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:04.767879 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.804584 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.758750 20790 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.701538 20865 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:04.816282 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:04.807701 20995 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:19:04.826973 20835 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:04.837327 20995 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:04.837661 20835 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:04.837980 20995 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:04.838248 20835 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:04.839031 20995 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:04.842244 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:04.844054 17435 leader_election.cc:400] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:19:04.845082 21000 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:04.845634 21000 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.846037 21000 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.849078 20767 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:04.853251 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 101711us
I20260709 13:19:04.810061 20864 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:04.862003 20967 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:04.865466 20985 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:19:04.866319 20984 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:19:04.874859 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:04.810415 20999 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:04.902935 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 190661us
W20260709 13:19:04.884277 20989 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:19:04.906127 17962 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:04.908053 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:04.896534 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:04.920724 17964 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:04.813688 20892 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:19:04.868759 20767 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:04.875252 20439 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.926182 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 158742us
W20260709 13:19:04.921355 20966 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 13:19:04.923782 20959 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:04.943018 20718 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.005s
I20260709 13:19:04.922912 20967 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:04.942709 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46260.3us
W20260709 13:19:05.081776 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62637us
I20260709 13:19:04.918844 20842 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 13:19:05.099463 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 442508us
I20260709 13:19:05.100302 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:05.103281 20725 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:05.106431 20979 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:19:05.107165 20973 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:05.107758 20973 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:05.108702 20973 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.109131 20784 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.109772 20784 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.104210 20725 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.113456 20827 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.113684 20725 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:05.120321 21005 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:05.121270 21005 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:05.122463 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.006889 20892 consensus_queue.cc:1243] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:19:05.136672 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 228696us
I20260709 13:19:05.112581 20784 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:05.005249 21004 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:05.020123 20966 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8.
I20260709 13:19:05.121737 21005 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:05.127452 20990 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.001s
W20260709 13:19:05.159161 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 228168us
W20260709 13:19:05.006011 20989 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:05.148403 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:05.199275 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.212656 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.217274 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 68948.7us
I20260709 13:19:05.218560 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:05.018358 20959 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:05.153038 20829 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:05.203756 20626 consensus_meta.cc:287] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.816s	user 0.007s	sys 0.003s
I20260709 13:19:05.019300 20614 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:05.020335 21001 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:05.239037 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 318405us
W20260709 13:19:05.244175 17463 consensus_meta.cc:287] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.000s
I20260709 13:19:05.229084 20784 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:05.166990 20718 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.016464 20767 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.224659 20834 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:05.237629 20828 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:05.261250 17463 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:05.081274 20439 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.168208 20725 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:19:05.239042 20959 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:05.289659 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:05.316205 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 172824us
W20260709 13:19:05.308816 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.215377 20835 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.294459 21005 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.314517 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:05.230121 20827 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:19:05.214345 20990 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.347222 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:05.290944 20626 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.253069 20614 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.251745 20829 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.321815 17393 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:05.351357 17469 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:05.375393 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2733) took 1476 ms. Trace:
I20260709 13:19:05.375674 17463 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:05.388104 17463 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:05.304703 20834 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.376526 17990 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:05.386066 17466 rpcz_store.cc:276] 0709 13:19:03.899020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.899167 (+   147us) service_pool.cc:224] Handling call
0709 13:19:03.936911 (+ 37744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.108207 (+171296us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:04.404665 (+296458us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.510116 (+105451us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.525518 (+ 15402us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.532034 (+  6516us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:04.532101 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.532225 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.375180 (+842955us) raft_consensus.cc:1685] finished
0709 13:19:05.375200 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.375326 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31236,"prepare.queue_time_us":390776,"prepare.run_wall_time_us":39,"raft.queue_time_us":343403,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":24305,"spinlock_wait_cycles":25386240,"thread_start_us":450393,"threads_started":3,"wal-append.queue_time_us":256622}
I20260709 13:19:05.397269 17463 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.405973 17964 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:05.407572 17463 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:05.398298 20834 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:05.319408 20828 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:05.412529 21000 consensus_meta.cc:287] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.004s
I20260709 13:19:05.394770 21004 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:05.429549 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 172694us
I20260709 13:19:05.256295 21001 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.432744 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:05.319465 21018 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
W20260709 13:19:05.413973 20810 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.908s	user 0.010s	sys 0.002s
W20260709 13:19:05.424798 20790 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 13:19:05.450379 17463 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
W20260709 13:19:05.450832 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.450902 17463 pending_rounds.cc:85] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 7
I20260709 13:19:05.451483 17463 pending_rounds.cc:107] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:19:05.451773 17463 raft_consensus.cc:2889] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:05.411487 20626 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.459884 17435 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:05.462225 20439 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.462752 20626 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.449179 20790 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.464063 20767 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:05.465049 20790 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:05.465093 17464 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:05.468092 20967 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:05.463194 21016 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:19:05.449483 20810 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.469221 21004 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.469785 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2732) took 1582 ms. Trace:
I20260709 13:19:05.470142 21001 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.470504 20810 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.471493 17467 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:05.470216 17468 rpcz_store.cc:276] 0709 13:19:03.886938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.887101 (+   163us) service_pool.cc:224] Handling call
0709 13:19:03.897206 (+ 10105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.221824 (+324618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.221865 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.255623 (+ 33758us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.901198 (+645575us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b1800416140. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:19:05.098796 (+197598us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:05.098834 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.098913 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.469484 (+370571us) raft_consensus.cc:1685] finished
0709 13:19:05.469504 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.469727 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37843,"raft.queue_time_us":324878,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":16075,"spinlock_wait_cycles":9713024,"thread_start_us":468679,"threads_started":2,"wal-append.queue_time_us":951460}
I20260709 13:19:05.472688 20718 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:05.473673 21009 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:19:05.484442 20926 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:05.461413 17463 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:05.486007 20828 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:05.487041 20835 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:05.449926 20784 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:05.474269 20829 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:05.488672 21012 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:19:05.441404 21000 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.502245 20614 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:05.602566 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:05.603329 17992 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:05.603578 17466 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:19:05.503906 20990 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:05.606745 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:05.604485 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:05.607620 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 1.01624e+06us
I20260709 13:19:05.587025 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:05.491390 20827 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.606763 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:05.517908 17998 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:05.607101 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:05.515295 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:05.612051 17388 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
W20260709 13:19:05.609753 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 177086us
I20260709 13:19:05.493238 20790 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:05.502127 20971 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:05.613804 20971 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.615195 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45632 (request call id 31) took 1235 ms. Trace:
W20260709 13:19:05.510301 20994 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.795s	user 0.008s	sys 0.003s
I20260709 13:19:05.651919 17389 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:05.506830 20695 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:05.620275 17964 leader_election.cc:336] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.983s (SENT)
I20260709 13:19:05.653656 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:05.663148 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:05.562161 21028 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:05.655048 20790 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:05.616041 20827 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.609933 20964 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:19:05.618104 20639 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:19:05.615979 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.657546 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:05.658294 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 198520us
W20260709 13:19:05.659017 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.661247 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45512.7us
I20260709 13:19:05.663372 17998 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:05.616950 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:05.504274 21017 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.562004 21029 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.661707 17319 rpcz_store.cc:276] 0709 13:19:04.381150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.381856 (+   706us) service_pool.cc:224] Handling call
0709 13:19:05.505877 (+1124021us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b54000b0f20. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d62771520 00007f7d627ee652 00007f7d677bc60a 00007f7d60d427d4 00007f7d60d42762 00007f7d60d42691 00007f7d60d4260c 00007f7d60d418c2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:05.610344 (+104467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115239680}
I20260709 13:19:05.542301 21018 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:05.546630 20767 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:05.615569 20719 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:05.601828 20959 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.661017 20867 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.672816 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:05.673486 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.662431 20749 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:05.672135 17999 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:05.654134 20865 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.670019 20790 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:05.677279 20969 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:05.677537 17395 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:05.680974 21029 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.681586 20639 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.682111 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:05.709048 17998 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:05.676996 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:05.683949 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:05.710319 17318 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:05.671993 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:05.691638 17996 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:19:05.685111 20719 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.671140 21004 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:05.701900 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 81651.3us
I20260709 13:19:05.714556 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:05.670822 20695 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:05.719954 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:05.688408 20971 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.683000 17316 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:05.677006 20990 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:05.713143 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:05.717200 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.718843 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 560) took 1228 ms. Trace:
I20260709 13:19:05.719393 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:05.692579 20834 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.672535 19574 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:05.721408 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:05.723002 17469 rpcz_store.cc:276] 0709 13:19:04.486179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.486288 (+   109us) service_pool.cc:224] Handling call
0709 13:19:05.714118 (+1227830us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54001c02d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:05.714228 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627259776}
I20260709 13:19:05.728665 17999 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:05.726656 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:05.727023 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 52521.9us
I20260709 13:19:05.662678 20784 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.722004 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:05.708571 20969 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:05.727748 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:05.719863 20719 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:05.738389 17991 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:05.739156 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:05.733757 17315 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:05.703764 20864 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:19:05.694088 20867 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.686679 20767 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.728382 20964 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:05.727130 20439 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:05.747313 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 54115.2us
I20260709 13:19:05.748306 17318 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:05.749413 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2789) took 1349 ms. Trace:
I20260709 13:19:05.749723 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:05.753230 17320 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:05.737712 20828 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:05.754201 20828 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.755043 21033 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:05.755602 21033 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:05.755975 20834 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.756196 21031 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:05.756964 21031 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.757474 20964 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:05.758548 20964 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.684638 21017 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.741865 20971 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:05.689388 21018 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.756091 21033 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.759074 21031 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.704401 20749 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.751039 17397 rpcz_store.cc:276] 0709 13:19:04.399564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.399723 (+   159us) service_pool.cc:224] Handling call
0709 13:19:04.420100 (+ 20377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.440065 (+ 19965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.440095 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.498557 (+ 58462us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.557258 (+ 58701us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:04.615292 (+ 58034us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.649393 (+ 34101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.649474 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.509342 (+859868us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:05.749122 (+239780us) raft_consensus.cc:1685] finished
0709 13:19:05.749210 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.749353 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44259,"prepare.queue_time_us":63720,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":53852,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":43682,"spinlock_wait_cycles":24751488,"thread_start_us":58281,"threads_started":1,"wal-append.queue_time_us":165262}
I20260709 13:19:05.763015 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:05.766335 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:05.770249 17388 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:19:05.770931 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:05.774878 17992 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:05.780819 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:05.783943 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:05.785207 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:05.785739 17388 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:05.788580 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.793520 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:05.795766 17391 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:05.737267 20990 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.756110 20828 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:05.748706 21011 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 13:19:05.737602 19574 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:05.764743 20829 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:05.764256 20973 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:19:06.002724 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:05.812650 17388 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:05.977488 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:05.880820 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.018424 17469 raft_consensus.cc:2410] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:05.990607 17320 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:19:06.009196 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 83407.5us
I20260709 13:19:05.774394 21017 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:05.965894 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.035917 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:05.799732 17997 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:05.887391 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:05.984011 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 203347us
I20260709 13:19:05.809580 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:05.890820 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:06.014349 21038 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:19:06.058293 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:06.029121 20992 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:19:06.048478 20767 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:05.794090 21000 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.977563 21026 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:06.061399 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:05.854395 21031 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:05.806864 21034 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:05.995675 20827 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.087755 21031 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.873174 20834 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:06.088903 20834 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.090188 21031 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.799176 21004 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.292s
I20260709 13:19:06.090977 20834 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.872380 20971 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.091650 20971 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:06.092073 20971 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.049070 20829 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.988968 20749 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:06.093216 20749 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:06.093852 20829 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.093819 20749 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.095209 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:06.095582 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.067785 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:05.906497 20995 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:06.105376 20995 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.107579 20995 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:06.109014 20767 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.109756 20767 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.112586 20767 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.115650 17991 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:06.117280 21000 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:06.119355 20749 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:06.120608 20990 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:06.121371 21018 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:06.123188 21026 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.125444 21026 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:06.127947 20926 consensus_meta.cc:287] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.002s
I20260709 13:19:06.128810 17995 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:06.130465 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:06.131345 20835 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.131845 20835 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:06.133155 20977 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.517s	user 0.005s	sys 0.011s
I20260709 13:19:06.126082 20971 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.135422 20971 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:05.904587 21002 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.270s
I20260709 13:19:06.151544 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2728) took 2276 ms. Trace:
I20260709 13:19:06.152104 17465 rpcz_store.cc:276] 0709 13:19:03.874862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.890646 (+ 15784us) service_pool.cc:224] Handling call
0709 13:19:03.890974 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.113556 (+222582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.113610 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.142034 (+ 28424us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.414630 (+272596us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:04.414667 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.414749 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.132497 (+1717748us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:06.140910 (+  8413us) raft_consensus.cc:1685] finished
0709 13:19:06.140934 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.151461 (+ 10527us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55611,"raft.queue_time_us":342309,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":13291,"spinlock_wait_cycles":18031360,"thread_start_us":356870,"threads_started":2,"wal-append.queue_time_us":363907}
I20260709 13:19:06.153748 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 547) took 1851 ms. Trace:
I20260709 13:19:06.154198 17393 rpcz_store.cc:276] 0709 13:19:04.302616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.302725 (+   109us) service_pool.cc:224] Handling call
0709 13:19:04.303022 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.385574 (+1082552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.153533 (+767959us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540023cdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:06.153691 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342357248}
I20260709 13:19:06.156011 20924 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:06.156430 20924 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:06.157339 20924 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.158402 20924 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.079113 20867 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:05.794144 20969 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.082214 21042 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:05.808009 20790 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.087831 21034 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.078094 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:05.905471 21037 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:19:06.052492 20828 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.104945 17313 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:06.106042 20719 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.175581 20719 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.175642 21034 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:06.133004 20834 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:06.132694 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:06.175813 20790 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:05.970736 21029 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:06.143332 17320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:06.176831 17320 raft_consensus.cc:606] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:06.177201 17320 raft_consensus.cc:614] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:06.147543 17999 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:06.051981 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:06.078580 19574 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:06.165979 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 246711us
I20260709 13:19:05.808125 20695 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:05.921332 20531 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.164566 21026 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:06.180229 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.166970 21042 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.171617 20614 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.184518 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 51911.9us
I20260709 13:19:06.182987 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:06.189472 20969 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.184542 20531 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.193001 17315 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.193569 20829 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:06.194146 20829 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 12 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:06.195019 20829 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.181830 20971 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:06.200955 17320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6758d139882843e5bddc827c260b81a9"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:06.201700 17320 raft_consensus.cc:606] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:06.201725 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.202169 17320 raft_consensus.cc:614] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:06.202193 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:06.203815 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:06.167081 21031 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:19:06.203683 20971 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:06.206854 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:06.207230 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 129275us
I20260709 13:19:06.207386 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.208642 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:06.189510 21042 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.209852 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:06.210203 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.210415 17992 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.210738 17465 raft_consensus.cc:2376] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8. Re-sending same reply.
I20260709 13:19:06.208163 17320 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:06.212766 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:06.214831 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.215901 17317 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:06.217756 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.219758 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:06.218708 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:06.221555 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.221778 17316 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.204088 20614 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.225369 20614 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:06.225534 17465 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:19:06.184882 20790 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:06.227244 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:06.227538 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2750) took 1571 ms. Trace:
I20260709 13:19:06.227968 17464 rpcz_store.cc:276] 0709 13:19:04.656507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.812883 (+156376us) service_pool.cc:224] Handling call
0709 13:19:04.813186 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.466021 (+652835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.227319 (+761298us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54000636d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:06.227475 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498813824}
I20260709 13:19:06.228468 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:06.229543 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:06.230237 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:06.230638 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.230540 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:06.230844 17392 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:06.231170 17991 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.233649 17468 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:06.234547 20959 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:06.235236 17316 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:06.235337 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.235930 17465 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:06.236527 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:06.236802 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.237288 20969 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:06.238387 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:06.238945 20969 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:06.239496 17469 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:06.241384 17463 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:06.241686 20790 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:06.242286 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.242604 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:06.242854 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:06.243382 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.244010 17463 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:06.201805 21029 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:06.245065 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.245771 17322 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:06.245887 21026 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:06.246279 21026 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:06.246650 21026 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.247176 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:06.249951 17313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7601a632a565453b83b93c1020924101"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:06.250171 17465 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:06.250494 17313 raft_consensus.cc:606] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:06.252774 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.253532 17313 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:06.254278 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:06.255957 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:06.234573 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.261466 17468 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.261891 17313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:06.262423 17313 raft_consensus.cc:606] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:06.262970 20725 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:06.263404 20725 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:06.264290 20954 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:06.265558 17464 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:06.266278 21042 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.266804 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:06.267582 17998 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:06.268339 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:06.264295 20725 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.269766 20864 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:06.269948 20725 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.270210 20864 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:06.274048 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47399.9us
I20260709 13:19:06.269801 21033 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.275655 17470 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:06.276013 17470 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:06.276117 21033 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.277007 17469 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:06.258142 20856 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.282780 17992 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:06.220479 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:06.276721 17470 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.257648 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:06.277194 21002 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:06.285051 17470 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:06.287700 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 67266.5us
I20260709 13:19:06.288338 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:06.302577 17315 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:06.284590 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:06.329362 20614 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:06.179507 20828 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.284502 20892 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:19:06.332386 20828 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.277045 21049 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:19:06.282837 21031 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.357612 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:06.356101 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:06.357163 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 99588.6us
W20260709 13:19:06.357951 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 66064us
I20260709 13:19:06.362375 17464 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:06.334321 17998 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:06.358613 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:06.363727 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:06.363727 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:06.366190 17468 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:06.367301 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.368469 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.369046 17468 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:19:06.369771 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.370319 17468 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:06.371058 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.372140 17470 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:19:06.372655 17470 pending_rounds.cc:85] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 7
I20260709 13:19:06.372979 17470 pending_rounds.cc:107] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:19:06.373347 17470 raft_consensus.cc:2889] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.378118 20828 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:06.377733 21031 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.378708 20828 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:06.379841 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.379647 20828 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.380470 17314 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:06.381485 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.382087 17314 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:06.382946 20966 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.383471 20966 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.385679 17468 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:06.386744 17991 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:06.388612 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 565) took 1849 ms. Trace:
I20260709 13:19:06.389227 17470 rpcz_store.cc:276] 0709 13:19:04.539059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.548933 (+  9874us) service_pool.cc:224] Handling call
0709 13:19:04.549260 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.275565 (+1726305us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b54004342a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d6276bdc0 00007f7d627f61c0 00007f7d627f7231 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c
0709 13:19:06.388383 (+112818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.388561 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127780608}
I20260709 13:19:06.374976 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:06.386682 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:06.391340 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 550) took 1635 ms. Trace:
I20260709 13:19:06.391465 17991 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:06.387130 17468 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:06.392053 17394 rpcz_store.cc:276] 0709 13:19:04.756404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.756545 (+   141us) service_pool.cc:224] Handling call
0709 13:19:04.766497 (+  9952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.811756 (+ 45259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.811808 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.816356 (+  4548us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.287941 (+1471585us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b18003c51a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:19:06.355328 (+ 67387us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:06.355371 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.355596 (+   225us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.384123 (+ 28527us) raft_consensus.cc:1685] finished
0709 13:19:06.384143 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.391278 (+  7135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5388,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":8555,"spinlock_wait_cycles":59844864,"thread_start_us":67171,"threads_started":1,"wal-append.queue_time_us":1538745}
I20260709 13:19:06.403759 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:06.365834 20981 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:06.406394 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:06.367152 21033 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:06.409409 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:06.387893 20971 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:06.413161 17314 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [7.10-7.10]
W20260709 13:19:06.415520 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.418072 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:06.422122 17463 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:06.439013 17463 pending_rounds.cc:85] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 5
I20260709 13:19:06.439366 17463 pending_rounds.cc:107] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:06.439666 17463 raft_consensus.cc:2889] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.426203 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:06.441267 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.441509 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:06.441931 17468 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:06.442763 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.404399 20834 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:06.388729 20924 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:06.404577 20925 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:19:06.433144 17393 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:06.410410 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2788) took 2011 ms. Trace:
I20260709 13:19:06.433686 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:06.428082 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:06.447371 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:06.411271 21034 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.448719 17468 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:06.462157 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.415611 20999 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.433987 20784 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.463313 17468 raft_consensus.cc:2376] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9. Re-sending same reply.
I20260709 13:19:06.464673 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.466435 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.468825 17468 raft_consensus.cc:2368] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:19:06.475121 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.470707 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.456288 17390 rpcz_store.cc:276] 0709 13:19:04.398735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.398912 (+   177us) service_pool.cc:224] Handling call
0709 13:19:04.419608 (+ 20696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.890228 (+470620us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:04.890553 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.932423 (+ 41870us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.932481 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:04.932554 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.289605 (+1357051us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180043e220. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f707522 00007f7d5f7097c1
0709 13:19:06.410176 (+120571us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400253d54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:06.410225 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.410341 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":629,"prepare.queue_time_us":22727,"prepare.run_wall_time_us":53,"raft.queue_time_us":976,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":62143,"spinlock_wait_cycles":1128215424,"thread_start_us":41400,"threads_started":1,"wal-append.queue_time_us":214413,"wal-append.run_cpu_time_us":1235,"wal-append.run_wall_time_us":1003296}
I20260709 13:19:06.467816 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:06.454293 20827 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:06.481388 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:06.485216 17390 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:06.425664 20926 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:19:06.454104 20924 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:06.447275 20959 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:06.482728 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:06.489573 20904 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.535616 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:06.503509 20924 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.537454 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:06.538646 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:06.539371 17389 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:06.540067 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:06.540128 20531 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:06.497776 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.498668 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:06.532706 20959 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.541577 17393 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:06.541919 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 676) took 1028 ms. Trace:
I20260709 13:19:06.542505 17996 rpcz_store.cc:276] 0709 13:19:05.513880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.518873 (+  4993us) service_pool.cc:224] Handling call
0709 13:19:06.541696 (+1022823us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b54005d2354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:06.541840 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188581504}
I20260709 13:19:06.543088 20959 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:06.546509 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.547726 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.548496 17393 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:06.549729 20966 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:06.549985 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:06.551017 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:06.551517 17393 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.496245 21055 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:06.531337 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:06.540824 17389 raft_consensus.cc:2410] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:06.554325 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.554579 17389 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:06.555511 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.556217 21013 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:06.460398 21034 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:06.568698 17468 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:06.526868 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:06.523962 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.544724 17996 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:06.548558 17463 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:06.564407 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.467759 20784 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.593870 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:06.594308 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.594695 17313 raft_consensus.cc:2368] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12.
I20260709 13:19:06.595196 17463 raft_consensus.cc:2410] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:06.588465 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 984) took 1713 ms. Trace:
I20260709 13:19:06.594008 20784 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.560632 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:06.596007 17393 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:06.532394 21031 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:06.632979 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.635859 17314 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:06.636021 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.636618 17463 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:06.637554 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.637934 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:06.568291 20904 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.640244 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.642190 17463 raft_consensus.cc:2368] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7.
I20260709 13:19:06.570068 21034 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:06.639658 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 79129.7us
I20260709 13:19:06.654637 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:06.654846 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.657102 21023 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.657655 21023 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.658069 21023 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.476253 20999 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.659798 17470 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:19:06.665500 21041 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.669s	user 0.000s	sys 0.005s
I20260709 13:19:06.669960 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.671064 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 552) took 1066 ms. Trace:
I20260709 13:19:06.671509 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.673256 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.674849 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.675709 17464 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:06.513140 20962 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.247s
I20260709 13:19:06.633664 21025 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.514348 20835 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:06.671506 17395 rpcz_store.cc:276] 0709 13:19:05.604696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.605890 (+  1194us) service_pool.cc:224] Handling call
0709 13:19:05.606202 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.704808 (+ 98606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.670823 (+966015us) spinlock_profiling.cc:243] Waited 70.9 ms on lock 0x7b5400124654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:06.670997 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163095424}
I20260709 13:19:06.672647 17463 raft_consensus.cc:2410] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:06.595654 17990 rpcz_store.cc:276] 0709 13:19:04.855514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.855665 (+   151us) service_pool.cc:224] Handling call
0709 13:19:04.875108 (+ 19443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.393359 (+518251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.568702 (+1175343us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400680954. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:06.569158 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152788736}
I20260709 13:19:06.648722 20904 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.688966 17991 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:06.601048 20834 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:06.522274 21026 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.694312 17322 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:06.687278 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.702186 17464 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:06.705363 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.706382 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.724906 17463 raft_consensus.cc:2368] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
W20260709 13:19:06.707307 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 52773.4us
I20260709 13:19:06.712349 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 727) took 1143 ms. Trace:
W20260709 13:19:06.713263 17467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 559) took 2227 ms (client timeout 1983 ms). Trace:
I20260709 13:19:06.713997 21026 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.689568 21025 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.715065 21044 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:06.716918 20825 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:06.739089 20825 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:06.740077 20825 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.741495 20825 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.744903 20639 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.717383 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.748114 17462 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:06.749284 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.709218 20790 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:06.718410 20834 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.685191 20999 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:06.535020 20864 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.764961 20842 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.765259 20864 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.765746 20842 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.767913 17463 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:06.768424 20842 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:06.726962 17467 rpcz_store.cc:269] 0709 13:19:04.485860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.485997 (+   137us) service_pool.cc:224] Handling call
0709 13:19:06.713061 (+2227064us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54002e2554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:06.713192 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263888256}
I20260709 13:19:06.726239 17999 rpcz_store.cc:276] 0709 13:19:05.569285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.701707 (+132422us) service_pool.cc:224] Handling call
0709 13:19:06.712135 (+1010428us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b54001a8bd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:06.712285 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12226304}
I20260709 13:19:06.729265 17464 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:06.774459 17464 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:06.774900 17464 pending_rounds.cc:85] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 4
I20260709 13:19:06.775175 17464 pending_rounds.cc:107] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:06.775480 17464 raft_consensus.cc:2889] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.738023 21025 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:06.738471 21044 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.747650 20961 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:06.777104 21044 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.750082 17462 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:06.700361 21023 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.782212 21023 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:06.760339 21039 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:06.761215 20531 raft_consensus.cc:993] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:19:06.785543 20531 raft_consensus.cc:1081] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:19:06.769538 17463 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:19:06.722517 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:06.788290 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 57858.9us
W20260709 13:19:06.788309 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 65910.8us
I20260709 13:19:06.789937 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:06.795753 17468 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:06.797955 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.825945 17462 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:06.797571 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:06.823014 20954 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:06.828560 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.828742 20961 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:06.829388 17463 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:06.829488 20961 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:06.830619 20961 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.812003 17287 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:06.796543 20925 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:06.796768 20924 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.835261 21034 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.828603 20954 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:06.837339 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:06.841922 20825 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:06.842406 20825 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:06.842984 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.843824 20892 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:06.844256 20892 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:06.827596 21044 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.837754 17992 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:06.836393 20864 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:06.837222 20954 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.851748 20825 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.859035 21034 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:06.862015 21034 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:06.862058 20904 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.838716 20924 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:06.862735 21034 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.845909 17287 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:06.866617 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.868731 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.869150 21034 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:06.869345 17469 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.870064 20954 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.874274 21042 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.875476 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:06.876217 17999 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.877136 20892 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:06.878444 20892 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.886194 17999 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:06.886876 17469 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:06.889144 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:06.895890 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 450809us
I20260709 13:19:06.899161 17360 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:06.864609 20904 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.888368 21034 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.906309 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.926973 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:06.927977 17463 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:06.926683 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:06.932006 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.918251 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:06.904561 20954 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:06.905109 20439 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.759084 21055 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.169s
I20260709 13:19:06.906563 20982 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:06.797004 21001 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:19:06.907279 20864 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:06.908803 20614 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:06.924759 20639 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.087s
W20260709 13:19:07.075606 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.133909 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 227933us
I20260709 13:19:07.072762 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2734) took 3136 ms. Trace:
W20260709 13:19:07.140717 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.980774 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:07.101960 17994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 681) took 1558 ms (client timeout 2000 ms). Trace:
I20260709 13:19:07.131896 17470 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:07.099296 17463 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:07.142647 17462 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
W20260709 13:19:07.142586 17994 rpcz_store.cc:269] 0709 13:19:05.515153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.519106 (+  3953us) service_pool.cc:224] Handling call
0709 13:19:07.073300 (+1554194us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b5400640354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:07.073425 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008966912}
I20260709 13:19:06.929729 20448 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.167s
I20260709 13:19:07.145691 17469 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:07.149634 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:07.150431 17469 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.907024 21056 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.188s
I20260709 13:19:06.926005 20987 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.002502 17962 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:07.163012 17394 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:07.164204 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:07.169414 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:07.095805 20988 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:07.172830 17392 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:07.131425 20614 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.176708 17435 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:07.177855 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:07.181876 17392 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.144646 21065 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:07.201828 21065 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:07.202404 21065 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.148896 20982 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:07.183141 20966 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:07.205530 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:07.205713 20982 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.206478 17397 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:07.207311 21044 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:07.140919 20439 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:07.209224 20439 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:07.212178 20784 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.558s	user 0.005s	sys 0.005s
I20260709 13:19:07.212675 20784 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.213907 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:07.214885 20784 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:07.215140 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:07.215801 20825 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:06.930730 21034 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.219455 21034 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:07.219710 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:07.220273 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:07.179544 20600 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.221390 20600 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.146874 19574 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:19:07.222745 19574 consensus_queue.cc:1243] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:07.223627 17434 leader_election.cc:400] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12.
I20260709 13:19:07.223975 17434 leader_election.cc:403] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:07.224143 20600 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:07.224629 20925 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.225368 20925 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:07.226013 20925 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12.
I20260709 13:19:07.227381 21072 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.227895 21072 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.230230 21072 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:07.231932 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:07.178711 20864 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:07.221954 20954 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:07.235291 17319 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:07.241324 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 238938us
I20260709 13:19:07.069414 20926 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:19:07.230715 21072 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:07.249042 17392 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
W20260709 13:19:07.258648 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 380694us
I20260709 13:19:07.260334 17321 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:19:07.261415 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.262288 17962 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:07.267071 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:07.269078 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.192076 20614 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.271123 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:07.012367 21042 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.243s
I20260709 13:19:07.275329 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 571) took 2420 ms. Trace:
I20260709 13:19:07.275862 17466 rpcz_store.cc:276] 0709 13:19:04.854982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.410309 (+555327us) service_pool.cc:224] Handling call
0709 13:19:05.426270 (+ 15961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.604028 (+177758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.275026 (+1670998us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540020f154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:07.275257 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407168768}
W20260709 13:19:07.255447 20835 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.064s	sys 0.123s
I20260709 13:19:07.277074 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:06.980799 20709 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.269s
I20260709 13:19:07.281852 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:07.255160 21034 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:07.285640 17216 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 217) took 31310 ms (client timeout 15000 ms). Trace:
I20260709 13:19:07.289322 17962 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:07.300279 17465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.010s	sys 0.005s
W20260709 13:19:07.279572 20835 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.064s	sys 0.123s
W20260709 13:19:07.302313 17465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.011s	sys 0.005s
W20260709 13:19:07.286159 17216 rpcz_store.cc:269] 0709 13:18:35.968690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.978152 (+  9462us) service_pool.cc:224] Handling call
0709 13:19:07.279142 (+31300990us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:04.849214 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:04.849954 (+   740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:04.850012 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:19:04.850032 (+    20us) tablet.cc:662] Decoding operations
0709 13:19:04.851263 (+  1231us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:04.851351 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:04.851381 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:04.857434 (+  6053us) tablet.cc:701] Row locks acquired
0709 13:19:04.857498 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:19:04.857681 (+   183us) write_op.cc:270] Start()
0709 13:19:04.857841 (+   160us) write_op.cc:276] Timestamp: P: 1783603144857609 usec, L: 0
0709 13:19:04.857866 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:19:04.858530 (+   664us) log.cc:844] Serialized 4334 byte log entry
0709 13:19:05.614038 (+755508us) op_driver.cc:464] REPLICATION: finished
0709 13:19:05.655069 (+ 41031us) write_op.cc:301] APPLY: starting
0709 13:19:05.655153 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:05.655344 (+   191us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:05.655456 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:05.656851 (+  1395us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:05.657223 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:19:05.657282 (+    59us) write_op.cc:312] APPLY: finished
0709 13:19:05.657686 (+   404us) log.cc:844] Serialized 83 byte log entry
0709 13:19:05.657878 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.658051 (+   173us) write_op.cc:454] Released schema lock
0709 13:19:05.658128 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:05.658529 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.658569 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1128081,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":40766,"apply.run_cpu_time_us":3423,"apply.run_wall_time_us":3427,"num_ops":11,"prepare.queue_time_us":318803,"prepare.run_cpu_time_us":13117,"prepare.run_wall_time_us":171648,"raft.queue_time_us":99769,"raft.run_cpu_time_us":4807,"raft.run_wall_time_us":42663,"replication_time_us":756005,"thread_start_us":403441,"threads_started":4,"wal-append.queue_time_us":379603,"wal-append.run_cpu_time_us":16477,"wal-append.run_wall_time_us":1470697}]]}
I20260709 13:19:07.300626 20842 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:07.283715 21054 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:19:07.304160 17466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:19:07.284993 21072 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:07.418069 20439 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:07.426302 17469 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
W20260709 13:19:07.431677 20892 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.000s
I20260709 13:19:07.433106 20719 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:07.433642 20719 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:07.434621 20719 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:07.399302 20961 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:07.436033 20961 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.438112 20961 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:07.398825 20825 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:07.440178 21070 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:19:07.441805 21071 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:07.443858 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 622) took 1049 ms. Trace:
I20260709 13:19:07.375244 20926 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:19:07.444298 17314 rpcz_store.cc:276] 0709 13:19:06.394544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.636703 (+242159us) service_pool.cc:224] Handling call
0709 13:19:06.637047 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.637426 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.637454 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.645114 (+  7660us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.931452 (+286338us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:06.931514 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.931612 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.443601 (+511989us) raft_consensus.cc:1685] finished
0709 13:19:07.443626 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.443787 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166,"raft.queue_time_us":328,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6734,"thread_start_us":261861,"threads_started":1,"wal-append.queue_time_us":633327}
W20260709 13:19:07.512113 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.547916 21019 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:07.550153 19574 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:07.550716 19574 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:07.551805 19574 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:07.556180 21072 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:07.557971 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1001) took 1341 ms. Trace:
I20260709 13:19:07.558387 17992 rpcz_store.cc:276] 0709 13:19:06.216226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.446915 (+230689us) service_pool.cc:224] Handling call
0709 13:19:06.453489 (+  6574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.853095 (+399606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.557715 (+704620us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400600ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:07.557898 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883302656}
I20260709 13:19:07.559729 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1604) took 1120 ms. Trace:
I20260709 13:19:07.560113 17468 rpcz_store.cc:276] 0709 13:19:06.439408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.474748 (+ 35340us) service_pool.cc:224] Handling call
0709 13:19:07.559567 (+1084819us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b54004213d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:07.559672 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213767936}
I20260709 13:19:07.561225 20439 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:07.548589 21019 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:07.562909 21019 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.564805 21019 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:07.565308 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1000) took 1349 ms. Trace:
I20260709 13:19:07.565817 17991 rpcz_store.cc:276] 0709 13:19:06.215618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.427280 (+211662us) service_pool.cc:224] Handling call
0709 13:19:06.453885 (+ 26605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.695970 (+242085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.565068 (+869098us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400695d54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:07.565247 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516406016}
I20260709 13:19:07.567112 19574 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:07.600263 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 375824us
I20260709 13:19:07.614094 17466 raft_consensus.cc:476] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Not starting forced leader election -- already a leader
I20260709 13:19:07.620898 17392 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:07.624123 17394 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:07.624481 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:07.624979 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:07.625309 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:07.626030 17318 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:07.625305 17314 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:07.629009 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:07.629335 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:07.630071 17394 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:07.631062 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:07.632097 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:07.632324 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:07.633474 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:07.635437 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:07.635980 17318 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:07.636709 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:07.642098 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:07.643028 17395 raft_consensus.cc:2393] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:07.643597 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:07.633227 20961 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:19:07.644793 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:07.646014 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:07.646317 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:07.646637 17991 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:07.647042 17999 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:07.647538 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:07.643383 20954 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.649425 20954 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.650117 17395 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:07.651548 20954 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:07.652330 21019 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:07.653191 17395 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:07.652979 21019 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.655319 21019 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:07.655930 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:07.620555 21034 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:07.675136 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:07.675565 21034 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.673882 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:07.677902 21034 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:07.678032 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:07.679389 17464 pending_rounds.cc:85] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 8
I20260709 13:19:07.679786 17464 pending_rounds.cc:107] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:19:07.680071 17464 raft_consensus.cc:2889] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.684618 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:07.685297 17469 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:07.685626 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1599) took 1247 ms. Trace:
I20260709 13:19:07.686841 17392 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:07.686034 17465 rpcz_store.cc:276] 0709 13:19:06.438084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.765580 (+327496us) service_pool.cc:224] Handling call
0709 13:19:06.765953 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.766344 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.766376 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.766876 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.306703 (+539827us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:07.312998 (+  6295us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.313485 (+   487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.313578 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.685410 (+371832us) raft_consensus.cc:1685] finished
0709 13:19:07.685431 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.685568 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5780,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":3060,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":205,"thread_start_us":539383,"threads_started":1,"wal-append.queue_time_us":789136}
I20260709 13:19:07.687790 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:07.661334 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:07.675913 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:07.690147 17470 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.674118 20614 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:07.690338 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 420744us
I20260709 13:19:07.671990 21065 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:07.709707 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 397908us
W20260709 13:19:07.710107 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 396089us
I20260709 13:19:07.696269 17469 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:07.696861 17392 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:07.636973 20982 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.713022 17994 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:07.714030 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:07.691768 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:07.733799 17462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.017s
W20260709 13:19:07.734805 17462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.005s	sys 0.017s
I20260709 13:19:07.736068 17470 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:07.701839 21054 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:07.706823 21082 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.694113 20448 consensus_queue.cc:1243] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:07.743227 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:07.746593 17999 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:07.748323 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:07.709053 21026 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:07.749564 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.012s	sys 0.037s
W20260709 13:19:07.762156 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.037s
W20260709 13:19:07.762902 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 547795us
I20260709 13:19:07.763806 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:07.765558 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:07.763152 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:07.781034 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:07.781895 17468 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:07.782034 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:07.784186 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:07.734789 21034 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:19:07.785108 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:07.740502 21086 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:07.786667 21086 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:07.784337 19574 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:07.789026 19574 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:07.790067 19574 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:07.797435 17362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.018s
W20260709 13:19:07.798409 17362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.001s	sys 0.018s
W20260709 13:19:07.799887 17993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.014s
W20260709 13:19:07.800707 17993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.009s	sys 0.014s
I20260709 13:19:07.748319 21054 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.844831 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:07.733569 20982 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:07.769521 21092 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.787817 21086 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.748503 21082 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:07.766325 21026 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:07.828578 21095 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:07.788419 21034 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:19:07.849261 20924 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.867648 20790 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:07.900818 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 157780us
I20260709 13:19:07.902446 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:07.853893 21023 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:19:07.867054 21092 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:07.893544 21095 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:07.915091 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:07.909379 21096 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.955070 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.931466 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.956784 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.922149 20614 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:07.963104 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 197646us
I20260709 13:19:07.968618 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:07.969661 20892 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:07.970130 20892 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.970072 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:07.970659 20892 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:07.964676 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.959647 21065 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:07.961691 20790 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:07.961923 21099 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:08.020814 21097 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:19:08.022294 20982 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:07.973307 21026 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:07.975504 17362 connection.cc:256] RPC call timeout handler was delayed by -1.083093430999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:19:08.049477 17362 connection.cc:256] RPC call timeout handler was delayed by -1.0685649339998236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 13:19:08.050459 17362 leader_election.cc:336] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.562s (SENT)
I20260709 13:19:08.050974 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:07.991744 21090 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:08.068616 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:08.069730 17362 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.589s (SENT)
I20260709 13:19:07.962939 21096 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.079726 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:08.084827 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:08.085338 17463 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.089977 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:08.052464 21065 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:08.093374 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:08.095459 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 354977us
I20260709 13:19:08.095099 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:08.072815 21026 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:08.078583 21082 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.120492 17395 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.044627 21099 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:08.115216 21093 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
W20260709 13:19:08.120217 21084 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:19:08.117892 21091 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:08.129896 17463 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:08.084779 21090 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.119279 21113 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:08.137916 17394 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:08.134838 17991 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:08.138542 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:08.124605 20961 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:08.115437 21054 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:08.140530 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 225530us
W20260709 13:19:08.141494 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 171484us
I20260709 13:19:08.153993 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:08.154546 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:08.155990 17463 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:08.156463 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:08.153954 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:08.158543 20961 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.159854 21090 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:08.141713 21100 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:19:08.139715 20790 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.150614 21122 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:08.166719 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2775) took 1027 ms. Trace:
I20260709 13:19:08.205178 17462 rpcz_store.cc:276] 0709 13:19:07.139119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.145115 (+  5996us) service_pool.cc:224] Handling call
0709 13:19:07.145438 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.168516 (+ 23078us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:07.168554 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.179091 (+ 10537us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.736208 (+557117us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:07.736266 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.736360 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.166500 (+430140us) raft_consensus.cc:1685] finished
0709 13:19:08.166517 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.166662 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11616,"raft.queue_time_us":12155,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":8692,"thread_start_us":518509,"threads_started":1,"wal-append.queue_time_us":912615}
I20260709 13:19:08.167680 21096 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.168052 21099 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.168295 21131 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:08.168779 21105 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:08.151760 21113 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.116523 21095 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:08.169687 21098 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:08.175194 17395 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:08.177839 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50030 (request call id 2777) took 1036 ms. Trace:
I20260709 13:19:08.130178 21092 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:08.118762 21065 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.181367 21091 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:08.181059 21094 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:19:07.136950 17471 rpcz_store.cc:276] 0709 13:19:03.935914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.936277 (+   363us) service_pool.cc:224] Handling call
0709 13:19:03.969469 (+ 33192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.969746 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:04.428784 (+459038us) log.cc:844] Serialized 14 byte log entry
0709 13:19:05.807492 (+1378708us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b1800416200. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:19:07.072248 (+1264756us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b1800416200. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287
0709 13:19:07.072408 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.072456 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:07.072513 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.072580 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.072702 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6495,"prepare.queue_time_us":458921,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":40183,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":5889,"spinlock_wait_cycles":14289024,"thread_start_us":742628,"threads_started":3,"wal-append.queue_time_us":294107,"wal-append.run_cpu_time_us":5836,"wal-append.run_wall_time_us":1299827}
I20260709 13:19:08.134126 21110 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:08.194155 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 99142.8us
I20260709 13:19:08.204996 21122 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.160609 20961 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:08.203843 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:08.180298 21088 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:08.245106 21088 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:08.245533 21088 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.245122 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:08.211872 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:08.208328 20790 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.247385 21131 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:08.247613 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 43889.4us
I20260709 13:19:08.247913 21131 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.248433 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:08.220712 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:08.208503 21119 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.157356 20614 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:19:08.194463 17463 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:19:08.239095 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 82675.2us
I20260709 13:19:08.245905 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:08.256985 17388 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:19:08.257241 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:08.219131 17466 rpcz_store.cc:276] 0709 13:19:07.148300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.277303 (+129003us) service_pool.cc:224] Handling call
0709 13:19:08.177634 (+900331us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400200b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627eba3d 00007f7d677bbcd0 00007f7d60d40254 00007f7d60d401e2 00007f7d60d40111 00007f7d60d4008c 00007f7d60d3f342 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:08.177736 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600630016}
I20260709 13:19:08.258450 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:08.249444 17395 raft_consensus.cc:2410] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:08.260484 17992 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:08.244445 21116 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:08.221014 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:08.220459 21096 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:08.208561 21130 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:08.253157 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:08.226949 21113 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:08.273213 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 52348.7us
I20260709 13:19:08.274287 17362 leader_election.cc:400] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:19:08.275315 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:08.271195 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:08.263361 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:08.181257 20892 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.289500 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:08.266266 17397 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:08.268603 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:08.270756 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:08.279529 21125 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:08.280196 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:08.299672 17997 raft_consensus.cc:2410] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 13:19:08.280663 21136 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:08.253329 20961 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:08.285282 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:08.306844 17991 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:08.241218 21122 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:08.293792 17388 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:08.280545 21131 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.300695 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:08.299528 17994 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:08.253499 21099 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.269043 21126 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:08.284806 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 678) took 2770 ms. Trace:
I20260709 13:19:08.313549 21117 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:08.315111 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:08.309347 21125 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.298864 21132 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:08.315982 21132 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.249050 21091 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.317348 21125 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:08.317670 21075 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.721s	user 0.000s	sys 0.006s
I20260709 13:19:08.318095 21132 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.318461 21091 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:08.318619 21123 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:08.319177 21123 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.309288 21136 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.321117 21123 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:08.321684 21092 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.322392 21136 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.323000 21019 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:19:08.323558 21108 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:08.324591 20386 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:08.324992 20386 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:08.325724 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:08.303706 20719 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.334461 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 588) took 1774 ms. Trace:
W20260709 13:19:08.333365 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 356226us
I20260709 13:19:08.349200 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1685) took 1946 ms. Trace:
I20260709 13:19:08.306083 21124 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:08.342002 17467 rpcz_store.cc:276] 0709 13:19:06.560555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.770384 (+209829us) service_pool.cc:224] Handling call
0709 13:19:06.770765 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.771244 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.771287 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.771870 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.274890 (+503020us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:07.274937 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.275004 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.317123 (+1042119us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:08.326565 (+  9442us) raft_consensus.cc:1685] finished
0709 13:19:08.326583 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.334387 (+  7804us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7625,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":77131008,"thread_start_us":493227,"threads_started":1,"wal-append.queue_time_us":771658}
W20260709 13:19:08.352126 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 54862.2us
I20260709 13:19:08.349691 17389 rpcz_store.cc:276] 0709 13:19:06.403008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.556553 (+153545us) service_pool.cc:224] Handling call
0709 13:19:06.556816 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.557514 (+   698us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:07.107353 (+549839us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.711855 (+604502us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.711988 (+   133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.725723 (+ 13735us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.725852 (+   129us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:07.726095 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.898230 (+172135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.898314 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.348933 (+450619us) raft_consensus.cc:1685] finished
0709 13:19:08.348962 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.349132 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11119,"prepare.queue_time_us":24239,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":5303,"raft.queue_time_us":395749,"raft.run_cpu_time_us":615,"raft.run_wall_time_us":108720,"thread_start_us":1033516,"threads_started":3,"wal-append.queue_time_us":814641}
I20260709 13:19:08.364476 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:08.365206 17990 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
W20260709 13:19:08.365876 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 76428.1us
I20260709 13:19:08.366465 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:08.367241 17990 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:08.369237 17362 leader_election.cc:400] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7.
I20260709 13:19:08.369655 17362 leader_election.cc:403] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.371066 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:08.371969 20784 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 6. Current term is 7.
I20260709 13:19:08.314441 17993 rpcz_store.cc:276] 0709 13:19:05.514414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.562189 (+ 47775us) service_pool.cc:224] Handling call
0709 13:19:05.562614 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.730315 (+167701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.730348 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.747371 (+ 17023us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.014522 (+267151us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:06.786814 (+772292us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b1800371da0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf 00007f7d6280e038
0709 13:19:07.263920 (+477106us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.846472 (+582552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.284355 (+437883us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400600254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:08.284427 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.284493 (+    66us) raft_consensus.cc:1685] finished
0709 13:19:08.284511 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.284705 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44774,"prepare.queue_time_us":1476442,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1469,"raft.queue_time_us":167730,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":14773,"spinlock_wait_cycles":385615104,"thread_start_us":1230585,"threads_started":3,"wal-append.queue_time_us":876901,"wal-append.run_cpu_time_us":1782,"wal-append.run_wall_time_us":1080559}
I20260709 13:19:08.372603 21065 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.373703 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:08.375947 20790 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:08.379410 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.382903 21095 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.383385 21095 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.365976 21124 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.353338 20982 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:08.333333 20961 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:08.470642 17466 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:19:08.399886 17286 connection.cc:256] RPC call timeout handler was delayed by -1.1418569459999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 13:19:08.388326 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:08.326617 21099 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:08.476063 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 87813.8us
W20260709 13:19:08.476586 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 105583us
I20260709 13:19:08.491991 17362 leader_election.cc:400] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:19:08.492389 17362 leader_election.cc:403] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.365523 21136 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:08.496181 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 208753us
I20260709 13:19:08.501686 20926 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:08.473344 21065 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:08.390223 21129 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:08.363085 20614 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:19:08.507543 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:08.521716 17994 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:08.414243 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:08.519625 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.389195 21132 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
W20260709 13:19:08.544786 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 52932.1us
I20260709 13:19:08.522481 17997 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.545832 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:08.501837 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:08.487490 20790 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:08.506446 21092 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:08.557312 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 55566.8us
W20260709 13:19:08.549962 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45279.7us
W20260709 13:19:08.550838 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 263654us
I20260709 13:19:08.491427 20448 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.552966 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:08.559158 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:08.507838 21130 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:08.325734 20386 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.561570 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:08.569882 20386 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.569555 21130 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.389084 21095 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.519555 21137 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8.
I20260709 13:19:08.556135 20725 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:08.573027 21053 consensus_queue.cc:1175] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c23a664ebf3347a4934dee377c8b5101" responder_term: 11 status { last_received { term: 6 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:08.543988 21129 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.594669 20961 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.595815 20892 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.555028 21136 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:19:08.601153 21119 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:08.601915 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:08.602748 21142 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:08.609310 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 51091.2us
I20260709 13:19:08.555940 20864 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:19:08.625890 21099 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.555147 21090 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:08.566443 21138 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:08.654968 17313 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:08.632144 20725 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.655349 17313 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:08.655573 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:08.656211 17316 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:08.656103 17313 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.657307 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:08.658157 17321 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:08.507550 20982 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:19:08.628203 21113 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.662443 17997 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:08.566073 21091 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.084s
W20260709 13:19:08.665051 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 63251.1us
I20260709 13:19:08.666101 17467 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:08.667273 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:08.667568 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:08.668288 17317 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.655654 20725 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.678417 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:08.679132 17316 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.675185 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:08.577097 21125 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:19:08.677070 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:08.677341 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:08.650811 21092 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:08.577947 21088 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.580384 20448 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.631016 21086 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:19:08.687393 17319 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:08.709501 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:08.671181 21144 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:08.677831 21119 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:08.744480 17464 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:08.711167 17963 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:08.745657 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 419954us
I20260709 13:19:08.743414 21129 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:08.714691 20892 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:08.740505 17317 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:08.752765 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:08.715899 21096 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:08.709271 21034 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:19:08.771899 17316 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:08.754257 21142 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:08.715441 21092 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.798022 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:08.799893 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 217010us
W20260709 13:19:08.753232 21005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.175s	user 0.008s	sys 0.011s
I20260709 13:19:08.749954 21146 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:08.810985 17319 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:08.759539 21123 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.755515 21096 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.801874 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:08.815524 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:08.811079 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:08.817585 17321 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:08.752655 20892 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:08.810751 21005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.009s	sys 0.011s
I20260709 13:19:08.798084 21142 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:08.816114 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 238862us
I20260709 13:19:08.837121 21096 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.751552 21119 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.850224 21116 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:08.850721 20988 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:08.851178 21126 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:08.809911 21124 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:08.817464 21113 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:08.863690 17995 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:08.848975 21142 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:08.864158 21140 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:19:08.841127 21123 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.870419 21116 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.886025 20988 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.890340 20865 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:08.890836 21114 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:08.891853 21122 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.000s
I20260709 13:19:08.925776 21114 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:08.926251 21122 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.926839 21114 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.927716 20988 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:08.928246 21114 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.892807 21148 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.929118 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:08.929418 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:08.929265 21148 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.930060 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:08.925611 20865 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:08.930469 21122 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:08.931167 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 67001us
I20260709 13:19:08.931571 20865 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.930090 17462 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:08.930689 17469 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:08.939603 21158 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:08.931757 21148 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:08.917304 20749 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:08.941335 21149 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:19:08.946226 17469 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
W20260709 13:19:08.948796 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.941366 21145 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:19:08.948108 17471 raft_consensus.cc:2376] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12. Re-sending same reply.
I20260709 13:19:08.952973 21092 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:08.893908 20892 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.958536 21142 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:08.966236 20790 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:08.965297 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 163506us
I20260709 13:19:08.967445 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:08.972092 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:08.963750 21088 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:08.985152 21123 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:08.977192 20448 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:08.985765 21150 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:08.986853 21044 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:08.987313 21044 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:08.987777 21142 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:08.992408 21164 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:19:08.994227 21119 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:08.994828 20926 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:08.911158 21126 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:08.977018 21086 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.001180 20926 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:09.009147 21163 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.009052 21161 consensus_queue.cc:1059] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:19:09.009728 20926 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.009881 21163 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.010571 21161 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.011337 21161 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.011129 21086 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.012491 21163 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:09.013476 21086 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:09.017138 20904 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:09.014319 21126 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:09.036531 20749 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:08.988361 21044 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.041771 21044 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.046505 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.021562 21163 raft_consensus.cc:3055] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:09.050956 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.055965 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.015758 21116 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:09.058390 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.058727 17994 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:19:09.058847 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.055449 17434 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:09.061244 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.061020 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:09.017052 21095 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:19:09.054623 21126 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.056705 21119 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.054723 20961 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.029935 20904 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:09.006861 20448 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:19:09.066169 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:09.061510 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 91485.5us
I20260709 13:19:09.068364 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.062927 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:09.066947 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:09.078107 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.080574 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.078706 17319 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
W20260709 13:19:09.128448 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.081713 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.155346 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.055944 21163 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:09.082661 20725 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.159308 17317 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:09.081951 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:09.158051 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 176438us
I20260709 13:19:09.158797 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.158407 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.076587 21088 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.154844 21101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.016s	sys 0.002s
I20260709 13:19:09.063098 21168 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:09.125640 21123 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:09.165805 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.061662 21116 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:09.064944 20448 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:09.165201 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 83373.5us
I20260709 13:19:09.178866 21116 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.190979 21116 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.155382 21092 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.187729 20448 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:09.193301 21092 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.194129 20448 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.195776 21092 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:09.174722 17998 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:09.062218 21126 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.192344 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.195745 20448 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:09.176898 21101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.017s	sys 0.002s
W20260709 13:19:09.161110 21082 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.004s	sys 0.011s
I20260709 13:19:09.173560 21148 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:09.178017 21123 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:09.217217 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 495080us
I20260709 13:19:09.177336 21168 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:09.062285 21119 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:09.231036 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 63851us
I20260709 13:19:09.062609 20961 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.063414 20904 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:09.213536 21082 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.004s	sys 0.011s
I20260709 13:19:09.234710 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.235275 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.247865 17469 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
W20260709 13:19:09.234239 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 153377us
I20260709 13:19:09.211025 21120 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:09.216562 21148 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:09.221144 21160 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:19:09.176493 21088 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.244808 17999 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:09.248740 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.253271 17465 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:09.248631 17998 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:19:09.239084 21165 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:19:09.256184 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:09.222380 21168 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.222633 21123 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.238703 21142 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:19:09.221892 21092 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:19:09.243767 21113 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.259860 17464 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:09.239964 21163 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.252346 21148 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.290127 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.290443 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.289148 17993 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:09.292591 21173 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:19:09.304199 17315 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:09.285912 20904 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:09.293897 21177 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:09.291940 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:09.294548 21182 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.290195 20790 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:09.292783 21176 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.336786 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:09.355247 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 99105.9us
W20260709 13:19:09.367264 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.369972 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:09.370503 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.371461 17463 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:09.375506 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.377781 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.286356 21166 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.204s
W20260709 13:19:09.381533 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.381958 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.382051 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.319041 21113 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.366979 21124 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:09.389933 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.400158 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.389746 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:09.398192 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:09.379228 20725 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:09.367830 20790 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.405172 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:09.389384 21096 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 13:19:09.406144 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:09.422259 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:09.390108 21163 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.387007 20924 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.409150 21135 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:09.418447 20835 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:09.425385 21130 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.401998 21142 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:09.373584 21176 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.428732 21099 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.451504 20982 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.393818 21178 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.223s
W20260709 13:19:09.463403 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 910579us
I20260709 13:19:09.399354 21124 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.432654 21092 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.461540 17470 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:19:09.464159 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 810226us
I20260709 13:19:09.503024 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:09.501920 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.502274 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.504027 17389 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:09.504343 17388 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:09.503160 17397 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:09.463189 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 573) took 1207 ms. Trace:
I20260709 13:19:09.506335 17388 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:09.507527 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.508145 17393 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:09.509398 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:09.453697 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 682) took 3254 ms. Trace:
I20260709 13:19:09.510393 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.471882 17313 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.511379 17397 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:09.442307 20835 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:09.514151 17318 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:09.516180 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:09.512874 20835 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.518200 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:09.436753 21135 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:09.418551 21096 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.518358 17397 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:09.518970 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.523535 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.523963 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.510505 17995 rpcz_store.cc:276] 0709 13:19:06.199453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.205002 (+  5549us) service_pool.cc:224] Handling call
0709 13:19:06.205285 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.897798 (+2692513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.453423 (+555625us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b54007611d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:09.453633 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6113331584}
I20260709 13:19:09.520515 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:09.520417 17388 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:09.525079 17388 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:09.519443 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:09.525763 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:09.525902 17394 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:09.528472 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:09.529461 17998 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:09.465044 21091 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:09.526088 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:09.535523 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:09.536073 17397 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:09.523656 20725 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:09.472438 21126 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:09.453286 20961 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:09.470016 21144 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:09.464615 21065 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:09.436563 20924 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.468524 21072 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:09.528931 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.452687 21170 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:09.519752 21092 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.644593 21170 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.646139 21092 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:09.646642 21170 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:09.646812 21174 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.354s	user 0.000s	sys 0.002s
I20260709 13:19:09.471999 20790 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:09.451535 21119 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:09.462172 20954 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:09.650519 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:09.465626 21088 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:09.526594 21135 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.693655 20924 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:09.606963 17997 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:19:09.521351 20614 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.554569 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:09.694958 17397 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:09.696125 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45666.5us
I20260709 13:19:09.689359 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:09.581223 17462 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:19:09.697485 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.620043 17313 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:09.458570 21113 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:09.697783 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:09.513151 21103 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:09.521587 21142 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.569479 21148 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.635465 21096 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:09.500365 20982 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.681255 20725 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:09.704336 21187 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.713990 21187 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.714473 21187 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.714812 20982 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:09.636565 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:09.531103 20749 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
W20260709 13:19:09.523838 21181 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:19:09.637367 21065 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.717249 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.719063 21065 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:09.631636 21144 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:09.566084 20834 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:19:09.524228 21082 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:09.641863 17394 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:09.720101 21144 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.721464 21144 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:09.643703 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 118138us
I20260709 13:19:09.722656 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.649403 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2788) took 1268 ms. Trace:
I20260709 13:19:09.725054 17467 rpcz_store.cc:276] 0709 13:19:08.380584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.413877 (+ 33293us) service_pool.cc:224] Handling call
0709 13:19:09.649172 (+1235295us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54002607d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:09.649326 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326800128}
I20260709 13:19:09.725737 21065 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:09.726595 20834 raft_consensus.cc:2764] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:09.513275 20828 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.463696 21117 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.724418 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:09.727246 20828 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.728570 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.729352 20828 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:09.729403 20725 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.730396 20725 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.506137 17391 rpcz_store.cc:276] 0709 13:19:08.255521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.255651 (+   130us) service_pool.cc:224] Handling call
0709 13:19:08.287962 (+ 32311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.288157 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:08.311070 (+ 22913us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.553925 (+242855us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.462619 (+908694us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b18003a9f00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:19:09.462845 (+   226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.462892 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:09.462945 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.463023 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.463136 (+   113us) inbound_call.cc:177] Queueing success response
0709 13:19:09.499790 (+ 36654us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b18003a9f00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f707522 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
Metrics: {"mutex_wait_us":926489,"prepare.queue_time_us":31677,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":941854,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":17615,"spinlock_wait_cycles":22876800,"thread_start_us":210707,"threads_started":1,"wal-append.queue_time_us":398325}
I20260709 13:19:09.730861 20725 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:09.633781 21072 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.698380 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1732) took 1044 ms. Trace:
W20260709 13:19:09.700645 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 327144us
I20260709 13:19:09.731882 17313 rpcz_store.cc:276] 0709 13:19:08.654420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.654532 (+   112us) service_pool.cc:224] Handling call
0709 13:19:08.654846 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.892662 (+237816us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b1800056580. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d6282f646 00007f7d6276958e 00007f7d627eaf9e 00007f7d627ec7de 00007f7d627f6b49 00007f7d627f7416 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4
0709 13:19:09.471711 (+579049us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5800495bd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627500aa 00007f7d627d2447 00007f7d627eafe7 00007f7d627ec7de 00007f7d627f6b49 00007f7d627f7416 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4
0709 13:19:09.698127 (+226416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.698326 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666840064}
I20260709 13:19:09.701761 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.733095 21072 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:09.733170 17462 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:19:09.703706 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.734107 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:09.734450 17434 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:09.735041 21072 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:09.735138 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:09.655210 21161 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.000s
I20260709 13:19:09.735317 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.739881 21072 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:09.740998 21170 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.740866 21072 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.741458 21168 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.742071 21161 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:09.738523 17467 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:19:09.743462 17316 raft_consensus.cc:2410] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:19:09.739296 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.743732 21168 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:09.735767 21119 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.744102 17467 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:09.744490 21168 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:09.744136 17462 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:09.741596 20790 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:09.744987 21092 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:09.745518 20790 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.745591 20448 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:09.746017 20790 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:09.746569 21170 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:09.746954 21170 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:09.747608 21148 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:09.747675 21170 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.649498 17466 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:09.537820 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:09.749109 21170 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:09.749219 21176 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:09.749583 20834 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:09.749714 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 211999us
I20260709 13:19:09.750200 20834 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:09.750860 21182 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.738890 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.751642 17468 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:09.751181 20834 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.535719 21091 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:09.752740 21090 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:09.752892 21091 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.754230 21091 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.655754 21123 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.756276 21123 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:09.731389 20725 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.757022 20828 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:09.757984 21026 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:09.758347 21026 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:09.759151 21026 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.760253 21026 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.763928 20725 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.720137 17395 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:09.687827 21120 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.750713 21176 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:09.767220 21124 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:09.767612 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.767762 20531 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:09.768285 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.769467 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.736898 21142 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.768181 21114 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:09.771160 21114 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:09.771343 17990 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:09.771450 21142 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:09.772517 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 740) took 1409 ms. Trace:
I20260709 13:19:09.770799 17992 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:19:09.773185 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:09.774017 17994 raft_consensus.cc:2410] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 13:19:09.775915 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.776576 17313 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:09.706307 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:09.778231 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 71982us
I20260709 13:19:09.778748 17465 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:09.778896 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:09.776695 17315 raft_consensus.cc:2410] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 12 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:19:09.779583 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.783696 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.784255 17395 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
I20260709 13:19:09.786369 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.786695 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.787032 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.788539 17991 rpcz_store.cc:276] 0709 13:19:08.363208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.363329 (+   121us) service_pool.cc:224] Handling call
0709 13:19:08.372939 (+  9610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.666406 (+293467us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:08.684787 (+ 18381us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.887499 (+202712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.887569 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:08.887627 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.195508 (+307881us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b1800493a80. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:19:09.772317 (+576809us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400604854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:09.772360 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.772466 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18376,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":1312,"raft.queue_time_us":126,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"spinlock_wait_cycles":677331072,"thread_start_us":201990,"threads_started":1,"wal-append.queue_time_us":360443}
I20260709 13:19:09.790719 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:09.792616 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:09.793327 17314 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.793439 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.794064 17994 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:09.795744 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.796305 17395 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:09.754074 21090 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:09.797044 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.802665 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.807639 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:09.797621 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:09.802654 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.802855 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.803755 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:09.804665 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.811949 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.806879 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.817162 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.817548 17468 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:09.818032 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.818609 17462 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
W20260709 13:19:09.820071 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.820785 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.817269 20904 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:09.821358 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.707827 21088 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:09.822759 21088 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:09.823156 21088 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:09.826835 21044 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.785s	user 0.011s	sys 0.000s
I20260709 13:19:09.827039 20790 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.690366 20954 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:09.829113 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.829756 17322 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:09.704063 20386 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:09.830236 21114 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.830983 20386 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.831238 21114 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.831393 20386 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.831825 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:09.833992 20924 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.834441 20924 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:09.834666 21117 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.834766 20924 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.835877 17390 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:09.836416 21096 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:09.780540 21050 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:19:09.837225 21113 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:09.837668 21113 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.709332 21103 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.838016 21113 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.816702 20988 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:19:09.839624 21103 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:09.839716 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1006) took 1569 ms. Trace:
I20260709 13:19:09.840145 17996 rpcz_store.cc:276] 0709 13:19:08.269949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.270156 (+   207us) service_pool.cc:224] Handling call
0709 13:19:08.270375 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.306395 (+ 36020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.306422 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.306461 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:08.306493 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.839497 (+1533004us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b54001a9854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:09.839538 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.839660 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82429824}
I20260709 13:19:09.842962 17395 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:09.821157 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.844013 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.844924 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:09.845934 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:19:09.739557 21116 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.502s	user 0.003s	sys 0.003s
I20260709 13:19:09.850992 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:09.847622 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:09.848575 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.849644 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.848743 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.855501 17314 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:09.845947 17397 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
W20260709 13:19:09.857192 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50784.6us
I20260709 13:19:09.866254 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.867977 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.868557 17464 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:09.874030 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.856720 20864 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:09.816632 21176 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.863397 21183 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:09.869004 21117 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:09.869423 20828 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:09.871990 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.872390 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:09.858736 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:09.857836 21090 consensus_queue.cc:1243] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:09.878407 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.885610 17992 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:09.882967 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:09.879956 21183 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:09.879063 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.855520 21144 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:09.858574 21044 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:09.856449 21123 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:09.881310 17990 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:09.897262 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:09.877861 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.842741 20835 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.889756 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.875243 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:09.891980 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.846519 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:09.857338 21116 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.898334 17397 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 5.
I20260709 13:19:09.898305 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.900355 17464 raft_consensus.cc:2368] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13.
I20260709 13:19:09.876967 21176 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.882141 20790 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:09.856321 20904 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:19:09.882504 21112 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:19:09.904163 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.909969 17397 raft_consensus.cc:2410] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:19:09.910382 17963 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:09.910864 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:09.910769 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:09.911515 17464 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:09.911712 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 65289.7us
I20260709 13:19:09.897719 21044 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:09.947671 17464 raft_consensus.cc:2410] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:09.961207 17992 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:09.962029 17463 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:09.959344 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.964326 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.964660 17390 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
W20260709 13:19:09.958715 17287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.022s	sys 0.016s
I20260709 13:19:09.959981 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:09.966080 17287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.023s	sys 0.016s
W20260709 13:19:09.966473 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 516256us
W20260709 13:19:09.970819 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.963800 17471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.010s	sys 0.028s
I20260709 13:19:09.911682 17397 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:09.971601 17471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.010s	sys 0.028s
I20260709 13:19:09.973694 17466 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:09.973694 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:09.976393 17464 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
W20260709 13:19:09.984481 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.975590 17964 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:09.985752 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.940523 17994 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:09.956159 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:09.909843 21176 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.915270 20988 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:09.999320 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:09.988700 17392 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:10.004072 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.006166 17390 raft_consensus.cc:2393] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:10.007097 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.897993 21144 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:09.922382 21123 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.908823 21090 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:09.899360 21039 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:19:10.008927 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.973156 21044 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.024341 17396 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:09.962205 21023 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:10.025599 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.023274 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:09.999456 21101 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.949029 21026 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:19:09.942199 20962 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:19:10.028472 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.021754 21090 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.007984 21065 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.034493 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:10.036857 17322 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:09.996342 20531 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:19:10.037854 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:09.918099 20386 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.038817 17471 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:10.039424 17389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.017s	sys 0.021s
W20260709 13:19:10.057329 17389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.018s	sys 0.021s
I20260709 13:19:10.040998 17397 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:10.050298 17322 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:19:10.039634 17437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.013s	sys 0.031s
I20260709 13:19:10.028961 20828 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:10.058163 17321 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:10.028317 21192 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:10.060545 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.061002 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:10.081805 17322 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:19:10.057823 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.030992 21099 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:10.060671 17437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.013s	sys 0.031s
I20260709 13:19:10.033388 20725 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:10.092342 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.097210 17396 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:10.034971 21090 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:09.972785 21183 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.024478 21123 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.035108 21023 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:10.130383 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.100005 21132 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:19:10.092173 21099 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.151119 21099 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.107698 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:10.113490 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1629) took 1196 ms. Trace:
I20260709 13:19:10.153891 17470 rpcz_store.cc:276] 0709 13:19:08.923015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.923166 (+   151us) service_pool.cc:224] Handling call
0709 13:19:09.461156 (+537990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.503261 (+ 42105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.113220 (+609959us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54004213d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:10.113419 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181256064}
I20260709 13:19:10.117467 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.057837 20790 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.158742 17390 raft_consensus.cc:2410] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:10.053472 21115 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.099787 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.062467 20828 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:10.136034 21153 consensus_queue.cc:1175] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7108577e5754060b7e468a43dfdcdeb" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 8 index: 5 } }
I20260709 13:19:10.137285 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:10.180550 17396 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:10.054133 21065 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.147608 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:10.125732 20988 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:10.149751 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:10.185307 17464 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:10.152732 21132 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:10.158432 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50829.1us
I20260709 13:19:10.119267 17317 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:10.187184 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:10.195322 21194 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:19:10.195839 17321 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:10.197299 17321 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:10.198061 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.198940 21095 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.199429 17462 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 12. Ops: []
I20260709 13:19:10.199486 21095 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.201895 21095 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:10.202500 20834 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:10.202934 20834 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:10.203320 20834 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.205277 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:10.206764 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:10.207911 21168 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:10.208637 21148 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:10.209154 17392 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:10.209604 21148 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:10.210114 21148 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:10.211601 21119 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:10.211987 21119 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:10.212572 20988 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.212796 21119 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.214454 21119 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.189868 21132 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:10.216706 21132 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.218027 21132 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:10.219960 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.160470 17471 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.221292 21065 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:10.160962 17389 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:19:10.162041 21197 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:10.179144 20828 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.224022 17391 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:10.225551 17391 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:19:10.228890 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:10.175820 21115 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.168540 21191 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:10.168170 21187 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.232049 21191 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:10.173420 21026 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:10.088521 21192 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:10.168285 21044 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.258627 21044 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:10.260907 20954 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:10.178064 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:10.262378 17390 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:10.263459 20614 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.001s
I20260709 13:19:10.263924 20614 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:10.264575 17394 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.173034 20790 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.266330 21123 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:10.267257 20790 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:10.211081 21148 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.162794 21162 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:10.230109 20865 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.273139 21162 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:10.274881 21198 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 13:19:10.275636 21191 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.277204 21191 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.278731 20926 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.173128 17397 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
W20260709 13:19:10.236747 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.163682 20386 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:10.237385 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:19:10.234421 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.242949 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:10.223423 21144 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:10.253847 21187 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:10.300431 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.307054 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:10.309548 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 72287.2us
I20260709 13:19:10.255631 21192 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.256569 21116 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:10.274260 21162 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.278348 20834 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.237993 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:10.283275 17314 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:10.253091 17391 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:10.102788 21072 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.290026 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 49427.9us
I20260709 13:19:10.292493 17390 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:10.293500 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.294775 17317 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.308514 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:10.314842 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:10.320870 17395 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:10.327335 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:10.334648 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:10.338428 17462 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:10.326766 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:10.333321 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:10.342729 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:10.344460 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.348069 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:10.340651 21114 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.001s
I20260709 13:19:10.377025 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:10.334228 20790 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:10.324406 21124 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.396054 17462 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:10.396867 17471 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:19:10.401114 17464 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:10.405580 17395 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:10.418141 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.426018 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.426738 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.434675 17320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.057s	sys 0.064s
I20260709 13:19:10.437441 17395 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:10.334307 21096 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
W20260709 13:19:10.464730 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.400348 21192 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:10.462203 17435 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.531s (SENT) [suppressed 23 similar messages]
I20260709 13:19:10.443293 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:10.282684 21023 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.494475 17397 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:10.490374 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 534296us
W20260709 13:19:10.435146 17320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.057s	sys 0.064s
I20260709 13:19:10.376243 21162 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.352910 21072 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.400960 21103 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:10.500023 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:10.503429 17462 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:10.538105 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:10.470956 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:10.545121 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45255us
W20260709 13:19:10.539877 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.546223 17397 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.553767 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:10.510775 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.557986 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:10.439595 21114 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:10.559881 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:10.435107 20790 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:10.403901 20614 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
I20260709 13:19:10.552733 17395 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:10.532076 21182 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.538870 21103 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.567685 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:10.566093 17313 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:10.589797 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:10.548518 21026 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.575187 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:10.432943 21124 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.581737 20834 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:10.585788 21182 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.586192 21119 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.556430 21135 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.853s	user 0.010s	sys 0.002s
I20260709 13:19:10.573616 21054 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:10.561575 20962 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.593472 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:10.501718 21138 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:19:10.561069 21101 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.597422 20614 consensus_queue.cc:1243] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:19:10.607724 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 280468us
W20260709 13:19:10.630685 21206 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:10.631022 21170 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:10.632134 21170 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:10.632246 21205 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:19:10.608515 17397 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:10.633446 20531 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:10.609359 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:10.634578 20614 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:10.634971 20614 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:10.635105 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 586) took 1101 ms. Trace:
W20260709 13:19:10.612942 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.615936 21054 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:10.637111 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:10.638209 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:10.636490 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:10.638949 21155 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.639701 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:10.641094 21054 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.641239 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:10.641425 20725 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.642632 17362 leader_election.cc:400] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13.
I20260709 13:19:10.643414 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:10.590781 21114 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:10.591652 21103 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.622792 17463 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:10.618466 21135 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.599150 20828 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.620766 20386 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:10.628607 21202 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:19:10.629341 20864 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:10.629200 20790 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.647200 20834 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:10.635411 20614 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.641577 20962 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:10.635589 17393 rpcz_store.cc:276] 0709 13:19:09.533250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.573114 (+ 39864us) service_pool.cc:224] Handling call
0709 13:19:09.633556 (+ 60442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.652936 (+ 19380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.652970 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.682502 (+ 29532us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.054787 (+372285us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:10.054834 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.054899 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.634884 (+579985us) raft_consensus.cc:1685] finished
0709 13:19:10.634905 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.635045 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18896,"raft.queue_time_us":21144,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":14837,"thread_start_us":207053,"threads_started":1,"wal-append.queue_time_us":582695}
I20260709 13:19:10.632553 21170 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:10.604810 20865 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:10.617933 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 275275us
I20260709 13:19:10.711007 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:10.629104 20835 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:10.662253 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:10.672278 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:10.712129 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 50008.8us
I20260709 13:19:10.635607 20531 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:10.680401 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:10.629842 21115 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:10.682525 17995 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:19:10.672788 21153 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:10.711826 21065 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:10.722366 21153 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.722841 21153 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.677007 21210 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:10.618803 21119 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:10.679811 21189 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:10.674257 20386 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:10.646059 21207 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:19:10.714038 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.744650 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:10.721797 21124 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:10.690815 17999 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:10.679630 21182 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:10.726601 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:10.697878 21148 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.716922 17397 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:10.744827 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.744864 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:10.710515 20865 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.750895 17992 raft_consensus.cc:2410] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:10.718292 21175 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:10.724571 21099 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
I20260709 13:19:10.752183 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:10.756181 17469 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:10.715533 20531 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:10.717561 20892 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:10.742363 21090 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.003s
I20260709 13:19:10.789958 21090 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.791100 17392 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:10.793864 20828 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:10.795631 21088 consensus_meta.cc:287] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.972s	user 0.007s	sys 0.006s
I20260709 13:19:10.796056 21088 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.796552 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1747) took 1017 ms. Trace:
I20260709 13:19:10.797041 17313 rpcz_store.cc:276] 0709 13:19:09.778879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.778995 (+   116us) service_pool.cc:224] Handling call
0709 13:19:10.796390 (+1017395us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54003e21d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:10.796495 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745507072}
W20260709 13:19:10.798681 21203 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:19:10.799220 21183 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.756980 17464 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:19:10.792393 21090 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:10.825914 21212 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:19:10.763654 20531 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.765883 20988 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:10.767827 20864 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:19:10.770495 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.770797 21119 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:10.772608 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:10.773250 21114 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.774551 21072 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:10.782583 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:10.859444 17468 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:10.860231 17467 raft_consensus.cc:2393] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:10.860627 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:10.756278 21148 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.861272 17468 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:10.784287 21113 consensus_meta.cc:287] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.946s	user 0.009s	sys 0.003s
W20260709 13:19:10.764047 21209 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:10.816075 21175 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:10.815964 17388 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.755193 20865 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.747748 20386 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.800627 21099 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:10.823314 21176 consensus_meta.cc:287] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.812s	user 0.009s	sys 0.000s
I20260709 13:19:10.833839 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:10.802798 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:10.877852 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 75174.4us
I20260709 13:19:10.792172 21170 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:10.862466 17470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.021s	sys 0.058s
W20260709 13:19:10.879805 17470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.021s	sys 0.058s
W20260709 13:19:10.863096 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.861339 20864 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:10.883381 17469 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:10.891443 17468 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:10.873525 17388 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.873844 20531 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:10.864939 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1647) took 1055 ms. Trace:
I20260709 13:19:10.893586 17992 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:10.910285 17388 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:10.911180 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2833) took 1401 ms. Trace:
I20260709 13:19:10.899217 17466 rpcz_store.cc:276] 0709 13:19:09.809609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.974547 (+164938us) service_pool.cc:224] Handling call
0709 13:19:10.004226 (+ 29679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.012113 (+  7887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.012143 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.012579 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.496059 (+483480us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:10.864343 (+368284us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.864624 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.864692 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.864727 (+    35us) raft_consensus.cc:1685] finished
0709 13:19:10.864738 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.864883 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89255,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"raft.queue_time_us":17761,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":14258,"thread_start_us":776702,"threads_started":2,"wal-append.queue_time_us":613253}
I20260709 13:19:10.911580 17388 rpcz_store.cc:276] 0709 13:19:09.509314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.510446 (+  1132us) service_pool.cc:224] Handling call
0709 13:19:09.510718 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.838694 (+327976us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b4c0015e540. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d60ac0a20 00007f7d60ad1a29 00007f7d60a97644 00007f7d60abef2d 00007f7d60abeb93 00007f7d627ef18b 00007f7d627efcb5 00007f7d627eaf30 00007f7d627ec7de 00007f7d627f6b49 00007f7d627f7416
0709 13:19:10.566432 (+727738us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b540032d0a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d6277206f 00007f7d627eaf60 00007f7d627ec7de 00007f7d627f6b49 00007f7d627f7416 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62
0709 13:19:10.815594 (+249162us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b540032d0a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d62771520 00007f7d627eaf70 00007f7d627ec7de 00007f7d627f6b49 00007f7d627f7416 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62
0709 13:19:10.910874 (+ 95280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.911117 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581155584}
W20260709 13:19:10.892930 20924 consensus_meta.cc:287] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.058s	user 0.011s	sys 0.002s
I20260709 13:19:10.882309 20988 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:10.932927 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1757) took 1089 ms. Trace:
I20260709 13:19:10.882210 20864 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:10.946213 20864 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.947371 20864 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.948125 21026 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:10.872880 21113 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.950560 21113 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:10.882977 21176 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.954527 21088 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:10.955411 21175 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:10.956875 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:10.931598 21170 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.957579 17313 raft_consensus.cc:2368] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9.
I20260709 13:19:10.931288 21182 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:19:10.958341 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.930192 21212 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:19:10.934361 20924 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:10.961925 20924 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:10.961997 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:10.962646 17990 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:10.935693 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:10.933909 20988 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.963769 20988 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.944317 21148 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:10.962586 21099 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:10.933444 17319 rpcz_store.cc:276] 0709 13:19:09.843887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.856643 (+ 12756us) service_pool.cc:224] Handling call
0709 13:19:09.859882 (+  3239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.875620 (+ 15738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.875665 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.876184 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.327735 (+451551us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:10.327779 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.327849 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.932606 (+604757us) raft_consensus.cc:1685] finished
0709 13:19:10.932637 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.932828 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25906,"raft.queue_time_us":22472,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":12100,"thread_start_us":430163,"threads_started":1,"wal-append.queue_time_us":731219}
I20260709 13:19:10.956269 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:10.992761 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 530573us
I20260709 13:19:10.995249 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:10.975834 21222 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:19:10.975636 21215 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:19:10.995988 17394 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:11.000594 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 357217us
I20260709 13:19:11.001719 17362 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:11.003326 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:11.024085 17995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 757) took 1237 ms (client timeout 1560 ms). Trace:
W20260709 13:19:11.024510 17995 rpcz_store.cc:269] 0709 13:19:09.786612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.786824 (+   212us) service_pool.cc:224] Handling call
0709 13:19:11.023892 (+1237068us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54006054d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:11.024025 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057530624}
W20260709 13:19:11.024828 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 382493us
I20260709 13:19:11.027451 17320 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:11.034286 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:11.034976 17320 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:11.037781 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:11.038499 17996 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:11.039446 17394 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:11.040923 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.042891 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:11.049528 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:11.021325 21072 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.010074 21026 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:11.051039 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.053052 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1640) took 1245 ms. Trace:
I20260709 13:19:11.020733 21176 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.060640 17467 rpcz_store.cc:276] 0709 13:19:09.807274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.807436 (+   162us) service_pool.cc:224] Handling call
0709 13:19:11.052785 (+1245349us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400061654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:11.052975 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2418450176}
I20260709 13:19:11.048890 21186 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.063484 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1027) took 1016 ms. Trace:
I20260709 13:19:11.067464 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1025) took 1105 ms. Trace:
W20260709 13:19:11.054312 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49520us
I20260709 13:19:11.067955 17990 rpcz_store.cc:276] 0709 13:19:09.962447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.962596 (+   149us) service_pool.cc:224] Handling call
0709 13:19:09.972967 (+ 10371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.963323 (+990356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.067164 (+103841us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54006d1354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:11.067392 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275639552}
W20260709 13:19:11.075515 17287 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.005s	sys 0.022s
W20260709 13:19:11.075877 17287 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.005s	sys 0.022s
I20260709 13:19:11.066645 17998 rpcz_store.cc:276] 0709 13:19:10.047631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.106353 (+ 58722us) service_pool.cc:224] Handling call
0709 13:19:10.106809 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.107274 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.107302 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.107710 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.543107 (+435397us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:10.543150 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.543237 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.063216 (+519979us) raft_consensus.cc:1685] finished
0709 13:19:11.063244 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.063415 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":435029,"threads_started":1,"wal-append.queue_time_us":609933}
W20260709 13:19:11.076145 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 518636us
W20260709 13:19:11.106117 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 43572.4us
W20260709 13:19:11.108472 17991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.021s
W20260709 13:19:11.109925 17991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.006s	sys 0.021s
I20260709 13:19:11.058854 21072 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:11.122624 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:11.122720 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.125643 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.108527 21204 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:19:11.128479 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.130494 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:11.134400 17464 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.061540 21090 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:19:11.104509 21186 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:11.140728 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:11.126128 21207 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:11.127730 21072 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:11.154654 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51003.7us
W20260709 13:19:11.155424 17462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.002s	sys 0.010s
I20260709 13:19:11.066329 20614 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.185364 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:11.186424 17462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.002s	sys 0.010s
W20260709 13:19:11.188706 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 52481.9us
I20260709 13:19:11.195660 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:11.196352 17393 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.184284 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:11.115751 21187 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:19:11.121047 21039 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:19:11.182677 21132 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.964s	user 0.017s	sys 0.000s
I20260709 13:19:11.154101 20828 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:11.132128 21091 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:19:11.183157 21229 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.208418 21236 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.249871 17393 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:11.251760 17464 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
W20260709 13:19:11.222824 21191 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.945s	user 0.015s	sys 0.000s
W20260709 13:19:11.242063 21103 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.001s
W20260709 13:19:11.270789 21238 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:19:11.272241 21232 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:19:11.274798 21231 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:19:11.277601 21225 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:11.277173 21186 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.279466 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1650) took 1469 ms. Trace:
W20260709 13:19:11.279594 21054 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.638s	user 0.006s	sys 0.006s
I20260709 13:19:11.279875 17465 rpcz_store.cc:276] 0709 13:19:09.810475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.974928 (+164453us) service_pool.cc:224] Handling call
0709 13:19:09.975259 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.998150 (+ 22891us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:10.347385 (+349235us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.881502 (+534117us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.881766 (+   264us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.897376 (+ 15610us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.897513 (+   137us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:10.897542 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.897606 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.279256 (+381650us) raft_consensus.cc:1685] finished
0709 13:19:11.279277 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.279403 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4288,"prepare.queue_time_us":557490,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":36067,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":32602,"spinlock_wait_cycles":63691776,"thread_start_us":771285,"threads_started":2,"wal-append.queue_time_us":715003}
I20260709 13:19:11.254371 21236 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.259366 21155 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:11.316656 17393 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:11.315778 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.326589 21135 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.328153 20614 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:11.329383 21192 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.831s	user 0.012s	sys 0.000s
I20260709 13:19:11.333882 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:11.282361 21103 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.346752 21103 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:11.356333 17434 leader_election.cc:400] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9.
I20260709 13:19:11.356559 21088 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:11.356634 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.357170 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:11.357282 21088 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.357911 17395 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:11.357854 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:11.358686 17391 raft_consensus.cc:2368] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9.
I20260709 13:19:11.358778 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.359365 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.359591 17395 raft_consensus.cc:2410] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:11.359935 17391 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:11.360352 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.388243 17395 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
W20260709 13:19:11.360687 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.390141 17435 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.597s (SENT)
I20260709 13:19:11.390640 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:11.362597 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2797) took 1215 ms. Trace:
I20260709 13:19:11.363814 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.364094 21253 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.364336 20834 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.356426 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:11.365228 21252 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:11.365358 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.366097 17394 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:11.370791 17471 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:11.373919 21169 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.318395 21236 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.318547 21155 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:11.288875 21054 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.377027 17434 leader_election.cc:403] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:11.422804 17469 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:19:11.423715 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:11.378865 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 194661us
I20260709 13:19:11.379293 21099 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:11.356336 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:11.415891 20865 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 13:19:11.427345 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.391938 17470 rpcz_store.cc:276] 0709 13:19:10.147163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.161846 (+ 14683us) service_pool.cc:224] Handling call
0709 13:19:10.162186 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.162427 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:10.880235 (+717808us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.362300 (+482065us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.362349 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:11.362388 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.362447 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.362545 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":205899,"prepare.queue_time_us":422532,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":206247,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":993148,"threads_started":2,"wal-append.queue_time_us":380519}
I20260709 13:19:11.409596 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:11.259706 21229 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.418951 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:11.431658 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:11.426211 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 70021.1us
I20260709 13:19:11.432379 17393 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:11.425848 17467 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:11.426658 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 712) took 1233 ms. Trace:
I20260709 13:19:11.427240 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:11.421494 21183 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
I20260709 13:19:11.351985 20988 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.430720 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:11.415380 21116 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.394097 17396 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:19:11.432898 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.436393 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:11.488350 17996 raft_consensus.cc:2410] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:11.418634 21123 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.415773 20790 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.468482 17316 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:11.464387 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:11.432931 17991 rpcz_store.cc:276] 0709 13:19:10.193112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.200925 (+  7813us) service_pool.cc:224] Handling call
0709 13:19:10.201207 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.201418 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:10.562113 (+360695us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.187476 (+625363us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.376475 (+188999us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b1800371b00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:19:11.376864 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.426374 (+ 49510us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.426419 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:11.426458 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.426511 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.426606 (+    95us) inbound_call.cc:177] Queueing success response
0709 13:19:11.429292 (+  2686us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b1800371b00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1
Metrics: {"mutex_wait_us":245886,"prepare.queue_time_us":157246,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":309771,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":7632,"spinlock_wait_cycles":109390336,"thread_start_us":909247,"threads_started":2,"wal-append.queue_time_us":574917}
W20260709 13:19:11.475353 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.491847 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.437911 20865 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.438521 21148 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:11.421586 20834 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.464339 17388 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:11.432406 21124 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9.
I20260709 13:19:11.432328 21103 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:11.468505 20386 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.003s
I20260709 13:19:11.418334 21253 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:11.496029 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 65377.4us
I20260709 13:19:11.471123 21113 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.426853 21169 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.504725 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:11.509137 21155 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.498478 21148 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.510546 20834 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:11.511899 20988 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:11.512467 21253 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:11.554827 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2810) took 1058 ms. Trace:
I20260709 13:19:11.555241 17471 rpcz_store.cc:276] 0709 13:19:10.496409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.496514 (+   105us) service_pool.cc:224] Handling call
0709 13:19:10.496798 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.370550 (+873752us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b540029a2a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d6276bdc0 00007f7d627f61c0 00007f7d627f7231 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c
0709 13:19:11.420850 (+ 50300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.554595 (+133745us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b5400200b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:11.554771 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005408768}
I20260709 13:19:11.512959 21054 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.513094 21142 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.496492 21168 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:11.503053 20790 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:11.557224 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 57511.5us
I20260709 13:19:11.557636 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1761) took 1235 ms. Trace:
I20260709 13:19:11.558750 20790 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:11.559449 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 66982us
I20260709 13:19:11.559690 17465 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:11.553915 17320 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:11.561050 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:11.514410 21229 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:11.563383 17391 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:11.496192 21123 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.514690 21196 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:11.521327 21072 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.526467 21088 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:11.531349 21026 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:11.506593 20386 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.534160 17315 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:19:11.534518 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 349547us
I20260709 13:19:11.486353 21099 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:11.547271 21234 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.415s	user 0.004s	sys 0.000s
I20260709 13:19:11.548033 20982 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:11.548475 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:11.534970 21113 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:11.535354 21153 consensus_meta.cc:287] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.812s	user 0.009s	sys 0.006s
W20260709 13:19:11.567708 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 355290us
W20260709 13:19:11.608278 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 47337us
I20260709 13:19:11.608897 17389 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:11.589756 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.600270 17392 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:11.600863 17391 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:11.603281 17393 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:11.545006 21148 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:11.608510 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60101.8us
I20260709 13:19:11.615262 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:11.558014 17316 rpcz_store.cc:276] 0709 13:19:10.322613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.323185 (+   572us) service_pool.cc:224] Handling call
0709 13:19:11.557464 (+1234279us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003e30d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:11.557558 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2486675840}
I20260709 13:19:11.608661 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:11.556524 21142 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.568640 21196 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:11.617801 17318 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:11.619045 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:11.626904 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:11.628818 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.542824 21191 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:19:11.636590 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:11.642112 17321 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.643230 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:11.613279 17209 maintenance_manager.cc:419] P 6a4082b2c6894817acb2d2a07603a4d6: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033401
W20260709 13:19:11.643993 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 77056.7us
I20260709 13:19:11.639539 17313 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:11.646553 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:11.647193 17392 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.648063 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.648640 17394 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:11.648923 20954 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:11.649789 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:11.616345 21088 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:11.639997 21023 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:19:11.637465 20835 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:19:11.653680 20835 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:11.654022 20835 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:11.654933 20835 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.667827 20835 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.668196 21196 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.668216 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:11.669534 21196 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.617954 21175 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:11.674414 17996 raft_consensus.cc:2410] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:11.681005 17392 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:19:11.607581 21103 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:19:11.639489 21168 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:11.604687 21099 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.643580 21227 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.687173 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:11.697147 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:11.701539 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 262485us
I20260709 13:19:11.638293 21135 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:19:11.677999 21231 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:11.616324 21153 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.633786 20842 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:19:11.711303 17998 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:11.722543 17314 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:11.722805 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:11.724026 17320 raft_consensus.cc:2410] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:11.713007 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:11.734234 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 91272.4us
I20260709 13:19:11.703635 21168 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.738943 17360 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.698817 20865 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.701900 21054 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.744366 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.709314 21169 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.758229 21182 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:11.758677 21182 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:11.758751 21153 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.760223 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1762) took 1034 ms. Trace:
I20260709 13:19:11.737589 21257 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.748294 21168 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.760610 17318 rpcz_store.cc:276] 0709 13:19:10.726190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.726341 (+   151us) service_pool.cc:224] Handling call
0709 13:19:11.760028 (+1033687us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54002b0554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:11.760168 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2003059072}
I20260709 13:19:11.774354 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.740633 21187 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:19:11.752950 21091 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.752374 21227 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:11.772267 20865 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:11.749318 20864 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:19:11.752656 21254 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:19:11.754953 21054 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.791910 21099 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.791998 21026 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:11.792685 21142 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:11.793064 21183 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:11.793624 21183 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:11.792722 21026 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.794663 21183 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.796916 21026 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:11.797922 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.798282 20924 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:11.798537 17396 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:11.798910 20924 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.799943 21086 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.800446 21086 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.802469 21086 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.803983 21113 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:11.804230 21099 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.804823 21099 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.805183 21176 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:11.806211 21176 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:11.806565 21176 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:11.806983 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:11.807389 21095 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.807571 17391 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.807873 21095 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.808138 20924 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.808991 21123 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:11.810719 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.811960 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.811774 20924 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:11.813192 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1763) took 1041 ms. Trace:
I20260709 13:19:11.813284 20924 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.814473 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.813994 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.816713 17397 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:11.797207 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.818280 17321 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:11.819367 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:11.819715 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:11.784051 20865 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.820250 17392 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.820705 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:11.813546 17315 rpcz_store.cc:276] 0709 13:19:10.772136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.772316 (+   180us) service_pool.cc:224] Handling call
0709 13:19:11.813022 (+1040706us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54003e17d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:11.813134 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493219072}
I20260709 13:19:11.824095 17393 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:11.820138 17991 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:11.825596 17391 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:11.826252 17360 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.826558 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.829460 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:11.778963 21256 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:11.831874 17392 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:11.783527 21091 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.829814 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.807410 21176 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.815809 20924 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.834456 17993 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:11.837445 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.841574 20842 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:11.840812 21091 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.843675 20842 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.831758 21113 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:11.849331 21113 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.849167 21086 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:19:11.849736 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 206576us
I20260709 13:19:11.851143 20988 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.851337 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:11.851544 20988 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:11.851997 20988 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.840126 20386 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.845072 21135 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.836629 21169 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:19:11.831660 20834 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.852494 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:11.854146 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.807008 21099 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.849171 20842 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:11.859879 21119 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:11.836078 21256 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.849349 21088 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:11.853745 21192 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.849748 21113 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.862144 21124 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:11.862941 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 149987us
I20260709 13:19:11.863482 21264 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.875231 21256 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.863619 21095 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:11.832432 21072 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.863988 21195 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:11.864602 21054 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.864953 20954 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.827955 21114 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:11.867930 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:11.870831 17435 leader_election.cc:400] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9.
I20260709 13:19:11.869151 20531 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:11.869410 20834 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:11.862203 21227 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.873107 21123 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:11.830320 21236 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.884339 21086 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:11.873878 21135 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.913714 21072 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:11.914505 21135 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:11.869850 21153 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:19:11.916055 17991 raft_consensus.cc:2410] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:19:11.915951 20988 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.916952 20531 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:11.885313 21088 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.900061 21176 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.869587 21169 consensus_queue.cc:1243] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:11.932709 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:11.935184 17466 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:11.899232 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:11.903800 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:11.908936 17465 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:19:11.936537 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:11.937067 17465 pending_rounds.cc:85] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 5
I20260709 13:19:11.937363 17465 pending_rounds.cc:107] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 7.6
W20260709 13:19:11.910530 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.911432 17360 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.886616 21264 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.918371 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:11.919093 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:11.939891 17468 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:11.891688 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:11.904110 21114 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:11.905030 20834 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.926578 21086 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:11.903971 21195 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:11.928529 21236 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:11.931259 17993 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:11.949236 17990 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:11.937661 17465 raft_consensus.cc:2889] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.949540 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:11.938269 17462 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:11.940092 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:11.940688 17471 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.936390 17464 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.943821 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:11.944947 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.945578 21124 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:11.947269 20954 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.948005 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:11.967662 17468 raft_consensus.cc:2376] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9. Re-sending same reply.
I20260709 13:19:11.954041 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:11.954999 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:11.969753 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:11.970299 17990 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.970875 17394 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:11.944308 17434 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:11.956319 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:11.972543 17462 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.956939 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:11.958299 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:11.959280 17321 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:11.974066 17315 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:11.959702 17469 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:11.974773 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:11.960135 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:11.975553 17320 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:11.975472 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:11.960359 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:11.975463 17321 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.960762 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:11.930836 21119 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:11.964643 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.965993 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:11.985775 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:11.986574 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:11.959828 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:11.976867 17317 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:11.989358 17318 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.982537 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:11.968873 21072 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:11.985612 17322 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:19:11.990994 21253 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:11.992944 21026 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.993522 21026 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.994020 21026 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.997005 21072 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:11.998365 21072 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:11.999547 20988 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:12.002257 21195 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:12.005909 21091 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.008236 21091 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.011111 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:12.011735 17995 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.990643 20725 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.986677 17465 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:12.014397 17464 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:11.990243 17468 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:11.941296 20828 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.981627 17321 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:12.024574 17468 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.031776 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:12.031888 20988 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:12.032938 17434 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:12.033461 20988 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:12.033911 20988 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:12.034368 20988 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.956463 21187 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.971400 21123 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:12.044345 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.033763 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:12.044811 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 72754.8us
I20260709 13:19:12.046660 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:12.011162 21186 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.016558 20790 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:12.105576 17463 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.109943 17318 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:11.932524 20531 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.123751 17990 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:12.036677 21195 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.972076 21124 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.061271 20954 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:12.061017 21278 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.050675 21196 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.017174 21119 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.043535 21039 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.041742 21095 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.128397 20865 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.108624 20790 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.056102 20828 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:12.127282 21023 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:12.154613 17463 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:12.107391 21183 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:19:12.149106 20954 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.169147 17998 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:19:12.172245 17998 pending_rounds.cc:85] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 8
I20260709 13:19:12.122429 21186 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.096881 21187 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.171379 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:12.172672 17998 pending_rounds.cc:107] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:19:12.021724 20725 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.185122 17998 raft_consensus.cc:2889] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.169344 20790 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.144440 21195 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.098959 21114 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:12.180198 21148 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.001s
I20260709 13:19:12.168298 21123 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.179627 20954 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.170033 21168 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.194056 21117 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:12.128158 21086 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.168893 21039 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.159351 21196 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.165171 21095 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.179391 21023 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.226703 21123 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.281024 17466 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:12.246656 21117 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:12.283383 21117 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.156016 21278 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.294921 17471 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:12.299561 17995 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:12.226120 21148 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:12.295359 21277 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:19:12.308717 21276 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
W20260709 13:19:12.309350 21281 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:19:12.309532 21119 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:12.297569 20982 raft_consensus.cc:2764] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:12.316908 21195 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.319399 21026 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:12.321278 21284 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:19:12.335206 21264 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.337631 21148 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.329355 21124 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.341383 21168 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:12.341617 21255 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:12.342290 21255 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:12.343633 21255 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.344800 21186 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:12.345177 21255 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.346172 21187 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:12.349422 21257 consensus_meta.cc:287] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.003s
I20260709 13:19:12.350085 21257 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:12.355577 21113 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.359072 21260 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:12.359710 21260 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:12.360945 21260 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.362449 21260 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.372043 21278 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.203933 17321 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:12.410972 17321 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:12.410557 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:12.413580 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:12.414609 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:12.415242 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:12.415519 17315 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.419209 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:12.420244 17316 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:12.412472 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:12.422703 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:12.423043 17319 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:12.423844 17321 raft_consensus.cc:2410] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:12.414609 17317 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.442425 17394 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:12.446733 21095 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:12.449393 21054 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.449878 20725 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:12.450541 21054 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.301733 20924 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.457981 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:12.460134 21072 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.461078 21072 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.461951 21039 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.288825 20828 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.463567 21072 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:12.456099 20924 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:12.333004 21088 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:12.465646 21088 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:12.467293 21088 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.469167 21088 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:12.469831 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:12.474318 21026 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:12.476246 21023 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:12.476269 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:12.477084 21023 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:12.478046 17392 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.478132 21023 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.478581 20835 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.479485 20835 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:12.482524 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.489024 20982 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.490128 17394 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:19:12.492641 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:12.498462 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:12.498462 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:12.499456 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:12.501374 21026 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.501950 21072 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:12.504072 20834 consensus_meta.cc:287] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.006s
I20260709 13:19:12.489863 20982 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.506973 21023 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:12.511328 20988 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.572611 17393 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:12.513840 21054 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.573808 21072 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.515511 17315 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:12.570653 17396 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:12.518697 20835 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:12.526507 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:12.526677 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 573116us
I20260709 13:19:12.529273 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:12.533628 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:12.535737 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:12.540723 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:12.570603 17391 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:12.570195 20834 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:12.571151 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.578624 17392 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:12.598934 17319 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.599810 17320 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:12.601045 17389 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:19:12.603325 21176 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.010s
W20260709 13:19:12.606874 21286 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.309s	user 0.004s	sys 0.000s
I20260709 13:19:12.606307 21123 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:12.607200 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.623370 17463 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:12.623660 17469 pending_rounds.cc:85] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 6
I20260709 13:19:12.624609 17316 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
W20260709 13:19:12.627998 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50068.1us
I20260709 13:19:12.629540 21026 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:12.641099 21256 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.004s
I20260709 13:19:12.727432 17317 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:12.731105 17315 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:19:12.722980 17469 pending_rounds.cc:107] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:12.733388 17469 raft_consensus.cc:2889] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.735654 21256 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.736586 21196 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.737032 21114 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.740031 21113 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:12.735703 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:12.742129 21116 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.744148 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:12.684968 21072 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.745255 21116 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:12.733901 17434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.003s	sys 0.006s
W20260709 13:19:12.760469 17434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.004s	sys 0.006s
I20260709 13:19:12.766188 20982 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:12.768256 20842 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.895s	user 0.013s	sys 0.012s
I20260709 13:19:12.768419 17360 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:12.768815 20842 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.769598 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:12.769394 21182 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.770162 17991 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:12.771288 21072 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:12.771834 21072 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:12.772617 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 738858us
I20260709 13:19:12.773028 21054 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:12.776093 21026 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.777302 20988 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.777918 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:12.779423 17220 catalog_manager.cc:5697] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 8, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:12.782063 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.785105 21088 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:12.788144 20842 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:12.607052 20954 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:12.788980 17462 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.816s	user 0.014s	sys 0.022s
I20260709 13:19:12.790809 21256 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:12.792058 20834 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:12.792739 17319 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:12.793277 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:12.792851 21072 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:12.793545 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 52013.8us
I20260709 13:19:12.794811 21113 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:12.795805 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.801452 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:12.801595 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 165617us
I20260709 13:19:12.807641 21260 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:12.815033 17465 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:19:12.821341 21113 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:12.823786 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:12.824332 21113 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:12.826901 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:12.829044 20531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.016s	sys 0.013s
W20260709 13:19:12.829492 20531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.017s	sys 0.013s
I20260709 13:19:12.830626 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:12.831423 17471 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:12.814661 17462 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:19:12.814213 21260 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.835047 21260 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.843721 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:12.844352 20954 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:12.845129 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:12.838660 17220 catalog_manager.cc:5697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:12.848379 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.850129 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:12.850868 17389 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:12.851804 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:12.854405 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:12.859627 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:12.861295 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:12.850879 20835 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.868242 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:12.868201 17391 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:12.878463 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:12.882320 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55673.7us
I20260709 13:19:12.863768 20954 raft_consensus.cc:2764] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:19:12.889045 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 77141.3us
I20260709 13:19:12.890640 17392 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.892681 17463 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:12.897667 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:12.897892 17396 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:12.897997 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:12.898375 21144 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.898967 17315 raft_consensus.cc:2410] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:12.898567 17390 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:19:12.905390 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.874276 21054 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:12.907804 17319 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:12.912052 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62564.1us
I20260709 13:19:12.898135 21298 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.915899 21254 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.917327 17990 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:12.919709 21182 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.920126 17314 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:12.921988 21256 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:12.912109 17220 catalog_manager.cc:5697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 6, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 6 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:19:12.923620 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:12.932998 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:12.933802 17990 pending_rounds.cc:85] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 8
I20260709 13:19:12.924466 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:12.940011 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:12.942329 17990 pending_rounds.cc:107] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:12.943455 17990 raft_consensus.cc:2889] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.943508 17390 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.944042 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:12.942269 17991 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:12.946561 17391 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:12.948123 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:12.944679 17396 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:12.952956 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:12.958271 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:12.942888 21256 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.959136 17389 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 6.
I20260709 13:19:12.962484 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:12.946424 20790 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.011s
I20260709 13:19:12.908783 21144 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:19:12.971824 17316 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:12.957082 21135 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:12.974565 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:12.970846 17220 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 5 to 6, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 6 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.974887 17321 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.968490 21256 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:12.986121 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:12.952999 21054 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:12.990842 17392 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
W20260709 13:19:12.993211 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 89906.4us
I20260709 13:19:12.978610 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:12.975674 21135 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:12.994459 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 110063us
I20260709 13:19:12.994846 17315 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:12.976018 20954 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:12.992487 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:12.995777 17318 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:12.953924 21298 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.007352 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.006855 17220 catalog_manager.cc:5697] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.996310 21135 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.013659 17998 raft_consensus.cc:2368] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11.
I20260709 13:19:13.011337 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:12.977010 20790 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.000142 21155 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.978633 21091 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:19:13.010031 17996 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:19:13.018759 21162 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:13.019192 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 103996us
I20260709 13:19:13.019090 21113 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:13.025444 21054 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.026068 17993 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:19:12.993381 21095 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:19:13.013702 21236 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:12.996765 21254 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.040056 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:13.026760 20749 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.039008 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:13.044970 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:13.051609 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 92487.3us
I20260709 13:19:13.030886 21227 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:19:13.030949 21162 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:13.042835 20749 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.044276 17220 catalog_manager.cc:5697] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.073089 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:13.059671 20531 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:13.075055 21170 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:13.062630 21091 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:19:13.059566 20749 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.081315 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:13.080480 17220 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:13.075127 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 123671us
I20260709 13:19:13.083319 17392 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:13.078240 21023 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:13.085780 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 70402.9us
I20260709 13:19:13.074496 21287 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:13.092989 21251 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:13.089887 21255 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.008s
I20260709 13:19:13.082023 20531 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:13.100901 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "036c02de798949eeb02d27e9dd520825"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:13.108815 17316 raft_consensus.cc:606] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:13.107808 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.109086 21298 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:13.109143 20531 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.109256 17316 raft_consensus.cc:614] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:13.110953 17220 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 4 to 9, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 9 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:13.062325 21236 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.118351 20835 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:13.118994 20835 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.119577 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:13.119904 21236 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.090129 21253 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:19:13.121105 21191 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:13.121313 20835 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.117589 21144 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:13.122264 21144 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.122689 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1501) took 1165 ms. Trace:
I20260709 13:19:13.123090 21191 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:13.123509 21191 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:13.123888 21191 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.124475 21144 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.126740 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:13.127045 21113 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:13.127709 20835 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.128161 20835 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.128504 20835 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.113536 21170 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.131096 21170 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:13.117735 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.137161 17321 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:13.084671 21023 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.138504 17391 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:19:13.139514 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:13.127632 21113 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:13.142294 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59843.5us
I20260709 13:19:13.113950 21114 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:13.141906 21123 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:13.154666 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:13.105091 21287 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.161608 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.123128 17314 rpcz_store.cc:276] 0709 13:19:11.957575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.960153 (+  2578us) service_pool.cc:224] Handling call
0709 13:19:13.122480 (+1162327us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b540035c0d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:13.122615 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731865472}
I20260709 13:19:13.158682 17220 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.162276 17996 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:13.166530 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:13.168429 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:13.143421 21162 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.200953 17996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:48172
I20260709 13:19:13.212316 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:13.216223 17996 raft_consensus.cc:606] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:13.197247 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:13.216631 17996 raft_consensus.cc:614] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:13.201469 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:13.175108 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.221276 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 86833.9us
I20260709 13:19:13.222448 17390 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:13.167451 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:13.224730 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:13.152256 21236 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:13.145812 21298 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:19:13.161041 21114 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:13.229279 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 70871.5us
W20260709 13:19:13.238669 21309 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.161s	user 0.002s	sys 0.000s
I20260709 13:19:13.244598 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:13.168206 21095 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:13.198675 21023 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.202950 21113 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:13.222069 20790 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:13.161728 21260 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.263792 21260 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.264611 17315 raft_consensus.cc:2368] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:19:13.267251 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:13.271202 21259 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:13.271620 21259 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:13.272410 21259 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:13.273001 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 110802us
I20260709 13:19:13.273355 20790 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:13.273782 21259 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.273962 20790 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.247845 21026 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:13.276127 20790 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:13.276206 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.276602 21095 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:13.277494 21095 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:13.280200 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.282125 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:13.194878 21287 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:13.256330 21114 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.286317 21256 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.189586 20835 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.274402 21023 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:13.284442 21236 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.252956 17990 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:13.293232 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.246534 17220 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:19:13.303773 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.309451 17463 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:13.293305 21113 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:13.311439 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:13.312206 17322 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:13.185438 21135 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.315344 17993 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:13.314484 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:13.316327 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.325198 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:13.349267 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 196696us
I20260709 13:19:13.351570 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.352430 17994 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:13.352934 21191 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.353907 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.354662 17999 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:13.355222 21191 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.302876 21256 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:13.355783 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.356441 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.357594 17995 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:19:13.357896 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.362993 21254 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:13.363142 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:13.364337 21254 raft_consensus.cc:2764] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:13.364929 21182 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:13.365151 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.365841 17462 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:13.366477 17285 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:13.366755 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.367825 21278 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:13.368257 21278 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.368342 21256 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.368697 21278 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:13.369477 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.370330 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.371696 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.372408 21289 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:13.382146 17468 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:13.373596 20749 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.376084 17313 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:13.382543 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.367975 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.312980 21236 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:13.384218 17990 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:13.403203 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:13.403905 17462 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.356535 17999 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:13.313166 21103 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:13.385660 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.406556 17390 raft_consensus.cc:2368] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
I20260709 13:19:13.403924 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:13.387533 17396 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:13.393105 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:13.394161 21135 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.408012 21191 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.394640 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:13.408859 17470 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.314605 21026 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:13.395265 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:13.313840 21117 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.396016 17463 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:13.396322 17995 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:13.313606 21113 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:13.418489 17466 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.396878 21256 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.397280 20835 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.385509 17467 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:13.401170 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:13.413789 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:13.408634 21191 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.409894 17220 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.421108 17991 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:13.423676 17314 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:13.419178 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:13.425638 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:13.436342 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.435550 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.442638 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.440793 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.447717 17285 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:13.449036 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:13.449607 17318 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:13.450361 17390 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.454981 17321 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:13.455281 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:13.456210 17319 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:13.457058 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.458220 17392 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:13.463035 21123 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:13.463053 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:13.463838 17467 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.464129 20790 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:13.464699 20790 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:13.465730 20790 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.458667 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.469211 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:13.471501 21192 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.471971 21192 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.472332 21192 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.472563 17467 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:13.473791 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:13.474382 17467 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:13.477546 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:13.485338 17470 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:13.449914 21155 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:13.422044 21289 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:19:13.499801 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.493176 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.500821 17220 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.501924 17465 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:13.492136 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:13.456705 21254 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:13.504385 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.470650 21260 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:13.515226 17467 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:13.520677 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:13.463780 21123 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.527705 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:13.523655 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:13.525103 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.498075 21155 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:13.529904 21155 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.534315 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.534845 17465 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:13.536295 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.454913 21117 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.545902 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.539707 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.511327 21260 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:13.539291 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.507405 21254 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:13.546965 17467 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:13.548707 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 305313us
I20260709 13:19:13.546747 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:13.553009 17463 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:13.556617 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:13.591343 17462 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:13.540899 17220 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.641000 17467 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:13.522746 21095 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:13.655699 17465 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:13.646629 17462 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:19:13.648005 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.659777 17360 leader_election.cc:400] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11.
I20260709 13:19:13.660207 17360 leader_election.cc:403] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:13.661085 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:13.495023 21026 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.548280 21260 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:13.549367 21254 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.663592 21023 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:13.672201 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 125533us
I20260709 13:19:13.667090 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.653146 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:13.691988 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 128112us
I20260709 13:19:13.705176 17390 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:13.692687 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:13.673552 20954 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:13.718500 17360 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:13.691437 21144 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:13.724599 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.728359 17992 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:13.729362 21117 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.729996 20828 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:13.714442 21114 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.739861 21114 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.741032 20614 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.741640 20614 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:13.742131 20614 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.747282 21278 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.748785 17316 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:13.749897 21123 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:13.548919 21113 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.751808 21256 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.752138 21196 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.752730 21196 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.721081 21259 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.753645 21259 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.754098 21259 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.754753 21196 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.711762 21103 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11.
I20260709 13:19:13.758042 17466 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:13.764012 21289 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:13.727545 17220 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 6 to 8, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 8 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:13.713369 20531 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:13.685653 21095 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.777516 17396 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:13.778446 17360 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:13.781634 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.787413 17220 catalog_manager.cc:5697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 5, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.774456 21236 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.732388 21023 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.774818 21144 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:13.802150 21253 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.806551 21253 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.783946 21289 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.794399 21256 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:13.814980 17220 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 5 to 6, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 6 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.817430 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:13.818322 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.818696 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.772145 21091 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:19:13.826264 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.812698 21095 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.814888 21256 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.814519 21289 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:13.808816 21253 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:13.831141 21256 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:13.817387 21255 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:13.832968 21103 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:13.819197 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.833228 21255 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:13.835616 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.836186 17397 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.819675 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.817461 21236 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.839449 21236 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:13.839938 21253 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.840492 17220 catalog_manager.cc:5697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.842181 17220 catalog_manager.cc:5697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 8, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.844605 17390 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:19:13.836278 21255 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:13.845680 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.846827 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:13.847393 17390 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:13.848198 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.839947 21236 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:19:13.852102 17392 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:13.818102 21144 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.825139 17389 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:13.861410 17220 catalog_manager.cc:5697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.878547 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.895251 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:13.873749 17220 catalog_manager.cc:5697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.895905 17392 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.896518 17390 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:13.901299 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:13.901895 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 161829us
I20260709 13:19:13.799074 20531 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.917166 17390 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:13.921808 17220 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 5 to 8, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 8 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:19:13.816437 21259 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:13.933080 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 98813.2us
I20260709 13:19:13.852149 21192 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:13.913166 21256 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:19:13.938470 17389 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:13.939661 17392 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:13.943779 17395 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:13.940740 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:13.946401 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:13.947675 17220 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 7, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 7 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.958130 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 664) took 1549 ms. Trace:
I20260709 13:19:13.958691 17322 rpcz_store.cc:276] 0709 13:19:12.408752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.409516 (+   764us) service_pool.cc:224] Handling call
0709 13:19:13.957913 (+1548397us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54000c99d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:13.958044 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970416384}
I20260709 13:19:13.947530 21326 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.934214 21155 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.015410 17220 catalog_manager.cc:5697] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 5 to 6, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 6 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:19:14.014045 21319 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:19:13.957587 21328 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:14.023733 17313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 677) took 1496 ms (client timeout 1918 ms). Trace:
W20260709 13:19:14.037055 17313 rpcz_store.cc:269] 0709 13:19:12.526816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.539929 (+ 13113us) service_pool.cc:224] Handling call
0709 13:19:14.023492 (+1483563us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b540043f3d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:14.023653 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785198976}
I20260709 13:19:14.041313 17220 catalog_manager.cc:5697] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.019047 21227 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:19:14.053241 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 101934us
I20260709 13:19:13.969647 21260 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.040957 21135 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.060045 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1781) took 1025 ms. Trace:
I20260709 13:19:14.060606 17315 rpcz_store.cc:276] 0709 13:19:13.031334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.031469 (+   135us) service_pool.cc:224] Handling call
0709 13:19:14.056876 (+1025407us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540035b6d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:14.057052 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514807680}
I20260709 13:19:14.028172 21326 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.035354 21254 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.071269 21135 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.079468 21135 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:14.080267 21330 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:14.082490 20749 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:14.093196 21330 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:14.094265 21330 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.095146 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:14.095945 17470 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:14.097530 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:14.098476 17462 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:14.099565 17964 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:14.109108 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:14.049536 21328 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.117990 17313 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:14.118788 21328 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.120182 21192 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.121378 21260 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.123693 21253 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:14.138180 17397 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:14.125022 21155 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:14.125521 21334 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:14.125870 21259 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.129632 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:14.142665 17320 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:14.129804 20531 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.067459 20614 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.139379 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:14.140326 17996 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:14.141032 21323 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:14.141566 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:14.143935 17435 leader_election.cc:400] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
I20260709 13:19:14.146565 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:14.152338 17435 leader_election.cc:403] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:14.147888 17390 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:14.147323 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:14.153014 17397 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:14.146163 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.116135 21135 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.155337 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:14.157431 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 48460.5us
I20260709 13:19:14.158525 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:14.157199 17995 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:14.161448 17313 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:14.175673 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:14.148249 21323 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.174276 17998 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:14.186821 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.184188 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:14.187994 17996 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.189288 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:14.177851 21135 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.266418 17995 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.267937 21135 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:14.231130 21254 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:14.243899 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 128810us
I20260709 13:19:14.270961 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:14.189587 17396 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:14.185504 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2833) took 1620 ms. Trace:
I20260709 13:19:14.235903 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:14.275540 17998 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.163036 21289 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:14.242026 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:14.282894 17992 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:14.276651 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 143273us
I20260709 13:19:14.162694 21328 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
I20260709 13:19:14.176944 21023 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:14.293401 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:14.190608 21323 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.256203 20790 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.306516 20790 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.308790 20790 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.312181 17995 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
W20260709 13:19:14.284157 21335 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:19:14.242332 21316 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:14.331807 17992 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
W20260709 13:19:14.333577 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.285822 21328 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:19:14.249667 20835 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:19:14.368997 21339 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:19:14.373962 21314 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.554s	user 0.003s	sys 0.000s
W20260709 13:19:14.376071 21325 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.548s	user 0.000s	sys 0.002s
I20260709 13:19:14.377480 17998 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:14.383061 17434 leader_election.cc:400] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:19:14.383487 17434 leader_election.cc:403] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:14.385104 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 114548us
I20260709 13:19:14.386592 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.351542 20614 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.392478 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.395656 17996 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:14.357002 21328 consensus_queue.cc:1243] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:14.273348 17469 rpcz_store.cc:276] 0709 13:19:12.556003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.569812 (+ 13809us) service_pool.cc:224] Handling call
0709 13:19:12.623112 (+ 53300us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:12.771339 (+148227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.771370 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:12.772039 (+   669us) log.cc:844] Serialized 78 byte log entry
0709 13:19:12.969939 (+197900us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:12.990439 (+ 20500us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.991230 (+   791us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.055209 (+1063979us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b180008d5e0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf 00007f7d6280e038
0709 13:19:14.055400 (+   191us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.158264 (+102864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.176292 (+ 18028us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.176337 (+    45us) raft_consensus.cc:1685] finished
0709 13:19:14.176350 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.176522 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1116179,"prepare.queue_time_us":2172962,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":1744,"raft.queue_time_us":49590,"raft.run_cpu_time_us":440,"raft.run_wall_time_us":9729,"spinlock_wait_cycles":5315328,"thread_start_us":257164,"threads_started":2,"wal-append.queue_time_us":444947,"wal-append.run_cpu_time_us":2959,"wal-append.run_wall_time_us":1005257}
I20260709 13:19:14.402318 17388 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:14.402788 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:14.439145 17467 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:14.438427 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1662) took 1155 ms. Trace:
I20260709 13:19:14.392541 21103 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:14.393740 20790 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.453790 21255 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:19:14.456496 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 68747.5us
I20260709 13:19:14.457283 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:14.444979 17471 rpcz_store.cc:276] 0709 13:19:13.283440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.283578 (+   138us) service_pool.cc:224] Handling call
0709 13:19:13.283873 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.284170 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:14.163842 (+879672us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.294094 (+130252us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.294373 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.401397 (+107024us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.401473 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:14.438177 (+ 36704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.438248 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.438365 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":785219,"prepare.queue_time_us":853360,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":118,"raft.queue_time_us":86209,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"thread_start_us":233303,"threads_started":3,"wal-append.queue_time_us":184382}
I20260709 13:19:14.439885 21328 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:14.469904 17467 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:14.439561 21326 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:14.482873 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 92277.5us
I20260709 13:19:14.483994 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:14.484644 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:14.488562 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.491696 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:14.492831 17996 raft_consensus.cc:2368] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
I20260709 13:19:14.509631 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:14.510540 17998 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:14.513569 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:14.514509 17464 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:14.519395 21170 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:14.519943 21170 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:14.520238 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:14.520881 21170 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.522581 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1058) took 1214 ms. Trace:
I20260709 13:19:14.522984 17997 rpcz_store.cc:276] 0709 13:19:13.308151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.314108 (+  5957us) service_pool.cc:224] Handling call
0709 13:19:14.522338 (+1208230us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400472a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:14.522494 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329678720}
I20260709 13:19:14.524008 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 778) took 1359 ms. Trace:
I20260709 13:19:14.524302 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:14.522446 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:14.462605 21103 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.466192 21323 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.534725 17994 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:14.524408 17993 rpcz_store.cc:276] 0709 13:19:13.164774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.165090 (+   316us) service_pool.cc:224] Handling call
0709 13:19:14.523803 (+1358713us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54006054d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:14.523936 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198909824}
I20260709 13:19:14.489456 20954 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:14.549309 21357 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:14.526558 20614 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:14.701407 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 155402us
W20260709 13:19:14.572149 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 90246.7us
I20260709 13:19:14.597182 17995 raft_consensus.cc:2368] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:19:14.601373 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:14.590777 17464 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:14.561400 17991 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:14.605619 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:14.703801 17471 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:14.544868 21254 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.727620 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:14.730099 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:14.591732 21353 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:14.733731 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:14.603432 21113 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:14.738530 21113 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:14.739159 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:14.739773 21113 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.605808 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:14.640813 21182 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.600594 21103 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:14.728160 21347 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:14.741277 17465 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:14.741715 21347 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.744076 21347 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.598920 21323 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:14.741272 21182 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.745625 21323 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:14.746819 21182 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:14.747385 17998 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:19:14.747116 21251 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:14.747670 21351 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:14.748111 21351 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:14.593058 21356 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:14.751258 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:14.666451 21155 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:14.754695 21355 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:14.756031 17962 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.702310 20614 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:14.741425 21103 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.765390 17962 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:14.767046 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:14.768268 17962 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:14.733337 21023 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:14.769811 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 176084us
I20260709 13:19:14.774436 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:14.777552 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:14.777796 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:14.778360 17315 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:14.778508 17314 raft_consensus.cc:2410] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:14.780435 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:14.780696 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.781833 17321 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:14.762236 21347 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:14.761811 20614 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.781095 17313 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:14.727831 21326 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:19:14.763805 21316 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:14.784593 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.733493 21254 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.771072 21113 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.749076 21351 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.769029 21355 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:14.769246 20835 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:14.795253 21362 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:19:14.731549 21363 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:19:14.796309 21358 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:14.797394 21363 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.797693 21358 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:14.797874 21363 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.772099 21330 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:14.769788 21364 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:14.780063 21323 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.792589 20749 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:14.760988 21155 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.794103 21351 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.798238 21358 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.787446 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:14.799934 17434 leader_election.cc:400] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
W20260709 13:19:14.803077 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 100143us
I20260709 13:19:14.814494 17434 leader_election.cc:403] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:14.814874 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.769109 21103 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.804169 21364 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.789443 21196 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:14.788120 21326 consensus_queue.cc:1243] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:14.818747 17314 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:14.815745 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:14.799067 21347 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:14.821491 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:14.801527 20842 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:14.763677 21356 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.818179 21355 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:14.825616 21357 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:19:14.828572 21355 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.829072 21374 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:14.829612 21374 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.830041 21374 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.830766 21363 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.830984 21355 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:14.831686 21369 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:19:14.832458 21254 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:14.834975 21289 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.838605 21374 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.820595 21196 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:14.840787 21374 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:14.840993 21196 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.842023 21196 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.820381 21256 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:14.826690 20842 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:14.853235 21256 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:14.853529 20842 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.853686 21256 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.855443 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:14.856073 17321 raft_consensus.cc:606] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:14.823935 20954 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:14.857728 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:14.858417 21364 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:14.858892 21370 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.859009 21364 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:14.859404 21364 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.859544 21371 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:14.859822 21364 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.859874 21373 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:19:14.860601 21329 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.772s	user 0.003s	sys 0.000s
I20260709 13:19:14.861054 21253 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:14.860973 21373 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.861729 21253 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:14.862494 21372 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:19:14.863747 21373 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.828480 21347 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.869403 21253 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:14.870960 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.893950 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:14.894824 17321 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:19:14.897841 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 70483.3us
I20260709 13:19:14.899421 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:14.900174 17321 raft_consensus.cc:2376] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9. Re-sending same reply.
I20260709 13:19:14.903586 17314 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:14.907060 17314 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:19:14.907476 17314 pending_rounds.cc:85] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 10
I20260709 13:19:14.907749 17314 pending_rounds.cc:107] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:19:14.908012 17314 raft_consensus.cc:2889] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:14.809202 21330 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.915410 21103 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:14.919613 20790 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:19:14.883437 20954 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:14.924299 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:14.924911 17322 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.925530 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:14.926020 17321 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:14.926115 17315 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:14.941672 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:14.941819 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:14.942512 17389 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:14.945595 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:14.946007 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 124653us
I20260709 13:19:14.946745 17319 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:14.946798 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:14.948180 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:14.948400 17389 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:14.948589 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:14.949024 17393 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:14.948732 17391 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.949923 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:14.859411 21370 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.951509 17285 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:19:14.952033 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 118785us
I20260709 13:19:14.953554 21385 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:14.954792 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:14.956138 17315 raft_consensus.cc:2368] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
I20260709 13:19:14.860067 21371 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.956202 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.958724 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:14.961066 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:14.962033 21384 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:14.965373 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:14.966033 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:14.966225 21385 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:14.966995 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:14.968032 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:14.968264 21385 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.969012 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:14.969496 17389 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:14.970950 21289 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
I20260709 13:19:14.971525 17391 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:14.973196 17468 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:14.982878 17322 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:14.972712 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:14.957273 21298 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:14.954603 21361 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:14.934644 21256 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:14.959944 20835 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:14.989466 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.988266 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:14.993700 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:14.959987 21357 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:14.998572 17319 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:14.978585 21374 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:14.971858 21381 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:15.001263 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:15.014622 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60265.6us
I20260709 13:19:15.001319 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:15.004071 17388 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:15.014782 17465 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:15.003995 17393 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.984961 21369 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:14.986824 21155 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:14.990891 20749 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:15.027292 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:15.014938 17314 raft_consensus.cc:2410] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:15.026399 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.028407 17319 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:15.029983 21356 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:15.030853 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:15.006739 21357 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:14.986186 21289 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:19:15.076668 17464 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.077414 21114 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:15.079263 21387 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:19:15.079819 21370 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:15.002692 21298 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:15.083716 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 76785.2us
I20260709 13:19:15.082031 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:15.014211 20842 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.102361 17319 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:15.104327 21383 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:15.104929 21383 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.105849 20842 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:15.106968 21383 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:15.017467 21374 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:15.114256 17464 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:15.108428 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:15.108668 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:15.109946 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 137314us
I20260709 13:19:15.006135 20835 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.033636 21381 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:15.076690 21357 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.084578 21369 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:15.117497 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 126005us
I20260709 13:19:15.120136 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:15.101229 21384 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:15.125380 17469 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:15.125521 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:15.120718 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:15.126451 17388 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:15.117991 17465 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:19:15.123282 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 122044us
W20260709 13:19:15.115338 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 340979us
I20260709 13:19:15.108098 21114 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:15.131188 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:15.004902 21361 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:15.129293 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:15.134734 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:15.136526 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.139611 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:15.140393 17321 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:15.130757 17964 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:15.138957 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:15.149510 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:15.124614 21384 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.151840 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:15.141824 21392 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:15.223834 17322 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:15.252717 17434 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:15.154996 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:15.146901 21330 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:15.297190 21191 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:15.150544 21114 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.150104 21356 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:15.202607 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50225.5us
W20260709 13:19:15.301258 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 155654us
I20260709 13:19:15.301321 17393 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:15.202476 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.154628 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:15.347000 17992 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:15.299847 17388 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:19:15.200594 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 69434.5us
I20260709 13:19:15.277607 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.348892 17317 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:15.148903 21355 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:15.215938 20749 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:15.224573 21380 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:15.302680 21384 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.322791 21328 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.249619 21362 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:15.319326 20834 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:15.371042 21378 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:19:15.378908 21399 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:15.379237 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.247792 21391 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.132s
I20260709 13:19:15.350672 21256 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:15.266886 21374 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.388948 21373 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:15.390400 20835 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:15.233278 21298 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:15.404017 21323 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.002s
I20260709 13:19:15.350361 21392 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.146260 21289 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.221s
I20260709 13:19:15.404659 21385 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.403008 20834 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:15.240885 21388 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
W20260709 13:19:15.416958 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.393396 21380 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.394053 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:15.458000 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 64072.6us
W20260709 13:19:15.421495 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 168879us
W20260709 13:19:15.426977 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.400507 21355 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:15.402359 21371 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:15.436249 21350 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.103s	user 0.001s	sys 0.001s
I20260709 13:19:15.440024 21392 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:15.447460 17388 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:19:15.448101 20614 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.005s
I20260709 13:19:15.448688 17391 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:19:15.461627 21327 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.429s	user 0.004s	sys 0.000s
I20260709 13:19:15.451839 21323 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.454879 17285 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:15.417382 21399 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:15.402380 20749 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.464811 17992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:48172
I20260709 13:19:15.493165 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:15.465695 21351 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.000s
I20260709 13:19:15.467216 21170 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.468215 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:15.469194 20834 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.505406 20834 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.505487 21399 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:15.506136 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2850) took 1120 ms. Trace:
I20260709 13:19:15.506728 17468 rpcz_store.cc:276] 0709 13:19:14.386064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.392015 (+  5951us) service_pool.cc:224] Handling call
0709 13:19:15.505841 (+1113826us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54002e2f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:15.506019 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1190355840}
I20260709 13:19:15.449954 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1750) took 1619 ms. Trace:
I20260709 13:19:15.300019 21381 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.508108 17390 rpcz_store.cc:276] 0709 13:19:13.830961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.934716 (+103755us) service_pool.cc:224] Handling call
0709 13:19:13.934997 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.153140 (+218143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.449704 (+1296564us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400410ad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:15.449879 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489205504}
I20260709 13:19:15.511845 20790 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:15.278108 21369 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.472533 21392 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:15.471167 21361 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:15.480731 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:15.484099 17994 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:15.485502 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.487931 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.488494 17319 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:15.512513 20790 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:15.461418 21378 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:15.497646 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.497905 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:15.459383 21380 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.517202 17317 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:15.477322 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.519212 17462 raft_consensus.cc:2410] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:19:15.519273 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60565.3us
I20260709 13:19:15.536512 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:15.416529 21362 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.539472 21362 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:15.524569 21114 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:15.488565 21113 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:15.543170 21113 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.487577 21256 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:15.546706 21256 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:15.547261 21256 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.549065 21113 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:15.527552 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:15.525662 21332 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:15.553966 21332 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:15.555172 21332 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:15.556756 21332 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.560060 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.560130 20790 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.561834 20790 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.563728 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:15.487644 21355 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.580569 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.581789 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.484560 20614 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:15.583554 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.582616 17317 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
W20260709 13:19:15.583508 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 434018us
W20260709 13:19:15.586638 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 189845us
I20260709 13:19:15.589449 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:15.592614 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:15.593159 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:15.593434 17468 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.598781 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:15.599663 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:15.569002 21392 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:19:15.580034 20828 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:15.674533 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:15.616317 17469 raft_consensus.cc:2368] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:15.701009 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.616024 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:15.666980 17463 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:15.601281 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:15.601413 17471 raft_consensus.cc:2368] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:15.718326 17464 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:19:15.718350 17465 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:15.706494 17468 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:15.604727 17434 leader_election.cc:400] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
W20260709 13:19:15.722041 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 117527us
I20260709 13:19:15.723136 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:15.624421 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:15.675945 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:15.725507 17468 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
W20260709 13:19:15.730986 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 106693us
I20260709 13:19:15.732071 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:15.701720 21378 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.687224 20749 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:15.670982 21026 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.745687 21026 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:15.746876 21358 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.877s	user 0.008s	sys 0.004s
I20260709 13:19:15.747309 21358 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.749115 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:15.749827 17463 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:15.752288 17992 raft_consensus.cc:606] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:15.752733 17992 raft_consensus.cc:614] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:15.756803 21278 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:15.757194 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:15.757756 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.667239 21369 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.774260 17993 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:15.670502 21362 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.775421 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:15.684948 21196 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.738402 21397 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.738453 21378 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.805105 21196 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.806957 21378 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:15.739117 21289 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:15.807332 21196 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:15.740070 21407 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:19:15.808065 21408 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:15.808471 21408 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:15.740732 21411 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:15.758001 17469 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:15.809072 21411 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.810786 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:15.811467 17465 raft_consensus.cc:2410] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:19:15.735132 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 59317.6us
I20260709 13:19:15.761504 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:15.769495 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60043.7us
I20260709 13:19:15.760222 17434 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:15.812652 17464 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:15.813004 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:15.813154 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 53019.8us
I20260709 13:19:15.814149 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:15.809958 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:15.814632 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:15.698897 21401 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:15.738706 21371 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:15.670284 21363 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:15.621450 21227 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.152s
I20260709 13:19:15.789242 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:15.790905 17468 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:15.621014 21351 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.143s
I20260709 13:19:15.791901 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:15.795248 21409 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:15.796240 21399 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:15.796363 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1743) took 1962 ms. Trace:
I20260709 13:19:15.821622 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:15.797516 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:15.798298 21364 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.926s	user 0.013s	sys 0.000s
I20260709 13:19:15.748737 21026 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:15.666697 21323 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:19:15.801151 17962 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:15.803431 21384 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.804437 20614 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:15.815855 17321 raft_consensus.cc:2410] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:15.726598 21385 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.698449 21382 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 13:19:15.820185 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:15.758383 21298 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:15.847214 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:15.848826 17320 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:15.844089 17395 rpcz_store.cc:276] 0709 13:19:13.814397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.819319 (+  4922us) service_pool.cc:224] Handling call
0709 13:19:15.776183 (+1956864us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54004119d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:15.776388 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239193856}
I20260709 13:19:15.819610 21123 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:15.815472 21328 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:15.818166 21196 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.856084 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:15.821894 21378 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.865093 21123 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.819679 21289 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:19:15.873867 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:15.849826 20834 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:15.883123 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 787) took 1364 ms. Trace:
I20260709 13:19:15.852501 21403 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:15.882947 21095 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:15.887315 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 121048us
I20260709 13:19:15.877517 21123 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:15.809302 21408 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.870967 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:15.897264 17470 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:15.872990 20614 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:15.821138 21347 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:19:15.819470 21401 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:15.820065 21362 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.883492 17995 rpcz_store.cc:276] 0709 13:19:14.518655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.519924 (+  1269us) service_pool.cc:224] Handling call
0709 13:19:15.882907 (+1362983us) spinlock_profiling.cc:243] Waited 76 ms on lock 0x7b54007611d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:15.883067 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174696320}
I20260709 13:19:15.889436 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:15.925566 17392 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.861625 21298 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.891251 21358 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:15.894546 21422 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:19:15.895313 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:15.880672 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:15.815776 21369 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:15.873263 21388 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:15.853317 21364 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.873394 21351 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:15.907438 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:15.858295 21385 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.857384 21363 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.898619 20835 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:19:15.855664 21399 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:15.881378 21357 consensus_meta.cc:287] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.739s	user 0.012s	sys 0.000s
I20260709 13:19:15.937330 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:15.942240 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 47012.9us
I20260709 13:19:15.940678 17467 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:15.914413 21255 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:15.947388 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 66758.1us
W20260709 13:19:15.948820 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 128780us
I20260709 13:19:15.965049 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:15.965102 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:15.949808 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:15.932405 21298 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.904187 21144 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:15.933207 20790 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:15.960246 17392 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:15.946803 21323 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:15.964092 17464 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
W20260709 13:19:15.965760 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 58432.8us
I20260709 13:19:15.967777 17394 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:15.951088 21408 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.951328 21170 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.969496 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:15.972500 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:15.967209 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:15.970432 17435 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.785s (SENT) [suppressed 17 similar messages]
I20260709 13:19:15.975767 21369 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:15.977901 21358 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:19:15.984293 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.973469 21328 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:15.987381 17469 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:15.952679 21388 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:15.990144 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:16.002193 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:15.966903 21255 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.970177 21332 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:15.966743 21289 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:15.995663 17362 leader_election.cc:400] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:15.971336 21196 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:16.017743 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.995819 21251 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:15.988036 21323 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:16.021515 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:15.988608 20790 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:15.994402 21328 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:15.969071 21357 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.050390 21404 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.028476 21332 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:16.060444 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.070730 21411 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.071300 21332 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.071875 21323 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.072815 20790 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.070794 21328 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.048182 17466 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:16.012173 17362 leader_election.cc:403] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:15.994537 21114 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:16.059123 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:16.054235 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:16.046991 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.130795 17999 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:16.012667 20842 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:16.006556 21255 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:16.077836 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.130613 17996 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:16.044567 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.068061 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:16.078222 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.138564 17396 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:16.062891 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:16.148563 17470 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
W20260709 13:19:16.045647 21423 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:16.162947 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:16.051734 21383 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:16.167550 17471 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:16.017623 21196 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.172477 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:16.168766 20790 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.172904 21196 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:16.173471 20749 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:16.173171 20790 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.173857 20749 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:16.174280 20749 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.175719 21298 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.073143 21404 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.179554 21404 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:16.180157 17468 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:16.058892 21385 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.069521 21388 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.043329 21123 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:16.044409 21425 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:19:16.051332 21399 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.066133 21364 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.170492 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:16.029074 21360 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:16.069052 21362 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.196056 17469 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:16.052194 21401 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:16.181139 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.200068 21360 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:16.200634 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.201210 21360 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.201277 17470 raft_consensus.cc:2376] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10. Re-sending same reply.
I20260709 13:19:16.203504 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.182919 21411 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.180328 21196 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.186676 21227 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:16.187561 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 194224us
I20260709 13:19:16.040123 21384 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.129586 21114 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:16.189806 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 199719us
I20260709 13:19:16.047039 21363 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.010344 21427 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.180s
I20260709 13:19:16.038134 21256 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:16.203552 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 231326us
I20260709 13:19:16.021896 21289 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.037719 21251 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:16.204754 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.165256 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.182807 21253 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:16.220410 21357 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.221160 20790 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.221344 21427 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:16.221704 21427 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:16.222376 21289 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:16.222502 21427 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.208973 21114 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.223491 21251 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.225805 21123 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.217480 21227 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.227981 20749 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.204232 21411 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.229921 21227 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:16.230492 21411 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:16.233172 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2913) took 1268 ms. Trace:
I20260709 13:19:16.233593 17394 rpcz_store.cc:276] 0709 13:19:14.964285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.965809 (+  1524us) service_pool.cc:224] Handling call
0709 13:19:16.232941 (+1267132us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b54004132d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:16.233107 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2288796416}
I20260709 13:19:16.237484 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:16.238936 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.239563 17464 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.060851 21380 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.211418 17362 leader_election.cc:400] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:16.247902 17362 leader_election.cc:403] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:16.172399 21383 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:16.218031 17470 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:16.244146 17434 leader_election.cc:400] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:19:16.209213 21401 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.211447 21385 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:16.251366 21380 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.252403 21135 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.253276 21383 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.196738 21430 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:16.254851 21256 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.256402 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:16.256139 21255 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.257490 17397 raft_consensus.cc:2368] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10.
I20260709 13:19:16.267211 21401 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.282130 21401 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.268211 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:16.264454 21091 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:16.265890 21227 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:16.283973 21323 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:16.275552 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 64251us
I20260709 13:19:16.295351 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:16.296326 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:16.297546 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:16.298686 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:16.299314 17470 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:16.267102 17434 leader_election.cc:403] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:16.285966 17466 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:19:16.301896 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 57904.8us
I20260709 13:19:16.275350 21430 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.272284 20749 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.293632 21352 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.296273 21383 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:16.265846 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53814.4us
I20260709 13:19:16.272198 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:16.315339 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.305788 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.303998 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:16.290927 17464 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:16.320182 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:16.320240 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.321242 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.322178 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:16.322329 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:16.322870 17466 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:16.270002 21135 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.303743 21380 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:16.268862 21385 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.320884 17470 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:16.310364 21401 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10.
I20260709 13:19:16.311944 21091 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:16.312384 21332 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:16.330654 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:16.335819 17464 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:16.333020 21431 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:16.312642 21430 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.337471 17464 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:16.331795 17466 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:16.329327 17999 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:16.334475 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:16.334959 17286 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:16.298151 21227 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.340210 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:16.337096 21135 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:16.321938 21352 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.332631 21091 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:16.351975 21256 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:16.351588 17396 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:16.330904 21380 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:16.354022 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.350020 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:16.359673 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.359721 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:16.360299 17395 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:16.342177 21431 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:16.344507 21176 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:16.357306 21256 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.357242 21091 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.369182 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:16.371248 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:16.372100 17996 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:16.379321 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:16.380227 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:16.359833 21380 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:16.382853 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.383670 21135 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:16.384755 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:16.387039 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:16.358913 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:16.389087 17395 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:16.353309 21332 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.393271 17996 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:16.396936 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:16.397702 17990 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.381716 21196 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:16.367143 21256 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:16.431094 21227 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:16.435539 21380 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.384474 21363 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:16.384135 21135 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:16.390528 21176 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:16.453608 17392 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:16.426826 20835 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.429190 21360 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.437070 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:16.438364 21298 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:16.439268 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:16.439968 21114 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:16.441468 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.391218 21358 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:19:16.439950 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:16.405761 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.448939 17990 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:16.401175 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:16.465809 17996 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:16.466903 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:16.467329 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:16.468116 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:16.470177 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:16.398545 21332 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.479760 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.479664 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:16.481550 17467 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:16.453795 21135 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.450940 21255 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:16.483368 21432 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:16.472458 21401 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:16.483598 21323 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:16.486554 21298 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:16.455569 21363 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.517330 21403 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.514546 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 113418us
I20260709 13:19:16.471217 20835 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.471551 21360 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.525626 21255 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:16.531458 21255 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.526172 17318 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:16.533303 17999 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:16.526172 17322 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:16.508536 21401 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:16.540195 21431 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:16.541766 21255 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:16.543174 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 793) took 1082 ms. Trace:
I20260709 13:19:16.544797 21408 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:16.565136 17467 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
W20260709 13:19:16.545989 21438 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:19:16.546306 21357 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:16.549330 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1527) took 1760 ms. Trace:
I20260709 13:19:16.549618 21091 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.556676 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:16.557827 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:16.558758 21095 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:16.559016 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:16.562975 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:16.568360 17993 rpcz_store.cc:276] 0709 13:19:15.461058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.461209 (+   151us) service_pool.cc:224] Handling call
0709 13:19:15.483282 (+ 22073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.796829 (+313547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.542913 (+746084us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400600ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:16.543086 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634109056}
W20260709 13:19:16.545240 21439 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:19:16.571452 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:16.624444 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:16.537684 21176 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.641393 21135 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.642884 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:16.643399 21360 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:16.644003 21411 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:16.644151 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:16.644435 21411 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:16.645650 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:16.645393 21411 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.646664 21411 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.647941 21135 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:16.648437 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:16.649271 17316 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:16.650275 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:16.651438 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:16.659214 17993 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:16.653421 17314 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:16.662508 17314 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:16.662588 21091 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.654201 21369 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:16.665125 21369 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.668934 21369 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.669665 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.671479 17469 pending_rounds.cc:85] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 3
I20260709 13:19:16.671738 17469 pending_rounds.cc:107] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:19:16.671999 17469 raft_consensus.cc:2889] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.673205 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 651) took 1664 ms. Trace:
I20260709 13:19:16.673621 17462 rpcz_store.cc:276] 0709 13:19:15.008600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.010404 (+  1804us) service_pool.cc:224] Handling call
0709 13:19:16.673005 (+1662601us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54003dfc54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:16.673140 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128849280}
I20260709 13:19:16.675228 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:16.676147 17462 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:16.677167 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:16.646844 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:16.679497 17316 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:16.616528 21123 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:16.617836 21385 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:16.682420 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:16.533601 21403 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.683135 17470 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:19:16.698056 17470 pending_rounds.cc:85] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 8
I20260709 13:19:16.698318 17470 pending_rounds.cc:107] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:19:16.698511 17470 raft_consensus.cc:2889] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.686241 17434 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:16.687002 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:16.687767 21404 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:16.691455 21435 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.496s	user 0.003s	sys 0.000s
I20260709 13:19:16.694321 21427 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.673206 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:16.715559 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:16.682799 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 155867us
I20260709 13:19:16.624101 17313 rpcz_store.cc:276] 0709 13:19:14.788720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.788855 (+   135us) service_pool.cc:224] Handling call
0709 13:19:14.789123 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.870478 (+ 81355us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:14.883767 (+ 13289us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.960197 (+ 76430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.960248 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:14.960283 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.549070 (+1588787us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b5400369a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:16.549120 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.549245 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":908,"prepare.queue_time_us":23765,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":1005,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6992,"spinlock_wait_cycles":186605440,"thread_start_us":75083,"threads_started":1,"wal-append.queue_time_us":125082,"wal-append.run_cpu_time_us":1444,"wal-append.run_wall_time_us":1061169}
I20260709 13:19:16.733989 17321 raft_consensus.cc:2410] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:16.734789 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:16.737021 17993 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:16.738214 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:16.701320 17462 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.741397 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:16.714304 20531 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.624408 21431 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.746953 21357 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:16.701220 21408 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:16.747226 20954 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:16.734481 21399 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.738312 21289 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:16.741525 21337 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:16.728332 21385 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:16.701865 21123 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.775655 21337 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.773543 21114 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:16.797415 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48172 (request call id 6) took 1329 ms. Trace:
I20260709 13:19:16.775396 21289 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.793838 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 651) took 1345 ms. Trace:
I20260709 13:19:16.772776 21380 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.774111 21357 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.797837 17992 rpcz_store.cc:276] 0709 13:19:15.461824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.462052 (+   228us) service_pool.cc:224] Handling call
0709 13:19:16.791365 (+1329313us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400600ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627ee853 00007f7d677bc60a 00007f7d60d427d4 00007f7d60d42762 00007f7d60d42691 00007f7d60d4260c 00007f7d60d418c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:16.791515 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596411648}
I20260709 13:19:16.798724 17391 rpcz_store.cc:276] 0709 13:19:15.448531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.472533 (+ 24002us) service_pool.cc:224] Handling call
0709 13:19:15.472892 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.540267 (+ 67375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.540310 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:15.540366 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:15.540410 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.793576 (+1253166us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b5400411ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:16.793636 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.793783 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154397568}
I20260709 13:19:16.805529 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.811389 17462 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:16.774372 20531 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:16.813371 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 73657.7us
I20260709 13:19:16.754335 21401 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.795650 21337 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.790337 21135 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:16.781329 21399 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.801259 21289 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.820892 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:16.784464 21385 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.840999 21385 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.842407 21385 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:16.844260 21384 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:16.844803 21384 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:16.845924 21384 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.847452 21384 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:16.850466 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 2873) took 1050 ms. Trace:
W20260709 13:19:16.678035 21434 consensus_queue.cc:1175] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c23a664ebf3347a4934dee377c8b5101" responder_term: 9 status { last_received { term: 7 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:16.850986 17468 rpcz_store.cc:276] 0709 13:19:15.800238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.067736 (+267498us) service_pool.cc:224] Handling call
0709 13:19:16.850253 (+782517us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b54001f7a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:16.850392 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74084096}
I20260709 13:19:16.778790 21451 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:19:16.755018 21404 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:19:16.886235 21256 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:16.887578 21443 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:19:16.850342 20531 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:16.893543 21454 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:16.897351 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2874) took 1096 ms. Trace:
I20260709 13:19:16.897869 17467 rpcz_store.cc:276] 0709 13:19:15.800536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.643433 (+842897us) service_pool.cc:224] Handling call
0709 13:19:16.643761 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.678342 (+ 34581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.678373 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.683820 (+  5447us) log.cc:844] Serialized 26 byte log entry
0709 13:19:16.779482 (+ 95662us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:16.779521 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.779573 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.897108 (+117535us) raft_consensus.cc:1685] finished
0709 13:19:16.897137 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.897287 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43080,"raft.queue_time_us":35115,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6004,"thread_start_us":91870,"threads_started":1,"wal-append.queue_time_us":207945}
I20260709 13:19:16.812405 21357 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.927873 17467 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:16.929155 21403 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:16.929968 21357 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.879693 21363 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:16.930058 21444 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:19:16.931440 21123 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:16.931670 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 110893us
I20260709 13:19:16.939234 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:16.939884 17313 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:16.942149 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.942755 17389 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:16.946136 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2875) took 1134 ms. Trace:
I20260709 13:19:16.946727 17469 rpcz_store.cc:276] 0709 13:19:15.850948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.670902 (+819954us) service_pool.cc:224] Handling call
0709 13:19:16.671262 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:16.685134 (+ 13872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.685182 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:16.687828 (+  2646us) log.cc:844] Serialized 52 byte log entry
0709 13:19:16.756098 (+ 68270us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:16.756139 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.756210 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.895095 (+138885us) raft_consensus.cc:1685] finished
0709 13:19:16.895122 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.935249 (+ 40127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6699,"raft.queue_time_us":12493,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":67796,"threads_started":1,"wal-append.queue_time_us":94187}
I20260709 13:19:16.932241 20531 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.950887 17389 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:16.951141 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2871) took 1151 ms. Trace:
I20260709 13:19:16.953581 17469 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:16.955951 21399 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:16.957257 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:16.957314 21431 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:16.957819 21451 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.973376 21451 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:16.952493 17464 rpcz_store.cc:276] 0709 13:19:15.799608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.341373 (+541765us) service_pool.cc:224] Handling call
0709 13:19:16.341711 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.346677 (+  4966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.346713 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.352644 (+  5931us) log.cc:844] Serialized 26 byte log entry
0709 13:19:16.462246 (+109602us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:16.561249 (+ 99003us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.561456 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.561529 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.950923 (+389394us) raft_consensus.cc:1685] finished
0709 13:19:16.950949 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.951081 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":233590,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":5441,"raft.queue_time_us":555,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":58514,"thread_start_us":169026,"threads_started":2,"wal-append.queue_time_us":157557}
I20260709 13:19:16.979916 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1082) took 1023 ms. Trace:
I20260709 13:19:16.980451 17995 rpcz_store.cc:276] 0709 13:19:15.956097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.956228 (+   131us) service_pool.cc:224] Handling call
0709 13:19:16.979639 (+1023411us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54006d1354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:16.979830 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703148416}
I20260709 13:19:16.955053 20531 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:16.957911 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:16.958817 21352 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:16.960562 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:16.961608 17466 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:16.962954 17469 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:19:16.969334 21328 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.805s	user 0.006s	sys 0.005s
I20260709 13:19:16.946908 21402 consensus_queue.cc:1059] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:19:17.002015 17395 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:17.010293 21451 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:17.011838 21391 raft_consensus.cc:3055] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:17.035214 21391 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:17.045753 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.033708 21328 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:17.033421 21431 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.050100 21431 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:17.053830 21259 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.072435 21259 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:17.072968 21287 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:17.073536 21287 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:17.074644 21259 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:17.075523 21287 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:17.076571 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:17.077507 17469 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
W20260709 13:19:17.097599 17397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 650) took 1649 ms (client timeout 1897 ms). Trace:
W20260709 13:19:17.098229 17397 rpcz_store.cc:269] 0709 13:19:15.448238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.448938 (+   700us) service_pool.cc:224] Handling call
0709 13:19:16.237335 (+788397us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b58001b9f98. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:19:17.097276 (+859941us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b54003020d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:17.097498 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57558528}
I20260709 13:19:17.105515 20835 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:17.112637 17320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1529) took 1636 ms (client timeout 2013 ms). Trace:
W20260709 13:19:17.118780 17320 rpcz_store.cc:269] 0709 13:19:15.476623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.476961 (+   338us) service_pool.cc:224] Handling call
0709 13:19:17.112402 (+1635441us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54001419d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:17.112548 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721749760}
W20260709 13:19:17.120589 21332 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 13:19:17.121179 21332 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:17.125108 17394 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:19:17.130290 20531 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:17.131434 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1697) took 1454 ms. Trace:
I20260709 13:19:17.131819 17470 rpcz_store.cc:276] 0709 13:19:15.676881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.335345 (+658464us) service_pool.cc:224] Handling call
0709 13:19:16.678905 (+343560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.713583 (+ 34678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.131232 (+417649us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54003dfc50. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:17.131368 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789408128}
I20260709 13:19:17.134486 17462 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:17.137421 21430 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.003s
I20260709 13:19:17.137843 21430 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:17.141741 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.013055 21278 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:17.149708 21278 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.150200 21278 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:17.166275 21383 consensus_meta.cc:287] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.843s	user 0.010s	sys 0.001s
I20260709 13:19:17.036355 21391 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:17.178284 21391 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:17.185388 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.223062 17315 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:17.051199 21328 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:17.224110 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1688) took 1634 ms. Trace:
I20260709 13:19:17.235888 17471 rpcz_store.cc:276] 0709 13:19:15.589829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.733629 (+143800us) service_pool.cc:224] Handling call
0709 13:19:15.805193 (+ 71564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.172543 (+367350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.223838 (+1051295us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400162454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:17.224030 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832898304}
I20260709 13:19:17.232398 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:17.234380 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:17.277740 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1798) took 2043 ms. Trace:
I20260709 13:19:17.278339 17315 rpcz_store.cc:276] 0709 13:19:15.233947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.234235 (+   288us) service_pool.cc:224] Handling call
0709 13:19:15.264047 (+ 29812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.223767 (+1959720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.277389 (+ 53622us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b540010ca54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:17.277656 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4504673024}
I20260709 13:19:17.233671 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:17.282447 17999 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:17.281533 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:17.291007 17996 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:17.034109 21403 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.189s
I20260709 13:19:17.215790 20835 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:17.216310 21256 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:17.339309 20835 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:17.493876 21135 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:17.511828 21135 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:17.514635 21135 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:17.594465 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.532660 21328 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.508304 21430 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:17.974725 17315 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:19:17.985013 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.977042 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:17.829908 17391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.016s	sys 0.030s
W20260709 13:19:17.987397 17391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.019s	sys 0.034s
I20260709 13:19:17.980216 17285 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:17.835737 17467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.032s	sys 0.088s
W20260709 13:19:17.979001 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 843240us
I20260709 13:19:17.990434 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:17.835579 17319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.023s	sys 0.023s
W20260709 13:19:17.991613 17319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.029s	sys 0.025s
I20260709 13:19:17.994130 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:17.994947 17320 raft_consensus.cc:2410] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:19:17.988229 17467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.032s	sys 0.096s
I20260709 13:19:17.988225 17992 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:17.988286 17996 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:18.003046 21431 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.003630 21431 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.996387 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:18.005138 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:18.005374 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:17.979909 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:18.008077 17395 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:18.014753 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.026556 17316 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:18.025243 17318 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:18.033794 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.034507 17320 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:18.007786 21135 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:18.035557 21135 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:17.973595 21332 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.037518 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:18.037793 21332 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:18.038259 21332 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.040795 21332 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.042026 21332 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.042526 21332 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.044553 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:18.041355 21384 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.193s	user 0.005s	sys 0.010s
I20260709 13:19:18.045889 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:18.046456 17317 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.049132 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:18.012984 21259 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:18.053407 21259 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.056118 21259 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.050336 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.045202 17993 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:18.058346 17318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd74e04425094277971ef1f372f80d50"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:18.058900 17318 raft_consensus.cc:606] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:18.059206 17318 raft_consensus.cc:614] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:17.793869 21337 consensus_meta.cc:287] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.953s	user 0.011s	sys 0.000s
W20260709 13:19:17.838392 21289 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.000s	user 0.010s	sys 0.001s
I20260709 13:19:18.060316 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:18.061420 21332 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:18.062355 21391 consensus_meta.cc:287] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.883s	user 0.002s	sys 0.007s
I20260709 13:19:18.062597 21259 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:18.066032 21403 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:18.004076 21431 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:18.099124 17963 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.006s	sys 0.010s
W20260709 13:19:18.099455 17963 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.006s	sys 0.010s
I20260709 13:19:18.084596 17317 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:18.099716 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:18.074923 20835 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:17.929514 21357 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.088064 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.082124 17389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.023s	sys 0.061s
I20260709 13:19:18.076050 21430 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:18.116724 17389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.023s	sys 0.069s
W20260709 13:19:18.097714 21401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.018s	sys 0.069s
I20260709 13:19:18.112303 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:18.010747 21328 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:18.122543 21401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.019s	sys 0.069s
I20260709 13:19:18.095245 21289 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.094213 21337 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.121059 20835 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:18.134570 17321 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:18.120648 21357 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.103344 21403 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.105264 21391 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:18.099718 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 1.0942e+06us
I20260709 13:19:18.138717 21430 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:18.157893 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 183115us
I20260709 13:19:18.101824 21259 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.138484 20835 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.168468 17321 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:18.170787 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:18.161064 21332 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:18.176949 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:18.181656 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:18.182344 17462 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.184099 17394 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:18.156497 21391 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.190114 21259 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.190639 21259 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.191167 21259 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.193310 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:18.194715 17470 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:18.181747 21135 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.195956 17397 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:18.196460 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:18.199466 21469 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.199704 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:18.200320 17471 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:18.200002 21469 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.202171 21391 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.202450 21469 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.192669 21259 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.204329 17462 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:18.205091 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:18.226455 17394 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
W20260709 13:19:18.206766 21456 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:19:18.207397 21462 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:19:18.208020 21458 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:18.208117 20835 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:18.208616 21460 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:19:18.208737 21431 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.210726 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:18.237562 17465 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.211374 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:18.212512 21278 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.062s	user 0.011s	sys 0.001s
I20260709 13:19:18.213382 21328 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.204051 21357 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.218209 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2942) took 1263 ms. Trace:
I20260709 13:19:18.229044 17214 catalog_manager.cc:5697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:18.221655 21337 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.186225 21332 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.231210 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:18.236694 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:18.250249 17462 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:18.239045 17463 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:18.225854 21384 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.249917 17469 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
W20260709 13:19:18.229246 17963 connection.cc:256] RPC call timeout handler was delayed by -1.085662511999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 13:19:18.252511 17963 connection.cc:256] RPC call timeout handler was delayed by -1.0262835979999636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:19:18.249871 17214 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.238396 21401 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.254678 17963 connection.cc:256] RPC call timeout handler was delayed by -1.0010835979999229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
I20260709 13:19:18.237658 21259 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.240242 21464 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.241959 17389 rpcz_store.cc:276] 0709 13:19:16.954956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.955351 (+   395us) service_pool.cc:224] Handling call
0709 13:19:16.955641 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.955976 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.956002 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.956446 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.119108 (+1162662us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:18.119162 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.119431 (+   269us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.217951 (+ 98520us) raft_consensus.cc:1685] finished
0709 13:19:18.217986 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.218146 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":945,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":104,"thread_start_us":1162256,"threads_started":1,"wal-append.queue_time_us":1213227}
I20260709 13:19:18.257124 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:18.249053 21289 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.270526 17465 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:18.277326 17963 leader_election.cc:400] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10.
W20260709 13:19:18.269809 17220 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49270 (request call id 326) took 25251 ms (client timeout 15000 ms). Trace:
I20260709 13:19:18.250784 21357 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:18.260919 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1818) took 1325 ms. Trace:
I20260709 13:19:18.279825 17319 rpcz_store.cc:276] 0709 13:19:16.935657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.935773 (+   116us) service_pool.cc:224] Handling call
0709 13:19:16.947996 (+ 12223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.948377 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:16.948406 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.948894 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.992044 (+1043150us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:17.992099 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.992199 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.260673 (+268474us) raft_consensus.cc:1685] finished
0709 13:19:18.260693 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.260821 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3518,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":1810,"thread_start_us":1011778,"threads_started":1,"wal-append.queue_time_us":1141340}
I20260709 13:19:18.282516 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2941) took 1327 ms. Trace:
I20260709 13:19:18.240775 21278 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.252075 21466 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:18.283062 17391 rpcz_store.cc:276] 0709 13:19:16.954692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.958308 (+  3616us) service_pool.cc:224] Handling call
0709 13:19:16.958614 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.958914 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.958944 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.959368 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.987770 (+1028402us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:17.987810 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.987881 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.282311 (+294430us) raft_consensus.cc:1685] finished
0709 13:19:18.282334 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.282461 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":883,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":1028032,"threads_started":1,"wal-append.queue_time_us":1141145}
I20260709 13:19:18.253216 21468 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:18.278959 20835 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.284660 17214 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:18.285004 21467 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:18.252800 21431 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:19:18.284623 21357 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:18.277895 17220 rpcz_store.cc:269] 0709 13:18:52.987755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.988508 (+   753us) service_pool.cc:224] Handling call
0709 13:19:18.239475 (+25250967us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:14.796372 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:14.797117 (+   745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:14.797181 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:19:14.797224 (+    43us) tablet.cc:662] Decoding operations
0709 13:19:14.860788 (+ 63564us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:14.860885 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:14.860910 (+    25us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:19:14.863057 (+  2147us) tablet.cc:701] Row locks acquired
0709 13:19:14.863121 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:19:14.863293 (+   172us) write_op.cc:270] Start()
0709 13:19:14.863422 (+   129us) write_op.cc:276] Timestamp: P: 1783603154863222 usec, L: 0
0709 13:19:14.863448 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:19:14.910944 (+ 47496us) log.cc:844] Serialized 9320 byte log entry
0709 13:19:15.298691 (+387747us) op_driver.cc:464] REPLICATION: finished
0709 13:19:15.313529 (+ 14838us) write_op.cc:301] APPLY: starting
0709 13:19:15.313667 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:15.410795 (+ 97128us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:15.427780 (+ 16985us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:15.750984 (+323204us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:15.751441 (+   457us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=48
0709 13:19:15.751491 (+    50us) write_op.cc:312] APPLY: finished
0709 13:19:15.752023 (+   532us) log.cc:844] Serialized 164 byte log entry
0709 13:19:15.752235 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:15.752449 (+   214us) write_op.cc:454] Released schema lock
0709 13:19:15.752528 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:15.843733 (+ 91205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:15.849425 (+  5692us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":322,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":14434,"apply.run_cpu_time_us":13464,"apply.run_wall_time_us":497819,"num_ops":24,"prepare.queue_time_us":428500,"prepare.run_cpu_time_us":36040,"prepare.run_wall_time_us":230317,"raft.queue_time_us":217825,"raft.run_cpu_time_us":4708,"raft.run_wall_time_us":14631,"replication_time_us":435065,"thread_start_us":284454,"threads_started":4,"wal-append.queue_time_us":102952,"wal-append.run_cpu_time_us":27762,"wal-append.run_wall_time_us":1732172}]]}
I20260709 13:19:18.264528 21464 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.255102 21384 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.333575 21135 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.338387 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:18.317766 21466 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.340277 21357 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.336797 21467 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.344762 17471 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:18.259758 21401 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.260215 21259 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.336129 17214 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 3 to 7, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 7 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.321695 21403 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.360407 21289 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.367666 21328 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:18.368076 21328 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:18.368374 21259 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.331101 21468 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.367660 21289 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.370469 21468 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.371132 21289 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.373821 21401 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.374328 21476 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:18.374877 21278 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.375938 21332 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.374893 21476 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.361043 21357 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:18.379642 21357 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.361092 21466 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.380401 21328 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.358165 21135 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.381693 21357 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.333783 21337 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:18.382469 21337 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.383489 21135 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.384466 21337 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.378957 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:18.385375 17389 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:18.388049 21457 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.250s	user 0.004s	sys 0.000s
I20260709 13:19:18.390252 21467 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.366910 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:18.394028 17389 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:18.396668 21476 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.397632 21384 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.398037 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:18.399166 21337 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:18.400238 21278 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:18.405889 21278 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.409305 21278 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.401845 21403 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:18.400498 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 420474us
I20260709 13:19:18.403910 21337 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.411839 21337 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.409337 21466 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.412490 21466 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.414435 21466 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.415227 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:18.404469 17389 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:18.448312 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 662) took 2145 ms. Trace:
I20260709 13:19:18.362600 21472 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:18.358575 21464 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.451674 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:18.448769 17467 rpcz_store.cc:276] 0709 13:19:16.302697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.928724 (+626027us) service_pool.cc:224] Handling call
0709 13:19:16.929011 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:16.929364 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.929390 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:16.929951 (+   561us) log.cc:844] Serialized 52 byte log entry
0709 13:19:17.759534 (+829583us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b4800210258. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:19:17.995452 (+235918us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:18.446931 (+451479us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.447907 (+   976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.447994 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.448031 (+    37us) raft_consensus.cc:1685] finished
0709 13:19:18.448105 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.448252 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1518,"raft.run_cpu_time_us":5088,"raft.run_wall_time_us":842135,"spinlock_wait_cycles":8720768,"thread_start_us":1456828,"threads_started":2,"wal-append.queue_time_us":1190935}
W20260709 13:19:18.459959 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 44793.3us
W20260709 13:19:18.461062 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 470674us
I20260709 13:19:18.459717 17214 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.462288 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:18.464147 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 44915.6us
I20260709 13:19:18.465793 21278 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:18.470644 21430 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:18.472918 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:18.473385 21430 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:18.421295 21135 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.474979 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 238854us
I20260709 13:19:18.478977 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:18.475348 17214 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:18.480855 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:18.496168 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:18.499042 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47460.2us
I20260709 13:19:18.499755 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:18.501835 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.509003 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 344847us
I20260709 13:19:18.521396 17434 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:18.502458 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:18.500330 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:18.526428 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:18.474495 21384 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:18.524953 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:18.530170 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.530359 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.459542 21466 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:19:18.463406 21476 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:19:18.496642 21357 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:18.474642 21475 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:18.526693 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 150946us
I20260709 13:19:18.530519 17992 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:18.552321 17214 catalog_manager.cc:5697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 4 to 7, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 7 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.494330 21403 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:18.545903 17991 raft_consensus.cc:2393] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:18.546693 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:18.554466 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.532292 17995 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:18.524780 21259 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:18.547967 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.493636 21467 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:18.558215 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.525843 21464 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:18.550489 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.553313 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:18.522229 21401 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.554041 17214 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.499863 21430 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:18.525394 21479 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:18.566910 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.559336 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.525915 21289 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.531075 21468 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:18.463747 21472 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.499569 21135 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.568035 17996 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:19:18.562012 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.559047 21259 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.552727 21357 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.573151 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.568639 17214 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 7 to 10, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 10 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:18.583885 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.585289 17991 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:18.546555 20835 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:19:18.568547 21487 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.586875 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.599437 17996 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:18.587471 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:18.555874 21482 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:18.591832 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.594878 21135 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:18.594213 17214 catalog_manager.cc:5697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 8 to 10, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 10 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.614445 17214 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:18.560734 21464 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:18.560374 21475 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:18.560920 21474 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:18.547282 21384 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.617729 21492 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.588508 21483 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:19:18.572660 21468 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.596266 21357 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.597357 21484 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:18.565781 21467 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.590207 21259 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.582476 21470 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:19:18.621232 21464 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.583592 21289 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.621073 21482 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:18.623162 21466 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:18.630676 21468 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.573101 21479 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.644292 21491 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:18.648454 17214 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 7 to 9, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 9 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:18.632501 21480 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:18.628257 21486 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:18.665611 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 116261us
I20260709 13:19:18.686506 17993 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:18.686031 17214 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 4 to 10, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 10 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:18.688144 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 163264us
I20260709 13:19:18.689353 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:18.691468 21473 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:18.640486 21484 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:18.699149 21490 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:18.709117 21500 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:18.709657 21500 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:18.710229 21500 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:18.706147 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 66645.6us
W20260709 13:19:18.721344 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50555.5us
I20260709 13:19:18.721025 17214 catalog_manager.cc:5697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 1 to 5, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 5 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.687749 21486 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.667781 21480 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:18.705569 21489 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.722082 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:18.726997 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:18.733373 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:18.734361 17468 raft_consensus.cc:2410] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:18.730912 17467 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:18.630826 21492 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.705440 21391 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:18.739042 17214 catalog_manager.cc:5697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:18.743346 21473 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:18.744446 21473 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:18.744786 21473 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:18.745666 21473 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.746665 21473 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.746843 21492 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.748435 21492 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:18.723448 21337 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:18.757293 21485 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:18.748993 21391 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.750723 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:18.651582 21430 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.797457 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:18.762277 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:18.798063 17466 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:18.767783 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:18.799268 17468 raft_consensus.cc:2410] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:19:18.799408 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 246168us
I20260709 13:19:18.772235 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.772708 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.784759 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:18.791404 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 291115us
W20260709 13:19:18.789618 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 57762.3us
I20260709 13:19:18.790001 21507 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.791523 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:18.794358 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:18.801522 17470 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:18.725430 21486 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:18.801507 17462 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:18.794960 17214 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 8 to 9, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 9 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:18.802608 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 113710us
I20260709 13:19:18.804157 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.804589 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.805276 17314 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:18.805368 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.806389 17320 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:18.807824 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.809036 17463 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:18.809350 17463 pending_rounds.cc:85] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 5
I20260709 13:19:18.809594 17463 pending_rounds.cc:107] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:19:18.788906 21466 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:18.809855 17463 raft_consensus.cc:2889] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:18.811060 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.790776 21403 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:18.815459 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:18.811589 17465 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:18.812144 17471 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:18.814721 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:18.759907 21502 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:18.761655 21337 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:18.824214 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 73547.1us
I20260709 13:19:18.818599 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.825593 17321 raft_consensus.cc:2410] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:19:18.825528 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:18.827885 21401 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.828524 21488 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.195s	user 0.003s	sys 0.000s
I20260709 13:19:18.828416 21401 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.830453 21289 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.812752 17214 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 6 to 9, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 9 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:18.731400 21470 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:19:18.806754 21507 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:18.838187 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 111287us
I20260709 13:19:18.839241 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:18.843766 17214 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 4 to 6, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 6 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:18.830880 21401 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.811389 21494 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.847465 17214 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 6 to 8, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 8 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.793220 21492 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.845599 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:18.856261 17214 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 7 to 8, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 8 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.834905 21278 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:18.887456 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:18.738782 21489 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:18.889472 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 64047.3us
W20260709 13:19:18.891754 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 52622.7us
W20260709 13:19:18.868607 21498 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:19:18.837718 21507 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.901108 21337 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.894881 21401 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.912364 21513 raft_consensus.cc:2764] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:19:18.894111 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.914072 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 99431.8us
I20260709 13:19:18.916458 21492 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.901961 21511 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:18.917590 21511 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.918041 21511 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:18.921283 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:18.897063 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:18.922016 17471 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:18.915009 21337 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.923120 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:18.923723 17470 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.923995 21328 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.925606 21487 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.749552 21475 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.929957 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:18.930111 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:18.931934 17466 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:18.931386 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:18.933314 17470 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:18.929991 17462 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:18.936571 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:18.906514 21467 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:18.937183 17465 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.905424 21506 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.891198 21332 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:19:18.947968 21384 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.935487 17471 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:18.938158 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:18.942088 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:18.911449 21472 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.887051 21480 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.946916 21135 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:18.952013 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:18.797222 21482 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.811118 21484 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:18.934686 21469 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:18.887692 21494 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.939507 21470 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:18.987076 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:18.987910 17318 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:18.988046 17313 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:18.930424 21517 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:19.001027 17465 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:18.948861 20835 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:19.005568 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 168676us
I20260709 13:19:18.961920 21135 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:19.009862 17322 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:18.954793 21479 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:19.015515 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:19.017009 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:19.017567 17317 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.929268 21401 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:18.955149 21512 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.027357 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.026090 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.022818 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.023341 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.025867 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.976122 21469 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.997884 21470 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.038545 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.027982 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:19.134732 17318 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:19.135840 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:18.922577 21403 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:19.010290 20835 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:19.077294 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.081460 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.058024 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:19.081887 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.067778 17317 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:19.138706 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.058593 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.016150 21135 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.015375 21491 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:19.099324 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 295841us
I20260709 13:19:19.025331 21472 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:19.101326 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 142804us
W20260709 13:19:19.078866 21499 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:19:19.057229 21467 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.081198 21476 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:19.081090 21522 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:19:19.114143 21464 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:19.083245 21391 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:18.959054 21506 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.057749 21490 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:19:19.104429 21357 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.169488 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:19.137583 21470 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.911597 21466 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:19.138870 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 80929.9us
I20260709 13:19:19.029348 21480 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:19.145058 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.146126 17396 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:19.147006 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.143508 21491 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:19.107321 17469 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:19.018823 21515 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:19.158305 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.134575 21469 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.160004 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.167259 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.168931 17397 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:19.168504 20835 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.169508 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:19.216804 21489 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:19.170019 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:19.133029 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 181077us
I20260709 13:19:19.196376 17394 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:19.196462 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:19.196660 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.139078 21517 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.144582 21328 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:19.210116 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:19.151515 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 123576us
I20260709 13:19:19.312516 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:19.219475 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.313932 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.169620 21467 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.152683 21476 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:19.242944 17467 raft_consensus.cc:2368] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12.
I20260709 13:19:19.245159 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:19.330911 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.284724 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:19.292166 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 350130us
I20260709 13:19:19.292708 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:19.197569 21529 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:19.210352 21391 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:19.152978 21472 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:19.252004 21499 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:19:19.296135 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.364034 17388 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:19.300781 17391 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:19.169961 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:19.289705 21534 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:19:19.320031 21508 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:19.314410 17396 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:19:19.224640 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.370508 17393 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:19.317585 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:19.322800 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.287463 21515 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:19.333961 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 88863.6us
I20260709 13:19:19.375653 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.350926 21401 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:19.380594 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.351715 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.318369 21328 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:19.310910 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.388664 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.389101 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.389488 17462 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:19.333670 21476 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:19.282711 21486 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:19.367895 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:19.368134 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.372853 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.394330 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.371328 17397 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:19.372853 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.376955 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.394939 17465 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:19.396624 17393 raft_consensus.cc:2410] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:19:19.397562 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.352321 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.357348 21489 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:19.357287 21391 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.382179 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.386730 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.400808 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.387732 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.389786 17395 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
W20260709 13:19:19.389935 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 85169.8us
I20260709 13:19:19.391667 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.402395 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:19.374866 21520 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:19:19.389809 17394 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:19.405778 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.365464 21529 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:19.408530 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.409874 17393 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:19.410912 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.392668 21328 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.399542 17392 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:19.401155 21489 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.405795 21391 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.407087 21490 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.369773 21508 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:19.401427 17463 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:19.401324 17469 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:19.401837 17471 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:19.318079 21517 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.402937 17468 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:19.402787 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:19.466987 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 64263.7us
I20260709 13:19:19.393457 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:19.468243 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 74852.1us
I20260709 13:19:19.416996 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.469185 17393 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 6.
I20260709 13:19:19.418185 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.420289 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.470229 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:19.360958 21491 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:19.407850 21401 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.400728 21474 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:19.395622 17388 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:19.475355 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.463979 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.466171 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.423043 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:19.477299 17313 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:19.436275 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.411336 21506 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:19.403003 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:19.470253 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.470609 17394 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:19.499750 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.498337 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.499089 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.526467 17471 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:19.527645 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.471068 21508 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:19.543766 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:19.500367 21538 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:19:19.485157 21523 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:19.457527 21357 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:19.506913 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 101519us
I20260709 13:19:19.498828 17388 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:19.465128 21511 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.003s
I20260709 13:19:19.474352 21515 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:19.435945 21524 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.303s	user 0.002s	sys 0.000s
I20260709 13:19:19.487084 21526 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:19.508772 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.457541 21489 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.511904 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.513082 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:19.515988 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.482604 21332 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:19.529910 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:19.530710 17287 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:19.542400 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.493904 17317 raft_consensus.cc:2376] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10. Re-sending same reply.
I20260709 13:19:19.473203 21464 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:19.630478 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.631285 17463 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:19.544595 17393 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:19.548871 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.557982 21482 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:19.569532 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:19.632664 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 102074us
W20260709 13:19:19.633136 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 63728.3us
I20260709 13:19:19.570000 21555 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:19.578955 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45489.5us
I20260709 13:19:19.635520 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:19.580685 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.420289 21535 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:19:19.636343 17471 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:19.584105 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:19.587623 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.517297 21506 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.499236 21401 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:19.592625 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 122507us
I20260709 13:19:19.646507 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:19.646559 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:19.651273 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:19.636248 21487 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:19.621850 17395 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.621151 17467 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
W20260709 13:19:19.627310 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 77613us
I20260709 13:19:19.499327 21474 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:19.585912 21523 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.580893 21494 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:19.579414 21553 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:19.639436 17468 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:19.588685 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.628448 21509 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.589509 21518 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:19:19.663411 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:19.634382 21482 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.591635 21511 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.641724 21554 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:19.624280 17466 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:19.703783 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:19.658826 21357 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:19.675693 21500 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.958s	user 0.009s	sys 0.002s
I20260709 13:19:19.649833 21516 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:19:19.662423 21332 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:19.586707 21529 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.670436 21523 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.652938 21506 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:19.733151 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 86701.3us
I20260709 13:19:19.727139 17392 raft_consensus.cc:2368] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
I20260709 13:19:19.734941 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:19.654088 21551 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
W20260709 13:19:19.724380 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 66260.4us
W20260709 13:19:19.722277 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 75850.8us
I20260709 13:19:19.752514 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:19.681293 21482 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:19.676440 21535 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:19:19.727517 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:19.721560 21494 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.708915 21554 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:19.749286 21259 consensus_meta.cc:287] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.103s	user 0.009s	sys 0.003s
I20260709 13:19:19.776081 21259 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.777734 21401 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:19.778318 21259 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:19.760490 21473 consensus_meta.cc:287] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.013s	user 0.009s	sys 0.005s
I20260709 13:19:19.746949 21486 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:19.784970 17390 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:19.723703 21500 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:19.781160 21543 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:19:19.746927 21467 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:19.761117 21554 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.707038 21509 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.816385 17320 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:19.785696 21464 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:19.788203 21539 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:19:19.842267 17397 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
W20260709 13:19:19.840284 21530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.006s	sys 0.011s
W20260709 13:19:19.848515 21530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.007s	sys 0.011s
I20260709 13:19:19.843070 21332 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.865686 17395 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:19.845969 21464 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:19.878599 21278 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.983s	user 0.012s	sys 0.000s
I20260709 13:19:19.879616 21278 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.882903 21472 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:19.878567 21569 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.890568 17319 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
W20260709 13:19:19.895290 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 241155us
W20260709 13:19:19.863587 21507 consensus_meta.cc:287] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.953s	user 0.012s	sys 0.000s
I20260709 13:19:19.896744 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:19.860451 21328 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:19.906726 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.925619 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:19.925294 17963 leader_election.cc:336] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.555s (SENT)
W20260709 13:19:19.936915 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 209484us
W20260709 13:19:19.932142 21135 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.777s	user 0.014s	sys 0.004s
W20260709 13:19:19.931581 21468 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.263s	user 0.012s	sys 0.000s
I20260709 13:19:19.943009 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.948920 17396 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:19.906920 21575 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:19.946027 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:19.905055 21507 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.949999 21468 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:19.952618 21572 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:19:19.954419 21468 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:19.959028 21491 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:19.961349 21506 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:19.945402 21549 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:19:19.975739 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.933190 21473 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:19.944782 21135 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.977892 21473 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:19.948483 21502 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:19:19.978469 21473 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:19.978999 17388 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:19.979367 21135 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:19.979897 21391 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.005s
I20260709 13:19:19.980176 17995 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:19.980305 21391 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.979382 17388 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:19.998672 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 54146.6us
I20260709 13:19:20.000190 17287 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:20.005417 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:19.984067 17388 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:19.900990 21569 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.007126 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:19.947639 21511 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:20.010790 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:20.011003 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.012269 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:20.011127 17388 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.025426 17388 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:19:20.003350 21476 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 13:19:20.030256 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.001488 21572 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:20.012084 21469 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.724s	user 0.005s	sys 0.007s
I20260709 13:19:20.006862 21513 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:20.032058 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.054376 21530 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:20.054795 17388 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:20.055361 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.054983 21530 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.055750 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.056819 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:20.034511 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:20.027484 17287 leader_election.cc:400] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12.
I20260709 13:19:20.008059 21391 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.038885 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:20.028800 21278 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:20.041960 21554 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.012482 21575 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:19:20.043227 21469 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.009874 21510 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:20.029636 21495 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:20.057922 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.081374 17388 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:20.026757 21521 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:20.034168 21527 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:19:20.064805 17397 raft_consensus.cc:2376] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10. Re-sending same reply.
W20260709 13:19:20.058205 21480 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.829s	user 0.010s	sys 0.002s
I20260709 13:19:20.092067 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.092725 17397 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 3.
I20260709 13:19:20.093870 17397 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:19.947465 21508 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.034775 21476 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.097995 17468 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:20.081118 21495 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:20.094929 17466 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:20.065069 21530 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:20.097030 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.426704 21494 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:20.426985 17394 raft_consensus.cc:2410] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:19:20.426468 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 673973us
I20260709 13:19:20.430030 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.424827 21357 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:20.431306 21357 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:20.425555 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 690678us
I20260709 13:19:20.435007 21494 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:20.435560 21494 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.437849 21494 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:20.424969 21559 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:20.438759 21559 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:20.399283 21517 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:20.096282 21328 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:20.209065 17963 leader_election.cc:336] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.865s (SENT)
I20260709 13:19:20.442550 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:20.442770 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 233761us
I20260709 13:19:20.120004 21510 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:20.095434 21509 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:20.443948 21480 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:20.439864 21559 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.444278 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:20.121208 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.444455 21480 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:20.447082 21515 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:20.447165 17465 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.447616 21515 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:20.448177 21515 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.125901 21476 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.444816 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 709) took 1458 ms. Trace:
I20260709 13:19:20.452329 17320 rpcz_store.cc:276] 0709 13:19:18.986728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.986837 (+   109us) service_pool.cc:224] Handling call
0709 13:19:20.164022 (+1177185us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54003facd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:20.444755 (+280733us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814667520}
I20260709 13:19:20.453439 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:20.454720 21571 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:20.455111 21571 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:20.444561 17391 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:20.182529 21554 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.456542 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.120314 21485 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:20.458299 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.458590 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.426016 21551 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:20.459359 21551 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:20.459801 21551 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.455475 21571 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.460666 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:20.461355 17466 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:20.129102 17468 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:20.447432 21480 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.178009 20835 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.462539 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:20.463276 21468 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:20.463630 21468 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:20.464179 21468 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.124768 17389 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:20.465193 21495 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.466166 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.468322 17388 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:20.469425 17388 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:20.445779 21559 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.082760 21521 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:20.461447 21494 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.457175 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:20.470309 21469 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.456248 21515 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.471771 21468 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:20.162025 21578 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.266s	user 0.001s	sys 0.002s
I20260709 13:19:20.082095 21278 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:20.068994 21507 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.126021 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 713) took 1138 ms. Trace:
I20260709 13:19:20.474532 21508 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:20.124809 21470 consensus_meta.cc:287] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.902s	user 0.009s	sys 0.000s
I20260709 13:19:20.507426 21470 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.509794 21470 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:20.163348 21576 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:19:20.511780 17992 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:19:20.293154 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.515202 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:20.515949 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:20.517107 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:20.463687 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.142073 21569 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.443951 21510 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.457077 17391 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:20.458650 21328 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:20.503844 21501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.447s	user 0.000s	sys 0.019s
W20260709 13:19:20.139160 21489 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.001s
I20260709 13:19:20.463719 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:20.499742 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.472220 21480 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.532224 17466 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:20.500902 17388 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:20.446725 21500 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.503639 17465 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
W20260709 13:19:20.518532 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 54915.5us
I20260709 13:19:20.519107 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:20.518196 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:20.536289 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.536563 17388 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:20.537433 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:20.530642 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:20.491639 21521 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.458245 21485 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.522799 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:20.543407 17319 raft_consensus.cc:2410] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:20.496133 21509 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.524629 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:20.546890 17397 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.527895 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:20.529906 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 426994us
I20260709 13:19:20.504519 21530 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:20.503196 17316 rpcz_store.cc:276] 0709 13:19:18.987924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.988066 (+   142us) service_pool.cc:224] Handling call
0709 13:19:18.988478 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.032299 (+ 43821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.032330 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.056927 (+ 24597us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.208959 (+152032us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:19.277087 (+ 68128us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.283947 (+  6860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.125652 (+841705us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b5400212354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:20.125703 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.125749 (+    46us) raft_consensus.cc:1685] finished
0709 13:19:20.125836 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.125964 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22107,"prepare.queue_time_us":67916,"prepare.run_cpu_time_us":2898,"prepare.run_wall_time_us":4184,"raft.queue_time_us":93356,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":18272,"spinlock_wait_cycles":62831488,"thread_start_us":126628,"threads_started":1,"wal-append.queue_time_us":121098,"wal-append.run_cpu_time_us":2823,"wal-append.run_wall_time_us":1185816}
I20260709 13:19:20.531574 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.536700 17322 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:20.521916 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:20.539749 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.541082 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:20.541635 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:20.552352 17315 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.552902 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.553325 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.554191 17466 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.542080 17391 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:20.554529 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.520632 21494 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:20.520253 21493 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.562109 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:20.529146 21501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.497s	user 0.000s	sys 0.020s
I20260709 13:19:20.562727 17468 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.564783 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.568217 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:20.542663 21472 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:20.545665 21328 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:20.541443 21516 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.545372 21542 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:20.585032 21542 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.585493 21542 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.587203 17466 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:20.588029 21500 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:20.560529 21509 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.590363 21480 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.561642 21467 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:20.591007 21509 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.592583 21485 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:20.583647 21482 consensus_meta.cc:287] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.000s
I20260709 13:19:20.593461 21482 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.595718 17471 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:19:20.583943 21328 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:20.590957 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.597055 21328 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:20.582022 21468 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:20.601713 21515 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.601959 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:20.558601 21530 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.602548 21530 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.603561 21564 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:20.604439 21564 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:20.605343 21357 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:20.568616 21473 consensus_meta.cc:287] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.002s
I20260709 13:19:20.606120 21564 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:20.606220 21473 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.607771 21500 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:20.608155 21500 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:20.608389 21473 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.608916 21500 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.569058 21401 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:20.610118 21500 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.557123 21278 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.613123 21564 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:20.614012 21564 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.533639 21489 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.617812 17469 raft_consensus.cc:2368] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11.
I20260709 13:19:20.621199 21516 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.622087 21509 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:20.622870 21509 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.623330 21516 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.625965 21509 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:20.628916 21587 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:19:20.629979 21482 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:20.631860 21523 consensus_meta.cc:287] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.880s	user 0.006s	sys 0.003s
I20260709 13:19:20.638515 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:20.640015 17313 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.566840 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:20.641377 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 74641.1us
I20260709 13:19:20.642081 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:20.643560 17397 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:20.640153 17468 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:20.646631 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.647797 17465 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.632313 21523 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.654603 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.656638 17468 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:20.646061 21514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.611s	user 0.043s	sys 0.073s
I20260709 13:19:20.644734 21482 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:20.673074 17465 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:20.674468 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.676496 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:20.678162 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.679648 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.647053 21515 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:20.651695 21480 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.683054 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2910) took 1260 ms. Trace:
I20260709 13:19:20.690835 17463 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:20.693548 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.697103 21495 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.699276 21495 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:20.707377 21551 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.708500 21515 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:20.690323 21472 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:20.709914 21472 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.710279 21472 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.713238 21480 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.715711 21480 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.717721 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.718073 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.718672 17993 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
W20260709 13:19:20.680899 21514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.655s	user 0.044s	sys 0.073s
I20260709 13:19:20.574075 21493 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.748127 21555 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:20.748553 21555 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:20.748718 21551 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:20.730661 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.690554 21357 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:20.731328 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.749490 21555 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.750487 21555 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.733089 21468 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:20.747038 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.754741 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.691922 17470 rpcz_store.cc:276] 0709 13:19:19.422152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.424940 (+  2788us) service_pool.cc:224] Handling call
0709 13:19:19.425283 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.425522 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:19.632387 (+206865us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.970833 (+338446us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b18000d3840. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:19:20.424490 (+453657us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b18000d3840. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:19:20.680899 (+256409us) log.cc:844] Serialized 14 byte log entry
0709 13:19:20.682589 (+  1690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:20.682660 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:20.682732 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.682823 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.682984 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9372,"prepare.queue_time_us":287685,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":2575,"raft.queue_time_us":729607,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":193,"spinlock_wait_cycles":13969152,"thread_start_us":453680,"threads_started":3,"wal-append.queue_time_us":115632}
I20260709 13:19:20.731986 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.734818 17315 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:20.737169 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.734226 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.745397 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:20.745920 21515 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.746562 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:20.746697 21523 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:20.690614 21401 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:20.757864 17470 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:20.760493 17997 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:20.681070 21482 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.758427 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:20.758904 17998 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:20.756392 17993 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:20.758864 17313 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
W20260709 13:19:20.731350 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 51792.8us
I20260709 13:19:20.762085 17435 leader_election.cc:400] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
I20260709 13:19:20.762574 17435 leader_election.cc:403] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:20.761207 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.765342 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:20.766000 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:20.767339 17990 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:20.764262 17470 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.768025 17990 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:20.683698 21560 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:20.768934 17990 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.777275 17990 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.759960 21495 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.760103 21401 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:20.761713 21391 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.780040 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:20.765878 21135 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:20.795389 21135 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:20.797528 17360 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:20.798858 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.765102 21482 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.771203 20835 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:20.805174 20835 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:20.805639 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1797) took 1346 ms. Trace:
I20260709 13:19:20.806016 17394 rpcz_store.cc:276] 0709 13:19:19.459158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.543386 (+ 84228us) service_pool.cc:224] Handling call
0709 13:19:20.805428 (+1262042us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540009c4d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:20.805578 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739582464}
I20260709 13:19:20.748561 21493 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:20.808668 21391 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.812248 21391 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:20.812072 21493 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:20.812974 21493 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:20.813385 21493 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:20.814198 21493 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.815375 21493 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.818106 21482 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.820009 17999 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:19:20.821388 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.767331 21551 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11.
I20260709 13:19:20.826095 17467 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:20.826707 17990 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:19:20.829108 17990 pending_rounds.cc:85] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 7
I20260709 13:19:20.830881 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:20.831511 17393 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.831048 17990 pending_rounds.cc:107] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:19:20.832469 17990 raft_consensus.cc:2889] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:20.761551 21542 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.779549 21553 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:20.853618 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:20.855798 17393 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:20.861568 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:20.862480 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:20.805648 20835 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:20.770680 21470 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:19:20.824491 21500 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.864121 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.857277 17470 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:20.789830 21401 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.866643 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:20.866799 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.835052 21522 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:20.882450 17470 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:20.869292 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.879868 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2912) took 1457 ms. Trace:
I20260709 13:19:20.898823 17464 rpcz_store.cc:276] 0709 13:19:19.422688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.426126 (+  3438us) service_pool.cc:224] Handling call
0709 13:19:19.465346 (+ 39220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.465514 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.465538 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.465582 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:19.465612 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.465667 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.879624 (+1413957us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54000bfed0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:20.879789 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89453312}
I20260709 13:19:20.862926 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.878165 17462 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:20.773804 21328 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.905465 17462 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:20.906967 17470 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:20.790805 21571 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.917950 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:20.921954 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.923704 17462 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:20.932016 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:20.932370 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 243533us
W20260709 13:19:20.926064 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 149911us
I20260709 13:19:20.828584 21495 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:20.937309 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.850943 21468 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:19:20.940678 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:20.941989 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.898183 21522 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.947678 17468 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:20.951443 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:20.952183 17391 raft_consensus.cc:2376] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8. Re-sending same reply.
I20260709 13:19:20.933458 21523 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:20.960325 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.968724 17994 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:20.964695 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:20.965157 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:20.967592 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:20.971884 17462 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:20.974141 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:20.975889 17462 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:20.897486 21500 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:20.878901 21588 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:19:20.983006 17994 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:20.981439 17462 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:19:20.953492 21522 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.988713 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:20.948922 21507 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:20.988818 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:20.991906 17462 raft_consensus.cc:2368] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:21.000385 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:20.944499 21469 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:20.986689 21485 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:21.033751 17999 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:20.950578 21604 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:19:21.034317 17462 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:21.067593 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:21.067945 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.998070 21535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.237s	user 0.024s	sys 0.043s
I20260709 13:19:21.078996 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:21.079869 17396 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:21.042584 17362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.514s (SENT) [suppressed 25 similar messages]
I20260709 13:19:21.001543 21530 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:21.064036 21612 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:19:21.103582 17317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 720) took 1822 ms (client timeout 1505 ms). Trace:
I20260709 13:19:21.003022 21507 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:21.107659 17317 rpcz_store.cc:269] 0709 13:19:19.280919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.283393 (+  2474us) service_pool.cc:224] Handling call
0709 13:19:21.103405 (+1820012us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540043f8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:21.103521 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350748544}
I20260709 13:19:21.110409 17990 raft_consensus.cc:2368] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14.
I20260709 13:19:21.062697 21482 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:21.117975 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.080408 21485 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.120703 17462 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:21.130666 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:21.125129 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:21.080094 21535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.028s	sys 0.058s
W20260709 13:19:21.134039 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.136075 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:21.102494 21542 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:21.159524 17462 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:21.126654 21588 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:21.131091 21485 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.131703 21559 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.186160 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:21.186688 21559 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.187301 17998 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:21.192515 21530 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:21.162839 21555 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.165066 21357 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:21.184360 21495 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:21.199404 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1108) took 1521 ms. Trace:
I20260709 13:19:21.201884 17995 rpcz_store.cc:276] 0709 13:19:19.678333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.679845 (+  1512us) service_pool.cc:224] Handling call
0709 13:19:19.680199 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.980542 (+300343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.199073 (+1218531us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54002afdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:21.199324 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689224576}
W20260709 13:19:21.202864 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 160270us
W20260709 13:19:21.197314 21521 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.003s
I20260709 13:19:21.182009 21588 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:21.208313 17362 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.635s (SENT)
I20260709 13:19:21.195536 21571 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:21.195766 21328 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:21.211057 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:21.216725 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:19:21.210748 21598 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:19:21.198465 21555 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:21.225411 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:21.226037 21569 raft_consensus.cc:2764] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:19:21.229297 21589 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.768s	user 0.000s	sys 0.004s
W20260709 13:19:21.232990 17962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.082s	user 0.024s	sys 0.036s
I20260709 13:19:21.232942 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:21.226101 21602 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:19:21.237458 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:21.234869 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:21.238289 17317 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:21.239245 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:21.239526 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:21.240598 17322 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:21.242411 21513 raft_consensus.cc:2764] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:21.237347 21569 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.244547 21569 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:21.244746 21603 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:21.244983 21569 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.245199 21603 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:21.245275 21571 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:21.245790 21571 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.246136 21571 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:21.246194 21603 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.247552 21603 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:21.238778 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:21.249526 21328 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:21.250097 21328 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:21.250340 21495 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.250903 21495 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.251034 21328 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.254043 21493 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:21.254859 21516 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:21.255223 21516 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:21.255502 21472 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.000s
I20260709 13:19:21.255877 21472 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:21.256040 21516 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.214082 21610 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:21.209753 21521 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:21.260205 17962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.109s	user 0.025s	sys 0.036s
I20260709 13:19:21.261863 17994 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:21.262408 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:21.262972 17993 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.263036 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:21.263813 17999 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:21.265089 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:21.267380 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:21.267846 17471 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:21.262760 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:21.290192 17998 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:21.202346 21507 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.291666 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:21.293933 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:21.295017 17317 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:21.295107 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:21.296757 17322 raft_consensus.cc:2393] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:21.296900 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:21.298075 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:21.298100 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:21.298864 17999 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:21.300801 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:21.250362 21473 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.300560 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:21.307746 17322 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:21.309108 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:21.256284 21401 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.293927 21515 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:21.320959 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:21.290975 21468 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.319989 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:21.323220 17317 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:21.299918 21482 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.293308 21278 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:19:21.310197 21516 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:21.330797 21586 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.840s	user 0.001s	sys 0.002s
I20260709 13:19:21.332605 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1717) took 1816 ms. Trace:
I20260709 13:19:21.333599 21278 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:21.407338 21278 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:21.408317 21278 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.409858 21278 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.293607 21562 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:19:21.334894 21482 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:21.413901 21502 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:21.414503 21502 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:21.415613 21502 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.337421 21569 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.337633 21485 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.338205 21521 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:21.338970 21588 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:21.339396 21555 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:21.293668 20835 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:21.354660 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:21.333348 17315 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:22.683405 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1565) took 1359 ms. Trace:
I20260709 13:19:22.683782 17315 rpcz_store.cc:276] 0709 13:19:21.325184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.325371 (+   187us) service_pool.cc:224] Handling call
0709 13:19:21.333168 (+  7797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.683135 (+1349967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.683343 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:22.444685 21628 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:22.686833 21628 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:22.689093 21628 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:22.496459 21627 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:22.496788 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.690507 17286 connection.cc:256] RPC call timeout handler was delayed by -1.825422849000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:19:22.690959 17286 connection.cc:256] RPC call timeout handler was delayed by -1.7120228489998226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 13:19:22.691241 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:22.691416 17286 connection.cc:256] RPC call timeout handler was delayed by -1.2827228489998106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 13:19:22.691830 17286 connection.cc:256] RPC call timeout handler was delayed by -1.2557228489999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
I20260709 13:19:22.692010 17315 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:22.531992 17316 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:22.693069 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:22.693838 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:22.694115 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:22.694965 17315 raft_consensus.cc:2410] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:22.695132 17316 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:22.533999 17321 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:22.695847 17315 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:22.696557 21633 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.697082 21633 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:22.699265 21633 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:22.567193 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:22.578311 21634 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.702117 21634 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:22.704336 21634 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:22.591408 17313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1847) took 2069 ms (client timeout 2089 ms). Trace:
W20260709 13:19:22.704978 17313 rpcz_store.cc:269] 0709 13:19:20.521589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.521712 (+   123us) service_pool.cc:224] Handling call
0709 13:19:22.591192 (+2069480us) spinlock_profiling.cc:243] Waited 87.9 ms on lock 0x7b54001419d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:22.591331 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202246912}
W20260709 13:19:21.633896 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.015213 17362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.030s	sys 0.033s
W20260709 13:19:22.818058 17362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.583s	user 0.044s	sys 0.048s
W20260709 13:19:22.818853 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 1.58586e+06us
I20260709 13:19:22.708257 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:22.820508 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:22.822853 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 114505us
I20260709 13:19:22.678545 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:22.824409 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:22.825809 17318 raft_consensus.cc:2410] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:22.824407 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:22.827611 21634 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:22.828177 21634 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:22.713629 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1566) took 1386 ms. Trace:
I20260709 13:19:22.545356 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:21.714771 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.707124 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.623621 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:22.506632 17389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1774) took 3304 ms (client timeout 1702 ms). Trace:
I20260709 13:19:22.860545 17208 maintenance_manager.cc:643] P 6a4082b2c6894817acb2d2a07603a4d6: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 11.084s	user 0.220s	sys 0.181s Metrics: {"bytes_written":30227,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":175032,"dirs.run_cpu_time_us":370,"dirs.run_wall_time_us":1149,"drs_written":1,"lbm_read_time_us":421,"lbm_reads_lt_1ms":4,"lbm_write_time_us":233674,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":9,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":133161,"threads_started":1,"update_count":24}
I20260709 13:19:23.715481 21645 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.200577 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 266587us
I20260709 13:19:22.829270 17319 rpcz_store.cc:276] 0709 13:19:21.326985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.327173 (+   188us) service_pool.cc:224] Handling call
0709 13:19:21.327510 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.357557 (+ 30047us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:22.697117 (+1339560us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.704131 (+  7014us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.713267 (+  9136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.713328 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:22.713380 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.713441 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.713572 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29548,"raft.queue_time_us":35212,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":335024,"thread_start_us":15273,"threads_started":2,"wal-append.queue_time_us":6713}
W20260709 13:19:22.921746 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.855937 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 310542us
I20260709 13:19:22.833921 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:22.841948 17388 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:22.611606 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1766) took 3457 ms (client timeout 2543 ms). Trace:
I20260709 13:19:22.605579 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:22.617247 17392 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:22.607172 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:23.758080 17393 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.847992 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:23.762830 17394 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.797179 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 659) took 1857 ms. Trace:
W20260709 13:19:22.363837 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.000s	sys 0.012s
W20260709 13:19:22.488399 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 209957us
I20260709 13:19:23.793705 21647 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:23.794582 21647 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:23.797389 21647 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:22.444092 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.444484 17462 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.024s	sys 0.066s
I20260709 13:19:22.599609 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:23.810314 17466 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.480360 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2925) took 1873 ms. Trace:
I20260709 13:19:22.492195 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 687) took 2041 ms. Trace:
W20260709 13:19:23.815903 17462 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.508s	user 0.027s	sys 0.068s
I20260709 13:19:21.400822 17463 rpcz_store.cc:276] 0709 13:19:19.516514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.632137 (+115623us) service_pool.cc:224] Handling call
0709 13:19:21.332394 (+1700257us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540020fdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:21.332541 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2369277696}
I20260709 13:19:23.819218 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:23.817600 17467 rpcz_store.cc:276] 0709 13:19:20.607439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.921559 (+314120us) service_pool.cc:224] Handling call
0709 13:19:20.946387 (+ 24828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.946615 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:20.990578 (+ 43963us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.464997 (+1474419us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b1800491c20. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a
0709 13:19:22.480038 (+ 15041us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.480091 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:22.480131 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.480191 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.480302 (+   111us) inbound_call.cc:177] Queueing success response
0709 13:19:23.587336 (+1107034us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
Metrics: {"mutex_wait_us":30972,"prepare.queue_time_us":45708,"prepare.run_cpu_time_us":271,"prepare.run_wall_time_us":28967,"raft.queue_time_us":21978,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":2509,"spinlock_wait_cycles":56058368,"thread_start_us":61540,"threads_started":1,"wal-append.queue_time_us":144282}
I20260709 13:19:23.820369 17463 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:22.044615 17471 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.000s
I20260709 13:19:23.822695 21551 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.823035 17471 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:19:23.823732 21467 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.823899 17471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 710) took 2573 ms (client timeout 1583 ms). Trace:
I20260709 13:19:23.823467 21551 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:21.398914 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.528199 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.920378 17962 connection.cc:256] RPC call timeout handler was delayed by -1.9986957349999557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
I20260709 13:19:22.452416 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 826) took 1114 ms. Trace:
I20260709 13:19:22.507423 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1107) took 2829 ms. Trace:
I20260709 13:19:21.465880 17993 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:23.068320 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:23.114856 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:23.845548 17466 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:22.490557 20835 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:22.351323 21278 consensus_meta.cc:287] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.941s	user 0.009s	sys 0.001s
I20260709 13:19:23.888963 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:22.455152 17995 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:22.984478 21466 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.730051 21469 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:21.312466 21473 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:22.445356 21401 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:21.731482 21476 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.910964 21476 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:22.454802 21472 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:22.487551 21474 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:21.326654 21468 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:22.490314 21485 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:22.529316 21490 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.994s	user 0.008s	sys 0.006s
I20260709 13:19:21.327876 21495 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:21.730504 21501 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:22.460528 21502 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:23.924556 21501 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:23.927307 21501 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:23.927836 17963 connection.cc:256] RPC call timeout handler was delayed by -1.27197096399982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 13:19:23.124501 21507 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.325168 21515 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:23.929828 21507 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:23.932104 21507 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:22.485302 21516 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.028s	user 0.007s	sys 0.004s
I20260709 13:19:22.485908 21523 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:22.452967 21555 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.464196 21569 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:22.460299 21571 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.214s	user 0.006s	sys 0.001s
I20260709 13:19:23.937951 21571 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:23.149938 21588 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.102780 21591 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.942775 21591 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:21.416210 21482 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:22.501048 21489 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:22.300523 21522 consensus_meta.cc:287] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.169s	user 0.010s	sys 0.000s
I20260709 13:19:23.140883 21509 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:22.092413 21603 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.949708 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45166.3us
W20260709 13:19:23.155411 21609 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 2.089s	user 0.000s	sys 0.006s
W20260709 13:19:22.575690 21613 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.508s	user 0.001s	sys 0.000s
I20260709 13:19:23.175765 21611 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.955806 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2924) took 3348 ms. Trace:
W20260709 13:19:22.202783 21622 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.431s	user 0.000s	sys 0.000s
I20260709 13:19:23.960170 21588 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:22.203804 21623 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 13:19:22.987682 21625 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.965459 21649 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:23.966498 21625 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:22.710727 21628 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:23.970310 21628 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:23.971171 21625 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:22.798301 21633 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.973270 21628 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:23.973781 21633 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:22.800321 21638 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.977115 21638 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:23.978228 17313 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:22.850208 21639 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:23.982645 17434 connection.cc:256] RPC call timeout handler was delayed by -1.4792513529998814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:19:22.937090 21640 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:19:23.988222 21640 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:22.933197 21641 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:22.828722 21634 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:23.488946 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:23.993216 17997 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:23.994459 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:23.995217 17997 raft_consensus.cc:2368] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14.
I20260709 13:19:23.996064 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:23.996161 21639 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:23.521598 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:23.997784 21638 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:23.998343 17314 raft_consensus.cc:2368] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:23.998601 21633 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:23.988730 21640 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:23.550347 21259 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:23.999498 21259 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:23.999917 21640 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.000551 21259 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.002100 21259 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.002689 21640 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:23.626843 17389 rpcz_store.cc:269] 0709 13:19:19.202619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.209855 (+  7236us) service_pool.cc:224] Handling call
0709 13:19:22.506450 (+3296595us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54004114d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:22.506549 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868811648}
I20260709 13:19:23.997793 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:24.003162 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:23.630156 21559 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:23.635226 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:23.638808 17990 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1120) took 2795 ms (client timeout 1910 ms). Trace:
I20260709 13:19:24.005303 17997 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
W20260709 13:19:24.005546 17990 rpcz_store.cc:269] 0709 13:19:20.843517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.861288 (+ 17771us) service_pool.cc:224] Handling call
0709 13:19:23.638341 (+2777053us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400600ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:23.638611 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565082496}
I20260709 13:19:23.645538 17464 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:23.660377 21500 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:23.669435 21567 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.672876 17343 debug-util.cc:398] Leaking SignalData structure 0x7b0800303460 after lost signal to thread 16195
W20260709 13:19:23.710122 21601 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 2.648s	user 0.005s	sys 0.006s
W20260709 13:19:23.713588 17287 connection.cc:256] RPC call timeout handler was delayed by -1.5117628060002062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 13:19:24.012950 17287 connection.cc:256] RPC call timeout handler was delayed by -1.4811628060001567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:19:24.013295 17287 connection.cc:256] RPC call timeout handler was delayed by -1.1535628060000818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
I20260709 13:19:23.716146 21645 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:23.719043 17209 maintenance_manager.cc:419] P 6a4082b2c6894817acb2d2a07603a4d6: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9309 bytes on disk
I20260709 13:19:24.017203 21401 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:24.017604 17321 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:24.017838 21401 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:23.740343 21646 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.749467 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 915856us
I20260709 13:19:23.750084 21535 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:23.753890 17390 rpcz_store.cc:269] 0709 13:19:19.154275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.157530 (+  3255us) service_pool.cc:224] Handling call
0709 13:19:22.611360 (+3453830us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54001397d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:22.611534 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093506816}
I20260709 13:19:23.755523 17391 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.761638 21624 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:23.782215 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 658) took 3842 ms. Trace:
I20260709 13:19:24.022572 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:23.582445 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:24.023439 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1804) took 2809 ms (client timeout 2173 ms). Trace:
W20260709 13:19:24.023878 17390 rpcz_store.cc:269] 0709 13:19:21.213685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.023230 (+2809545us) service_pool.cc:211] Skipping call since client already timed out
0709 13:19:24.023366 (+   136us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:19:23.783022 17395 rpcz_store.cc:276] 0709 13:19:19.939527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.939809 (+   282us) service_pool.cc:224] Handling call
0709 13:19:19.940125 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.946679 (+  6554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.946725 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.947263 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.187407 (+240144us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:20.187461 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.187558 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.330243 (+1142685us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:21.768460 (+438217us) raft_consensus.cc:1685] finished
0709 13:19:21.768490 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.797100 (+ 28610us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4084,"raft.queue_time_us":61314,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":20014,"spinlock_wait_cycles":3793664,"thread_start_us":177685,"threads_started":1,"wal-append.queue_time_us":494922,"wal-append.run_cpu_time_us":9251,"wal-append.run_wall_time_us":2478743}
W20260709 13:19:24.024724 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1811) took 2809 ms (client timeout 2216 ms). Trace:
I20260709 13:19:24.025100 21401 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:24.025638 17395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1800) took 2813 ms (client timeout 2413 ms). Trace:
W20260709 13:19:24.026007 17395 rpcz_store.cc:269] 0709 13:19:21.212578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.025426 (+2812848us) service_pool.cc:211] Skipping call since client already timed out
0709 13:19:24.025563 (+   137us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:19:24.026809 17395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1812) took 2811 ms (client timeout 2543 ms). Trace:
W20260709 13:19:24.027159 17395 rpcz_store.cc:269] 0709 13:19:21.215857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.026655 (+2810798us) service_pool.cc:211] Skipping call since client already timed out
0709 13:19:24.026762 (+   107us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:19:23.788758 17393 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
W20260709 13:19:24.028863 17393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1807) took 2814 ms (client timeout 1693 ms). Trace:
W20260709 13:19:23.790591 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.057s	user 0.002s	sys 0.015s
I20260709 13:19:24.029207 21646 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.031669 21646 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:23.791671 17388 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
W20260709 13:19:24.033156 17388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1810) took 2817 ms (client timeout 1886 ms). Trace:
W20260709 13:19:24.033519 17388 rpcz_store.cc:269] 0709 13:19:21.215405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.623316 (+1407911us) service_pool.cc:224] Handling call
0709 13:19:24.033049 (+1409733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.034262 21645 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.034446 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.023012 17392 rpcz_store.cc:276] 0709 13:19:19.939179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.939279 (+   100us) service_pool.cc:224] Handling call
0709 13:19:22.616963 (+2677684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.761175 (+1144212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.781835 (+ 20660us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b54001397d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:23.782007 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6127542144}
I20260709 13:19:24.035171 17388 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:23.815910 17468 rpcz_store.cc:276] 0709 13:19:20.451253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.692885 (+241632us) service_pool.cc:224] Handling call
0709 13:19:20.693227 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.950572 (+257345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.491917 (+1541345us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54003df754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:22.492118 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584604416}
I20260709 13:19:24.035621 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.036357 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:24.036571 17392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2980) took 1190 ms (client timeout 1546 ms). Trace:
W20260709 13:19:24.037017 17392 rpcz_store.cc:269] 0709 13:19:22.846226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.035383 (+1189157us) service_pool.cc:224] Handling call
0709 13:19:24.036509 (+  1126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.037732 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.038028 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.038455 17468 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:19:24.038810 17392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1803) took 2825 ms (client timeout 3366 ms). Trace:
W20260709 13:19:24.039193 17392 rpcz_store.cc:269] 0709 13:19:21.213420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.037720 (+2824300us) service_pool.cc:224] Handling call
0709 13:19:24.038763 (+  1043us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.039739 17468 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:24.040060 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.040345 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1723) took 3188 ms. Trace:
W20260709 13:19:22.505900 17469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1712) took 3008 ms (client timeout 3225 ms). Trace:
W20260709 13:19:24.043064 17469 rpcz_store.cc:269] 0709 13:19:19.497862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.499532 (+  1670us) service_pool.cc:224] Handling call
0709 13:19:22.505672 (+3006140us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540041fad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:22.505822 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2515867008}
I20260709 13:19:23.817123 21357 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:23.814885 21554 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:19:23.821805 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:23.824421 21467 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:23.828588 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:24.040715 17468 rpcz_store.cc:276] 0709 13:19:20.852339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.038982 (+3186643us) service_pool.cc:224] Handling call
0709 13:19:24.039417 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.040114 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.040279 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.831423 17991 rpcz_store.cc:276] 0709 13:19:21.338347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.354383 (+ 16036us) service_pool.cc:224] Handling call
0709 13:19:22.452351 (+1097968us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.834182 17992 rpcz_store.cc:276] 0709 13:19:19.677957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.679394 (+  1437us) service_pool.cc:224] Handling call
0709 13:19:19.683038 (+  3644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.512272 (+829234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.507127 (+1994855us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b5400604854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:22.507295 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905237760}
I20260709 13:19:23.826428 21551 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:23.838783 17993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 820) took 2576 ms (client timeout 2570 ms). Trace:
W20260709 13:19:23.854550 17962 connection.cc:256] RPC call timeout handler was delayed by -1.7486780340000223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 13:19:24.048656 17962 connection.cc:256] RPC call timeout handler was delayed by -1.6502937120001206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:19:24.048553 17993 rpcz_store.cc:269] 0709 13:19:21.261819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.262187 (+   368us) service_pool.cc:224] Handling call
0709 13:19:23.838594 (+2576407us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:24.049135 17962 connection.cc:256] RPC call timeout handler was delayed by -1.6409703750000517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 13:19:24.049227 21554 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:24.049537 17962 connection.cc:256] RPC call timeout handler was delayed by -1.4944337199999609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
I20260709 13:19:24.049712 21554 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:24.049940 17962 connection.cc:256] RPC call timeout handler was delayed by -1.4601080959998853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:19:24.050268 17962 connection.cc:256] RPC call timeout handler was delayed by -1.05343371999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23130000000000003s for a response
I20260709 13:19:24.050694 21554 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.051386 21651 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:24.052107 21554 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.050405 17992 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:23.852521 17998 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:24.052875 21467 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:23.855216 17466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 709) took 2604 ms (client timeout 2168 ms). Trace:
I20260709 13:19:24.053139 17467 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
W20260709 13:19:24.053488 17466 rpcz_store.cc:269] 0709 13:19:21.249755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.599308 (+1349553us) service_pool.cc:224] Handling call
0709 13:19:23.846142 (+1246834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.054487 17467 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:24.054821 17466 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:24.055042 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1726) took 3186 ms. Trace:
I20260709 13:19:24.055394 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 707) took 3113 ms. Trace:
I20260709 13:19:24.055770 17466 rpcz_store.cc:276] 0709 13:19:20.941881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.054242 (+3112361us) service_pool.cc:224] Handling call
0709 13:19:24.054569 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.055189 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.055341 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.871652 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:23.873037 21527 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:23.869616 17999 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.873188 21484 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:23.875541 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:24.058171 17319 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.058416 21484 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:24.058864 21484 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:24.058933 17469 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:24.059689 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1724) took 3198 ms. Trace:
I20260709 13:19:23.884922 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:23.887789 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:24.020717 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1721) took 3195 ms. Trace:
I20260709 13:19:23.895408 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:23.896533 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:23.897374 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:23.873862 21479 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:23.909379 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1123) took 2693 ms. Trace:
I20260709 13:19:23.904873 21466 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:23.918563 21474 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.037240 17215 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.072458 21474 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.072829 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.074143 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:24.073763 17215 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 2 to 5, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 5 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.074626 21474 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.074831 17316 raft_consensus.cc:2368] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:24.075729 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.076792 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:24.076949 21634 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.077710 21479 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:24.078157 21479 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:24.047363 21401 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.079164 21479 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.079540 21401 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:23.920222 21476 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:23.920980 21473 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:23.921169 21490 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.390s	user 0.008s	sys 0.008s
I20260709 13:19:23.932273 21515 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:23.933856 21521 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.934656 21523 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.083740 21521 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:24.085430 17435 connection.cc:256] RPC call timeout handler was delayed by -1.4510866120001538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 13:19:24.085829 17435 connection.cc:256] RPC call timeout handler was delayed by -1.3942490740000721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 13:19:24.086115 17435 connection.cc:256] RPC call timeout handler was delayed by -1.2205490740000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 13:19:24.086396 17435 connection.cc:256] RPC call timeout handler was delayed by -1.0378490739999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:19:24.086679 17435 connection.cc:256] RPC call timeout handler was delayed by -1.0324490739999419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 13:19:24.086736 21521 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.087654 21467 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:24.088171 21467 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:23.935859 21555 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.090211 21467 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:24.090449 21555 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:23.948143 21591 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:23.949091 21655 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.091197 17997 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:24.091320 21655 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.092374 17322 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:23.949401 21509 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:23.950280 21603 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.101421 21634 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.101598 21603 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:24.102828 17319 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
W20260709 13:19:22.458088 21606 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.395s	user 0.001s	sys 0.000s
I20260709 13:19:23.950708 21522 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.105188 17215 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 10 to 11, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 11 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:19:24.104736 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.106494 21658 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.107453 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:24.107807 21522 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:23.940418 21571 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:24.109144 17397 raft_consensus.cc:2368] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8.
I20260709 13:19:24.107810 21658 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:24.110293 17397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 684) took 3279 ms (client timeout 1610 ms). Trace:
W20260709 13:19:24.110680 17397 rpcz_store.cc:269] 0709 13:19:20.830838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.834564 (+  3726us) service_pool.cc:224] Handling call
0709 13:19:24.110046 (+3275482us) spinlock_profiling.cc:243] Waited 3.23 s on lock 0x7b5400410ad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:24.110219 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7422276992}
I20260709 13:19:24.111974 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.112401 21571 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.956221 21611 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:23.957507 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1112) took 3138 ms. Trace:
I20260709 13:19:23.956223 17470 rpcz_store.cc:276] 0709 13:19:20.607154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.916865 (+309711us) service_pool.cc:224] Handling call
0709 13:19:20.944898 (+ 28033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.945375 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:20.945416 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.958559 (+ 13143us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.992611 (+ 34052us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:20.992658 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.992730 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.575056 (+1582326us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:23.955291 (+1380235us) raft_consensus.cc:1685] finished
0709 13:19:23.955331 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.955596 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6272,"raft.queue_time_us":3834,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7603,"spinlock_wait_cycles":13333248,"thread_start_us":33599,"threads_started":1,"wal-append.queue_time_us":108525}
I20260709 13:19:23.962646 21507 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:23.964398 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 89706.5us
I20260709 13:19:24.117800 21603 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:24.118150 21603 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:24.118413 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:22.690238 21627 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:23.981814 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.121410 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.121447 21521 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:24.122344 21521 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:24.122654 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:23.998788 17314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1569) took 1464 ms (client timeout 1909 ms). Trace:
W20260709 13:19:24.123976 17314 rpcz_store.cc:269] 0709 13:19:22.534726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.520894 (+986168us) service_pool.cc:224] Handling call
0709 13:19:23.998712 (+477818us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.123656 21521 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.125178 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.124825 21603 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.125993 17314 raft_consensus.cc:2410] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:24.126390 21603 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.126796 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:24.127502 17314 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:23.536418 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.121520 21627 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:24.128747 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:24.129168 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.588392 21615 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 2.404s	user 0.007s	sys 0.000s
W20260709 13:19:24.003852 17389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1808) took 2788 ms (client timeout 2095 ms). Trace:
W20260709 13:19:24.130775 17389 rpcz_store.cc:269] 0709 13:19:21.215032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.003615 (+2788583us) service_pool.cc:211] Skipping call since client already timed out
0709 13:19:24.003779 (+   164us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:19:23.627626 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.004235 17285 leader_election.cc:400] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14.
I20260709 13:19:24.004684 21641 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:24.014267 17434 connection.cc:256] RPC call timeout handler was delayed by -1.3150150409999242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 13:19:24.014935 21567 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.140707 21611 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:24.016381 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 688) took 3564 ms. Trace:
W20260709 13:19:24.016793 17343 debug-util.cc:398] Leaking SignalData structure 0x7b0800321100 after lost signal to thread 17254
I20260709 13:19:24.141544 17465 rpcz_store.cc:276] 0709 13:19:20.451506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.694556 (+243050us) service_pool.cc:224] Handling call
0709 13:19:20.694873 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.695230 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.695255 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.695736 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.915715 (+219979us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:20.915761 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.915825 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.708524 (+2792699us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:24.015743 (+307219us) raft_consensus.cc:1685] finished
0709 13:19:24.015770 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.016065 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1263,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"spinlock_wait_cycles":21476608,"thread_start_us":219636,"threads_started":1,"wal-append.queue_time_us":287727}
W20260709 13:19:24.142735 17343 debug-util.cc:398] Leaking SignalData structure 0x7b08003db1c0 after lost signal to thread 17346
I20260709 13:19:24.142912 21567 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:24.021498 17362 leader_election.cc:400] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:24.143476 17362 leader_election.cc:403] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:19:24.143859 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.143782 17465 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:24.144021 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 122738us
I20260709 13:19:24.022243 17208 maintenance_manager.cc:643] P 6a4082b2c6894817acb2d2a07603a4d6: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.004s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":627,"lbm_reads_lt_1ms":4}
I20260709 13:19:23.783959 17394 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:24.145141 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:24.145519 17394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1805) took 2931 ms (client timeout 2089 ms). Trace:
W20260709 13:19:24.025123 17390 rpcz_store.cc:269] 0709 13:19:21.215629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.024555 (+2808926us) service_pool.cc:211] Skipping call since client already timed out
0709 13:19:24.024670 (+   115us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:19:24.146138 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:24.146694 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.146975 21535 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:19:24.035672 17388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2982) took 1188 ms (client timeout 1511 ms). Trace:
W20260709 13:19:24.147691 17388 rpcz_store.cc:269] 0709 13:19:22.846963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.034179 (+1187216us) service_pool.cc:224] Handling call
0709 13:19:24.035598 (+  1419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.147538 21535 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.148715 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.148941 17362 leader_election.cc:400] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11.
I20260709 13:19:24.149353 17362 leader_election.cc:403] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:24.149488 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2978) took 1304 ms. Trace:
I20260709 13:19:24.149712 21554 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
I20260709 13:19:24.149936 17388 rpcz_store.cc:276] 0709 13:19:22.845469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.148447 (+1302978us) service_pool.cc:224] Handling call
0709 13:19:24.149422 (+   975us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.150300 21591 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:24.150538 21554 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:24.151288 21569 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:24.029234 17393 rpcz_store.cc:269] 0709 13:19:21.214621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.606841 (+1392220us) service_pool.cc:224] Handling call
0709 13:19:24.028738 (+1421897us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.150981 21591 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:24.145167 17318 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:24.152873 21591 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.028002 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.047490 17463 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.154549 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:24.155622 17435 leader_election.cc:336] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:19:24.155838 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.152684 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.156942 21554 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.157351 17393 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:24.158030 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2986) took 1273 ms. Trace:
I20260709 13:19:24.158420 17393 rpcz_store.cc:276] 0709 13:19:22.884305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.152390 (+1268085us) service_pool.cc:224] Handling call
0709 13:19:24.157937 (+  5547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.159349 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:24.159606 17362 connection.cc:256] RPC call timeout handler was delayed by -2.719098939000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
I20260709 13:19:24.160123 17360 leader_election.cc:400] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10.
W20260709 13:19:23.824383 17471 rpcz_store.cc:269] 0709 13:19:21.250038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.259114 (+  9076us) service_pool.cc:224] Handling call
0709 13:19:23.823758 (+2564644us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.160817 21588 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:24.161499 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.161098 17215 catalog_manager.cc:5697] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 5 to 8, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 8 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.162146 17471 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:24.162995 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.055624 21357 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:23.888603 21652 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:19:24.163668 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 44861.7us
I20260709 13:19:24.163846 21652 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.165169 21357 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:24.165230 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:24.145889 17394 rpcz_store.cc:269] 0709 13:19:21.214115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.847287 (+1633172us) service_pool.cc:224] Handling call
0709 13:19:24.145452 (+1298165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.165968 17997 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:24.165277 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:24.166603 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.167378 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2976) took 1322 ms. Trace:
I20260709 13:19:24.167712 17394 rpcz_store.cc:276] 0709 13:19:22.844719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.166389 (+1321670us) service_pool.cc:224] Handling call
0709 13:19:24.167311 (+   922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.055406 17467 rpcz_store.cc:276] 0709 13:19:20.869106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.053869 (+3184763us) service_pool.cc:224] Handling call
0709 13:19:24.054240 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.054839 (+   599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.054983 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.052439 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:24.169011 21652 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.169533 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:24.169708 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 117365us
I20260709 13:19:24.169884 21507 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:24.170138 17467 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.061493 17469 rpcz_store.cc:276] 0709 13:19:20.861728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.043823 (+3182095us) service_pool.cc:224] Handling call
0709 13:19:24.044204 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.059399 (+ 15195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.059611 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.172663 21650 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:24.161528 21588 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.065270 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.066120 17317 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.174223 17315 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:24.175155 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.175351 21588 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.065279 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.175779 17315 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:24.059779 21484 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.149518 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.176736 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.071748 21559 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:24.046195 17391 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:24.177480 17320 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:24.177599 21559 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.069041 17995 rpcz_store.cc:276] 0709 13:19:21.215413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.215582 (+   169us) service_pool.cc:224] Handling call
0709 13:19:21.215868 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.895716 (+2679848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.908962 (+ 13246us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001a9854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:23.909178 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2849662208}
I20260709 13:19:24.081660 21466 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:24.178380 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:24.178736 21466 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:24.179112 17390 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.179566 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.080608 21479 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.179795 21559 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:24.071933 17466 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:24.177490 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2973) took 1336 ms. Trace:
I20260709 13:19:23.920321 21468 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:24.082417 17999 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:24.103156 17994 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:24.180694 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1731) took 3214 ms. Trace:
I20260709 13:19:24.185839 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.186033 17466 rpcz_store.cc:276] 0709 13:19:20.965913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.056542 (+3090629us) service_pool.cc:224] Handling call
0709 13:19:24.062197 (+  5655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.180411 (+118214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.180620 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.187153 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.168597 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.187136 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:24.181200 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08000afee0 after lost signal to thread 16195
I20260709 13:19:24.082144 17316 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:24.176618 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.097718 21655 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:24.194878 17466 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:24.194907 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1125) took 1131 ms. Trace:
I20260709 13:19:24.112921 21571 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.113813 17996 rpcz_store.cc:276] 0709 13:19:20.818623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.819915 (+  1292us) service_pool.cc:224] Handling call
0709 13:19:20.820201 (+   286us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:20.820577 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:20.820605 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:20.863608 (+ 43003us) log.cc:844] Serialized 52 byte log entry
0709 13:19:20.973436 (+109828us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:20.973492 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.973579 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.154257 (+2180678us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:23.957051 (+802794us) raft_consensus.cc:1685] finished
0709 13:19:23.957086 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.957348 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8503,"raft.queue_time_us":1586,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":19699,"spinlock_wait_cycles":17090432,"thread_start_us":75957,"threads_started":1,"wal-append.queue_time_us":159412}
I20260709 13:19:24.117117 17470 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:23.967404 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 690) took 2979 ms. Trace:
I20260709 13:19:24.196918 17994 rpcz_store.cc:276] 0709 13:19:23.064519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.634741 (+570222us) service_pool.cc:224] Handling call
0709 13:19:24.194733 (+559992us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b5400687754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:24.194851 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224702336}
W20260709 13:19:24.156704 17435 leader_election.cc:336] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:19:24.201279 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 711) took 2404 ms. Trace:
I20260709 13:19:24.203581 17470 rpcz_store.cc:276] 0709 13:19:21.796803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.116376 (+2319573us) service_pool.cc:224] Handling call
0709 13:19:24.116733 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.200938 (+ 84205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.201211 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.129513 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:24.131639 17285 leader_election.cc:403] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:24.108130 17319 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.060684 17462 rpcz_store.cc:276] 0709 13:19:20.825566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.161476 (+335910us) service_pool.cc:224] Handling call
0709 13:19:21.161772 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:21.165734 (+  3962us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:21.193645 (+ 27911us) log.cc:844] Serialized 14 byte log entry
0709 13:19:23.829427 (+2635782us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:23.833532 (+  4105us) log.cc:844] Serialized 52 byte log entry
0709 13:19:23.833746 (+   214us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:23.900259 (+ 66513us) log.cc:844] Serialized 14 byte log entry
0709 13:19:23.988981 (+ 88722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.013777 (+ 24796us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.013822 (+    45us) raft_consensus.cc:1685] finished
0709 13:19:24.013832 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.020672 (+  6840us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165440,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":724785,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":74473,"thread_start_us":2775141,"threads_started":4,"wal-append.queue_time_us":214192}
I20260709 13:19:24.138195 21523 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.210800 21523 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:24.140161 17434 connection.cc:256] RPC call timeout handler was delayed by -1.281251353000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23090000000000002s for a response
W20260709 13:19:24.211493 17434 connection.cc:256] RPC call timeout handler was delayed by -1.2626030320000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 13:19:24.211812 17434 connection.cc:256] RPC call timeout handler was delayed by -1.2283246430001782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 13:19:24.212122 17314 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
W20260709 13:19:24.012190 17464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1729) took 3080 ms (client timeout 1703 ms). Trace:
I20260709 13:19:24.150985 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:24.212704 17464 rpcz_store.cc:269] 0709 13:19:20.932300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.933202 (+   902us) service_pool.cc:224] Handling call
0709 13:19:24.009000 (+3075798us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b540020f654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:24.012121 (+  3121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6194771712}
I20260709 13:19:24.213831 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:24.213996 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.214548 17464 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:24.215386 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.215901 17464 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:23.903856 21469 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:24.217059 17464 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:24.217558 21469 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.218813 21469 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.219270 17464 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:24.219497 17317 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:24.169736 17471 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:24.221269 17464 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:24.221588 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:24.222374 17318 raft_consensus.cc:2410] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:24.222699 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:24.173427 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.173573 21650 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:24.063158 17392 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
W20260709 13:19:24.177881 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1813) took 2961 ms (client timeout 1538 ms). Trace:
I20260709 13:19:24.223906 21650 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:24.224092 17392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2975) took 1379 ms (client timeout 1798 ms). Trace:
W20260709 13:19:24.224310 17391 rpcz_store.cc:269] 0709 13:19:21.216118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.605264 (+1389146us) service_pool.cc:224] Handling call
0709 13:19:24.177799 (+1572535us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:24.224485 17392 rpcz_store.cc:269] 0709 13:19:22.844305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.039815 (+1195510us) service_pool.cc:224] Handling call
0709 13:19:24.224015 (+184200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.225069 21658 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.225471 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.225062 21650 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.225704 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.226044 17391 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:24.226452 21650 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.150024 21535 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.227020 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.227597 17315 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:24.227696 17391 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:24.177793 17962 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:24.099649 21509 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.180877 17389 rpcz_store.cc:276] 0709 13:19:22.843562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.132661 (+1289099us) service_pool.cc:224] Handling call
0709 13:19:24.177414 (+ 44753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.228960 17315 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 11. Ops: []
W20260709 13:19:24.229527 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 51869.1us
I20260709 13:19:24.229717 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.230422 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2983) took 1383 ms. Trace:
I20260709 13:19:24.231006 17389 rpcz_store.cc:276] 0709 13:19:22.847313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.229429 (+1382116us) service_pool.cc:224] Handling call
0709 13:19:24.230370 (+   941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.231560 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:24.231920 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.232197 17994 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:24.190009 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf800 after lost signal to thread 17254
I20260709 13:19:24.233055 21655 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:24.233798 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08000afc40 after lost signal to thread 17346
W20260709 13:19:24.234105 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080005c920 after lost signal to thread 17347
W20260709 13:19:24.234735 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003475c0 after lost signal to thread 17390
W20260709 13:19:24.234988 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800138de0 after lost signal to thread 17391
W20260709 13:19:24.235219 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6540 after lost signal to thread 17392
W20260709 13:19:24.235421 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800252ce0 after lost signal to thread 17393
W20260709 13:19:24.235642 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800252e20 after lost signal to thread 17395
W20260709 13:19:24.236155 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800392000 after lost signal to thread 17421
W20260709 13:19:24.236393 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003b30e0 after lost signal to thread 17422
I20260709 13:19:24.236485 21473 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:24.112818 17397 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:24.223938 17469 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 7.
I20260709 13:19:24.223449 17471 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:24.192055 17390 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:24.227063 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.238708 17392 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:24.238744 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2987) took 1354 ms (client timeout 1789 ms). Trace:
W20260709 13:19:24.239261 17390 rpcz_store.cc:269] 0709 13:19:22.884691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.146444 (+1261753us) service_pool.cc:224] Handling call
0709 13:19:24.238596 (+ 92152us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b54002be654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:24.238695 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73110784}
I20260709 13:19:24.239665 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.240279 17392 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 7.
I20260709 13:19:24.240320 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.237069 21567 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:19:24.179731 21466 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.241629 21474 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:24.241994 21474 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:24.242203 21466 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.242702 17393 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:24.242901 21474 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.243762 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2981) took 1397 ms. Trace:
I20260709 13:19:24.244246 21474 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.192930 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1127) took 1122 ms. Trace:
I20260709 13:19:24.245240 17999 rpcz_store.cc:276] 0709 13:19:23.065347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.114289 (+ 48942us) service_pool.cc:224] Handling call
0709 13:19:24.188115 (+1073826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.193571 17313 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:24.246315 17319 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:19:24.246927 17313 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:24.247417 17319 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:24.228618 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.248111 17313 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:24.249102 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.249406 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:24.193470 21484 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.249970 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.250165 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.250592 17390 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:24.251250 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:24.251581 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.252125 17390 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:24.115765 17214 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 218) took 19576 ms (client timeout 15000 ms). Trace:
I20260709 13:19:24.252740 21259 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.254374 17388 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
W20260709 13:19:24.206740 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 202687us
I20260709 13:19:24.207652 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.255002 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2985) took 1371 ms. Trace:
I20260709 13:19:24.196280 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.211062 21571 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.200999 17396 rpcz_store.cc:276] 0709 13:19:20.987523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.081551 (+ 94028us) service_pool.cc:224] Handling call
0709 13:19:21.081958 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.082408 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:21.204441 (+122033us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.298599 (+ 94158us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.305193 (+  6594us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.305835 (+   642us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:21.305869 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.305929 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.966964 (+2661035us) raft_consensus.cc:1685] finished
0709 13:19:23.967000 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.967211 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3468,"prepare.queue_time_us":145854,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":471,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":14758,"thread_start_us":170129,"threads_started":2,"wal-append.queue_time_us":194527}
W20260709 13:19:24.212249 17434 connection.cc:256] RPC call timeout handler was delayed by -1.0463513529998636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.257s for a response
I20260709 13:19:24.141150 21641 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:24.143018 17343 debug-util.cc:398] Leaking SignalData structure 0x7b0800384b80 after lost signal to thread 17347
I20260709 13:19:24.223569 17318 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:24.231974 17962 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:24.237612 17397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1801) took 3024 ms (client timeout 3438 ms). Trace:
W20260709 13:19:24.265200 17397 rpcz_store.cc:269] 0709 13:19:21.212937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.111640 (+2898703us) service_pool.cc:224] Handling call
0709 13:19:24.237546 (+125906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.241034 21645 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:24.166072 21401 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:24.270088 17990 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
W20260709 13:19:24.270972 17343 debug-util.cc:398] Leaking SignalData structure 0x7b080032ff40 after lost signal to thread 17421
W20260709 13:19:24.271351 17343 debug-util.cc:398] Leaking SignalData structure 0x7b08001640c0 after lost signal to thread 17422
I20260709 13:19:24.250717 17391 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.211719 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.198745 17463 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:24.255648 17466 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
W20260709 13:19:24.236630 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003399a0 after lost signal to thread 17434
I20260709 13:19:24.244108 17393 rpcz_store.cc:276] 0709 13:19:22.846564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.159103 (+1312539us) service_pool.cc:224] Handling call
0709 13:19:24.243613 (+ 84510us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b540009c9d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:24.243710 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190483328}
W20260709 13:19:24.252246 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 95612.9us
I20260709 13:19:24.258095 17467 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
W20260709 13:19:24.274500 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003657a0 after lost signal to thread 17435
W20260709 13:19:24.274930 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800396400 after lost signal to thread 17437
I20260709 13:19:24.275170 17465 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:24.275611 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080022b560 after lost signal to thread 17462
W20260709 13:19:24.276001 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003b15c0 after lost signal to thread 17463
W20260709 13:19:24.276237 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800217b00 after lost signal to thread 17466
W20260709 13:19:24.276429 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08001cb6c0 after lost signal to thread 17467
W20260709 13:19:24.276633 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfee0 after lost signal to thread 17468
W20260709 13:19:24.276819 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08002d88a0 after lost signal to thread 17469
I20260709 13:19:24.233834 17215 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 5 to 9, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 9 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.230569 17315 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:24.112788 17321 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:24.261766 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:24.261864 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.255417 17316 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:24.253291 21259 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:24.266878 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.220505 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.255335 17388 rpcz_store.cc:276] 0709 13:19:22.883882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.150703 (+1266821us) service_pool.cc:224] Handling call
0709 13:19:24.254946 (+104243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.280172 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.284124 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:24.285969 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8720 after lost signal to thread 17471
W20260709 13:19:24.286588 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003326c0 after lost signal to thread 17495
I20260709 13:19:24.287750 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:24.288254 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.284020 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:24.270560 17990 pending_rounds.cc:85] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 9
W20260709 13:19:24.291864 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08000996a0 after lost signal to thread 17963
I20260709 13:19:24.292541 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:24.293954 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:24.287513 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:24.295214 17343 debug-util.cc:398] Leaking SignalData structure 0x7b080014f400 after lost signal to thread 17495
W20260709 13:19:24.296379 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8920 after lost signal to thread 17965
W20260709 13:19:24.297106 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800393680 after lost signal to thread 17991
W20260709 13:19:24.298584 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08000f7200 after lost signal to thread 17992
W20260709 13:19:24.298797 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080037fb20 after lost signal to thread 17993
W20260709 13:19:24.299010 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080031e2a0 after lost signal to thread 17995
I20260709 13:19:24.299388 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:24.299584 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080039cb60 after lost signal to thread 18023
I20260709 13:19:24.264542 21634 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14.
W20260709 13:19:24.300396 17343 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5060 after lost signal to thread 18023
I20260709 13:19:24.266584 21641 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.301023 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:24.332072 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.290254 17990 pending_rounds.cc:107] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:19:24.334779 17990 raft_consensus.cc:2889] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:24.328012 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.300896 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:24.335685 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 51762.7us
I20260709 13:19:24.266614 21645 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:24.336359 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 52416.6us
I20260709 13:19:24.337173 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.336189 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:24.339265 17313 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:24.337325 17390 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:24.335996 17388 raft_consensus.cc:2410] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:24.337637 17389 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:24.288340 21658 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:24.341380 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.338452 17998 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:24.341452 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:24.270046 21509 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:24.354977 17395 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:24.302575 17996 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:24.303153 17396 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:24.338677 17997 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
W20260709 13:19:24.343425 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 81745.2us
I20260709 13:19:24.294303 21469 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:24.344594 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 112697us
I20260709 13:19:24.346707 21502 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:24.347621 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:24.348382 17994 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:24.352385 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:24.366758 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080023f2c0 after lost signal to thread 20835
W20260709 13:19:24.367333 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6ba0 after lost signal to thread 21278
W20260709 13:19:24.367654 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb5c0 after lost signal to thread 21401
W20260709 13:19:24.367978 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800246120 after lost signal to thread 21468
W20260709 13:19:24.368275 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003079a0 after lost signal to thread 21472
W20260709 13:19:24.368544 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800364080 after lost signal to thread 21473
W20260709 13:19:24.368811 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003db640 after lost signal to thread 21474
W20260709 13:19:24.369109 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5860 after lost signal to thread 21476
W20260709 13:19:24.369398 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080037e000 after lost signal to thread 21482
W20260709 13:19:24.372800 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2960 after lost signal to thread 21485
W20260709 13:19:24.373157 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003d56a0 after lost signal to thread 21489
W20260709 13:19:24.373426 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080035f720 after lost signal to thread 21490
W20260709 13:19:24.373625 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8b00 after lost signal to thread 21495
W20260709 13:19:24.373826 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0080 after lost signal to thread 21501
W20260709 13:19:24.374040 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800253b00 after lost signal to thread 21502
W20260709 13:19:24.374300 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2f20 after lost signal to thread 21515
W20260709 13:19:24.374507 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1d40 after lost signal to thread 21516
W20260709 13:19:24.374735 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080022df60 after lost signal to thread 21522
W20260709 13:19:24.374929 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080018f2c0 after lost signal to thread 21523
W20260709 13:19:24.375314 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800400560 after lost signal to thread 21555
W20260709 13:19:24.375672 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080022dd40 after lost signal to thread 21569
W20260709 13:19:24.375891 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800363e00 after lost signal to thread 21571
W20260709 13:19:24.376276 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08002d7400 after lost signal to thread 21603
W20260709 13:19:24.376562 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800344dc0 after lost signal to thread 21606
W20260709 13:19:24.376901 17492 debug-util.cc:398] Leaking SignalData structure 0x7b080036efe0 after lost signal to thread 21613
W20260709 13:19:24.377235 17492 debug-util.cc:398] Leaking SignalData structure 0x7b0800245f00 after lost signal to thread 21622
W20260709 13:19:24.377507 17492 debug-util.cc:398] Leaking SignalData structure 0x7b08003466e0 after lost signal to thread 21623
W20260709 13:19:24.397253 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd240 after lost signal to thread 16195
W20260709 13:19:24.397918 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800195680 after lost signal to thread 17208
W20260709 13:19:24.397984 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 103628us
W20260709 13:19:24.398299 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1020 after lost signal to thread 17211
W20260709 13:19:24.398756 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080030f8e0 after lost signal to thread 17221
I20260709 13:19:24.399076 21401 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:24.399328 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080033a720 after lost signal to thread 17245
W20260709 13:19:24.399729 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08001a5040 after lost signal to thread 17246
I20260709 13:19:24.400014 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.397339 17397 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:24.400060 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08001790c0 after lost signal to thread 17254
W20260709 13:19:24.401950 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800096f00 after lost signal to thread 17288
W20260709 13:19:24.402726 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1a00 after lost signal to thread 17314
W20260709 13:19:24.403033 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800189f40 after lost signal to thread 17319
I20260709 13:19:24.399461 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:24.403687 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5a00 after lost signal to thread 17346
I20260709 13:19:24.404879 17388 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:24.405000 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080009c160 after lost signal to thread 17347
W20260709 13:19:24.405514 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1960 after lost signal to thread 17356
W20260709 13:19:24.405891 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd6c0 after lost signal to thread 17357
W20260709 13:19:24.404357 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 47239.4us
W20260709 13:19:24.406389 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800096740 after lost signal to thread 17360
W20260709 13:19:24.406960 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 110646us
I20260709 13:19:24.342018 21646 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:24.406978 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08001ac200 after lost signal to thread 17362
I20260709 13:19:24.294626 21567 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:24.357373 17215 catalog_manager.cc:5697] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 5 to 6, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 6 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:24.408741 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.408638 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:24.411482 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff580 after lost signal to thread 17379
W20260709 13:19:24.415346 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.351004 21628 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:24.416133 17964 leader_election.cc:336] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.873s (SENT)
I20260709 13:19:24.416966 17390 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:24.418407 21259 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.404455 21554 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11.
W20260709 13:19:24.419072 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800394280 after lost signal to thread 17387
I20260709 13:19:24.412684 21658 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:24.422757 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080032d8c0 after lost signal to thread 17388
W20260709 13:19:24.426713 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003c79e0 after lost signal to thread 17389
I20260709 13:19:24.410295 21646 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.428623 17215 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:24.432005 17391 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:24.432978 17397 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:24.434973 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003cac00 after lost signal to thread 17390
W20260709 13:19:24.435282 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800369720 after lost signal to thread 17391
W20260709 13:19:24.435491 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003946c0 after lost signal to thread 17392
W20260709 13:19:24.435732 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed860 after lost signal to thread 17393
I20260709 13:19:24.423556 21628 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:24.435966 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800391ac0 after lost signal to thread 17394
I20260709 13:19:24.437389 17394 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
W20260709 13:19:24.437160 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080036a880 after lost signal to thread 17395
I20260709 13:19:24.440045 21472 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.440519 21658 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:24.441995 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003db760 after lost signal to thread 17401
W20260709 13:19:24.442792 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003db7e0 after lost signal to thread 17421
I20260709 13:19:24.443059 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1806) took 3219 ms. Trace:
W20260709 13:19:24.443382 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800314160 after lost signal to thread 17422
W20260709 13:19:24.444128 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002739a0 after lost signal to thread 17434
I20260709 13:19:24.443602 17397 rpcz_store.cc:276] 0709 13:19:21.214380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.404574 (+3190194us) service_pool.cc:224] Handling call
0709 13:19:24.432717 (+ 28143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.433589 (+   872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.433821 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:24.444725 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003444a0 after lost signal to thread 17435
W20260709 13:19:24.445158 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003db5a0 after lost signal to thread 17437
W20260709 13:19:24.446165 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800354480 after lost signal to thread 17462
W20260709 13:19:24.446583 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080034c140 after lost signal to thread 17463
W20260709 13:19:24.446960 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800314f60 after lost signal to thread 17466
W20260709 13:19:24.447043 17395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2979) took 1592 ms (client timeout 1512 ms). Trace:
W20260709 13:19:24.447304 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf820 after lost signal to thread 17467
W20260709 13:19:24.447633 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080030a7a0 after lost signal to thread 17468
W20260709 13:19:24.447542 17395 rpcz_store.cc:269] 0709 13:19:22.845876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.027731 (+1181855us) service_pool.cc:224] Handling call
0709 13:19:24.437852 (+410121us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400012f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:24.437948 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443571456}
W20260709 13:19:24.448041 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7260 after lost signal to thread 17469
I20260709 13:19:24.419566 21509 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.449484 21658 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.427503 21500 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.450816 21509 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.446630 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 692) took 3327 ms. Trace:
I20260709 13:19:24.453563 17396 rpcz_store.cc:276] 0709 13:19:21.110676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.411339 (+3300663us) service_pool.cc:224] Handling call
0709 13:19:24.437867 (+ 26528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.438036 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.438072 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.438121 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:24.438164 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.438232 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.438344 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:24.454569 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3f80 after lost signal to thread 17471
W20260709 13:19:24.454873 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 55569us
W20260709 13:19:24.455163 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5800 after lost signal to thread 17495
I20260709 13:19:24.412750 21571 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:19:24.435591 21646 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:24.469501 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 68492.8us
I20260709 13:19:24.469657 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:24.441504 21473 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:24.464689 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50603us
I20260709 13:19:24.464956 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:24.467875 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:24.461309 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9880 after lost signal to thread 17962
W20260709 13:19:24.477859 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9fc0 after lost signal to thread 17963
W20260709 13:19:24.478168 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080022f1a0 after lost signal to thread 17965
W20260709 13:19:24.478904 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080031c3e0 after lost signal to thread 17991
W20260709 13:19:24.479187 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003d89c0 after lost signal to thread 17992
W20260709 13:19:24.479400 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800252c60 after lost signal to thread 17993
W20260709 13:19:24.479621 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003c77e0 after lost signal to thread 17995
W20260709 13:19:24.479849 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800234460 after lost signal to thread 17998
W20260709 13:19:24.480093 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800314500 after lost signal to thread 17999
W20260709 13:19:24.480587 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002dddc0 after lost signal to thread 18023
W20260709 13:19:24.480901 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6840 after lost signal to thread 20835
W20260709 13:19:24.481148 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800325740 after lost signal to thread 21278
W20260709 13:19:24.481379 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08000e54e0 after lost signal to thread 21401
W20260709 13:19:24.481583 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcd40 after lost signal to thread 21466
W20260709 13:19:24.481796 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6880 after lost signal to thread 21468
I20260709 13:19:24.478150 17395 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:19:24.478662 17360 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:24.482378 17395 pending_rounds.cc:85] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 4
I20260709 13:19:24.487829 17395 pending_rounds.cc:107] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:19:24.488322 17395 raft_consensus.cc:2889] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:24.489954 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 142426us
I20260709 13:19:24.490914 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 693) took 3224 ms. Trace:
I20260709 13:19:24.486366 17215 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 5 to 6, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 6 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.445837 21259 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:19:24.491458 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800393460 after lost signal to thread 21469
I20260709 13:19:24.501931 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2974) took 1658 ms. Trace:
I20260709 13:19:24.515405 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2972) took 1675 ms. Trace:
I20260709 13:19:24.543454 17393 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:24.496425 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:24.491882 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:24.566969 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08000eab60 after lost signal to thread 21472
I20260709 13:19:24.492174 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:24.566329 17391 rpcz_store.cc:276] 0709 13:19:21.259888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.433771 (+3173883us) service_pool.cc:224] Handling call
0709 13:19:24.468771 (+ 35000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.483526 (+ 14755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.483611 (+    85us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.483735 (+   124us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:24.483813 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.484002 (+   189us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.484276 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.530944 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:24.567222 17395 rpcz_store.cc:276] 0709 13:19:22.843962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.448530 (+1604568us) service_pool.cc:224] Handling call
0709 13:19:24.471558 (+ 23028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.501700 (+ 30142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.501876 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:24.563411 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 225084us
W20260709 13:19:24.492044 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 57600us
W20260709 13:19:24.569362 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080035df80 after lost signal to thread 21473
W20260709 13:19:24.574338 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0680 after lost signal to thread 21474
I20260709 13:19:24.496773 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:24.519979 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.532390 17995 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:19:24.252988 17214 rpcz_store.cc:269] 0709 13:19:04.418782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.430478 (+ 11696us) service_pool.cc:224] Handling call
0709 13:19:23.971946 (+19541468us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:19.400630 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:19.495726 (+ 95096us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:19.500939 (+  5213us) write_op.cc:435] Acquired schema lock
0709 13:19:19.510723 (+  9784us) tablet.cc:662] Decoding operations
0709 13:19:19.848892 (+338169us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:19.848954 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:19.848977 (+    23us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:19:19.850463 (+  1486us) tablet.cc:701] Row locks acquired
0709 13:19:19.850484 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:19:19.850630 (+   146us) write_op.cc:270] Start()
0709 13:19:19.850740 (+   110us) write_op.cc:276] Timestamp: P: 1783603159850582 usec, L: 0
0709 13:19:19.850763 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:19.898720 (+ 47957us) log.cc:844] Serialized 7750 byte log entry
0709 13:19:20.815252 (+916532us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b540011f1a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275e090 00007f7d6276b6b8 00007f7d6276b2fa 00007f7d627ef965 00007f7d627efe09 00007f7d6622a581 00007f7d66229d58 00007f7d6622e9f1 00007f7d6622e9a9 00007f7d6622e939 00007f7d6622e901
0709 13:19:20.894203 (+ 78951us) op_driver.cc:464] REPLICATION: finished
0709 13:19:21.161224 (+267021us) write_op.cc:301] APPLY: starting
0709 13:19:21.169345 (+  8121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:21.221280 (+ 51935us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:21.221309 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:22.517939 (+1296630us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b1800260380. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d622776cf 00007f7d625333b6 00007f7d62535af7 00007f7d62536fb0 00007f7d6624b1bb 00007f7d662925d4 00007f7d662d6333 00007f7d6613e8da 00007f7d661413cb
0709 13:19:22.567596 (+ 49657us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:22.567958 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=40
0709 13:19:22.568028 (+    70us) write_op.cc:312] APPLY: finished
0709 13:19:22.568549 (+   521us) log.cc:844] Serialized 260 byte log entry
0709 13:19:22.593538 (+ 24989us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:22.593736 (+   198us) write_op.cc:454] Released schema lock
0709 13:19:22.593792 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:22.594338 (+   546us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:22.594366 (+    28us) write_op.cc:454] Released schema lock
0709 13:19:22.724945 (+130579us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f132a 00007f7d62776f14 00007f7d62776ec3 00007f7d62776e38 00007f7d62776df3 00007f7d627760dc 00007f7d6279fe16 00007f7d62787cbb 00007f7d6277239d 00007f7d62775d75
Metrics: {"mutex_wait_us":900547,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":215426,"apply.run_cpu_time_us":107979,"apply.run_wall_time_us":1454510,"cfile_cache_hit":38,"cfile_cache_hit_bytes":39710,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":1,"lbm_read_time_us":27463,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":7,"num_ops":20,"prepare.queue_time_us":238248,"prepare.run_cpu_time_us":40428,"prepare.run_wall_time_us":1432773,"raft.queue_time_us":418494,"raft.run_cpu_time_us":27677,"raft.run_wall_time_us":2235528,"replication_time_us":992516,"spinlock_wait_cycles":811426176,"thread_start_us":658144,"threads_started":5,"wal-append.queue_time_us":176973,"wal-append.run_cpu_time_us":24509,"wal-append.run_wall_time_us":2440344}]]}
I20260709 13:19:24.499729 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1725) took 3635 ms. Trace:
I20260709 13:19:24.516180 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:24.581255 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2bc0 after lost signal to thread 21476
I20260709 13:19:24.568651 17397 rpcz_store.cc:276] 0709 13:19:22.840460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.445138 (+1604678us) service_pool.cc:224] Handling call
0709 13:19:24.477789 (+ 32651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.514872 (+ 37083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.514912 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.514973 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:24.515021 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.515109 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.515333 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.476112 21473 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:24.583389 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003b70a0 after lost signal to thread 21482
W20260709 13:19:24.589550 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080033bec0 after lost signal to thread 21484
W20260709 13:19:24.589843 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003b08a0 after lost signal to thread 21485
W20260709 13:19:24.590044 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3540 after lost signal to thread 21489
W20260709 13:19:24.590238 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003370c0 after lost signal to thread 21490
W20260709 13:19:24.590433 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003ef3c0 after lost signal to thread 21495
I20260709 13:19:24.582218 17215 catalog_manager.cc:5697] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 5 to 6, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 6 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:24.590652 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003dec20 after lost signal to thread 21501
W20260709 13:19:24.591759 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800382d40 after lost signal to thread 21502
W20260709 13:19:24.592042 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800110be0 after lost signal to thread 21507
W20260709 13:19:24.592309 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2ce0 after lost signal to thread 21509
W20260709 13:19:24.592593 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4660 after lost signal to thread 21515
W20260709 13:19:24.592886 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3c00 after lost signal to thread 21516
W20260709 13:19:24.593169 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080037f740 after lost signal to thread 21522
W20260709 13:19:24.597139 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002646a0 after lost signal to thread 21523
W20260709 13:19:24.597575 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800288d60 after lost signal to thread 21554
W20260709 13:19:24.597859 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003ceae0 after lost signal to thread 21555
W20260709 13:19:24.598229 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800378160 after lost signal to thread 21569
I20260709 13:19:24.602460 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.602068 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:24.604576 17395 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:24.604485 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49622.3us
I20260709 13:19:24.602224 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 691) took 3479 ms. Trace:
W20260709 13:19:24.605253 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 115661us
I20260709 13:19:24.605387 17388 rpcz_store.cc:276] 0709 13:19:21.105204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.398052 (+3292848us) service_pool.cc:224] Handling call
0709 13:19:24.404699 (+  6647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.405275 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.584812 (+179537us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b5400253350. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:24.584970 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14358784}
I20260709 13:19:24.584385 21474 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:19:24.497287 21638 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:24.515790 21648 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:24.492488 21401 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:24.606832 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:24.613770 17388 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:24.493878 21490 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:24.601517 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002987e0 after lost signal to thread 21571
W20260709 13:19:24.615613 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800372000 after lost signal to thread 21588
I20260709 13:19:24.615459 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:24.615860 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800388460 after lost signal to thread 21591
W20260709 13:19:24.616115 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800233c80 after lost signal to thread 21603
I20260709 13:19:24.615914 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1802) took 3402 ms. Trace:
W20260709 13:19:24.616442 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080033f540 after lost signal to thread 21606
W20260709 13:19:24.616797 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002b8240 after lost signal to thread 21609
I20260709 13:19:24.539378 21628 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:24.495362 21591 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:24.580711 17468 rpcz_store.cc:276] 0709 13:19:20.864252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.067103 (+3202851us) service_pool.cc:224] Handling call
0709 13:19:24.081293 (+ 14190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.081671 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.081714 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:24.113007 (+ 31293us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.295830 (+182823us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:24.344340 (+ 48510us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.344555 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.344627 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.499493 (+154866us) raft_consensus.cc:1685] finished
0709 13:19:24.499514 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.499651 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2351,"prepare.queue_time_us":48857,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1029,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":18119,"thread_start_us":182279,"threads_started":1,"wal-append.queue_time_us":371500}
W20260709 13:19:24.609704 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 113318us
W20260709 13:19:24.610474 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 79598.2us
W20260709 13:19:24.611850 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.529393 21567 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:19:24.601076 21473 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:24.614961 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 122886us
W20260709 13:19:24.617590 17418 debug-util.cc:398] Leaking SignalData structure 0x7b080034d880 after lost signal to thread 21611
I20260709 13:19:24.529649 21521 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:19:24.611826 21648 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:24.607355 21603 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.611581 21638 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.625730 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:24.628448 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002db380 after lost signal to thread 21613
W20260709 13:19:24.641431 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8a80 after lost signal to thread 21622
I20260709 13:19:24.641639 17391 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:24.608738 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:24.616662 21466 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:24.633034 17395 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4.
I20260709 13:19:24.616458 21551 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:24.644660 21551 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:24.645288 17388 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:19:24.624058 21490 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:24.645726 21485 raft_consensus.cc:2764] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:24.645641 21551 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.646603 21490 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.633373 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:24.640043 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:24.645653 17388 pending_rounds.cc:85] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 6
I20260709 13:19:24.650048 17388 pending_rounds.cc:107] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:19:24.650347 17388 raft_consensus.cc:2889] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:24.653335 17388 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:24.654742 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49427.9us
W20260709 13:19:24.655006 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 163235us
W20260709 13:19:24.641728 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800380680 after lost signal to thread 21623
I20260709 13:19:24.642300 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2984) took 1765 ms. Trace:
W20260709 13:19:24.656158 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3140 after lost signal to thread 21625
I20260709 13:19:24.498723 21645 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.613463 21401 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.632791 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:24.623167 21523 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:24.622799 21591 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:24.656608 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa940 after lost signal to thread 21627
W20260709 13:19:24.669095 17418 debug-util.cc:398] Leaking SignalData structure 0x7b0800245b00 after lost signal to thread 21628
I20260709 13:19:24.613031 21633 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:19:24.643101 21638 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.665505 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:24.670428 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 51850.8us
W20260709 13:19:24.672219 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08003beb40 after lost signal to thread 21633
W20260709 13:19:24.679011 17418 debug-util.cc:398] Leaking SignalData structure 0x7b08002df1e0 after lost signal to thread 21634
I20260709 13:19:24.676520 21502 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:24.656211 17391 rpcz_store.cc:276] 0709 13:19:22.877350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.621784 (+1744434us) service_pool.cc:224] Handling call
0709 13:19:24.634384 (+ 12600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.642064 (+  7680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.642246 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.680757 17215 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 4 to 7, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 7 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.667552 21401 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.699605 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:24.700630 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.698927 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:24.703474 21468 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:24.704277 21500 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:24.682672 21502 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.709182 21502 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.712118 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.712808 17468 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:24.712975 21516 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:24.713201 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.713862 17463 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:24.713999 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.714824 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.715147 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.715572 17470 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:24.715749 17466 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:24.716382 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.717185 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.717707 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:24.718120 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.718884 17469 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:24.719388 21628 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:24.719699 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:24.720194 21628 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:24.720885 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:24.721926 21571 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:24.721458 21628 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.722302 21571 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:24.722730 21571 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:24.722934 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.723735 21603 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:24.719941 21670 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:19:24.713778 21516 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:24.722808 21468 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:24.725926 21468 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.726476 21567 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:24.725934 21516 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.726663 21468 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.727061 21567 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:24.727986 21567 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.729445 21603 raft_consensus.cc:2764] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 13:19:24.730367 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 44401us
W20260709 13:19:24.725929 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 54467us
I20260709 13:19:24.733989 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:24.734897 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:24.734781 21502 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:24.732750 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.735872 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:24.736737 21633 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:24.737406 21500 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:24.737228 21648 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.737895 21500 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.677168 21357 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:24.738351 21500 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.738790 21357 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:24.739708 21357 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:24.740665 17962 connection.cc:256] RPC call timeout handler was delayed by -1.9677579460001198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:19:24.741101 17962 connection.cc:256] RPC call timeout handler was delayed by -1.76705794600025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260709 13:19:24.741027 21474 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:24.741729 21474 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.742096 21474 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:24.744982 17962 connection.cc:256] RPC call timeout handler was delayed by -1.7400579460002064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:19:24.745314 17962 connection.cc:256] RPC call timeout handler was delayed by -1.7067579460001525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 13:19:24.745231 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:24.745711 17962 connection.cc:256] RPC call timeout handler was delayed by -1.6626579460000812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:19:24.746009 17962 connection.cc:256] RPC call timeout handler was delayed by -1.5717579460001616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 13:19:24.746276 17962 connection.cc:256] RPC call timeout handler was delayed by -1.503357946000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
I20260709 13:19:24.746232 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:24.746737 17962 connection.cc:256] RPC call timeout handler was delayed by -1.4799579460002406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
I20260709 13:19:24.746922 17313 raft_consensus.cc:2376] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10. Re-sending same reply.
W20260709 13:19:24.747134 17962 connection.cc:256] RPC call timeout handler was delayed by -1.441257946000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
W20260709 13:19:24.747433 17962 connection.cc:256] RPC call timeout handler was delayed by -1.3809579460000805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
I20260709 13:19:24.716593 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.753345 17395 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:24.748860 17462 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:24.683753 21645 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:24.761104 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.764107 17215 catalog_manager.cc:5697] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 1 to 4, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 4 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:19:24.762513 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:24.770826 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:24.771605 17314 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:24.778179 17321 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:24.737227 21633 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.783167 17395 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:24.789032 21485 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:24.789739 21485 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:24.791003 21485 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.616523 17392 rpcz_store.cc:276] 0709 13:19:21.213194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.401166 (+3187972us) service_pool.cc:224] Handling call
0709 13:19:24.422032 (+ 20866us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:24.436169 (+ 14137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.436213 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:24.440045 (+  3832us) log.cc:844] Serialized 52 byte log entry
0709 13:19:24.461915 (+ 21870us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:24.607728 (+145813us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.615306 (+  7578us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.615536 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.615608 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.615662 (+    54us) raft_consensus.cc:1685] finished
0709 13:19:24.615681 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.615845 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12032,"raft.queue_time_us":19669,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":136814,"threads_started":2,"wal-append.queue_time_us":61416}
I20260709 13:19:24.792799 21485 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:24.821713 17391 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:24.800040 17397 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 13:19:24.802984 21591 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:24.827939 21591 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.817809 17392 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:19:24.829838 21639 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:24.830353 21639 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:24.830778 21639 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:24.831390 21648 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.832167 17388 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:24.840986 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:24.844030 17395 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:24.846200 17997 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:24.847337 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:24.848683 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:19:24.852679 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 218538us
I20260709 13:19:24.853420 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:24.857775 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 136965us
I20260709 13:19:24.785640 21633 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.850660 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:24.860483 17990 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:24.869587 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:24.872131 17995 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:19:24.874255 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.874202 17467 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:24.875809 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:24.880678 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:24.884598 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:24.885056 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:24.886432 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:24.915498 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 48674.5us
I20260709 13:19:24.916399 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:24.919092 21551 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:24.919639 21551 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:24.920099 21551 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:24.916951 17964 leader_election.cc:336] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.583s (SENT)
I20260709 13:19:24.926162 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:24.927358 21523 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:24.927837 21523 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.928265 21523 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:24.933427 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:24.934651 21628 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:24.935241 21628 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:24.935390 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:24.935767 21628 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:24.941308 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.936550 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:24.943807 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 63204.3us
I20260709 13:19:24.891214 21646 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:24.949672 17962 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:24.946291 21684 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:24.953019 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 190618us
W20260709 13:19:24.957756 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.941363 21650 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:24.960647 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 76179.6us
I20260709 13:19:24.962833 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:24.966430 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:24.951078 21502 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:24.966095 21641 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.000s
I20260709 13:19:24.968245 21469 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:24.946417 21495 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.211s
W20260709 13:19:24.995545 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 59097.1us
W20260709 13:19:24.993455 21472 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.002s
I20260709 13:19:24.994187 21502 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:24.986188 21521 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:25.015602 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.014216 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:24.991813 21469 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.021394 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.046594 17466 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:24.984807 21678 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:25.055649 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:25.010927 21472 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:24.996174 21687 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:25.016317 21521 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.015512 21502 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.059109 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:24.989437 21641 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.030822 21551 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.029294 21469 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.066149 21685 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:19:25.055703 21628 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:25.067174 21681 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:19:25.045697 21401 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.070677 21689 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:19:25.073871 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 440527us
W20260709 13:19:25.116878 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 163095us
I20260709 13:19:25.007989 21473 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.007531 21571 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.136986 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:25.071288 21495 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:19:25.139791 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 194858us
I20260709 13:19:25.124429 17471 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:25.119884 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 2977) took 2235 ms. Trace:
I20260709 13:19:25.010337 21468 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.144968 17396 rpcz_store.cc:276] 0709 13:19:22.845135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.454615 (+1609480us) service_pool.cc:224] Handling call
0709 13:19:24.472537 (+ 17922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.482824 (+ 10287us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:24.610287 (+127463us) log.cc:844] Serialized 14 byte log entry
0709 13:19:25.080248 (+469961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:25.080305 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:25.080350 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.080419 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.080544 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420064,"prepare.queue_time_us":189023,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"raft.queue_time_us":432045,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6099,"thread_start_us":156510,"threads_started":2,"wal-append.queue_time_us":154141}
I20260709 13:19:25.146919 17320 raft_consensus.cc:2368] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13.
I20260709 13:19:25.147362 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:25.089040 17964 leader_election.cc:336] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.023s (SENT)
W20260709 13:19:25.148391 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59421.2us
I20260709 13:19:25.133803 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:25.073247 21687 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:25.124709 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.170492 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.062021 21648 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:25.081789 21569 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.124681 17466 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:19:25.128170 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.080124 21640 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:19:25.082711 21521 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:25.154170 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.116732 21502 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:25.173416 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.062750 21678 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.115881 21523 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:25.175261 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.140679 21679 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:19:25.176141 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:25.138123 21472 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:25.184633 17462 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:25.187377 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50521.3us
W20260709 13:19:25.188508 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 118653us
I20260709 13:19:25.187222 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.190864 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 2989) took 1045 ms. Trace:
I20260709 13:19:25.191270 17393 rpcz_store.cc:276] 0709 13:19:24.145492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.328684 (+183192us) service_pool.cc:224] Handling call
0709 13:19:25.190689 (+862005us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540013abd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:25.190810 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426548480}
W20260709 13:19:25.192896 17964 leader_election.cc:336] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.123s (SENT)
I20260709 13:19:25.193516 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:25.175716 21648 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:25.174633 21687 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:25.206384 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 61100.4us
I20260709 13:19:25.180917 21509 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:25.211970 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:25.183166 21646 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.184201 21678 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.205188 21259 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:25.220302 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3000) took 1071 ms. Trace:
I20260709 13:19:25.220886 17394 rpcz_store.cc:276] 0709 13:19:24.148643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.168352 (+ 19709us) service_pool.cc:224] Handling call
0709 13:19:25.220091 (+1051739us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b540036fbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:25.220224 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573195136}
I20260709 13:19:25.227464 21695 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:25.213212 21509 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:19:25.233016 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 44792.2us
I20260709 13:19:25.234881 21523 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:25.235023 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:25.239159 21624 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:25.220402 21259 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:25.240597 21624 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:25.240989 21259 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.241039 21624 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:25.241628 21624 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:25.247745 21500 consensus_meta.cc:287] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.001s
W20260709 13:19:25.250151 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 608758us
I20260709 13:19:25.252332 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:25.253223 21648 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.255722 21696 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:19:25.257498 21641 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.223764 21694 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:25.261575 21473 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:25.261807 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1809) took 4046 ms. Trace:
I20260709 13:19:25.262099 21551 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:25.262261 21554 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:25.274212 21591 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.250329 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:25.232331 21509 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.224184 21634 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:25.281718 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 102122us
I20260709 13:19:25.248232 21500 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:25.323278 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 71016.6us
I20260709 13:19:25.279111 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:25.335496 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.336822 17390 rpcz_store.cc:276] 0709 13:19:21.215239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.424144 (+3208905us) service_pool.cc:224] Handling call
0709 13:19:24.462317 (+ 38173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.462699 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.462729 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:24.463220 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.261179 (+797959us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b18003fa000. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1
0709 13:19:25.261343 (+   164us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:25.261376 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.261460 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:25.261504 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:25.261514 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.261739 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8108,"raft.queue_time_us":6389,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":13042,"spinlock_wait_cycles":170175744,"thread_start_us":25488,"threads_started":1,"wal-append.queue_time_us":142893}
I20260709 13:19:25.263001 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:25.353379 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 146817us
I20260709 13:19:25.333667 21357 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:25.301573 21639 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.332551 21472 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:25.395015 21357 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:25.412312 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 54769.8us
W20260709 13:19:25.413504 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 139130us
I20260709 13:19:25.413589 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:25.419842 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:25.421939 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:25.399911 21694 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:25.422492 17390 raft_consensus.cc:2376] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11. Re-sending same reply.
I20260709 13:19:25.355295 21591 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:25.404495 21658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.004s	sys 0.017s
W20260709 13:19:25.424021 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 161103us
I20260709 13:19:25.425433 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:25.426738 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:25.432732 17393 raft_consensus.cc:2376] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10. Re-sending same reply.
I20260709 13:19:25.432832 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:25.429505 17394 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:25.405010 21479 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.411679 21484 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:25.415268 21603 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.426190 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:25.438361 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:25.438884 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 728) took 1393 ms. Trace:
I20260709 13:19:25.444703 17991 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.445631 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:25.446288 17964 leader_election.cc:336] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.125s (SENT)
I20260709 13:19:25.447120 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:25.439705 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:19:25.427068 21474 consensus_meta.cc:287] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
I20260709 13:19:25.417940 21357 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:25.427980 21694 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:25.441740 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 191491us
W20260709 13:19:25.432204 21658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.004s	sys 0.017s
W20260709 13:19:25.437968 21645 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.004s
I20260709 13:19:25.444766 17320 rpcz_store.cc:276] 0709 13:19:24.038284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.179320 (+141036us) service_pool.cc:224] Handling call
0709 13:19:25.431935 (+1252615us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400367254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:25.432077 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220685568}
I20260709 13:19:25.409752 21707 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:19:25.416749 21469 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:25.452720 21638 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.000s
I20260709 13:19:25.443861 21490 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:25.526237 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 82420.4us
I20260709 13:19:25.521746 17390 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:25.458827 21633 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.000s
W20260709 13:19:25.524103 21698 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:19:25.534861 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 75360.9us
I20260709 13:19:25.539232 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:25.536242 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:25.452904 21704 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:25.541275 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 85057.1us
I20260709 13:19:25.542378 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:25.541671 17963 leader_election.cc:336] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.610s (SENT)
I20260709 13:19:25.525195 21687 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.462549 21628 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:25.460963 21694 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:25.552023 21484 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:25.449318 21603 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.529088 21490 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.561758 17996 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:25.569057 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:25.563184 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:25.550065 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:25.458721 21474 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.547052 21535 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:25.586148 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 162367us
I20260709 13:19:25.558857 21641 raft_consensus.cc:2764] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:25.566807 21695 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:25.590197 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:25.564409 21484 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:25.533116 21638 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.570204 21490 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.548759 21633 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.569849 21705 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:25.597396 21466 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:25.608990 21554 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:25.612524 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.613159 21500 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.613368 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:25.613567 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.613765 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:25.614163 17468 raft_consensus.cc:2376] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8. Re-sending same reply.
I20260709 13:19:25.590510 21628 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:25.591277 21645 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:25.615116 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:25.615307 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.610476 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.616079 17464 raft_consensus.cc:2376] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9. Re-sending same reply.
I20260709 13:19:25.616295 17462 raft_consensus.cc:2376] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14. Re-sending same reply.
I20260709 13:19:25.613207 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:25.615267 21645 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:25.618428 17322 raft_consensus.cc:2368] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:25.618845 21645 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.610965 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.612553 21554 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:25.520388 21472 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.615729 17468 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:25.609870 21469 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:25.614883 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:25.614166 17467 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:25.593891 17991 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:25.625473 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.596366 21484 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:25.633220 17463 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:25.636611 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 197061us
I20260709 13:19:25.628237 21705 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:25.638350 21697 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:25.639701 21469 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.632962 21628 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:25.641945 21603 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:25.642259 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1597) took 1383 ms. Trace:
I20260709 13:19:25.641834 21628 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.643756 17360 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:25.643918 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:25.649750 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:25.651485 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:25.653752 21468 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.654345 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:25.656270 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:25.657761 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:25.657943 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.658593 17471 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.658871 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:25.659667 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:25.660269 17317 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:25.660743 17462 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:25.661566 17467 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:25.643199 21639 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:25.663697 17467 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:25.659966 21521 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.665561 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:25.625507 21640 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.640463 21469 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:19:25.604564 21624 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.679348 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:25.673839 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:25.680496 17463 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:25.642628 17318 rpcz_store.cc:276] 0709 13:19:24.258400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.288500 (+ 30100us) service_pool.cc:224] Handling call
0709 13:19:24.292879 (+  4379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.293160 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.293208 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:24.293735 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.461134 (+167399us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:24.461170 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.461235 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:25.641350 (+1180115us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b2400170d38. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f58d9c4 00007f7d5f58bacb 00007f7d5f746dc9 00007f7d5f746a55 00007f7d5f745fb0 00007f7d623bc488 00007f7d623bcbe8 00007f7d62394398 00007f7d6238f76a 00007f7d6238ebb6
0709 13:19:25.641954 (+   604us) raft_consensus.cc:1685] finished
0709 13:19:25.641975 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.642184 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80974208,"thread_start_us":165938,"threads_started":1,"wal-append.queue_time_us":319411}
I20260709 13:19:25.688730 17322 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:25.664429 21678 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:25.682296 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 140665us
I20260709 13:19:25.604610 21259 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.683748 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.685823 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:25.692639 17320 raft_consensus.cc:2393] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:25.693427 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.697232 17468 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:25.638384 21591 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.624698 21714 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:19:25.711359 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:25.711925 21678 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.712949 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:25.624516 21704 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:19:25.720155 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:25.681921 21646 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:25.704514 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:25.638947 21705 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.715087 17466 raft_consensus.cc:2368] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:25.711941 17313 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:25.718585 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:25.718732 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:25.724957 17394 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:25.703953 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:25.713785 21571 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:25.731603 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:25.736209 17318 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:25.688129 21715 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:25.734046 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 143176us
I20260709 13:19:25.715022 21569 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:25.678562 21603 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:19:25.683921 21640 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.713539 21357 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.750790 17319 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:19:25.703881 21479 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:25.683845 21641 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:19:25.750147 21466 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.755628 21569 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:25.756157 21717 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:19:25.772253 17317 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:25.696115 21535 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:19:25.712749 21720 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:25.737910 21715 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:25.777029 21715 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:25.772018 21466 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.778976 21466 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.779888 21569 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.780745 21357 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.781514 17464 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:25.782706 17396 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:25.735502 21695 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:25.764863 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 69221.7us
I20260709 13:19:25.794593 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.795011 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:25.801513 17471 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:25.804593 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:25.805910 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:25.810001 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:25.807170 21634 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:25.801301 21723 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:25.825460 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.827548 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:25.828306 17313 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:25.830515 17471 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:25.830444 17992 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:25.829764 17396 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:25.833254 17994 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 4: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:19:25.834478 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 148173us
W20260709 13:19:25.835840 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.815119 21725 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.837913 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:25.839236 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.840672 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:25.841529 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:25.842100 17469 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.843123 17388 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:25.846216 21706 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:25.846639 21259 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:25.832855 21633 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.847417 21706 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:25.847867 21706 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:25.848820 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:25.849498 17396 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:25.853042 21695 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:25.855093 21719 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:19:25.859988 21490 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.861477 21484 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.865258 21624 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:25.865721 21640 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:25.866801 17321 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:25.867235 21655 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:25.842499 21699 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:19:25.870201 21699 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:25.870630 21699 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:25.839597 21516 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:25.872484 21516 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:25.832898 21479 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:25.878165 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:25.830268 21723 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:25.840720 21502 consensus_meta.cc:287] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.002s
I20260709 13:19:25.837911 21466 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:25.893484 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 137519us
W20260709 13:19:25.894632 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56798us
I20260709 13:19:25.879442 21634 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:25.877007 21521 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.878588 21516 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:25.925002 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:25.929013 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:25.868968 21509 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.939950 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:25.885466 21639 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:19:25.918586 17471 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:25.882210 21535 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.915409 21401 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.943049 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:25.950145 21516 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.951016 21509 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:25.919116 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:25.933326 21485 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:25.914623 21603 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:19:25.954792 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 147854us
I20260709 13:19:25.910863 21502 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.874732 21725 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.942433 21634 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:25.959425 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:25.924129 21715 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:25.979662 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 163292us
W20260709 13:19:25.998644 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 55676.5us
W20260709 13:19:26.000464 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 122365us
I20260709 13:19:25.940481 21259 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:25.959986 21485 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:25.953994 21535 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:25.959985 21466 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.004431 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:26.020124 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 214309us
I20260709 13:19:26.002276 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:25.978957 21591 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.013087 17390 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:26.002724 21516 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:26.032323 17434 leader_election.cc:336] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.666s (SENT)
I20260709 13:19:26.033138 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:26.027014 21645 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:26.034552 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 116704us
I20260709 13:19:26.038280 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:25.951691 21706 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.024634 21401 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.045205 17362 leader_election.cc:400] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:26.002027 21634 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.033870 21521 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:26.033435 21704 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.053184 21704 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.055424 21704 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:26.041985 21569 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.047238 17362 leader_election.cc:403] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:25.951929 21699 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.048198 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:26.046003 21472 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:26.074048 21731 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:19:26.067063 21509 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.028015 21466 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:25.957535 21723 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.036108 21554 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:26.085117 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 84833.5us
W20260709 13:19:26.089713 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 57420.2us
I20260709 13:19:26.092641 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:26.093858 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:26.069243 21738 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:26.097055 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 48947.2us
I20260709 13:19:26.075657 21720 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:26.113626 21720 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:26.113533 21734 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:26.084906 21695 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:26.115252 21695 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:26.042701 21645 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.078200 21259 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.075155 21735 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:26.071208 21521 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:26.090047 17963 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.922s (SENT) [suppressed 42 similar messages]
I20260709 13:19:26.098758 17434 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.106339 21554 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.084568 21509 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.108829 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:26.109771 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 69061.1us
I20260709 13:19:26.114830 21720 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.071918 21490 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.061523 21401 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.118335 21695 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.176550 17469 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:26.132090 17992 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.140561 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:26.142352 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 52323.8us
I20260709 13:19:26.149053 21502 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.129403 21723 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.157287 21535 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.158465 21715 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.160558 21725 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.151569 21743 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:26.152295 21745 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:26.153259 21691 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:26.162842 21645 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:26.163388 21737 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:19:26.163623 21634 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.164767 21638 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.165908 21466 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:26.166599 21694 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.004s
I20260709 13:19:26.129156 21485 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.167894 21474 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.126765 21633 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:19:26.170423 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.154567 21521 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:26.183542 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 51817.6us
I20260709 13:19:26.178421 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:26.186952 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:26.186789 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.192313 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.196386 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.201344 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.142731 21735 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:26.205825 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.205605 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:26.208237 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 203917us
I20260709 13:19:26.208338 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.185708 21640 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.189502 21628 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:26.205390 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.188534 21509 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.218425 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.219760 17394 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:26.231029 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.232035 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.233278 21735 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.243294 17992 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:26.246268 21401 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:26.206856 21743 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.249446 21628 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.250114 21628 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:26.265758 21687 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.270336 17395 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.271003 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.229894 17990 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:26.230623 17995 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:26.219985 17393 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:26.216248 17991 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:26.220793 17963 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.220930 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.220909 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:26.273241 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 52535.8us
I20260709 13:19:26.273639 17396 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.222147 17434 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.273875 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:26.272682 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 94376.7us
I20260709 13:19:26.232795 17394 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:26.279191 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:26.282372 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:26.282969 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 61123.3us
I20260709 13:19:26.285645 17462 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:26.221824 21726 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:19:26.269253 21640 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.298641 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.291465 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.293303 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.300693 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:26.294553 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 62548.9us
I20260709 13:19:26.301486 17391 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.296928 21705 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:26.296471 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:26.300909 17388 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.310681 17471 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:26.313611 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:26.314247 17467 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.278007 21502 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:26.324863 17395 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:26.316111 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.328135 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.328751 17389 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:26.329632 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:26.330214 17468 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:26.330966 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:26.318632 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.313441 21490 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:26.337280 21754 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:26.340915 21756 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:19:26.281855 21469 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:26.277673 21730 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.322625 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.368696 17393 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
I20260709 13:19:26.323247 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:26.291494 21500 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:26.369958 21500 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:26.370012 21740 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:26.370239 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:26.370565 21740 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:26.370934 21500 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.371518 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:26.371363 21740 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.372217 17464 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:26.324018 21502 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:26.373289 17464 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:19:26.373178 21502 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.347326 17462 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:26.348901 17467 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
W20260709 13:19:26.376550 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 61306.1us
I20260709 13:19:26.382542 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:26.383337 17396 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:26.347404 17391 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:26.387650 17388 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:26.320855 21535 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:26.357358 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:26.216298 21694 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.366137 21569 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:26.366286 21689 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.367781 21259 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:26.367995 21469 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.351240 21628 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:26.407217 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 365816us
I20260709 13:19:26.415539 17471 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:26.420433 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 100982us
I20260709 13:19:26.426805 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.427726 17392 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:26.432426 21640 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.407162 21490 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:26.444875 21490 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.448220 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:26.451763 21628 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.388157 21754 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:26.455150 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:26.455777 17962 leader_election.cc:400] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13.
I20260709 13:19:26.456131 17962 leader_election.cc:403] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:26.456945 17997 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:26.458133 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:26.458921 17468 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:26.455348 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:26.419762 21693 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:19:26.407588 21603 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.468719 17287 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:26.472720 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.473593 17392 raft_consensus.cc:2376] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 4. Re-sending same reply.
I20260709 13:19:26.478564 17468 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:26.479471 21638 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:26.479697 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.479935 21638 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.471903 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:26.480332 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 57507.3us
I20260709 13:19:26.481042 17471 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:26.481359 17962 leader_election.cc:400] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:26.481782 17962 leader_election.cc:403] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:26.480298 17389 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.423112 21469 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.429001 21745 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:26.466092 21754 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.408711 21695 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.469635 21759 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.472306 21740 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:26.477146 21640 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:26.515954 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.475416 21730 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13.
I20260709 13:19:26.501590 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.430708 21689 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.480360 21638 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.514273 17394 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:26.421082 21535 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.465868 21708 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:19:26.520502 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:26.497529 21754 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.529182 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:26.494968 21735 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:26.532789 17996 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:26.494926 21741 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:26.482671 21603 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.539996 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.524516 21628 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:26.545730 21760 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.546463 21760 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.549166 21762 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.527917 21640 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:26.571534 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 90338.6us
I20260709 13:19:26.572041 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:26.575634 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44071.7us
I20260709 13:19:26.577203 17392 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:26.581032 17434 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.538111 21697 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:26.585436 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.586581 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.588049 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.590893 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.583484 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.592082 17392 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 4.
I20260709 13:19:26.544059 21628 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.620771 17992 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:26.578217 21516 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:26.621843 21516 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.621996 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.622365 21516 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.592366 21704 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:26.593029 21357 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:26.623296 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:26.623628 21728 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.746s	user 0.000s	sys 0.004s
I20260709 13:19:26.624212 21704 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:26.624429 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.578305 21479 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.614815 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.627010 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:26.585345 21639 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:26.631831 17321 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:26.519472 21759 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.628989 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.559125 21535 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.585144 21697 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.590409 21730 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:26.589948 21705 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:26.590624 21726 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:26.612912 21691 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.637439 17320 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:26.636667 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.672107 17992 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:26.538844 21735 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.612320 21401 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:26.635643 21641 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.539068 21741 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:26.686440 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 94246.4us
I20260709 13:19:26.688711 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.693178 17313 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:26.693462 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.630640 21628 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:26.631850 21648 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.704717 21689 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.695098 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:26.589596 21658 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:19:26.726058 17320 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:26.726255 21699 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.727015 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.699049 17316 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:26.727689 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.700284 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.728657 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.701047 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.728814 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:26.737478 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.738401 17393 raft_consensus.cc:2410] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:26.739223 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:26.742585 21716 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.133s	user 0.005s	sys 0.000s
I20260709 13:19:26.744082 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3017) took 1308 ms. Trace:
W20260709 13:19:26.744884 21739 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.703s	user 0.001s	sys 0.002s
I20260709 13:19:26.718297 17434 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.744319 21628 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.746541 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.747749 21628 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.748406 21628 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:26.718473 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.679317 21479 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:26.702800 21723 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.000s
I20260709 13:19:26.683558 21697 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:26.703862 21761 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:19:26.705919 21703 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.615362 21745 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.708310 21759 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.640597 21760 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.708945 21516 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.710215 21469 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.723861 21706 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.714421 21735 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.696031 17993 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:26.716789 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.698469 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.749190 17316 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:26.717211 21741 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.750249 21705 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:19:26.803068 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.806090 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.807188 17998 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:26.808276 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.809808 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.810743 17998 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:26.811791 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.799058 21655 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:26.817286 21655 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:26.808337 21638 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:26.818459 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 594057us
I20260709 13:19:26.818372 21655 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.819864 21638 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.820560 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.821414 21695 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.727739 17320 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 4.
I20260709 13:19:26.750051 17317 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:19:26.823081 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:26.823514 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.824335 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:26.719044 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.737470 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.829633 17320 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:26.829958 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 92554.1us
W20260709 13:19:26.830435 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.750216 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.717669 17999 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:26.718334 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.834745 17313 raft_consensus.cc:2393] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:26.835177 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.835610 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:26.836488 17313 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:26.744491 17397 rpcz_store.cc:276] 0709 13:19:25.435823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.435953 (+   130us) service_pool.cc:224] Handling call
0709 13:19:25.436271 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.439479 (+  3208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.439508 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.449903 (+ 10395us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.558323 (+108420us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:25.558384 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.558484 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.741867 (+1183383us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:26.743729 (+  1862us) raft_consensus.cc:1685] finished
0709 13:19:26.743751 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.743973 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14983,"raft.queue_time_us":4073,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8481,"spinlock_wait_cycles":32412416,"thread_start_us":34695,"threads_started":1,"wal-append.queue_time_us":142276}
I20260709 13:19:26.729329 17992 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:26.836797 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.840585 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.841708 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.842207 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.842621 17999 raft_consensus.cc:2368] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13.
I20260709 13:19:26.843676 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.844372 17992 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.777062 17994 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:26.693176 21639 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:26.845969 21639 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.749055 21658 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:26.786875 17393 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:26.729544 21490 raft_consensus.cc:2764] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:26.694361 21726 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.846832 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.786856 17389 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:26.729737 21714 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:26.849422 21726 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:26.751632 21603 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.697685 21694 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:26.850106 17389 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:26.799933 17392 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:26.850472 21490 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:26.851131 21490 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:26.851424 17389 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:26.730317 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:26.824703 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.853236 21714 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.853792 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:26.854321 21624 raft_consensus.cc:2764] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:26.854485 17317 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.750005 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3023) took 1094 ms. Trace:
I20260709 13:19:26.798310 17396 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:26.855993 17390 rpcz_store.cc:276] 0709 13:19:25.655563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.731691 (+ 76128us) service_pool.cc:224] Handling call
0709 13:19:25.766901 (+ 35210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.026488 (+259587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.749807 (+723319us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540023c3d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:26.749952 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565243264}
I20260709 13:19:26.804622 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.857249 17396 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:26.857614 17390 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:19:26.857949 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:26.858554 17993 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:26.859891 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:26.860147 17993 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:26.852244 21490 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.861371 17993 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:19:26.853822 21714 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.853816 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.865873 17389 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:26.866022 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.843936 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.867296 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.868410 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.854856 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:26.837247 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.871654 17313 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:26.871721 21466 raft_consensus.cc:2764] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:26.870476 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:26.872718 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.873032 17465 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.875669 17313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:26.876302 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:26.876606 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:26.877475 21466 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:26.878214 21569 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:26.878765 21569 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.879209 21569 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:26.880712 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:26.882411 17314 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:26.882236 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:26.883881 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:26.886201 17990 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:26.692109 21730 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.796566 21628 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:26.754201 21641 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.913873 17286 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.718611 21777 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.083s
W20260709 13:19:26.918989 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 145562us
I20260709 13:19:26.919808 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.725281 21648 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.929759 17317 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
W20260709 13:19:26.929857 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47744.7us
I20260709 13:19:26.724189 21691 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 13:19:26.882615 21762 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:26.925206 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.931105 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:26.931705 17317 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:26.935595 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.941267 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.942154 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:26.936344 17992 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:26.941092 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.884639 21658 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:26.943305 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:26.953069 17313 raft_consensus.cc:606] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.951165 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:26.953514 17313 raft_consensus.cc:614] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:26.962493 17317 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:26.751911 21640 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:26.782318 21703 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:26.919344 21466 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.966077 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:26.930073 21472 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:26.967394 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 141445us
I20260709 13:19:26.915616 21401 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:26.950592 21777 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:26.888500 21735 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:19:26.937505 21759 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:26.974685 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 154228us
I20260709 13:19:26.938460 21634 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:26.980656 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 161223us
I20260709 13:19:26.893080 21603 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:19:26.984261 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:26.986142 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:26.962158 21758 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:26.993120 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:26.994258 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:26.995749 17315 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:26.969899 21479 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:26.980698 21685 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:27.001497 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:26.972015 21401 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:26.980851 21777 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:26.998905 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 59740.1us
I20260709 13:19:27.006554 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:27.013120 17999 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:26.987483 21705 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.951685 21554 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:19:27.010965 17992 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:26.990530 21634 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.018349 21634 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:27.005002 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:27.029561 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:26.988114 21472 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:27.043076 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:26.987172 21639 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:19:27.040334 21473 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:27.079989 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:27.189627 17995 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.040524 21726 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:19:27.194090 21781 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:27.194686 21781 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:27.086512 21785 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:19:27.087472 21776 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:19:27.068187 21691 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:19:27.202040 21691 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:27.202479 17392 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.202582 21691 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:27.202862 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 798) took 1382 ms. Trace:
I20260709 13:19:27.203773 17392 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:27.203244 17997 rpcz_store.cc:276] 0709 13:19:25.820831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.821020 (+   189us) service_pool.cc:224] Handling call
0709 13:19:25.821395 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.457581 (+636186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.202638 (+745057us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400198f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:27.202787 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461129600}
W20260709 13:19:27.141314 21731 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:27.008298 21638 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:19:27.181322 21469 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:27.203630 21691 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:27.205502 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1832) took 1014 ms. Trace:
I20260709 13:19:27.205901 17395 rpcz_store.cc:276] 0709 13:19:26.191625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.191772 (+   147us) service_pool.cc:224] Handling call
0709 13:19:27.205335 (+1013563us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b540023d7d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:27.205448 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106531712}
I20260709 13:19:27.181891 21685 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:27.182442 21799 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.207906 17389 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.207870 21799 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.182045 21401 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:27.210676 21569 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.211799 17396 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:27.207224 21685 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.183534 21760 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.214732 17392 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:27.067282 21628 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:27.216531 21569 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:26.995136 21633 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:19:27.218202 21687 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:27.218612 21687 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:27.218672 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:27.110462 21658 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:27.219563 21687 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:27.199021 17465 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:27.223037 17995 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:27.188062 17320 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:27.190901 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:27.207437 17395 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:19:27.182993 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 178036us
I20260709 13:19:27.226817 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:27.228756 17999 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
W20260709 13:19:27.237886 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 208411us
I20260709 13:19:27.184725 21723 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.197836 21473 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.244272 17463 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:27.251633 17320 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:19:27.254539 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 303503us
I20260709 13:19:27.266394 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:27.011049 21756 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:27.275064 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:27.277710 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:27.279280 17995 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.242827 21687 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.242558 21641 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:27.282871 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:27.062039 21634 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.283748 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:27.265398 21473 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.301184 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:27.301823 17990 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.305650 17992 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:27.308972 21706 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:27.309337 21699 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.000s
I20260709 13:19:27.208783 21777 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.309513 21706 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:27.310544 21777 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:27.311717 21706 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:27.318943 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:27.288043 21756 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:27.329538 21783 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.161s	user 0.000s	sys 0.004s
I20260709 13:19:27.322497 21723 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.326683 21730 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:27.359464 17995 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:27.334339 21795 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:19:27.347172 21735 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:19:27.401697 21740 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.886s	user 0.008s	sys 0.003s
I20260709 13:19:27.358806 21703 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:27.512104 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:27.402897 21800 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.536716 17992 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:27.551422 21781 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:27.551553 21799 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:27.360466 21793 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.331492 21472 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.486588 21735 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:27.529352 21791 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:27.483616 21796 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:27.562080 21714 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.698s	user 0.006s	sys 0.006s
W20260709 13:19:27.559562 21754 consensus_meta.cc:287] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.020s	user 0.011s	sys 0.000s
I20260709 13:19:27.557749 21795 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:27.558182 21685 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.594014 21473 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:27.601394 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.661566 21803 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:19:27.668079 21697 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.886s	user 0.009s	sys 0.000s
I20260709 13:19:27.669129 21634 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:27.587852 21687 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:27.672785 21789 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.746s	user 0.004s	sys 0.000s
I20260709 13:19:27.673241 21687 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.643780 21791 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:27.568329 21756 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.587688 21795 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:27.668552 21697 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:27.576665 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:27.562917 21703 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.694430 17996 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:27.697981 17996 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:27.640763 21714 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.698956 17996 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.725646 17996 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.643949 21685 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.735394 17318 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:27.575958 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.004s	sys 0.009s
W20260709 13:19:27.738301 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.005s	sys 0.010s
W20260709 13:19:27.738770 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 742081us
I20260709 13:19:27.742132 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:27.676004 21791 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:27.745469 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 462633us
I20260709 13:19:27.750872 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:27.751736 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.757934 17998 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:27.640575 21754 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.762663 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:27.764231 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:27.764231 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:27.764678 17465 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.774223 17463 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:27.775506 17990 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:19:27.781971 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 110182us
I20260709 13:19:27.723311 21703 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:27.757861 21484 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:27.759218 21793 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.790807 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:27.793015 17434 leader_election.cc:400] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13.
I20260709 13:19:27.793417 17434 leader_election.cc:403] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:19:27.787138 21808 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:19:27.798969 17285 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:27.789252 21705 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.764s	user 0.015s	sys 0.000s
I20260709 13:19:27.801987 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45632 (request call id 39) took 1095 ms. Trace:
I20260709 13:19:27.729409 21735 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.802381 17313 rpcz_store.cc:276] 0709 13:19:26.706484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.875533 (+169049us) service_pool.cc:224] Handling call
0709 13:19:27.801236 (+925703us) spinlock_profiling.cc:243] Waited 76.6 ms on lock 0x7b5400274554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627ee853 00007f7d677bc60a 00007f7d60d427d4 00007f7d60d42762 00007f7d60d42691 00007f7d60d4260c 00007f7d60d418c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:27.801374 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176084736}
I20260709 13:19:27.786787 21804 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.802493 21473 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:27.811753 17996 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:19:27.812289 17996 pending_rounds.cc:85] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 10
I20260709 13:19:27.812758 17996 pending_rounds.cc:107] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:19:27.808195 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:27.813333 17996 raft_consensus.cc:2889] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.749279 21795 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.796919 21691 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13.
W20260709 13:19:27.803375 21640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.000s	sys 0.024s
W20260709 13:19:27.819510 17466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.056s	sys 0.100s
W20260709 13:19:27.824641 17466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.057s	sys 0.101s
I20260709 13:19:27.805688 21705 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:27.825593 21745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.008s	sys 0.022s
W20260709 13:19:27.833247 21745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.022s
W20260709 13:19:27.824716 21640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.000s	sys 0.025s
I20260709 13:19:27.834167 17317 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:27.803233 21639 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:19:27.820832 21473 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.834084 21401 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:27.817305 21742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.047s	sys 0.067s
W20260709 13:19:27.850790 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.830384 21804 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.873835 17471 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:27.875890 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:27.876785 17469 raft_consensus.cc:2410] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:19:27.879417 17462 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:27.885737 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 86875.8us
I20260709 13:19:27.838115 21795 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.905262 17463 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:27.871933 21658 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:27.841476 21777 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:19:27.913479 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1892) took 1144 ms. Trace:
I20260709 13:19:27.873128 21705 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.918111 17320 rpcz_store.cc:276] 0709 13:19:26.769336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.277176 (+507840us) service_pool.cc:224] Handling call
0709 13:19:27.291406 (+ 14230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.291732 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.291751 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.293264 (+  1513us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.811949 (+518685us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:27.811995 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.812061 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.913225 (+101164us) raft_consensus.cc:1685] finished
0709 13:19:27.913247 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.913382 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8119,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11802,"thread_start_us":465290,"threads_started":1,"wal-append.queue_time_us":546941}
I20260709 13:19:27.919225 21705 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.920208 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:27.921010 17320 raft_consensus.cc:2410] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:27.904330 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:27.915700 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:27.837673 21691 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:19:27.905769 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:27.875309 21742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.054s	sys 0.072s
I20260709 13:19:27.843477 21472 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:27.914906 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:27.924226 17320 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:27.969358 17465 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:27.970223 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:27.933229 17463 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:27.921518 21705 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:27.923552 21658 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:27.963052 17435 leader_election.cc:336] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.216s (SENT)
I20260709 13:19:27.975126 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:27.936559 21485 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:27.975998 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:27.976342 21485 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:27.966223 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 2995) took 1110 ms. Trace:
I20260709 13:19:27.976640 17997 raft_consensus.cc:2376] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14. Re-sending same reply.
I20260709 13:19:27.977114 17466 rpcz_store.cc:276] 0709 13:19:26.855921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.859776 (+  3855us) service_pool.cc:224] Handling call
0709 13:19:26.860134 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.278897 (+418763us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:27.278955 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.279657 (+   702us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.825069 (+545412us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:27.825330 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.825472 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.965898 (+140426us) raft_consensus.cc:1685] finished
0709 13:19:27.965927 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.966124 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42266,"raft.queue_time_us":85069,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":15888,"thread_start_us":899786,"threads_started":2,"wal-append.queue_time_us":628268}
I20260709 13:19:27.970368 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:27.972307 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1614) took 1133 ms. Trace:
I20260709 13:19:27.980209 17320 rpcz_store.cc:276] 0709 13:19:26.839196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.921673 (+1082477us) service_pool.cc:224] Handling call
0709 13:19:27.921959 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.967652 (+ 45693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.972248 (+  4596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.956645 21685 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:27.908123 21697 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:27.973208 17996 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:27.956794 21754 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:27.879781 21806 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.182s	user 0.001s	sys 0.001s
I20260709 13:19:27.968129 21640 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:19:27.966804 21691 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:27.977355 21769 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.166s	user 0.017s	sys 0.006s
W20260709 13:19:27.988140 21769 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.018s	sys 0.006s
W20260709 13:19:27.973214 21811 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:19:27.988555 21814 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:19:27.915583 21628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.006s	sys 0.019s
I20260709 13:19:27.987982 21691 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:27.993393 21813 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:27.993796 21691 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.995041 21729 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:27.995373 21691 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.995468 21729 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:27.997597 21729 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:27.998502 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1854) took 1122 ms. Trace:
I20260709 13:19:27.998708 21729 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.998951 17396 rpcz_store.cc:276] 0709 13:19:26.876000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.943082 (+ 67082us) service_pool.cc:224] Handling call
0709 13:19:27.998252 (+1055170us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54004119d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:27.998432 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593486720}
I20260709 13:19:27.985365 17466 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:28.003644 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 708) took 1611 ms. Trace:
I20260709 13:19:28.004136 17389 rpcz_store.cc:276] 0709 13:19:26.392735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.866692 (+473957us) service_pool.cc:224] Handling call
0709 13:19:27.207748 (+341056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.208346 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.003448 (+795102us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540023d7d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:28.003582 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783614848}
I20260709 13:19:27.983212 21705 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:27.987497 21807 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:28.014925 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:28.022300 17434 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:27.968353 21703 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.014045 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:28.022528 17463 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.013522 17394 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:19:28.008469 21628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.007s	sys 0.019s
I20260709 13:19:28.024359 17999 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:19:28.024159 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:27.958382 21472 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.032202 21777 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.034871 21796 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:28.034902 21810 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:28.039400 21777 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:28.040552 17320 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.040547 21357 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:28.042652 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:28.045120 21357 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:28.045713 21777 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:28.046346 21777 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:28.046068 21357 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.047827 21357 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.049878 21485 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.050880 21648 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:28.052785 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1615) took 1213 ms. Trace:
I20260709 13:19:28.053145 17320 rpcz_store.cc:276] 0709 13:19:26.839565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.034051 (+1194486us) service_pool.cc:224] Handling call
0709 13:19:28.040395 (+  6344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.052323 (+ 11928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.052729 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:28.054196 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1602) took 1351 ms. Trace:
I20260709 13:19:28.047420 21777 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.054611 17317 rpcz_store.cc:276] 0709 13:19:26.702899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.963240 (+260341us) service_pool.cc:224] Handling call
0709 13:19:26.963475 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.834703 (+871228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.053949 (+219246us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b540035c0d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:28.054137 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001945856}
I20260709 13:19:28.017747 21726 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.058697 17992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:48172
I20260709 13:19:28.059506 17992 raft_consensus.cc:606] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:28.059937 17992 raft_consensus.cc:614] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:28.057389 17317 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.028128 21804 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.063386 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1886) took 1366 ms. Trace:
I20260709 13:19:28.063153 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:28.063864 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1619) took 1211 ms. Trace:
I20260709 13:19:28.063736 17318 rpcz_store.cc:276] 0709 13:19:26.697065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.697205 (+   140us) service_pool.cc:224] Handling call
0709 13:19:26.699610 (+  2405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.736617 (+1037007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.063183 (+326566us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540010cf54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:28.063334 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2381479296}
I20260709 13:19:28.064460 17317 rpcz_store.cc:276] 0709 13:19:26.849547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.056797 (+1207250us) service_pool.cc:224] Handling call
0709 13:19:28.057209 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.060775 (+  3566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.061043 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:28.065904 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:28.030998 21705 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:19:28.067991 17318 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:28.070024 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 752) took 1087 ms. Trace:
I20260709 13:19:28.070374 17318 rpcz_store.cc:276] 0709 13:19:26.982451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.065010 (+1082559us) service_pool.cc:224] Handling call
0709 13:19:28.067778 (+  2768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.068447 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.069973 (+  1526us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:28.071592 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:28.074824 21740 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.076622 21502 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.080588 17999 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:28.068406 21472 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:28.085263 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:28.070144 21754 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:28.100354 21714 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:28.101714 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 709) took 1708 ms. Trace:
I20260709 13:19:28.110703 17394 rpcz_store.cc:276] 0709 13:19:26.393078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.985374 (+592296us) service_pool.cc:224] Handling call
0709 13:19:28.009009 (+1023635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.025646 (+ 16637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.101519 (+ 75873us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54004119d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:28.101655 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338715008}
I20260709 13:19:28.063506 21726 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:28.109289 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.102715 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1881) took 1410 ms. Trace:
I20260709 13:19:28.112881 17314 rpcz_store.cc:276] 0709 13:19:26.691893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.692014 (+   121us) service_pool.cc:224] Handling call
0709 13:19:26.692275 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.883171 (+190896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.102449 (+1219278us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400367c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:28.102646 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436875136}
I20260709 13:19:28.113582 17318 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:19:28.115003 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:28.112265 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.122048 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.120507 21754 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:19:28.093695 21804 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:28.086272 21695 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:28.109632 21648 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.151655 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.152081 21401 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:28.152186 21795 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:28.085896 21740 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:19:28.153424 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:28.193248 17314 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:28.142125 21658 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:28.159191 21795 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:28.197402 17321 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:19:28.198184 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 112973us
I20260709 13:19:28.151006 21472 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:19:28.195004 21804 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:28.224376 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3037) took 1912 ms. Trace:
I20260709 13:19:28.225840 17390 rpcz_store.cc:276] 0709 13:19:26.311799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.858376 (+546577us) service_pool.cc:224] Handling call
0709 13:19:26.858672 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.858881 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:27.004449 (+145568us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.224005 (+1219556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.224063 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:28.224108 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.224182 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.224318 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1219308,"prepare.queue_time_us":3304,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"thread_start_us":145215,"threads_started":1}
I20260709 13:19:28.196163 21795 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:28.229532 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 1.02452e+06us
I20260709 13:19:28.228978 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3039) took 1707 ms. Trace:
I20260709 13:19:28.160341 21648 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.230541 17393 rpcz_store.cc:276] 0709 13:19:26.521840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.194700 (+672860us) service_pool.cc:224] Handling call
0709 13:19:27.194990 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.195191 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:27.195514 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.228562 (+1033048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.228623 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:28.228671 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.228748 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.228917 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1032799,"prepare.queue_time_us":244,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38}
I20260709 13:19:28.204531 21259 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:28.237462 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 977961us
I20260709 13:19:28.217097 21695 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:28.240640 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:28.220656 21466 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.253756 21830 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:28.254622 21830 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:28.207566 21509 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:19:28.237406 21723 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.827s	user 0.006s	sys 0.006s
I20260709 13:19:28.235807 21472 consensus_queue.cc:1243] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:28.234625 21591 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:28.224354 21791 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:19:28.250418 21569 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:28.250089 21259 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.250512 21695 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:28.318640 21818 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:19:28.272429 21723 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.272243 21740 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:28.334524 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 101911us
I20260709 13:19:28.321127 21591 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:28.336493 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 96511.9us
I20260709 13:19:28.337253 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:28.268548 21466 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.328655 21479 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.339781 21479 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.340291 21725 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:28.340718 21466 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.341195 21725 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:28.341609 21725 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:28.326653 21569 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:28.342406 21725 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.325507 21484 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:19:28.343731 21725 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.343890 21484 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:28.271835 21628 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:19:28.355662 21798 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:28.370579 21798 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:28.371219 21591 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.371415 21798 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.373267 21695 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.374584 21695 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.382047 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 749) took 1545 ms. Trace:
I20260709 13:19:28.382485 17313 rpcz_store.cc:276] 0709 13:19:26.836328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.813778 (+977450us) service_pool.cc:224] Handling call
0709 13:19:27.827629 (+ 13851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.832154 (+  4525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.832191 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.841366 (+  9175us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.917239 (+ 75873us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:27.917276 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.917341 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.381846 (+464505us) raft_consensus.cc:1685] finished
0709 13:19:28.381866 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.381988 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4948,"thread_start_us":73074,"threads_started":1,"wal-append.queue_time_us":140297}
I20260709 13:19:28.329105 21795 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.384889 21795 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.387609 21648 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.389242 21726 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:28.357273 21822 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:19:28.356513 21826 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:19:28.346078 21484 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:28.393687 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56527.4us
I20260709 13:19:28.394090 21484 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.395385 21484 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.395660 21490 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.396343 21490 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:28.337998 21472 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:28.397096 21490 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:28.397390 21472 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.398061 21535 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:28.398454 21535 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:28.399159 21535 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.399669 21472 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:28.400269 21535 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.362591 21479 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:28.364981 21804 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:28.363735 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.401357 21804 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.403399 21804 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:28.404098 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:28.404698 17394 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:28.404996 21797 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:28.405472 21769 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:28.405576 21797 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.406049 21769 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.407783 21401 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:28.336402 21740 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:28.407965 21797 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.408236 21401 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:28.408821 21740 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.409255 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:28.410079 21740 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.410436 21259 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.412595 17389 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.413946 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:28.334726 21554 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:28.414474 17396 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:28.414779 21554 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.415743 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:28.367319 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3027) took 2099 ms. Trace:
I20260709 13:19:28.409209 21401 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.416978 17397 rpcz_store.cc:276] 0709 13:19:26.267951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.837732 (+569781us) service_pool.cc:224] Handling call
0709 13:19:26.838021 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.838243 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:26.838558 (+   315us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.967196 (+128638us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.091880 (+1124684us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b1800342340. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:19:28.195816 (+103936us) spinlock_profiling.cc:243] Waited 8.75 ms on lock 0x7b1800342340. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:19:28.329517 (+133701us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.366724 (+ 37207us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.366935 (+   211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.366999 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:28.367055 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.367129 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.367256 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374867,"prepare.queue_time_us":3341,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":1836,"raft.queue_time_us":1297618,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":11213,"spinlock_wait_cycles":30577920,"thread_start_us":187071,"threads_started":2,"wal-append.queue_time_us":226623}
I20260709 13:19:28.418628 21401 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:28.420264 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 801) took 2497 ms. Trace:
I20260709 13:19:28.420657 17994 rpcz_store.cc:276] 0709 13:19:25.923196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.923402 (+   206us) service_pool.cc:224] Handling call
0709 13:19:28.420108 (+2496706us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b5400590454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:28.420207 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923526400}
I20260709 13:19:28.423424 21714 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.426257 21691 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:28.426816 21691 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.427861 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.428248 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:28.429368 21791 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:28.429766 21658 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:28.430205 21658 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:28.413951 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:28.431120 21658 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.431936 21516 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.432112 21658 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.432528 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.430125 21791 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.431491 17388 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:28.438585 17392 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:28.439968 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.440441 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.444557 17317 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:28.408043 21769 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.372717 21798 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:28.406306 21687 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:28.449216 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.461624 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:28.464159 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:28.440296 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:28.467087 17392 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.470016 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:28.451704 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.458209 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44284us
I20260709 13:19:28.459508 17316 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:28.496254 21769 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.497049 21769 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:28.498020 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.499584 21769 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.465687 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:28.513125 21743 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:28.522784 17314 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:28.523115 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.524535 17314 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:28.526204 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:28.408612 21797 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:28.534029 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:28.538424 17468 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:28.538745 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.416774 21554 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.521481 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.544066 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:28.534422 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.551260 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.558720 17963 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:28.540776 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:28.535229 21624 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:28.546710 17321 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:28.546877 21831 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:19:28.547909 21704 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:28.549024 21720 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:28.549363 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 87822us
I20260709 13:19:28.523643 21466 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:28.562963 17322 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:28.549490 21791 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:28.639355 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.640722 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.641451 17322 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:28.552229 21502 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:28.565277 21793 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.005s
I20260709 13:19:28.591225 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:28.591691 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.649863 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:28.651026 17322 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:28.540499 17392 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:28.520448 21769 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:19:28.571839 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:28.587419 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:28.590794 17319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1611) took 1885 ms (client timeout 2093 ms). Trace:
W20260709 13:19:28.666329 17319 rpcz_store.cc:269] 0709 13:19:26.705460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.805749 (+100289us) service_pool.cc:224] Handling call
0709 13:19:28.567452 (+1761703us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400369a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:28.590707 (+ 23255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327055616}
I20260709 13:19:28.542485 21685 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.596772 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:28.588600 21723 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:19:28.544726 21743 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.604063 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:28.637239 17467 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:28.642117 17464 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:28.595994 21833 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:28.645541 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.589308 17287 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:28.560041 21729 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:19:28.550022 21797 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.679425 17465 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:28.542126 21628 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:19:28.680466 17396 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:19:28.719086 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 129871us
I20260709 13:19:28.719022 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:28.680645 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:28.721469 17392 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.681299 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:28.681964 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:28.640570 21466 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.683919 17320 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:28.682909 21259 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.685612 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:28.643234 21691 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:28.649550 21791 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.644001 21804 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:28.725229 17394 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:19:28.618934 21720 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:28.663075 21793 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:28.733325 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:28.746196 17396 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:28.648859 21715 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:19:28.748260 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:28.749094 17396 raft_consensus.cc:2368] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13.
I20260709 13:19:28.749912 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:28.649634 21646 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:19:28.750491 17396 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:28.757699 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:28.801787 21759 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:28.802141 17394 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.802382 21759 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:28.747179 21720 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.803289 21759 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.804471 21797 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.806088 21837 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:28.806550 21837 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:28.806607 21796 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:28.807214 21796 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.807521 21837 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.775244 21754 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:28.810158 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:28.810891 17393 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:28.813154 21655 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.814308 17992 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:28.814473 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:28.815367 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:28.816687 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:28.817567 17990 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:28.801291 21603 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:28.821305 21603 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:28.822614 17316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1605) took 2118 ms (client timeout 1826 ms). Trace:
I20260709 13:19:28.822479 21603 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:28.823040 17316 rpcz_store.cc:269] 0709 13:19:26.703767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.881602 (+177835us) service_pool.cc:224] Handling call
0709 13:19:28.822424 (+1940822us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400368154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:28.822543 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3465261440}
I20260709 13:19:28.823788 21603 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.733835 21466 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.731630 21502 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:28.830960 17394 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 5.
W20260709 13:19:28.853659 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.683079 21834 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.850934 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:28.860451 17396 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.843995 21754 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.859294 21832 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:19:28.860915 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:28.863322 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 101725us
I20260709 13:19:28.690498 21509 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.690263 21831 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.866784 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 334770us
I20260709 13:19:28.693423 21685 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.694934 21743 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.743875 21691 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.875851 17393 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:28.804708 21759 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.892393 21691 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.894780 21691 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:28.883421 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:28.862347 21754 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.890136 21685 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:28.891844 21743 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:28.740114 21473 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.132s
I20260709 13:19:28.850402 21837 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:28.899036 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.900717 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:28.908599 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.738350 21259 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.908967 17393 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:28.863324 17394 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:28.871624 21502 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:28.922026 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:28.896814 21816 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.862s	user 0.000s	sys 0.013s
I20260709 13:19:28.748070 21791 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.906209 21655 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.941155 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:28.941732 17999 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:28.862049 21720 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.928561 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:28.929158 17998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.032s
W20260709 13:19:28.943761 17998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.006s	sys 0.032s
I20260709 13:19:28.755560 21804 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.949501 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:28.950994 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:28.951781 17990 raft_consensus.cc:2368] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13.
I20260709 13:19:28.939020 17394 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:28.939229 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:28.953477 17996 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:28.922559 17392 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:28.955108 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:28.917412 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 352296us
I20260709 13:19:28.897526 21754 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:28.921145 21729 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.956557 17992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:48172
I20260709 13:19:28.958489 17994 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:28.959801 17992 raft_consensus.cc:606] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:28.960263 17992 raft_consensus.cc:614] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:28.955667 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:28.920954 21734 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:28.924505 21691 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:28.962420 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 325440us
I20260709 13:19:28.963708 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:28.964998 17991 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:28.965972 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:28.967115 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:28.972328 17392 raft_consensus.cc:2410] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:19:28.888224 21509 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.888060 21831 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.031700 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:28.941563 21777 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:29.078809 17394 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:29.033190 17388 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:29.079216 17434 leader_election.cc:400] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13.
I20260709 13:19:29.080402 17434 leader_election.cc:403] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:28.940711 21705 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:19:28.957806 21793 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:29.087107 17388 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:29.088893 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 121844us
W20260709 13:19:29.100487 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 220100us
I20260709 13:19:29.148591 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:28.970034 21796 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:29.151180 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:29.159111 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 69538.4us
I20260709 13:19:29.165118 17394 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:29.170193 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:29.171056 17393 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:28.948972 21655 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:28.973315 21754 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.157052 21695 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.782s	user 0.014s	sys 0.005s
I20260709 13:19:29.032502 21759 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:29.166035 21743 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:28.884997 21834 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:28.974071 21729 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:29.085355 21658 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.013s
W20260709 13:19:29.171108 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 215521us
W20260709 13:19:29.184701 21844 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:19:29.175738 21648 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:19:29.190038 17360 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:29.182152 17314 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:29.186069 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.234104 17318 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:29.204375 17319 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:29.230654 17995 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:19:29.209295 17462 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:29.175654 21554 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:29.175346 21691 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:29.082379 21777 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:29.232368 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.241983 17463 raft_consensus.cc:2410] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:29.181372 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:29.277944 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.299264 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 109306us
W20260709 13:19:29.299636 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 220576us
I20260709 13:19:29.299048 17435 leader_election.cc:400] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13.
I20260709 13:19:29.301684 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:29.184089 21842 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:29.301222 17360 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:29.183204 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:29.231930 21840 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 13:19:29.208638 21484 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.813s	user 0.010s	sys 0.000s
I20260709 13:19:29.099901 21845 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.157s
I20260709 13:19:29.323887 17397 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
W20260709 13:19:29.231791 21846 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:19:29.146258 21502 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.074688 21734 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.283334 21791 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:29.173072 21646 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:29.287075 21843 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 13:19:29.287631 21740 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.877s	user 0.005s	sys 0.005s
I20260709 13:19:29.329254 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:29.179033 21848 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:29.338784 17388 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:29.323510 21567 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:29.238330 21695 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:29.343076 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 187089us
I20260709 13:19:29.284070 21259 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.177259 21685 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.297865 21777 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.315655 21490 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:29.392648 21490 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.393088 21490 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.393343 21858 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:29.315877 21479 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:19:29.172600 21645 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.167s
I20260709 13:19:29.325662 21658 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.342763 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 142902us
I20260709 13:19:29.173329 21624 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.177s
I20260709 13:19:29.333000 21691 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.235321 21759 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:29.384522 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.398499 21791 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:29.385933 17999 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:29.166699 21793 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.303267 21743 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:29.315804 21797 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:19:29.370087 21484 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:29.349532 21554 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.187484 21754 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.399523 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1903) took 1006 ms. Trace:
I20260709 13:19:29.376046 21646 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.383204 21567 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.406474 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:29.402038 21795 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.017s	user 0.011s	sys 0.000s
I20260709 13:19:29.398269 21796 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.391434 21860 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:29.474313 21860 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:29.474679 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:29.476194 21820 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.437s	user 0.004s	sys 0.000s
I20260709 13:19:29.476327 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.450891 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:29.399281 21685 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.452529 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1904) took 1059 ms. Trace:
I20260709 13:19:29.521066 17313 rpcz_store.cc:276] 0709 13:19:28.393237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.420035 (+ 26798us) service_pool.cc:224] Handling call
0709 13:19:28.420353 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:28.420705 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.420734 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:28.421265 (+   531us) log.cc:844] Serialized 52 byte log entry
0709 13:19:28.686147 (+264882us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:28.686199 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.686260 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.452293 (+766033us) raft_consensus.cc:1685] finished
0709 13:19:29.452315 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.452460 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2436,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":264530,"threads_started":1,"wal-append.queue_time_us":499571}
I20260709 13:19:29.411134 21720 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:29.395064 21695 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.430078 21791 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:29.452149 17315 rpcz_store.cc:276] 0709 13:19:28.392907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.411073 (+ 18166us) service_pool.cc:224] Handling call
0709 13:19:28.411455 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.411798 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.411828 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.412294 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.677672 (+265378us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:28.677734 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.677843 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.399230 (+721387us) raft_consensus.cc:1685] finished
0709 13:19:29.399259 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.399447 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2937,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":264267,"threads_started":1,"wal-append.queue_time_us":532406}
I20260709 13:19:29.464773 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.409193 21658 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.467046 21824 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:19:29.469401 21401 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.050s	user 0.012s	sys 0.000s
W20260709 13:19:29.470953 21851 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:19:29.471361 21466 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.001s
I20260709 13:19:29.471678 21490 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.452276 21554 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.456534 21473 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.473196 21521 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.578181 21473 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.578686 21521 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.473253 21509 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:29.473506 21796 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.474911 21758 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:29.536811 21867 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:29.387279 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58132.6us
I20260709 13:19:29.474730 21860 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:29.479512 17993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1163) took 1968 ms (client timeout 1675 ms). Trace:
W20260709 13:19:29.588882 17993 rpcz_store.cc:269] 0709 13:19:27.511624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.511786 (+   162us) service_pool.cc:224] Handling call
0709 13:19:29.479290 (+1967504us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001a9854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:29.479437 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2545861376}
I20260709 13:19:29.481341 17468 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:19:29.486406 21793 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:29.490099 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.493281 21645 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:29.441550 21484 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:29.433502 21740 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:19:29.494683 21603 consensus_meta.cc:287] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.000s
I20260709 13:19:29.498690 21655 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:29.500351 21831 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.502228 21759 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:29.504984 21841 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:19:29.554654 21466 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.616864 17393 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:29.618040 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.618959 17393 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:29.619922 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.507539 21754 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:29.509738 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:29.511188 21535 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.111s	user 0.011s	sys 0.001s
I20260709 13:19:29.511837 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3026) took 3244 ms. Trace:
I20260709 13:19:29.609392 21793 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.512252 17990 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:29.513147 21734 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:29.459046 21804 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.516237 21833 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:29.520183 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 69384.3us
I20260709 13:19:29.444597 21743 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:29.492597 21725 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.138s	user 0.008s	sys 0.002s
I20260709 13:19:29.461822 21646 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:29.429360 21691 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.463930 21567 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.545758 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:29.546747 17466 raft_consensus.cc:2410] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:19:29.533632 21830 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.559908 21569 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.560731 21685 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:29.560858 21554 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:29.562953 21490 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.563752 21834 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:29.568825 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:29.653535 17995 raft_consensus.cc:2410] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:19:29.570487 21819 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.535s	user 0.000s	sys 0.003s
I20260709 13:19:29.573035 21695 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:29.538929 21791 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:29.574996 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3009) took 1147 ms. Trace:
I20260709 13:19:29.426585 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:29.657351 17471 rpcz_store.cc:276] 0709 13:19:28.427269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.434583 (+  7314us) service_pool.cc:224] Handling call
0709 13:19:28.434870 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.437059 (+  2189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.437091 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.437136 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:28.437171 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.574770 (+1137599us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b54000636d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:29.574814 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.574938 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4570880}
I20260709 13:19:29.659260 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.581451 17321 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:29.542388 21824 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:29.635504 21833 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:29.586257 21798 consensus_meta.cc:287] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.124s	user 0.005s	sys 0.007s
I20260709 13:19:29.606647 17993 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:29.580786 21521 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:29.585623 21473 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.585134 21758 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:29.611537 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 310364us
I20260709 13:19:29.610767 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.588510 21401 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.687808 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:29.688151 21401 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.688580 17317 raft_consensus.cc:2376] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13. Re-sending same reply.
I20260709 13:19:29.690354 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.590781 21792 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.690994 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.691486 21792 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.592903 21628 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.692999 21628 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.616134 17394 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:29.694875 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3017) took 1104 ms. Trace:
I20260709 13:19:29.505550 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 735) took 1591 ms. Trace:
I20260709 13:19:29.695223 21628 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.695441 17462 rpcz_store.cc:276] 0709 13:19:27.914518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.914671 (+   153us) service_pool.cc:224] Handling call
0709 13:19:29.505389 (+1590718us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54003dfc54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:29.505491 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116116224}
I20260709 13:19:29.696727 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.696885 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.600207 21704 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.697139 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.697427 17465 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8.
I20260709 13:19:29.697535 21704 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.603870 21484 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.698376 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.699450 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.700423 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.700997 21725 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.701510 21725 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.702059 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:29.702617 17991 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.703491 21725 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.505661 21729 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:29.705013 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:29.668141 21834 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.601509 21867 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:29.625504 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.626128 17391 rpcz_store.cc:276] 0709 13:19:26.267666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.822958 (+555292us) service_pool.cc:224] Handling call
0709 13:19:27.196810 (+373852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.229484 (+1032674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.229516 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.514704 (+285188us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b2c0005c228. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:19:28.515175 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.679173 (+163998us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:28.679223 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.679308 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.233146 (+553838us) raft_consensus.cc:1685] finished
0709 13:19:29.233172 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.511677 (+278505us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400012f50. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:29.511786 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1067534,"raft.queue_time_us":1074685,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":10541,"spinlock_wait_cycles":870951168,"thread_start_us":163594,"threads_started":1,"wal-append.queue_time_us":423156}
I20260709 13:19:29.511780 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:29.609534 21848 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:29.611272 21509 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.629979 17396 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
W20260709 13:19:29.713997 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3007) took 1287 ms (client timeout 1511 ms). Trace:
I20260709 13:19:29.714190 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1617) took 2865 ms. Trace:
I20260709 13:19:29.615151 21795 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.714414 17463 rpcz_store.cc:269] 0709 13:19:28.426643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.427381 (+   738us) service_pool.cc:224] Handling call
0709 13:19:29.713823 (+1286442us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400280854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:29.713944 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762450688}
I20260709 13:19:29.632745 17389 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:29.629456 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 312809us
I20260709 13:19:29.722433 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:29.723014 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.722461 21795 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.724257 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:29.636034 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:29.725288 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:29.725582 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 89624.9us
I20260709 13:19:29.725821 21509 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:29.726485 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.726878 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.727476 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:29.727972 21509 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.728286 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:29.728530 21521 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:29.731948 21867 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.611291 21357 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:19:29.639005 21872 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.733922 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.641026 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.734315 21872 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.734745 17392 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
W20260709 13:19:29.657873 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 231423us
I20260709 13:19:29.610894 21777 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.660866 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:29.737555 17471 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:29.576543 21858 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13.
I20260709 13:19:29.601490 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.741744 21872 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:29.742031 17388 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:29.636495 21804 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.632078 21793 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.673149 21569 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.661716 21830 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:29.686043 21850 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.369s	user 0.001s	sys 0.001s
I20260709 13:19:29.686054 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:29.687485 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.704025 21725 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.668294 21554 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.623041 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.780249 17393 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:29.781517 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.782326 17393 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:29.783456 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.688151 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3015) took 1137 ms. Trace:
I20260709 13:19:29.708056 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.785271 17316 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:29.695305 17466 rpcz_store.cc:276] 0709 13:19:28.590713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.590956 (+   243us) service_pool.cc:224] Handling call
0709 13:19:29.694668 (+1103712us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54001afed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:29.694807 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062753536}
I20260709 13:19:29.786463 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.667973 21695 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:29.711186 17360 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:29.714643 17320 rpcz_store.cc:276] 0709 13:19:26.848808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.053840 (+1205032us) service_pool.cc:224] Handling call
0709 13:19:28.054131 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.727241 (+673110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.713948 (+986707us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54000ca8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:29.714132 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447942528}
I20260709 13:19:29.714006 17396 pending_rounds.cc:85] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 8
I20260709 13:19:29.790652 17396 pending_rounds.cc:107] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:19:29.603374 21799 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:19:29.705567 17287 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:29.791211 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 45493.4us
W20260709 13:19:29.791633 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 86151.4us
I20260709 13:19:29.791940 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:29.723150 17992 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:29.733829 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3049) took 1077 ms. Trace:
I20260709 13:19:29.793042 17397 rpcz_store.cc:276] 0709 13:19:28.656378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.681780 (+ 25402us) service_pool.cc:224] Handling call
0709 13:19:29.733661 (+1051881us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b5400015c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:29.733771 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376561408}
I20260709 13:19:29.639379 21658 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.738384 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.642656 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1170) took 1673 ms. Trace:
I20260709 13:19:29.739694 17462 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:29.741302 21849 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:29.715417 21834 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.748713 17996 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:29.813944 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:29.814574 17996 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:29.754192 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.756561 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.768031 17391 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:29.682446 17395 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:29.774887 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:29.817058 17990 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
W20260709 13:19:29.775946 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.818372 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:29.776876 17464 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:29.822810 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.725636 21795 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.760476 21729 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:29.785051 17468 rpcz_store.cc:276] 0709 13:19:28.550869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.551096 (+   227us) service_pool.cc:224] Handling call
0709 13:19:29.687946 (+1136850us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54001f1154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:29.688090 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876963712}
I20260709 13:19:29.789951 17466 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:29.790812 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 79684.7us
I20260709 13:19:29.790946 17396 raft_consensus.cc:2889] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:29.794466 17471 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:29.744922 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:29.812268 17995 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:19:29.814689 17397 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:29.816234 17465 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:29.767768 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3052) took 1110 ms. Trace:
I20260709 13:19:29.815656 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.765411 21754 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:19:29.742915 21804 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.798020 21796 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.839190 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.807305 21509 raft_consensus.cc:2764] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:29.840189 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.865232 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.763042 21685 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:19:29.765547 21689 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:19:29.901916 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:29.770232 21735 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:19:29.794939 17998 rpcz_store.cc:276] 0709 13:19:27.969235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.969358 (+   123us) service_pool.cc:224] Handling call
0709 13:19:28.411651 (+442293us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfeee 0000000000375939 00007f7d677431e0 00007f7d6780c0c4 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:19:28.411798 (+   147us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.415987 (+  4189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.416020 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.416469 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.944361 (+527892us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:28.944417 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.944505 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.639731 (+695226us) raft_consensus.cc:1685] finished
0709 13:19:29.639751 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.642587 (+  2836us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3794,"raft.queue_time_us":4958,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":3141888,"thread_start_us":527440,"threads_started":1,"wal-append.queue_time_us":987554}
I20260709 13:19:29.838234 21401 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:29.864876 17389 rpcz_store.cc:276] 0709 13:19:28.657499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.680967 (+ 23468us) service_pool.cc:224] Handling call
0709 13:19:29.767561 (+1086594us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54004114d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:29.767711 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096012160}
W20260709 13:19:29.875200 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 130385us
I20260709 13:19:29.784770 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.915985 17393 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:29.799583 21725 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.807658 21849 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.887777 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:29.888096 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.888211 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:29.930253 17466 raft_consensus.cc:2376] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10. Re-sending same reply.
I20260709 13:19:29.769989 21734 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:19:29.877647 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:29.894917 17962 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:29.813767 21473 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:29.897872 17388 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:29.900257 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.935243 17471 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:29.935424 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1858) took 1275 ms. Trace:
I20260709 13:19:29.935822 17396 rpcz_store.cc:276] 0709 13:19:28.660381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.941960 (+281579us) service_pool.cc:224] Handling call
0709 13:19:28.949922 (+  7962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.875772 (+925850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.935207 (+ 59435us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54002be154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:29.935368 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563129216}
I20260709 13:19:29.773522 21861 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:19:29.818638 21658 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.903578 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:29.949635 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 46122.2us
I20260709 13:19:29.950846 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:29.951434 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.904042 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.953299 17462 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:19:29.903478 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.954299 17468 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:29.844246 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.705166 21758 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.838585 21792 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:29.911824 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.827555 17991 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:29.912602 21798 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:29.809026 21554 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.987139 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:29.988164 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:29.763315 21857 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 13:19:29.886652 21490 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.896060 21795 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:29.758342 21824 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.936903 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.897156 21705 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:29.942373 17434 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:29.944272 17466 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:19:29.928771 21872 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:29.960455 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 65639.2us
W20260709 13:19:29.958509 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 80980us
I20260709 13:19:29.921430 17964 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:29.939554 21516 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:29.952266 17315 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:30.037782 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.906977 21729 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:29.971510 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:29.856428 21521 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:29.972723 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.973191 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:29.973302 21509 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:29.964948 21740 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:29.974557 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.993788 21535 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:29.837747 21855 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:19:29.978574 17320 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:29.979169 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:29.969974 21715 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:29.970184 21655 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:30.122287 21864 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:30.046572 21641 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:19:30.122611 21831 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:30.123035 21831 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.123171 21641 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:30.123279 21777 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:29.902654 21474 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:19:30.123685 21641 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:30.042441 21872 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.122366 21759 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:30.023193 17466 pending_rounds.cc:85] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 10
I20260709 13:19:30.124905 17466 pending_rounds.cc:107] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:19:30.125191 17466 raft_consensus.cc:2889] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:29.956739 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:30.023710 17396 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:30.125200 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:30.126410 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:30.028589 21798 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:29.997936 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:30.129676 17389 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:30.046799 21509 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.968439 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:29.939184 21849 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:30.042301 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 120921us
I20260709 13:19:30.042657 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:30.042815 17395 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 8.
I20260709 13:19:29.773193 21833 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:29.978636 21804 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:30.137557 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 94977.2us
I20260709 13:19:30.049523 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:30.109369 21729 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.137585 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:30.139644 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:30.140313 17395 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:29.970922 21658 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.037873 21705 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.103488 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:30.051241 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 303210us
I20260709 13:19:30.104171 21866 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:29.989661 21795 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:30.117794 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 129670us
I20260709 13:19:30.109866 21704 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.109046 21722 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.221626 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:29.945300 21603 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
W20260709 13:19:30.120131 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 148672us
I20260709 13:19:30.123438 21831 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:29.980749 21834 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.127008 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:30.026687 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:30.226539 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:30.227387 17321 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:30.227763 17396 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:30.124933 21875 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
W20260709 13:19:30.036206 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 66197.1us
W20260709 13:19:30.120494 21860 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
W20260709 13:19:30.229158 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.229074 21860 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:29.994426 21490 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.135886 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:30.237969 17393 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:30.239056 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:29.982923 21691 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.144928 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:30.146871 17322 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:30.149326 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:30.149744 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.139014 21740 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:30.151398 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:30.248416 17462 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:30.124591 21641 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.249310 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:30.249991 17462 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:30.161104 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.251380 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:30.251472 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.128667 21591 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:30.252708 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.225486 21830 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:30.128268 21877 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:19:30.049288 21735 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:30.231040 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:30.266435 21735 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.266642 21705 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.231256 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:30.267005 21735 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.133669 21509 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.133313 21872 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.146970 21793 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:30.150691 21824 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.151396 21795 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:30.284206 17462 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:30.246759 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:30.244011 17389 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:30.222105 21535 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.243520 17316 raft_consensus.cc:606] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:30.256588 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:30.136484 21791 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.224797 21866 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:30.265784 21881 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:19:30.309279 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:30.248718 21883 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:19:30.272060 21715 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:30.271893 21740 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.240132 21834 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.288059 17322 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:30.271456 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:30.322634 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:30.338418 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 102855us
I20260709 13:19:30.338625 17462 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:30.249513 21722 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.264698 21855 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:19:30.285871 21641 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.359191 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:30.365581 17467 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:30.366544 17466 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:30.368630 17470 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:30.310336 21866 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:30.369177 17462 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:19:30.372246 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 120859us
I20260709 13:19:30.372794 17462 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:19:30.374938 17467 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:19:30.376076 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 226440us
I20260709 13:19:30.339713 17286 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:19:30.355909 21885 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:19:30.368980 21484 consensus_meta.cc:287] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.002s
I20260709 13:19:30.379848 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.340500 21740 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:30.272310 21798 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.317946 21535 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.382545 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:30.384609 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 44968.9us
I20260709 13:19:30.390568 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.377449 21715 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.343467 21834 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.381486 21648 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:30.384485 21740 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.409114 21834 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.387375 21759 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:30.413885 21834 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:30.399077 21837 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.480s	user 0.014s	sys 0.000s
I20260709 13:19:30.422926 21756 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:30.426810 21706 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:30.429996 21791 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:30.432267 17471 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:19:30.432996 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 439201us
W20260709 13:19:30.433892 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 491540us
I20260709 13:19:30.451433 21472 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:30.402604 21867 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:30.453078 21777 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:30.453464 21867 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:30.453550 21777 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.454053 21777 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.454360 21867 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:30.456527 21890 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:19:30.418067 21743 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.779s	user 0.009s	sys 0.000s
I20260709 13:19:30.438372 17469 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:30.439828 17464 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:30.389508 21723 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:19:30.492983 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:30.442958 21648 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:30.445041 21687 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.395884 21554 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.456718 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:30.439409 21884 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:19:30.447353 17997 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:30.396919 21715 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.553241 21715 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.553423 21848 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:30.553879 21848 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:30.554263 21848 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:30.383980 21484 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.558996 21484 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:30.559759 21569 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.792s	user 0.005s	sys 0.004s
I20260709 13:19:30.481395 21860 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:30.439381 21509 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:30.565538 21899 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
W20260709 13:19:30.567248 21646 consensus_meta.cc:287] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.924s	user 0.011s	sys 0.000s
I20260709 13:19:30.465337 17471 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:30.480257 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:30.461099 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:30.470878 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:30.470402 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:30.438596 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.480649 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:30.439144 21896 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:30.492627 21892 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.102s	user 0.001s	sys 0.001s
W20260709 13:19:30.541257 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 84605us
I20260709 13:19:30.461735 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:30.446825 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 64419.4us
I20260709 13:19:30.584327 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:30.585530 17434 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:30.585930 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.586385 21793 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:30.537354 21567 consensus_meta.cc:287] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.875s	user 0.009s	sys 0.002s
I20260709 13:19:30.529764 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:30.543993 21535 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:30.590018 21357 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.567734 21646 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.590523 21357 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:30.590962 21357 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.543927 21687 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.592471 21646 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:30.476330 21834 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:30.597398 21834 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.598031 21849 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.599272 17993 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:30.599675 21834 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.543761 21722 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:30.448312 21756 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:30.458683 21706 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:30.574970 17390 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
W20260709 13:19:30.525621 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.586406 17434 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:30.580363 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.581040 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 181302us
I20260709 13:19:30.605335 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.496168 21628 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:19:30.588635 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 59002.8us
I20260709 13:19:30.607414 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:30.586673 21569 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:30.588485 21689 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:30.470120 21859 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.626410 21859 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.629216 21857 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:30.629822 21857 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:30.630295 21857 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.630744 21722 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.631274 21722 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.632274 21401 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:30.633157 21401 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:30.633353 21722 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:30.633528 21401 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:30.633741 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3030) took 1205 ms. Trace:
I20260709 13:19:30.633910 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.634290 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.634466 21401 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.634927 17992 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:30.635180 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.633273 21490 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:30.635768 21401 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:30.593112 21687 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.639088 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.639845 17999 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:30.593237 21509 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:30.593541 21567 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.593673 21866 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.588169 21793 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.594722 21901 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.594831 21648 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.525888 21466 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:30.537767 21804 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.606613 21869 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.641242 21759 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:30.587574 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.612504 17471 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:30.707587 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.614333 17464 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:30.708667 17992 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:30.618268 21706 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.619359 21799 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.641675 21569 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:30.620920 21756 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.636632 21490 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.635771 17996 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:30.654623 21845 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:30.644110 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.710951 21759 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:30.646718 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.646657 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:30.647543 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:30.732642 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 86134.6us
I20260709 13:19:30.732993 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.648427 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 821) took 1682 ms. Trace:
I20260709 13:19:30.733747 17962 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.733713 17997 rpcz_store.cc:276] 0709 13:19:28.965630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.965759 (+   129us) service_pool.cc:224] Handling call
0709 13:19:30.648255 (+1682496us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400396554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:30.648370 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3146847104}
I20260709 13:19:30.734984 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.634168 17470 rpcz_store.cc:276] 0709 13:19:29.428580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.516051 (+ 87471us) service_pool.cc:224] Handling call
0709 13:19:29.516335 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.377801 (+861466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.633519 (+255718us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b5400383bd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:30.633684 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899988864}
I20260709 13:19:30.656364 21859 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.658507 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:30.741719 17318 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
W20260709 13:19:30.710404 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 66698.3us
I20260709 13:19:30.710947 17315 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:30.620164 21858 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:30.717743 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 130236us
I20260709 13:19:30.717649 21799 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.653659 21793 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.648013 21641 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:30.727788 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.635870 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.729336 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.645222 21860 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:19:30.537637 21743 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.706792 21473 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:19:30.736544 17321 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:19:30.768625 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:30.769519 17321 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:30.770673 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:30.739027 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:30.739809 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.771862 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.653717 21791 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:19:30.715318 17317 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:30.740733 21722 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.740909 21729 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.747154 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:30.777892 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:30.723492 21856 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:19:30.747407 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:30.784273 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:30.785111 17392 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.748436 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:30.748798 21715 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.741551 21845 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.749992 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:30.737195 21490 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.750982 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.745004 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:30.751561 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.654901 21485 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:19:30.722069 21798 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:30.725863 21569 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:30.762015 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.722934 21516 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:30.763741 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:30.774855 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.774807 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:30.717757 21687 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:19:30.736804 21472 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:30.722375 21645 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:30.783003 17388 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:30.829424 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:30.830075 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:30.762858 21799 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.761685 21756 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:30.786046 17389 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:30.818526 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 67609.4us
I20260709 13:19:30.848500 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.820550 17996 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:30.821003 17992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:48172
I20260709 13:19:30.850852 17992 raft_consensus.cc:606] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:30.823216 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 71752.6us
I20260709 13:19:30.852092 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:30.762025 21855 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:19:30.832362 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 82486.1us
I20260709 13:19:30.857492 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:30.857733 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:30.857913 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:30.833755 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 59035.2us
I20260709 13:19:30.859166 21905 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.859699 21905 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.859534 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:30.839232 17392 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:30.860894 17462 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:30.861519 17392 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:30.776814 21720 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.777024 21723 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.864969 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:30.710842 21869 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.844873 21866 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.845134 21715 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.776855 21641 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:30.846772 17397 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:30.766927 21901 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.762900 21849 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:30.850018 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:30.898716 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48804.3us
I20260709 13:19:30.899528 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:30.860159 21905 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.796656 21567 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:30.824767 21516 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.825755 21466 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.795795 21904 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.847440 21691 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:30.866222 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:30.762192 21858 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.872642 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:30.852732 21798 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:30.901539 21509 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.902004 21896 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:30.865968 21628 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.904022 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.934206 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.891250 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.873430 21705 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:30.895123 21907 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:19:30.840593 21472 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.842041 21357 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.873684 21646 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.918838 21691 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.874022 21720 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:30.932610 21735 consensus_meta.cc:287] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.001s
I20260709 13:19:30.939062 21535 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:30.962024 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:30.920924 21509 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.874264 21723 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.951061 21473 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:30.920277 21689 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:30.948709 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 57558.5us
I20260709 13:19:30.916216 21740 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:30.957674 21910 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:19:30.951916 21502 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:30.917960 21834 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:19:30.972182 17465 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:30.941975 21896 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:30.972646 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:30.978576 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:30.990774 17992 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:30.945770 21484 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:30.950241 21691 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.946376 21646 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:30.964148 21735 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:30.987414 17389 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:30.933183 21874 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:30.979233 21509 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:30.972640 21824 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
I20260709 13:19:30.999869 21502 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:31.017499 21906 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:19:31.019058 21502 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:31.019707 21920 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:31.020128 17990 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:19:31.020555 17990 pending_rounds.cc:85] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 9
I20260709 13:19:31.020817 17990 pending_rounds.cc:107] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 14.10
W20260709 13:19:31.021044 21913 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:19:31.021229 17990 raft_consensus.cc:2889] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:30.993222 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:30.959081 21705 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.980765 21849 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:30.971748 21473 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:30.987905 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 121789us
I20260709 13:19:31.030114 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:30.909027 21901 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:30.983343 21904 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:30.999464 21848 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:31.017140 21909 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:19:31.019166 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1781) took 1275 ms. Trace:
I20260709 13:19:31.068009 17470 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
W20260709 13:19:31.023418 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.941817 21798 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:19:30.973788 21689 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:30.983304 21715 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:30.940189 21628 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.025297 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:31.006811 21646 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.020160 21920 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:31.077054 17388 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:31.051079 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1867) took 1451 ms. Trace:
I20260709 13:19:31.068159 17466 rpcz_store.cc:276] 0709 13:19:29.743977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.375705 (+631728us) service_pool.cc:224] Handling call
0709 13:19:30.383249 (+  7544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.491051 (+107802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.491538 (+   487us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.492101 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.669230 (+177129us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:30.730253 (+ 61023us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.736591 (+  6338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.736681 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.018951 (+282270us) raft_consensus.cc:1685] finished
0709 13:19:31.018973 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.019104 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102596,"prepare.queue_time_us":60838,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":123395,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":7666,"thread_start_us":131024,"threads_started":1,"wal-append.queue_time_us":216773}
I20260709 13:19:31.077770 17394 rpcz_store.cc:276] 0709 13:19:29.599500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.694897 (+ 95397us) service_pool.cc:224] Handling call
0709 13:19:29.738251 (+ 43354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.738692 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.738734 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.739273 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.908422 (+169149us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:30.131958 (+223536us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.132210 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.132274 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.132308 (+    34us) raft_consensus.cc:1685] finished
0709 13:19:30.132319 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.050805 (+918486us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b5400015c50. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:31.051002 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":369758,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":7960,"raft.queue_time_us":19153,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":17989,"spinlock_wait_cycles":98863360,"thread_start_us":296733,"threads_started":2,"wal-append.queue_time_us":204011}
I20260709 13:19:31.064410 21466 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:31.058180 21824 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.086505 21628 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.059058 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:19:31.061642 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 711) took 2658 ms (client timeout 2140 ms). Trace:
W20260709 13:19:31.062745 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 118712us
W20260709 13:19:31.088182 17390 rpcz_store.cc:269] 0709 13:19:28.402760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.408962 (+  6202us) service_pool.cc:224] Handling call
0709 13:19:31.061394 (+2652432us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b540023cdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:31.061536 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4945798400}
I20260709 13:19:31.089920 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:31.090427 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:31.065686 17999 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:31.074271 17313 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:19:31.092229 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:31.065623 21894 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:31.049402 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 768) took 1175 ms. Trace:
I20260709 13:19:31.100234 17314 rpcz_store.cc:276] 0709 13:19:29.874074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.874653 (+   579us) service_pool.cc:224] Handling call
0709 13:19:29.874949 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.982024 (+107075us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:29.982368 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.235063 (+252695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:30.235135 (+    72us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:30.235190 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.049060 (+813870us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400274f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:31.049129 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.049324 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11160,"prepare.queue_time_us":7350,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":10763,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":5123,"spinlock_wait_cycles":245612416,"thread_start_us":241635,"threads_started":1,"wal-append.queue_time_us":307510}
I20260709 13:19:31.054497 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:31.103106 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48728.6us
I20260709 13:19:31.103865 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:31.104511 21870 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:31.104632 21734 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:31.104988 21870 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.041043 21473 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.105402 21870 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.067216 21904 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.983561 21641 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.107580 21904 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.068315 21845 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:31.077183 21715 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:31.114627 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 89449.1us
I20260709 13:19:31.115803 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:31.070842 21911 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:19:31.091416 17390 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
W20260709 13:19:31.074652 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 44646.4us
I20260709 13:19:31.095280 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:31.096324 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:31.129227 17389 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:31.097204 21858 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.068472 21490 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.080389 21920 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.118767 21793 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.121057 21722 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:31.064742 21705 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.064220 21849 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.129969 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:31.045953 21743 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.082847 21466 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.136238 21917 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:31.135010 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:31.091570 21924 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:31.100090 21628 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:31.125339 21912 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:19:31.087489 21824 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.136873 21845 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:31.143711 21901 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:31.084544 21896 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.147679 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:31.149531 21735 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:31.150746 21473 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.150831 21904 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.153667 21474 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:31.155468 21793 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:31.155665 21567 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:31.156266 21722 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:31.158223 17962 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:31.158413 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:31.182494 17392 raft_consensus.cc:2376] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 8. Re-sending same reply.
I20260709 13:19:31.167614 21917 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.161314 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:31.161676 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:31.161942 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:31.135651 21648 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.125473 21715 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:31.139081 21858 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:19:31.172755 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:31.159767 21466 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:31.171547 21795 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.853s	user 0.010s	sys 0.002s
I20260709 13:19:31.166951 21924 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.179219 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:31.148267 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:31.212945 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 52366.4us
I20260709 13:19:31.219633 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:31.223083 17390 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.223855 17464 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:31.185716 21777 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.003s
I20260709 13:19:31.223990 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:31.224485 17462 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.225060 17471 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:31.177865 21357 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:31.267196 17314 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
W20260709 13:19:31.228629 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 118559us
I20260709 13:19:31.261445 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:31.263067 21831 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.021s	user 0.006s	sys 0.005s
W20260709 13:19:31.264696 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 116510us
I20260709 13:19:31.265151 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 1926) took 1273 ms. Trace:
I20260709 13:19:31.274257 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:31.274008 17315 rpcz_store.cc:276] 0709 13:19:29.991941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.037522 (+ 45581us) service_pool.cc:224] Handling call
0709 13:19:31.264897 (+1227375us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b5400212854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:31.265080 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546253184}
I20260709 13:19:31.265654 17466 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:31.267338 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.269130 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:31.269608 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:31.514566 17360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.635s (SENT) [suppressed 16 similar messages]
I20260709 13:19:31.358816 21725 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.520056 21357 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:31.516427 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:31.576447 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60109.6us
I20260709 13:19:31.579419 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:31.579934 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:31.580250 21935 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:31.509935 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 234065us
I20260709 13:19:31.526799 17389 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:31.580713 21935 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.584323 21935 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:31.272541 21889 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.269s
I20260709 13:19:31.277149 21923 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:31.265978 21845 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:31.222977 21734 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:31.264118 21924 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:31.272245 21872 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:31.336177 21928 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:31.184556 21870 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.318300 21918 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.178293 21799 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:31.306861 21857 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.676s	user 0.000s	sys 0.012s
I20260709 13:19:31.530905 21658 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:31.517936 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:31.272632 21831 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:31.514997 21401 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.879s	user 0.008s	sys 0.004s
I20260709 13:19:31.271293 21777 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:31.513289 21804 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.802s	user 0.001s	sys 0.015s
I20260709 13:19:31.319720 21848 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:31.536926 21759 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.784s	user 0.008s	sys 0.008s
W20260709 13:19:31.539875 21888 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.142s	user 0.000s	sys 0.003s
I20260709 13:19:31.269865 21795 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.662912 21928 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:31.698858 21795 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.541890 21689 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.699321 21928 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.545379 17464 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:31.700910 21831 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.701223 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3031) took 2207 ms. Trace:
I20260709 13:19:31.701648 21938 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:31.701835 21931 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.542811 21920 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.702194 21938 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.548748 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:31.184703 21567 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:31.661381 21725 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:31.232093 21720 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:31.221040 21535 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.222736 21723 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:31.556237 21473 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:31.201646 21740 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:31.199039 21917 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:31.556730 21738 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:31.201918 21735 consensus_queue.cc:1059] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:19:31.558792 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:31.735818 17392 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.572576 17390 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:31.737578 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:31.583846 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:31.738581 17389 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:31.739499 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:31.740021 17389 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:31.527997 21933 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:31.585738 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.585979 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 316481us
I20260709 13:19:31.741529 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:31.593273 21904 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.749806 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:19:31.607744 21569 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.767s	user 0.009s	sys 0.000s
W20260709 13:19:31.610750 21516 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.691s	user 0.006s	sys 0.003s
I20260709 13:19:31.613709 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:31.596089 21896 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:31.759860 21896 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.759369 21920 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:31.760555 21896 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.621299 17996 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:31.617386 21466 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.764415 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:31.765059 21466 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.765277 21936 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:31.576900 21758 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.765784 21936 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.766165 21936 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.635969 21870 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.594882 21874 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:31.576113 21357 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:31.638929 21509 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.000s
W20260709 13:19:31.645515 21646 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.005s
I20260709 13:19:31.686810 17998 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:31.690580 17396 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:19:31.778122 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:31.698930 21777 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:31.700068 17467 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:31.537652 17462 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
W20260709 13:19:31.544690 21905 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.624s	user 0.013s	sys 0.000s
W20260709 13:19:31.552178 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 277982us
I20260709 13:19:31.708433 21868 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:31.701676 17463 rpcz_store.cc:276] 0709 13:19:29.494086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.899729 (+405643us) service_pool.cc:224] Handling call
0709 13:19:29.920471 (+ 20742us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:29.933246 (+ 12775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.933290 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:29.933937 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 13:19:30.152459 (+218522us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:30.152512 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.152602 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.539197 (+1386595us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:31.700904 (+161707us) raft_consensus.cc:1685] finished
0709 13:19:31.700924 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.701144 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22885,"raft.queue_time_us":4654,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13629,"spinlock_wait_cycles":7779584,"thread_start_us":175383,"threads_started":1,"wal-append.queue_time_us":396841}
I20260709 13:19:31.720810 21725 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.711308 21938 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:31.702467 21931 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.681319 21705 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.690404 21804 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:31.721623 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 207078us
I20260709 13:19:31.805377 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:31.742533 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:31.778929 21930 raft_consensus.cc:3055] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:31.721939 21691 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.711s	user 0.013s	sys 0.001s
I20260709 13:19:31.703436 21824 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:31.655755 21857 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.756942 17393 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:31.758544 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:31.808748 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:31.758965 21516 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.759294 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:31.791483 21868 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:31.614621 21849 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:31.766785 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.731594 21738 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.769476 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:31.823895 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:31.824155 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 54751.3us
I20260709 13:19:31.703519 21759 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.779769 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:31.828593 17462 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:31.788203 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:31.774056 21935 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.757825 21919 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:31.719359 21535 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.789590 21509 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.841874 17463 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:31.802940 17392 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:31.846464 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:31.847085 17392 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:31.773792 21357 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.771040 21874 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.806450 17389 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:31.675917 21918 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.808753 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:31.809147 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:31.772433 21740 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:31.798218 21756 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.945s	user 0.012s	sys 0.006s
I20260709 13:19:31.818634 17388 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.777908 21646 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.819875 17315 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:31.767859 21569 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.723011 21845 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.720346 21734 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.825328 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:31.824384 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:31.869959 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 86905.1us
I20260709 13:19:31.871083 17320 raft_consensus.cc:2368] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11.
I20260709 13:19:31.824527 17316 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:31.827672 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:31.710287 21567 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:31.838426 17462 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:19:31.873195 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:31.873965 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:31.837616 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:31.848490 21705 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:31.850405 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:31.853384 21874 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.851799 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:31.877902 17389 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:31.831139 21938 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.829973 21473 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:31.829311 21738 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:31.865329 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.867300 21931 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:31.838368 21919 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.886438 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:31.791739 21905 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.867596 17393 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:31.869359 17468 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:19:31.851099 21777 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:19:31.892567 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:31.816752 21691 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:31.873241 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45659.4us
I20260709 13:19:31.892586 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:31.894688 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:31.894958 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:31.895398 17393 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.876248 17994 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.878315 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:31.813740 21930 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:31.857295 21795 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.876799 21848 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:31.893219 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:31.879997 21756 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.904131 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1636) took 2199 ms. Trace:
I20260709 13:19:31.881201 17462 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:31.904412 17319 rpcz_store.cc:276] 0709 13:19:29.696122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.708524 (+ 12402us) service_pool.cc:224] Handling call
0709 13:19:29.715634 (+  7110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.715986 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.716022 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.744405 (+ 28383us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.926686 (+182281us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:29.926727 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.926792 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.560867 (+634075us) raft_consensus.cc:1685] finished
0709 13:19:30.560891 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.889112 (+1328221us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b54003e17d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:31.895571 (+  6459us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29988,"raft.queue_time_us":79,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":20668,"spinlock_wait_cycles":15586688,"thread_start_us":128942,"threads_started":1,"wal-append.queue_time_us":338205,"wal-append.run_cpu_time_us":5503,"wal-append.run_wall_time_us":1455247}
I20260709 13:19:31.905790 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:31.906303 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:31.888012 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:31.879331 21940 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:19:31.908250 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:31.872597 17313 raft_consensus.cc:2410] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:19:31.884765 21401 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.897944 21691 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:31.898499 17465 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:31.914196 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:31.899550 21937 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:31.893926 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:31.883749 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:31.891817 21567 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.906555 17462 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:31.860110 21799 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:31.907282 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:31.887797 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:31.888253 21919 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.921378 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:31.920677 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:31.880417 21948 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:31.886270 21473 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:31.900512 21943 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:31.913549 17320 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:19:31.898933 21831 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:31.915129 17392 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:31.864313 21740 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.915326 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:31.938819 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:31.879364 21466 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:19:31.922004 17468 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:31.921525 21931 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:31.908018 21705 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:31.883256 21938 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.912002 21848 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.933023 21932 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:31.935846 21472 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:31.941819 21947 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:19:31.922355 17462 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:31.944578 21895 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.431s	user 0.000s	sys 0.003s
I20260709 13:19:31.949348 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:31.908241 21795 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.929255 21935 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:31.911909 21756 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.962960 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:31.915843 21401 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.957249 17320 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:31.955133 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:32.026119 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 71064.3us
I20260709 13:19:31.950747 21849 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.963311 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:31.972642 21831 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:31.936609 21473 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:31.950294 21804 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:32.014905 17313 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:31.955543 21950 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:31.953955 21725 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.023177 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:32.046603 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:32.032753 17388 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:31.961328 21931 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:31.963691 21918 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.018226 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:31.961556 21705 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:32.041333 21948 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.013556 21516 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.045100 17998 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:32.021564 21735 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:32.051054 17393 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:32.069044 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:32.069579 17393 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.044173 21857 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:32.010007 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60797.1us
I20260709 13:19:32.055529 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:32.056597 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:32.045917 21648 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.003s
I20260709 13:19:32.015923 17994 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:32.040206 21831 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:32.060474 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:32.058215 21725 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.062650 17993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 822) took 2377 ms (client timeout 1635 ms). Trace:
I20260709 13:19:32.059839 21948 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.066912 17999 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:19:32.052073 21646 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.073244 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:32.078480 17319 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:32.085598 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:32.086822 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:32.087446 17319 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:32.089082 21729 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.089526 21953 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:19:32.089629 21729 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.090447 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:32.091055 17990 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:32.091234 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:32.091877 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:32.092351 21946 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:19:32.092610 17990 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:32.091943 17992 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:32.092990 21905 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:32.093364 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:32.093623 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:32.093917 17990 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:32.094328 21914 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.134s	user 0.001s	sys 0.001s
I20260709 13:19:32.094487 17992 raft_consensus.cc:2410] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:32.095252 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:32.095677 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 731) took 1668 ms. Trace:
I20260709 13:19:32.095875 17992 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:32.096036 17397 rpcz_store.cc:276] 0709 13:19:30.427040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.427324 (+   284us) service_pool.cc:224] Handling call
0709 13:19:30.427690 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.895027 (+467337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.095457 (+1200430us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54004128d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:32.095627 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963255552}
I20260709 13:19:32.079752 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:32.097121 17392 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:32.097337 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:32.097925 17397 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 5.
W20260709 13:19:32.079670 17993 rpcz_store.cc:269] 0709 13:19:29.685578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.685774 (+   196us) service_pool.cc:224] Handling call
0709 13:19:32.062489 (+2376715us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400472a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:32.062601 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898406144}
I20260709 13:19:32.064474 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:32.098819 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:32.099470 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:32.099843 17320 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 8.
I20260709 13:19:32.100170 17464 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:32.098814 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:32.090137 21931 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.091945 21729 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:32.101415 17397 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:32.096603 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:32.088052 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:32.104389 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:32.104163 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:32.060738 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:32.108875 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:32.078810 21648 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:32.112740 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:32.072009 21950 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:31.963197 21930 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.079264 21641 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:19:32.072700 21889 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:19:32.082877 21725 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.113287 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:32.097286 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:32.083714 21948 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.124091 17392 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:19:32.120689 17462 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:32.125469 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1879) took 1379 ms. Trace:
I20260709 13:19:32.125941 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1187) took 1983 ms. Trace:
W20260709 13:19:32.139346 21934 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.432s	user 0.001s	sys 0.001s
I20260709 13:19:32.126720 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:32.127437 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:32.128055 17990 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:32.194675 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:32.158391 17360 leader_election.cc:400] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11.
I20260709 13:19:32.180454 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:32.102104 21734 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:32.143155 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:32.133487 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:32.078732 21917 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:32.170750 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 44416.5us
I20260709 13:19:32.276257 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:32.282303 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.269219 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:32.283924 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:32.284518 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:32.198961 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:32.285508 17462 raft_consensus.cc:2410] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:19:32.199563 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 85388.5us
I20260709 13:19:32.285772 17991 rpcz_store.cc:276] 0709 13:19:30.142165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.142686 (+   521us) service_pool.cc:224] Handling call
0709 13:19:30.143067 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:30.143508 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.143548 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:30.144245 (+   697us) log.cc:844] Serialized 52 byte log entry
0709 13:19:30.387242 (+242997us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:30.387282 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.387351 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.872274 (+1484923us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:32.099142 (+226868us) raft_consensus.cc:1685] finished
0709 13:19:32.099163 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.125881 (+ 26718us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6010,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":70103,"spinlock_wait_cycles":27894656,"thread_start_us":149705,"threads_started":1,"wal-append.queue_time_us":242119}
I20260709 13:19:32.276335 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:32.288328 17397 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:32.208161 17394 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
W20260709 13:19:32.179551 21916 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.130s	user 0.009s	sys 0.000s
I20260709 13:19:32.306073 17394 pending_rounds.cc:85] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 6
I20260709 13:19:32.313627 17394 pending_rounds.cc:107] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:19:32.313723 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:32.314306 17394 raft_consensus.cc:2889] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:32.315397 17320 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 9: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:32.305219 17360 leader_election.cc:403] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:32.205957 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1934) took 1596 ms. Trace:
I20260709 13:19:32.238905 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:32.317072 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 158821us
I20260709 13:19:32.309379 21655 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:32.318463 21691 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:32.319141 21777 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:32.320264 21777 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:32.320590 21777 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:32.321430 21777 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:32.322180 21955 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:19:32.323014 21777 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.133440 21894 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:32.309651 17468 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:32.319455 21798 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.319443 21935 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:32.128405 21848 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:32.316608 17322 rpcz_store.cc:276] 0709 13:19:30.609327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.609464 (+   137us) service_pool.cc:224] Handling call
0709 13:19:30.609833 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.611815 (+  1982us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:30.641181 (+ 29366us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.920039 (+278858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:30.920104 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:30.920160 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.205644 (+1285484us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b54003fbbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:32.205711 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.205882 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1903,"prepare.queue_time_us":29592,"prepare.run_cpu_time_us":9039,"prepare.run_wall_time_us":55500,"raft.queue_time_us":73434,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2473,"spinlock_wait_cycles":4061056,"thread_start_us":276511,"threads_started":2,"wal-append.queue_time_us":295528,"wal-append.run_cpu_time_us":2184,"wal-append.run_wall_time_us":1233265}
I20260709 13:19:32.271248 21793 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:32.332769 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:32.359869 17993 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:32.332029 17313 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:32.284099 17395 rpcz_store.cc:276] 0709 13:19:30.746473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.753738 (+  7265us) service_pool.cc:224] Handling call
0709 13:19:30.754048 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.762855 (+  8807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.762885 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.763667 (+   782us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.870155 (+106488us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:30.870209 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.870297 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:32.093861 (+1223564us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:32.099369 (+  5508us) raft_consensus.cc:1685] finished
0709 13:19:32.099389 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.125404 (+ 26015us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8390,"raft.queue_time_us":8549,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":11843,"spinlock_wait_cycles":6672768,"thread_start_us":105789,"threads_started":1,"wal-append.queue_time_us":156532}
I20260709 13:19:32.140831 21628 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.126477 21861 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:32.129539 21866 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:32.125896 21905 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:32.134159 21956 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:32.317834 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:32.338263 21894 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:32.343354 17321 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:32.352293 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:32.260445 21938 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.195163 21729 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:32.228479 21720 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.141577 21466 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:32.361315 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:32.363322 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:32.467579 17397 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:32.137477 21831 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.332768 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:32.471464 17991 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:32.312369 21950 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.310356 21648 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.365706 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:32.346753 21798 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.357812 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:32.487922 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1891) took 1226 ms. Trace:
W20260709 13:19:32.488157 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 130404us
I20260709 13:19:32.365167 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:32.342490 21715 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.066s	user 0.012s	sys 0.001s
I20260709 13:19:32.368782 17395 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:32.495739 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3073) took 1337 ms. Trace:
I20260709 13:19:32.496080 17395 rpcz_store.cc:276] 0709 13:19:31.158259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.362143 (+1203884us) service_pool.cc:224] Handling call
0709 13:19:32.362454 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.495479 (+133025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.495680 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:32.497076 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:32.497879 17395 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:32.337911 21758 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11.
I20260709 13:19:32.336930 21516 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:32.342129 21691 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:32.124294 17393 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:32.502504 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3075) took 1343 ms. Trace:
W20260709 13:19:32.502532 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 218678us
I20260709 13:19:32.503054 17393 rpcz_store.cc:276] 0709 13:19:31.158720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.501763 (+1343043us) service_pool.cc:224] Handling call
0709 13:19:32.502047 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.502214 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.502238 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:32.502280 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:32.502314 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.502364 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.502452 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:32.459136 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:32.342231 21935 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:32.144634 21896 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.235494 21357 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.362592 21918 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:32.486142 21831 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:32.463657 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 145895us
W20260709 13:19:32.513008 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.465224 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 153572us
I20260709 13:19:32.359985 21793 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:32.137815 21705 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.260002 21706 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.469285 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 881) took 1823 ms. Trace:
I20260709 13:19:32.273799 21874 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.369325 21866 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:32.482429 17991 raft_consensus.cc:2410] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:32.482980 17397 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:32.374851 21905 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:32.366067 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:32.489962 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3066) took 2739 ms. Trace:
W20260709 13:19:32.491003 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.490499 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:32.490001 17462 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:32.488495 17388 rpcz_store.cc:276] 0709 13:19:31.261431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.548443 (+287012us) service_pool.cc:224] Handling call
0709 13:19:32.487701 (+939258us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540023d2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:32.487849 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264517376}
I20260709 13:19:32.497766 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:32.503753 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:32.470108 21960 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:32.401933 21628 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.557193 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:32.498471 21859 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:32.515878 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:32.475248 21720 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.515971 17393 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:32.571125 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3077) took 1411 ms. Trace:
I20260709 13:19:32.520928 17390 raft_consensus.cc:2368] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12.
I20260709 13:19:32.571480 17393 rpcz_store.cc:276] 0709 13:19:31.159218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.504031 (+1344813us) service_pool.cc:224] Handling call
0709 13:19:32.515748 (+ 11717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.570851 (+ 55103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.571062 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:32.475407 21466 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.470329 21729 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.522390 21725 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.530622 21918 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:32.512705 21516 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:32.540328 21919 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.614s	user 0.000s	sys 0.007s
I20260709 13:19:32.611513 21918 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.544946 17993 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:32.493810 21648 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.546060 17391 rpcz_store.cc:276] 0709 13:19:29.750642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.971856 (+221214us) service_pool.cc:224] Handling call
0709 13:19:30.023900 (+ 52044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.133720 (+109820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.133753 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:30.133801 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:30.133833 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.489667 (+2355834us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54004132d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:32.489737 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.489890 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252093696}
I20260709 13:19:32.547253 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3074) took 1388 ms. Trace:
I20260709 13:19:32.614513 17397 rpcz_store.cc:276] 0709 13:19:31.158491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.468186 (+1309695us) service_pool.cc:224] Handling call
0709 13:19:32.475028 (+  6842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.546910 (+ 71882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.547173 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:32.553279 17389 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.552460 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:32.554452 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 64043.5us
I20260709 13:19:32.558374 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:32.556210 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:32.619258 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 63137.9us
I20260709 13:19:32.620528 21729 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.565835 21956 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:32.621014 17990 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.567363 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:32.620600 21648 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:32.622362 21869 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:32.568570 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51561.7us
I20260709 13:19:32.623224 21971 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.623757 21971 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:32.625689 21738 consensus_meta.cc:287] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.004s
W20260709 13:19:32.569686 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 66087.7us
I20260709 13:19:32.574054 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:32.626518 17462 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:32.574918 21896 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.551980 21905 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.627626 21725 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.631870 17990 raft_consensus.cc:2410] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:32.576931 21628 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:32.511915 21861 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:32.580349 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 64599.8us
I20260709 13:19:32.585806 21720 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:32.587232 21357 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:32.593142 21959 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.593016 21866 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.594111 21917 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.595607 21874 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:32.598290 21466 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:32.597910 21793 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:32.599264 21849 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.560s	user 0.004s	sys 0.005s
I20260709 13:19:32.652402 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:32.600410 21936 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.834s	user 0.001s	sys 0.010s
W20260709 13:19:32.601394 21924 consensus_meta.cc:287] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.964s	user 0.011s	sys 0.001s
I20260709 13:19:32.571022 21935 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.557159 21960 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.655220 21960 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.557826 21961 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:32.501483 21894 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.572396 21964 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:32.606812 21948 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.611801 21919 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.520267 17997 rpcz_store.cc:276] 0709 13:19:30.645973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.742491 (+ 96518us) service_pool.cc:224] Handling call
0709 13:19:30.761644 (+ 19153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.761968 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.761998 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.762423 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.918414 (+155991us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:30.918454 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.918522 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:32.109991 (+1191469us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:32.463801 (+353810us) raft_consensus.cc:1685] finished
0709 13:19:32.463821 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.469223 (+  5402us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":650,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":12729,"spinlock_wait_cycles":30502784,"thread_start_us":77536,"threads_started":1,"wal-append.queue_time_us":174429}
I20260709 13:19:32.622290 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:32.664448 17994 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.498947 21715 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.628463 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:32.630010 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:32.632369 21868 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.637495 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:32.686092 17462 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:32.638859 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:32.639006 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:32.622315 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:32.687139 17393 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.643904 17389 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:32.693164 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:32.693554 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:32.693907 17316 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:32.694957 17389 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:32.695070 17316 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:32.695554 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3080) took 1526 ms. Trace:
I20260709 13:19:32.695933 17389 rpcz_store.cc:276] 0709 13:19:31.169354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.694525 (+1525171us) service_pool.cc:224] Handling call
0709 13:19:32.694799 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.695342 (+   543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.695504 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:32.635500 21861 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.636124 21971 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:32.654438 21646 consensus_queue.cc:1175] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7108577e5754060b7e468a43dfdcdeb" responder_term: 11 status { last_received { term: 10 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:32.626097 21738 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.648471 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:32.621433 21848 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:32.698635 21848 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:32.611513 21516 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:32.702888 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 63955.5us
I20260709 13:19:32.649763 21648 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:19:32.703704 17434 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:32.656239 21866 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.704571 17393 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:32.704993 21357 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:32.705760 21357 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:32.706962 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 68179.8us
I20260709 13:19:32.708284 21874 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:32.708966 21874 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:32.710254 21874 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:32.710862 21874 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:32.656561 21849 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:32.699858 21848 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.650939 21959 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.702466 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:32.719676 17320 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:32.699265 21738 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.710345 21715 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:32.712657 17317 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:32.701174 17996 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:32.658906 21793 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:32.714215 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 76826.9us
I20260709 13:19:32.728425 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:32.728823 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.662036 21964 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:32.715142 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:32.702025 21868 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.715106 17392 raft_consensus.cc:2410] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:32.721297 21971 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:32.687381 21894 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.741756 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3039) took 2925 ms. Trace:
I20260709 13:19:32.742256 17467 rpcz_store.cc:276] 0709 13:19:29.815984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.379303 (+563319us) service_pool.cc:224] Handling call
0709 13:19:30.382221 (+  2918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.788974 (+1406753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.741457 (+952483us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400281c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:32.741683 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3030324480}
I20260709 13:19:32.743649 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:32.744515 17467 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.749673 21919 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:32.749966 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1893) took 1169 ms. Trace:
I20260709 13:19:32.729440 21685 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.750392 17390 rpcz_store.cc:276] 0709 13:19:31.580942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.737250 (+156308us) service_pool.cc:224] Handling call
0709 13:19:32.749774 (+1012524us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540038de54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:32.749909 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799664384}
I20260709 13:19:32.750898 21685 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.751551 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:32.752271 17390 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:32.753961 17313 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:32.756505 17388 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:32.757102 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1892) took 1495 ms. Trace:
I20260709 13:19:32.757391 17388 rpcz_store.cc:276] 0709 13:19:31.261616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.756033 (+1494417us) service_pool.cc:224] Handling call
0709 13:19:32.756345 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.756897 (+   552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.757051 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:32.759408 17997 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:32.761580 17994 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:32.731822 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:32.657569 21936 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.657099 21924 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.763104 17990 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:32.765095 17990 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:32.763693 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:32.771293 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:32.768517 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:32.772465 17390 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:32.734843 21466 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:32.808755 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.768532 21970 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:19:32.759353 21735 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.852059 17992 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:32.735482 21964 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:32.917553 17994 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:19:32.918008 17994 pending_rounds.cc:85] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 5
I20260709 13:19:32.918223 17994 pending_rounds.cc:107] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:19:32.918443 17994 raft_consensus.cc:2889] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:32.895092 17466 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:32.772279 21831 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:32.939798 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:32.774133 21857 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:32.947331 17469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 742) took 3225 ms (client timeout 1626 ms). Trace:
I20260709 13:19:32.728574 21874 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.950043 17464 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:19:32.950912 17469 rpcz_store.cc:269] 0709 13:19:29.722189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.725044 (+  2855us) service_pool.cc:224] Handling call
0709 13:19:32.946768 (+3221724us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b540020f154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:32.947259 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1605624704}
I20260709 13:19:32.894848 21735 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.953550 21948 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:32.961510 17467 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:32.979580 17390 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:33.117972 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1900) took 1205 ms. Trace:
I20260709 13:19:33.118445 17390 rpcz_store.cc:276] 0709 13:19:31.912795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.959048 (+1046253us) service_pool.cc:224] Handling call
0709 13:19:32.979360 (+ 20312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.117429 (+138069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.117768 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:33.056656 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3078) took 1893 ms. Trace:
W20260709 13:19:33.063480 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.969753 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.132611 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:33.134038 17320 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:33.135046 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 165351us
W20260709 13:19:33.065732 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.137408 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.138021 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1885) took 2388 ms. Trace:
I20260709 13:19:33.138449 21758 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.078106 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1805) took 1030 ms. Trace:
I20260709 13:19:33.121381 17395 rpcz_store.cc:276] 0709 13:19:31.162889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.505097 (+1342208us) service_pool.cc:224] Handling call
0709 13:19:32.505411 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.645636 (+140225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.645676 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:32.646339 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 13:19:32.727463 (+ 81124us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:32.727501 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.727576 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.055667 (+328091us) raft_consensus.cc:1685] finished
0709 13:19:33.055751 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.056258 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":836,"raft.queue_time_us":36087,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":21031,"thread_start_us":209824,"threads_started":2,"wal-append.queue_time_us":173438}
I20260709 13:19:33.140522 17397 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:33.141244 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 739) took 1197 ms. Trace:
I20260709 13:19:33.140408 17462 rpcz_store.cc:276] 0709 13:19:32.047880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.686814 (+638934us) service_pool.cc:224] Handling call
0709 13:19:32.727626 (+ 40812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.728074 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.728103 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:32.728593 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:19:32.978151 (+249558us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:32.978187 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.978253 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.077204 (+ 98951us) raft_consensus.cc:1685] finished
0709 13:19:33.077254 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.077767 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2505,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":3286,"thread_start_us":122981,"threads_started":1,"wal-append.queue_time_us":227963}
I20260709 13:19:33.141563 17390 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:33.141604 17397 rpcz_store.cc:276] 0709 13:19:31.943752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.139260 (+1195508us) service_pool.cc:224] Handling call
0709 13:19:33.139801 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.140997 (+  1196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.141176 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:33.142601 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1901) took 1222 ms. Trace:
I20260709 13:19:32.976146 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:33.143050 17390 rpcz_store.cc:276] 0709 13:19:31.920340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.120058 (+1199718us) service_pool.cc:224] Handling call
0709 13:19:33.120753 (+   695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.142315 (+ 21562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.142520 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:33.144059 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:33.089162 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.089473 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.959728 21735 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.977692 21738 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.966073 21857 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:33.146027 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.146081 21738 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.978123 21831 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:33.147507 21857 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:32.980906 21874 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.149307 21831 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.155406 17391 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:33.155565 17994 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:19:33.003937 21924 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.003842 21959 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.157917 21738 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:33.138495 17396 rpcz_store.cc:276] 0709 13:19:30.749672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.830408 (+ 80736us) service_pool.cc:224] Handling call
0709 13:19:30.854765 (+ 24357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.778742 (+923977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.137349 (+1358607us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b540023c8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:33.137815 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1921532160}
I20260709 13:19:33.161878 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1648) took 1353 ms. Trace:
I20260709 13:19:33.162088 17396 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:33.162292 17317 rpcz_store.cc:276] 0709 13:19:31.808349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.808458 (+   109us) service_pool.cc:224] Handling call
0709 13:19:33.161534 (+1353076us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b5400274a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.161686 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978011648}
I20260709 13:19:33.017570 21964 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:32.940265 21971 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:33.166471 17396 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:33.167289 21971 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:33.006724 21972 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:19:33.015077 21960 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.173714 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 760) took 1287 ms. Trace:
I20260709 13:19:33.174208 17464 rpcz_store.cc:276] 0709 13:19:31.885757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.317820 (+432063us) service_pool.cc:224] Handling call
0709 13:19:32.946884 (+629064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.955931 (+  9047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.173205 (+217274us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b540020f150. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.173507 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341451008}
I20260709 13:19:33.175261 21960 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.017169 21936 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:33.021418 21905 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.177357 17467 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.114041 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3082) took 1855 ms. Trace:
I20260709 13:19:33.179592 21905 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.178923 17393 rpcz_store.cc:276] 0709 13:19:31.258079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.705446 (+1447367us) service_pool.cc:224] Handling call
0709 13:19:32.705769 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.720248 (+ 14479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.720280 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:32.720724 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:19:32.971350 (+250626us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:33.107235 (+135885us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.112655 (+  5420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.113302 (+   647us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.113388 (+    86us) raft_consensus.cc:1685] finished
0709 13:19:33.113412 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.113772 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14101,"prepare.queue_time_us":127812,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":73,"raft.queue_time_us":14647,"raft.run_cpu_time_us":601,"raft.run_wall_time_us":9928,"thread_start_us":300825,"threads_started":2,"wal-append.queue_time_us":284655}
I20260709 13:19:33.182605 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1199) took 1437 ms. Trace:
I20260709 13:19:33.182714 21735 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.183180 17996 rpcz_store.cc:276] 0709 13:19:31.745220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.764189 (+ 18969us) service_pool.cc:224] Handling call
0709 13:19:33.182005 (+1417816us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b5400246154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.182326 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152478592}
I20260709 13:19:33.185439 17469 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:33.185874 21735 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.129779 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1898) took 1426 ms. Trace:
I20260709 13:19:33.136471 21961 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.186403 21535 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.101042 21868 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.147533 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.144985 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.176245 17464 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:33.186180 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3064) took 1019 ms. Trace:
I20260709 13:19:33.185765 21950 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:33.186400 17392 rpcz_store.cc:276] 0709 13:19:31.703445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.198713 (+495268us) service_pool.cc:224] Handling call
0709 13:19:33.129229 (+930516us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540023c3d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.129515 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986724736}
I20260709 13:19:33.170576 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:33.188462 17469 rpcz_store.cc:276] 0709 13:19:32.166706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.144425 (+977719us) service_pool.cc:224] Handling call
0709 13:19:33.184925 (+ 40500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.185906 (+   981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.186100 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:33.186976 21961 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.167307 21964 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.199644 21961 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.200480 21868 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.194227 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3065) took 1011 ms. Trace:
I20260709 13:19:33.204293 17464 rpcz_store.cc:276] 0709 13:19:32.180423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.175357 (+994934us) service_pool.cc:224] Handling call
0709 13:19:33.175844 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.189063 (+ 13219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.191741 (+  2678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:33.208659 21950 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.210316 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 892) took 1251 ms. Trace:
I20260709 13:19:33.210815 17997 rpcz_store.cc:276] 0709 13:19:31.954290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.732434 (+778144us) service_pool.cc:224] Handling call
0709 13:19:32.759239 (+ 26805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.763490 (+  4251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.201778 (+438288us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b54004443d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.205565 (+  3787us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60871424}
W20260709 13:19:33.216025 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 79611.3us
I20260709 13:19:33.217631 21758 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.180697 21509 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.213259 21950 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:33.227926 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.229938 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.230446 21740 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.230859 17317 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:33.229053 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:33.239159 17390 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:19:33.239811 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:33.243284 21685 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.232057 21798 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.249106 21971 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.249406 21833 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.261190 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.263589 17462 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:33.264797 21795 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.265304 17391 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:33.265942 17462 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:33.239094 21868 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:33.260632 21939 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.446s	user 0.000s	sys 0.012s
W20260709 13:19:33.272630 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.274221 21848 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:33.275585 21848 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.276239 21848 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.278034 17396 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:33.278808 21848 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:33.278915 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.281033 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.281860 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.282699 17313 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:33.284358 17317 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:33.285995 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3045) took 2126 ms. Trace:
I20260709 13:19:33.286463 17465 rpcz_store.cc:276] 0709 13:19:31.159629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.160381 (+   752us) service_pool.cc:224] Handling call
0709 13:19:31.160641 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.916376 (+755735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.285445 (+1369069us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b540041f5d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:33.285761 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696492416}
I20260709 13:19:33.287711 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:33.292461 21401 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.294528 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1188) took 1678 ms. Trace:
I20260709 13:19:33.295001 17999 rpcz_store.cc:276] 0709 13:19:31.616361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.617971 (+  1610us) service_pool.cc:224] Handling call
0709 13:19:32.062632 (+444661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.081839 (+ 19207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.294011 (+1212172us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400472a50. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.294272 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021651200}
I20260709 13:19:33.297478 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:33.298487 17465 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.292718 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3058) took 2105 ms. Trace:
I20260709 13:19:33.299626 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 833) took 1460 ms. Trace:
I20260709 13:19:33.293246 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 772) took 2554 ms. Trace:
I20260709 13:19:33.284747 17320 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:33.299502 17463 rpcz_store.cc:276] 0709 13:19:31.186885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.815737 (+628852us) service_pool.cc:224] Handling call
0709 13:19:31.831916 (+ 16179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.849742 (+ 17826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.292168 (+1442426us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b54000636d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:33.292508 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15645568}
I20260709 13:19:33.302086 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:33.306844 17962 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:33.300225 17992 rpcz_store.cc:276] 0709 13:19:31.838991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.108258 (+269267us) service_pool.cc:224] Handling call
0709 13:19:33.299208 (+1190950us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b5400687754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.299444 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515704192}
I20260709 13:19:33.309314 21905 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.309687 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:33.310138 21905 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.308621 21919 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:33.308529 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:33.316109 17467 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:33.318207 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:33.318676 17462 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:19:33.319291 21754 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:33.316504 21795 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.319738 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:33.320258 21924 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:33.320415 21795 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.300410 17318 rpcz_store.cc:276] 0709 13:19:30.738633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.775126 (+ 36493us) service_pool.cc:224] Handling call
0709 13:19:30.821360 (+ 46234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.821783 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.821828 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.831189 (+  9361us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.537080 (+705891us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b18000306a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:19:31.657466 (+120386us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:31.657516 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.657594 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.259735 (+1602141us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:33.289541 (+ 29806us) raft_consensus.cc:1685] finished
0709 13:19:33.289566 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.293015 (+  3449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17308,"raft.queue_time_us":628,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":13902,"spinlock_wait_cycles":13162496,"thread_start_us":120164,"threads_started":1,"wal-append.queue_time_us":923322}
I20260709 13:19:33.321018 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:33.321084 21924 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.320739 17463 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:33.321053 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:33.326287 21924 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:33.326895 17464 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:33.327162 21848 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:33.317006 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.335248 21848 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:33.326967 17318 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:33.336086 17318 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:33.336722 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:33.319736 21754 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.337208 17318 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.337960 21754 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.338650 17318 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:33.335364 21516 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:33.327898 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.341051 21521 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:19:33.344898 21964 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:33.378975 17287 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:33.383697 21868 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:33.344981 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:33.387431 21648 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:33.387956 21648 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:33.392481 21466 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.392966 21648 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.393219 21466 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.394470 21648 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.388599 21516 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:33.396003 21685 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:33.336776 21848 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.397117 17995 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:33.396829 21516 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.397912 21795 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.398710 21894 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:19:33.395490 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.408910 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:33.409158 17318 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:19:33.410491 21986 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:33.411810 21798 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:33.413082 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 186342us
I20260709 13:19:33.413832 17469 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:33.414165 21824 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.414611 21824 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.415076 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:33.415902 21935 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.416324 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:33.416911 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.417140 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 895) took 1101 ms. Trace:
I20260709 13:19:33.417484 17990 rpcz_store.cc:276] 0709 13:19:32.288890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.771051 (+482161us) service_pool.cc:224] Handling call
0709 13:19:32.771328 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.771685 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:32.976045 (+204360us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.295592 (+319547us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.296423 (+   831us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.301401 (+  4978us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:33.301442 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.313837 (+ 12395us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.384919 (+ 71082us) raft_consensus.cc:1685] finished
0709 13:19:33.384942 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.390356 (+  5414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305,"prepare.queue_time_us":221444,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":1075,"raft.queue_time_us":55703,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":70971,"thread_start_us":447144,"threads_started":2,"wal-append.queue_time_us":287480}
I20260709 13:19:33.419699 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:33.424188 21466 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:33.426344 21983 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:33.433018 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:33.434298 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 181533us
I20260709 13:19:33.435979 21735 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:33.437388 21905 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:33.438618 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 157809us
I20260709 13:19:33.439502 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:33.440882 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.441299 21924 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:33.441915 17320 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:33.445209 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:33.452893 17465 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:33.455160 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:33.454455 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:33.466259 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 142103us
W20260709 13:19:33.467047 17993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 890) took 1518 ms (client timeout 1855 ms). Trace:
I20260709 13:19:33.467348 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:33.467691 21793 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.013s
I20260709 13:19:33.469027 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3054) took 2290 ms. Trace:
I20260709 13:19:33.469256 21521 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:33.469803 21521 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.469470 17466 rpcz_store.cc:276] 0709 13:19:31.178488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.695856 (+517368us) service_pool.cc:224] Handling call
0709 13:19:31.716789 (+ 20933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.946137 (+1229348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.468508 (+522371us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002e2a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:33.468827 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2709084544}
I20260709 13:19:33.470387 17463 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:33.471011 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:33.471489 17991 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:33.471786 17392 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.473304 17462 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:33.469058 21648 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.445425 21735 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:33.479440 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:33.446393 21928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.666s	user 0.016s	sys 0.035s
I20260709 13:19:33.477350 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1198) took 1741 ms. Trace:
I20260709 13:19:33.483632 17991 rpcz_store.cc:276] 0709 13:19:31.736425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.630674 (+894249us) service_pool.cc:224] Handling call
0709 13:19:33.471056 (+840382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.471924 (+   868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.472736 (+   812us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b5400084150. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.477294 (+  4558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931730176}
I20260709 13:19:33.448659 21738 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:33.467602 17993 rpcz_store.cc:269] 0709 13:19:31.947980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.105412 (+157432us) service_pool.cc:224] Handling call
0709 13:19:33.466612 (+1361200us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400084154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.466819 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575846656}
I20260709 13:19:33.448738 21964 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:33.470400 21521 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:33.484447 21928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.707s	user 0.017s	sys 0.036s
I20260709 13:19:33.499159 17996 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 10: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:33.501050 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:33.505219 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.397903 21754 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:33.502344 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.512784 17397 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:33.453851 21936 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:19:33.496203 21831 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.528898 17994 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:33.526607 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.530606 17393 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:33.530802 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:33.511641 21919 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:33.536702 17467 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:33.537783 21722 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:33.538796 21849 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:33.496608 21740 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:19:33.540644 21927 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:19:33.541677 21927 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:33.542068 21927 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:33.543104 21927 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.543516 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:33.544425 17397 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:33.538640 21831 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.546579 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:33.548753 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:33.545634 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:33.557502 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:33.558297 17391 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.562049 21735 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.562688 21798 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.563253 21798 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.565603 21948 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:33.566052 21948 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:33.566417 21948 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.528975 21466 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:33.570088 21754 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:33.570430 21831 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.570911 21516 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:33.571389 21516 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.571660 17393 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:33.571820 21516 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:33.572923 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.573144 21993 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.573657 21798 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.574731 21964 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.576246 21868 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:33.577323 21868 consensus_queue.cc:1243] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:33.577172 21874 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:33.578954 21874 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:33.579587 21874 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:33.581585 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 103426us
I20260709 13:19:33.581928 17397 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:33.585217 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:33.585777 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:33.586853 21866 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:33.532091 21738 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.587301 21866 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.587669 21866 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.576334 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:33.589217 21738 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:33.589463 21685 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:33.591599 17469 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:33.599180 17391 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:33.599539 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.597394 21927 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.605250 17393 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:33.571883 21740 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:33.612700 17314 raft_consensus.cc:2410] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:33.613332 21936 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:33.613829 21759 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.614457 21936 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:33.615167 21936 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:33.615238 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:33.616214 17319 raft_consensus.cc:2368] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:33.616647 21646 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:33.617126 21646 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:33.614500 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3085) took 1142 ms. Trace:
I20260709 13:19:33.601066 21993 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:33.617702 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 119925us
I20260709 13:19:33.616381 21936 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.618299 17390 rpcz_store.cc:276] 0709 13:19:32.471815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.144227 (+672412us) service_pool.cc:224] Handling call
0709 13:19:33.144723 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.247869 (+103146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.614224 (+366355us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b540013abd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:33.614429 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210590464}
I20260709 13:19:33.603888 21793 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:33.625540 17392 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:33.621536 21646 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.627830 21740 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.631343 21646 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:33.633590 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 128478us
W20260709 13:19:33.629805 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 267913us
I20260709 13:19:33.638821 21936 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.640677 21473 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:19:33.642009 21473 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:33.642182 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:33.642462 21473 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:33.643684 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:33.635579 21648 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:19:33.599932 21874 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.647469 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:33.643232 21924 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:33.634934 21928 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.653205 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 148858us
I20260709 13:19:33.645829 21648 consensus_queue.cc:1243] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:19:33.655198 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 155310us
I20260709 13:19:33.649921 21924 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:33.650961 21834 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:33.656775 21924 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.658860 17468 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:33.664438 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.665596 21754 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:33.666208 21754 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.666749 21754 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.673242 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:33.675061 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.657941 21685 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:33.658619 21740 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.689961 21740 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:33.690657 21740 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:33.691637 21740 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.693600 21521 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.714859 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.722458 21569 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.660670 21993 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.719359 21848 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:33.716673 21874 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:33.737376 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.713757 21521 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:33.750083 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.755096 21992 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:33.756215 21824 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.675098 21919 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.757824 17465 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:33.697569 21868 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:19:33.748807 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:33.763255 21993 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:33.764428 21989 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:19:33.733408 21833 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:33.759943 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3097) took 1045 ms. Trace:
I20260709 13:19:33.680699 21473 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.721814 21738 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.686992 21928 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.772719 17395 rpcz_store.cc:276] 0709 13:19:32.714536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.167576 (+453040us) service_pool.cc:224] Handling call
0709 13:19:33.168098 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.168747 (+   649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.168783 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.225368 (+ 56585us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.532863 (+307495us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:33.532904 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.532980 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.759727 (+226747us) raft_consensus.cc:1685] finished
0709 13:19:33.759748 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.759881 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20086,"raft.queue_time_us":413,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":2154,"thread_start_us":243644,"threads_started":1,"wal-append.queue_time_us":399983}
I20260709 13:19:33.775408 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:33.785183 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 104665us
W20260709 13:19:33.788878 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 66788us
W20260709 13:19:33.791147 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 128691us
I20260709 13:19:33.787503 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:33.784072 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:33.792102 17319 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.789867 17434 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:33.772159 21833 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:33.772413 21848 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:33.772930 21849 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:33.804293 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:33.797791 21833 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.811980 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:33.812392 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50647.5us
I20260709 13:19:33.796412 21905 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:33.795673 21646 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.798288 21824 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:33.818279 17468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3068) took 1497 ms (client timeout 1918 ms). Trace:
I20260709 13:19:33.825641 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.859460 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3052) took 2685 ms. Trace:
W20260709 13:19:33.822158 17995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 828) took 3934 ms (client timeout 2959 ms). Trace:
I20260709 13:19:33.821014 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:33.823954 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:33.870229 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 58306.2us
W20260709 13:19:33.867763 17468 rpcz_store.cc:269] 0709 13:19:32.321201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.339218 (+ 18017us) service_pool.cc:224] Handling call
0709 13:19:33.818029 (+1478811us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540041fad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.818199 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2038600576}
W20260709 13:19:33.863374 17347 heartbeater.cc:646] Failed to heartbeat to 127.15.208.62:46299 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.208.62:46299 timed out after 15.000s (SENT)
I20260709 13:19:33.809226 21868 consensus_queue.cc:1243] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:33.811916 21735 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:33.864327 21848 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.811486 21738 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.821187 21849 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.906478 21738 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.907363 21849 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.816474 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3053) took 2625 ms. Trace:
I20260709 13:19:33.909255 21704 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:33.909410 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 98572.6us
I20260709 13:19:33.908062 17471 rpcz_store.cc:276] 0709 13:19:31.175717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.553882 (+378165us) service_pool.cc:224] Handling call
0709 13:19:31.554527 (+   645us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:31.564380 (+  9853us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:31.602971 (+ 38591us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.799362 (+196391us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:31.805032 (+  5670us) log.cc:844] Serialized 78 byte log entry
0709 13:19:31.806909 (+  1877us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:33.665669 (+1858760us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.758979 (+ 93310us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:33.766829 (+  7850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.782965 (+ 16136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.794205 (+ 11240us) raft_consensus.cc:1685] finished
0709 13:19:33.794222 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.801271 (+  7049us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3858432,"prepare.queue_time_us":1909482,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":86,"raft.queue_time_us":36781,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":23808,"spinlock_wait_cycles":3679488,"thread_start_us":130185,"threads_started":2,"wal-append.queue_time_us":310975,"wal-append.run_cpu_time_us":3284,"wal-append.run_wall_time_us":1234764}
I20260709 13:19:33.909941 21704 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:33.910450 17435 leader_election.cc:400] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12.
I20260709 13:19:33.911060 21704 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:33.868394 17995 rpcz_store.cc:269] 0709 13:19:29.887427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.887540 (+   113us) service_pool.cc:224] Handling call
0709 13:19:33.821793 (+3934253us) spinlock_profiling.cc:243] Waited 3.47 s on lock 0x7b54001de2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:33.822012 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7973433600}
I20260709 13:19:33.817071 21792 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:33.881999 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.882596 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:33.886500 17395 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:33.892410 21845 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:33.892993 21859 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:19:33.894011 21401 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:33.894982 21928 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:33.897033 21473 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.897157 21920 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:33.897513 21791 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:33.901008 21474 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:19:33.864554 21948 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.903173 21689 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:33.802853 21648 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:19:33.873950 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.875567 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:33.867000 21905 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.924259 17462 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:33.926084 17319 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:33.927148 21685 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:19:33.928754 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46293.7us
I20260709 13:19:33.928228 21569 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.932359 21804 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.928561 21401 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.868211 17470 rpcz_store.cc:276] 0709 13:19:31.174308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.550242 (+375934us) service_pool.cc:224] Handling call
0709 13:19:31.550575 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.550816 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:31.551146 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.663225 (+2112079us) spinlock_profiling.cc:243] Waited 979 us on lock 0x7b18003c2440. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf 00007f7d6280e038
0709 13:19:33.702504 (+ 39279us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.798032 (+ 95528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:33.803053 (+  5021us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:33.809683 (+  6630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.823753 (+ 14070us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.859251 (+ 35498us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26822,"prepare.queue_time_us":2082065,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":1236,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":11900,"spinlock_wait_cycles":2252672,"thread_start_us":130592,"threads_started":3,"wal-append.queue_time_us":222063,"wal-append.run_cpu_time_us":2008,"wal-append.run_wall_time_us":1130615}
I20260709 13:19:33.814620 21857 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:19:33.934957 21920 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.937237 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3071) took 2779 ms. Trace:
I20260709 13:19:33.885280 21646 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.939054 22011 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:33.944888 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.901726 17389 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
W20260709 13:19:33.946118 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 170786us
I20260709 13:19:33.950925 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:33.928505 21859 consensus_queue.cc:1243] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:33.966614 17394 rpcz_store.cc:276] 0709 13:19:31.157686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.165485 (+  7799us) service_pool.cc:224] Handling call
0709 13:19:31.175822 (+ 10337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.315189 (+1139367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.874651 (+1559462us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540038d954. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:33.937009 (+ 62358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372473088}
I20260709 13:19:33.969113 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.962122 21401 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.986265 17314 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:33.987986 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:33.960626 21804 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.980193 21833 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.964108 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:33.990453 17321 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:33.990651 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60664us
I20260709 13:19:33.991523 21857 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.992129 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:33.961098 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:33.992976 21857 raft_consensus.cc:2764] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:33.994455 21754 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:33.988715 17997 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:33.968953 21569 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.956332 21905 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.994867 17470 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:19:33.950282 21740 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:33.922886 21849 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:19:33.969267 21799 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
W20260709 13:19:34.008441 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 97078.8us
W20260709 13:19:34.003506 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 91960.5us
I20260709 13:19:33.957494 21824 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:34.004932 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:33.996608 21754 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:33.928509 21793 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:19:34.009341 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:34.015477 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.010193 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:34.014976 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:34.016607 17313 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:34.018698 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:34.019657 17319 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:33.962306 21845 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.020437 21756 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:34.021133 21591 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:34.021725 21591 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.029382 17468 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:34.029935 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3081) took 2852 ms. Trace:
I20260709 13:19:34.030316 17389 rpcz_store.cc:276] 0709 13:19:31.177380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.696610 (+1519230us) service_pool.cc:224] Handling call
0709 13:19:32.703037 (+  6427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.012660 (+1309623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.029578 (+ 16918us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540013a6d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:34.029859 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2755608960}
I20260709 13:19:34.031199 21868 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:34.031632 21646 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:34.032217 21793 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:33.975332 21516 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.032604 21793 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:34.006906 21735 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.033274 21894 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:34.009423 21740 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:34.033865 21894 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:34.033607 21793 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.034317 21516 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:34.034559 21740 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.034825 21894 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.036010 21894 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:34.038703 17215 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49294 (request call id 330) took 37744 ms (client timeout 15000 ms). Trace:
I20260709 13:19:34.040886 21799 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:34.041606 21799 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:34.041838 17314 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:19:34.042629 21799 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.045536 21924 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.048317 21920 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:34.033385 21735 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:34.052253 21995 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.435s	user 0.003s	sys 0.002s
I20260709 13:19:34.031642 21868 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:34.053333 21633 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:34.053820 21633 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:34.054106 21868 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.054838 21633 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:33.968261 21866 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.029198 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:34.082373 17321 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:34.070474 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:34.143883 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 133723us
I20260709 13:19:34.078610 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:34.063660 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.077050 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1894) took 2495 ms. Trace:
I20260709 13:19:34.063541 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.148151 17320 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:19:34.150552 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 133480us
I20260709 13:19:34.149415 17464 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
W20260709 13:19:34.071621 21999 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.316s	user 0.000s	sys 0.002s
I20260709 13:19:34.060495 21401 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.171595 21866 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:34.171931 21401 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:34.061924 21704 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:34.172963 21704 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:34.173941 21704 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.175159 21704 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:34.175995 17467 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:19:34.169879 21633 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:34.043339 21591 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:34.064674 21833 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:34.074891 21569 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:34.144615 21948 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:34.055619 21868 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:34.176656 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:34.076594 21905 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.187983 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:34.147233 17388 rpcz_store.cc:276] 0709 13:19:31.581254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.758136 (+1176882us) service_pool.cc:224] Handling call
0709 13:19:32.758438 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.920789 (+162351us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:33.054161 (+133372us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.194513 (+140352us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.291813 (+ 97300us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.291987 (+   174us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:33.314678 (+ 22691us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.317498 (+  2820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.076378 (+758880us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54002be154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:34.076445 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:34.076601 (+   156us) raft_consensus.cc:1685] finished
0709 13:19:34.076622 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.076850 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1175,"prepare.queue_time_us":200274,"prepare.run_cpu_time_us":140,"prepare.run_wall_time_us":138,"raft.queue_time_us":26129,"raft.run_cpu_time_us":484,"raft.run_wall_time_us":11851,"spinlock_wait_cycles":369604480,"thread_start_us":176743,"threads_started":2,"wal-append.queue_time_us":173242}
I20260709 13:19:34.148217 21735 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:34.190160 21930 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.190598 21919 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:34.184208 21924 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:34.193411 17962 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:19:34.195142 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.196949 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:34.197489 17313 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:34.249466 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 56130.3us
I20260709 13:19:34.197484 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:34.039112 17215 rpcz_store.cc:269] 0709 13:18:56.294026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.294384 (+   358us) service_pool.cc:224] Handling call
0709 13:19:34.038436 (+37744052us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:25.234970 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:25.235573 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:25.235629 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:19:25.235652 (+    23us) tablet.cc:662] Decoding operations
0709 13:19:25.237689 (+  2037us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:25.237773 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:25.237811 (+    38us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:25.238870 (+  1059us) tablet.cc:701] Row locks acquired
0709 13:19:25.238920 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:19:25.239176 (+   256us) write_op.cc:270] Start()
0709 13:19:25.239323 (+   147us) write_op.cc:276] Timestamp: P: 1783603165239104 usec, L: 0
0709 13:19:25.239359 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:19:25.240055 (+   696us) log.cc:844] Serialized 4355 byte log entry
0709 13:19:25.784249 (+544194us) op_driver.cc:464] REPLICATION: finished
0709 13:19:26.100236 (+315987us) write_op.cc:301] APPLY: starting
0709 13:19:26.100364 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:26.341040 (+240676us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:26.341174 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:26.800950 (+459776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:26.990723 (+189773us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:19:27.003079 (+ 12356us) write_op.cc:312] APPLY: finished
0709 13:19:27.101431 (+ 98352us) log.cc:844] Serialized 105 byte log entry
0709 13:19:27.956503 (+855072us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:27.963967 (+  7464us) write_op.cc:454] Released schema lock
0709 13:19:27.973617 (+  9650us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:28.055620 (+ 82003us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:28.057035 (+  1415us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5863823,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":313974,"apply.run_cpu_time_us":156720,"apply.run_wall_time_us":1922988,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"cfile_init":1,"lbm_read_time_us":2959,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"num_ops":11,"prepare.queue_time_us":221887,"prepare.run_cpu_time_us":27761,"prepare.run_wall_time_us":204398,"raft.queue_time_us":105783,"raft.run_cpu_time_us":6192,"raft.run_wall_time_us":291525,"replication_time_us":526910,"thread_start_us":1308436,"threads_started":5,"wal-append.queue_time_us":972125,"wal-append.run_cpu_time_us":32755,"wal-append.run_wall_time_us":2331415}]]}
I20260709 13:19:34.197865 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:34.199457 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.202234 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 50154.2us
W20260709 13:19:34.203064 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47508us
W20260709 13:19:34.253623 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.254230 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.203260 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 124876us
W20260709 13:19:34.208585 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.201380 21905 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:34.209159 22013 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.184077 21804 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.229089 21793 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:34.053694 21824 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:34.230136 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.249768 17313 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:34.250281 17315 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:34.257040 17320 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:34.259397 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:34.258906 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 346145us
I20260709 13:19:34.275591 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:34.278137 17321 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:34.279804 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:34.279906 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:34.258860 21735 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:34.285239 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:34.280393 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:34.286892 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:34.294700 17469 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:34.296931 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.261969 21919 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:34.286103 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:34.303717 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:34.304378 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:34.304767 17314 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:19:34.304975 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:34.306102 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:34.322012 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:34.308676 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.313745 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:34.312991 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:34.313186 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.313751 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:34.315176 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:34.303876 17313 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.323374 17394 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:34.324249 17395 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.321116 17316 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:19:34.325696 17994 raft_consensus.cc:2410] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:34.321909 17314 pending_rounds.cc:85] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 9
I20260709 13:19:34.328552 17393 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:34.329553 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:34.330332 17319 raft_consensus.cc:1217] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 9.7->[11.8-15.10]   Dedup: 11.8->[13.9-15.10]
I20260709 13:19:34.331105 17319 pending_rounds.cc:85] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 8
I20260709 13:19:34.332870 17389 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:34.287549 21845 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:34.333199 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.318316 21633 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:34.338223 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.333073 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:34.340221 17317 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.341929 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.342193 17466 raft_consensus.cc:2410] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:34.342849 17391 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:34.331439 17319 pending_rounds.cc:107] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:19:34.332808 17314 pending_rounds.cc:107] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:19:34.344955 17319 raft_consensus.cc:2889] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:34.345230 17314 raft_consensus.cc:2889] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:34.324218 21848 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:34.379040 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 61026.5us
W20260709 13:19:34.379750 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50601.9us
I20260709 13:19:34.394079 17395 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:34.379956 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.345549 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:34.380617 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.329217 21735 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:34.381322 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:34.396929 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 54053.2us
I20260709 13:19:34.332674 21569 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.285539 22020 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:19:34.325966 21894 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.401980 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:34.383221 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:34.384011 17322 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:34.383226 17997 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:34.384928 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:34.407663 17389 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:34.383113 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.389070 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:34.385689 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:34.395262 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.378960 17390 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:34.403498 17467 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:34.409425 17315 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.342034 21924 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.406850 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 131334us
I20260709 13:19:34.389063 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:34.378403 21905 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.415529 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:34.339488 21791 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:19:34.416512 17316 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:34.420130 17314 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:34.390053 21848 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:34.422050 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.423777 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.425277 17395 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:34.427282 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:34.422185 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:34.430215 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.433324 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:34.414976 21484 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.411517 22021 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:34.435684 17994 raft_consensus.cc:2410] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:34.440223 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.423413 21866 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:34.429100 21848 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.424976 21759 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:34.488418 17389 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:34.490104 21735 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.438452 21845 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:19:34.501782 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:34.502427 17389 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.450424 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:34.495972 17395 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:34.497125 17995 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:34.428964 21905 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.500389 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.439567 22021 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.421667 21894 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.553601 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:34.499066 22027 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:19:34.545604 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45441.8us
I20260709 13:19:34.622012 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:34.488482 21924 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:34.506832 22026 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:19:34.500599 21992 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.065s	user 0.000s	sys 0.012s
I20260709 13:19:34.615041 17394 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:34.622568 17393 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:34.623260 22021 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:34.503046 21866 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:34.624537 22028 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.121s	user 0.000s	sys 0.004s
I20260709 13:19:34.637348 17391 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:34.637583 17396 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:34.614038 21950 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.629822 17316 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:34.643661 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:34.491693 21484 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.662735 17314 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:34.622906 21591 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.665290 17389 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:34.662199 21569 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.667729 21569 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.505425 21759 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.666177 17467 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:19:34.438464 21919 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.683343 17466 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:34.689344 17321 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:34.696532 17315 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:34.684362 21961 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:34.686892 21859 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.701313 21944 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.721196 21961 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.682893 21950 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.722095 21845 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.748222 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.749109 17465 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:34.736400 21646 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:19:34.763799 22034 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:19:34.765691 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.766891 21845 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.767122 21848 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.769158 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.769017 22021 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.769956 17462 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:34.720769 21591 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.747269 21961 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:34.788182 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.785866 21646 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.797168 21905 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:34.797887 21924 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:34.799216 21646 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:34.801391 22035 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:19:34.761760 21944 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.806502 22021 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:34.795957 21845 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:34.820237 21793 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.545s	user 0.004s	sys 0.004s
I20260709 13:19:34.747726 21859 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.790791 21848 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:34.833055 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 205878us
I20260709 13:19:34.843087 17389 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:34.843698 17465 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:34.777884 21866 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.834689 21791 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.835984 21857 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:34.863822 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:34.849255 21759 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:34.885170 17390 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:34.892755 17388 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:34.881032 21484 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:34.897608 22042 raft_consensus.cc:2764] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:34.898250 21759 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:34.899174 21591 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:34.897796 17389 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:34.865337 21857 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:34.905664 17389 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:34.906248 17463 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:34.905315 22041 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:34.909245 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 469829us
I20260709 13:19:34.910254 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.913180 17360 leader_election.cc:400] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:34.913509 17360 leader_election.cc:403] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:19:34.913990 17317 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.004s
I20260709 13:19:34.914393 17317 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:34.916180 17287 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:34.920387 22032 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
I20260709 13:19:34.926424 21569 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:34.927053 21569 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:34.928056 22042 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:34.928442 22042 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:34.929066 21894 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:34.929694 21894 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:34.929324 22042 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.930217 21894 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:34.930737 22042 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.930884 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.931655 17389 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:34.931152 21894 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.932719 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:34.933321 17388 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:34.933701 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.899241 21759 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:34.868348 21791 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:34.942518 17360 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:34.942951 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:34.940904 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.944196 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:34.946264 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.946870 17393 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:34.944536 17389 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:34.947770 17397 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:34.950205 17397 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:34.952535 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:34.950253 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:34.937645 21759 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:34.953991 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:34.964993 17390 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:34.960043 17395 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:19:34.963114 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.967373 17463 raft_consensus.cc:2368] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:34.948397 21484 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:34.945273 21591 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:34.907615 22041 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:34.963634 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:34.971531 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:34.987983 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.988564 17317 raft_consensus.cc:2410] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:19:34.990475 17390 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:34.960417 21569 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:34.994438 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:34.976033 21484 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.996351 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:35.002725 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:34.991847 21569 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.988391 22040 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:35.007169 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:34.996527 21591 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:19:35.010421 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:35.011029 17314 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:34.991879 22046 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:35.012029 17315 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:35.009672 21848 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:35.006096 22039 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:34.998787 21944 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:35.014640 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:35.011554 21793 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:19:35.009570 21569 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.998966 21484 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.005795 21905 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:35.021471 21845 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:35.011680 21924 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:35.010329 22040 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.030704 17388 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:35.017304 22044 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:35.039976 21633 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.043067 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:35.044679 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:35.046906 17465 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:35.028496 21905 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:35.049883 17465 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:35.032116 21924 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:35.065254 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:35.006274 21759 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.034643 22040 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.029506 21848 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:19:35.044684 22044 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:35.009974 21857 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:35.068871 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 100167us
I20260709 13:19:35.078722 17471 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:35.062063 21905 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.081324 17463 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:19:35.081936 17463 pending_rounds.cc:85] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 9
I20260709 13:19:35.082257 17463 pending_rounds.cc:107] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:19:35.082614 17463 raft_consensus.cc:2889] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:35.068159 21924 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.096261 17360 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.050022 21646 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:19:35.057039 21633 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:35.103931 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 73889.9us
I20260709 13:19:35.045926 21919 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:19:35.048326 22046 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:35.107910 21791 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:35.079473 22044 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.067040 21521 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:35.115399 21919 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:35.116189 21791 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:35.110785 17470 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:35.112076 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.110299 21845 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:35.099397 21961 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.138675 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:35.144236 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.138453 22041 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.142690 21759 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:35.154138 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.154237 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:35.168804 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 72641.3us
I20260709 13:19:35.158133 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:35.169842 17314 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:35.170264 17360 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.171801 17360 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:35.171871 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:35.136152 22042 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:35.174678 17388 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
W20260709 13:19:35.148914 22047 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:19:35.198990 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3080) took 1449 ms. Trace:
I20260709 13:19:35.229980 17362 leader_election.cc:400] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:35.229900 17469 rpcz_store.cc:276] 0709 13:19:33.750011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.759375 (+  9364us) service_pool.cc:224] Handling call
0709 13:19:33.794519 (+ 35144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.302011 (+507492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.198664 (+896653us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54000636d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:35.198913 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149875584}
W20260709 13:19:35.148401 22048 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:35.232702 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.147580 21961 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:35.158622 21735 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.144074 21848 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:19:35.155628 21833 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:35.239667 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.194166 22039 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:35.151006 21633 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.163709 21859 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.152817 21569 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.274372 21956 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:35.274564 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.275352 17317 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:35.276278 21569 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:35.281265 22052 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:19:35.281042 17216 catalog_manager.cc:5697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 8 to 11, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 11 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:35.282823 17216 catalog_manager.cc:5697] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:19:35.284032 17216 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:35.288452 21658 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:35.289039 21658 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.289459 21658 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.235862 21799 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:19:35.165026 21484 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.293084 21484 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:35.293535 22051 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:19:35.267513 21833 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.295182 22053 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:35.295773 22053 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:35.296178 21833 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:35.296852 17471 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:35.298133 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:35.298807 17471 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:35.158309 21894 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:19:35.298944 21633 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:35.299643 21633 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.301091 21833 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:35.301699 21833 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.185132 22057 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:35.308884 22057 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.309351 22057 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.313151 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.314116 17388 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:35.316768 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:35.317996 22055 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:35.318414 22055 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:35.318602 17469 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:35.319290 22055 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.237455 22042 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 12 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:35.302371 21633 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.322422 17468 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:35.227226 22041 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:19:35.157433 22020 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:19:35.303282 17216 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 5 to 9, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 9 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.333730 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.320915 21799 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:35.284397 22040 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.320730 21516 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:35.339203 21833 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:35.339406 21516 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:35.339991 21799 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.340714 21516 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.342176 21799 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.342269 21516 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.343842 21833 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.257498 17314 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:35.296227 22053 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.343943 22042 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.351222 17317 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:35.351763 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.351428 22044 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.352766 21833 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.353791 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.353996 17321 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:19:35.355573 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:35.355597 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.357167 17388 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:35.367316 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:35.369434 17314 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:19:35.369911 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.367939 17990 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:35.374533 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:35.375217 17388 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.375644 22044 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.377125 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:35.378835 17397 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:35.379839 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.381011 17390 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:35.381896 17394 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:35.382067 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.382733 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:35.386123 17465 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:19:35.384654 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 152056us
I20260709 13:19:35.387480 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:35.388293 17997 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:35.373485 17216 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 8 to 12, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 12 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:19:35.390436 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.391840 22067 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:35.394259 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:35.394968 17999 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:19:35.385039 22041 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:35.397687 22041 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.398486 21833 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:35.399906 22041 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.405062 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:35.405714 17470 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.411446 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:35.411986 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1913) took 1094 ms. Trace:
I20260709 13:19:35.412551 17396 rpcz_store.cc:276] 0709 13:19:34.317491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.322632 (+  5141us) service_pool.cc:224] Handling call
0709 13:19:34.633251 (+310619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.644772 (+ 11521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.411773 (+767001us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54002bd750. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:35.411919 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698302336}
I20260709 13:19:35.414073 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:35.415304 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:35.417044 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 847) took 1130 ms. Trace:
I20260709 13:19:35.417152 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.337040 21845 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.417433 17360 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.417519 17992 rpcz_store.cc:276] 0709 13:19:34.286644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.286799 (+   155us) service_pool.cc:224] Handling call
0709 13:19:35.416859 (+1130060us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b5400396554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:35.416987 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558938368}
I20260709 13:19:35.418856 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:35.419653 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.420281 17360 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.420414 17392 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:35.421037 17388 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:35.421308 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:35.421657 17285 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.422005 17392 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:35.422473 21799 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.272261 21735 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.422991 21799 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.425010 21735 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:35.425542 21521 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:35.426199 17995 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:35.427887 17396 raft_consensus.cc:2410] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:35.421845 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.428793 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.429294 17388 raft_consensus.cc:2410] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:19:35.412103 17462 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.429890 17314 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:35.441881 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.444494 17360 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.444609 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.445498 17388 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:35.447301 17390 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:35.448764 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.453277 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.441704 17216 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 5 to 10, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 10 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.454916 17388 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:35.374064 21924 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.457134 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.457985 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.390194 22044 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.411460 22053 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.467154 22044 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.468734 22053 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:35.469384 22044 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.463047 22013 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:19:35.473480 17394 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:35.465569 17216 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:19:35.476694 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1919) took 1149 ms. Trace:
I20260709 13:19:35.479014 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3087) took 1097 ms. Trace:
I20260709 13:19:35.479513 17466 rpcz_store.cc:276] 0709 13:19:34.382004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.382293 (+   289us) service_pool.cc:224] Handling call
0709 13:19:34.416340 (+ 34047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.684857 (+268517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.478730 (+793873us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54002607d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:35.478940 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594635136}
I20260709 13:19:35.483162 17470 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:35.421840 21950 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:35.477223 17391 rpcz_store.cc:276] 0709 13:19:34.326831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.415398 (+ 88567us) service_pool.cc:224] Handling call
0709 13:19:34.637148 (+221750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.644334 (+  7186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.476438 (+832104us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400253d50. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:35.476618 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473219456}
I20260709 13:19:35.449489 21569 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:35.459226 21971 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:35.417361 22057 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.493320 17216 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 5 to 7, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 7 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:35.454052 22039 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:35.478554 17434 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:35.496577 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 52163.3us
I20260709 13:19:35.465271 21484 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:35.496939 17390 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:35.475116 22020 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:35.449163 22025 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:35.506798 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:35.504544 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:35.512737 17216 catalog_manager.cc:5697] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:35.514848 17397 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:35.509840 21567 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:35.522469 17468 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:35.512255 21924 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.496166 21646 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.493664 21735 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:35.496171 21971 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:35.502997 21799 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.506228 21804 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.543908 17216 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:19:35.508055 22067 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:35.548192 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 43761.8us
I20260709 13:19:35.522351 22040 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.522004 21950 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:35.522491 22041 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:35.551687 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 103026us
W20260709 13:19:35.558665 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.524544 21944 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:35.586437 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.587886 17390 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:35.502540 21905 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.581997 17216 catalog_manager.cc:5697] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.565143 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:35.494153 22060 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:19:35.590915 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.525976 22020 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:35.525162 21848 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:19:35.537518 21704 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:35.557345 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:35.579859 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:35.594352 17471 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:35.605835 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:35.607091 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51665.5us
I20260709 13:19:35.525424 21793 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:19:35.606922 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:35.626763 17469 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:35.540516 22039 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:19:35.595642 22053 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:35.633677 17216 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:19:35.640125 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:35.524772 22065 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.640151 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:35.641139 22065 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.642204 17216 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:19:35.643738 22065 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:35.643849 17216 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:35.604940 22060 consensus_queue.cc:1243] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:35.549360 21924 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
W20260709 13:19:35.676733 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 50535.9us
W20260709 13:19:35.677400 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 55461.1us
I20260709 13:19:35.680236 17360 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.681111 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.681823 17317 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:35.622272 22040 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:35.622359 22042 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:35.650204 17216 catalog_manager.cc:5697] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 5 to 9, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 9 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:35.653818 21791 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:35.649197 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:35.656172 22067 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.657078 22046 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:35.657156 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:35.600396 21950 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:35.760782 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 103732us
I20260709 13:19:35.658218 22020 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.579326 22070 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:35.660288 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:35.661274 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:35.765707 22070 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.766731 17997 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.662016 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:35.663115 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:35.664505 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:35.624785 21804 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:35.550344 21735 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.597609 21799 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:19:35.683266 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 151453us
I20260709 13:19:35.607921 22044 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:35.541879 21646 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.686645 17471 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.653687 21919 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:35.684497 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:35.792475 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 113293us
I20260709 13:19:35.793486 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:35.606786 21944 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.786314 17964 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.782159 17393 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:35.782156 17990 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
W20260709 13:19:35.789085 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.785542 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:35.798334 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:35.607784 22076 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 13:19:35.735462 21848 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.804021 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:35.818619 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.825740 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.760365 22046 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.758945 22039 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.770735 21857 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:35.768770 22070 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:35.781689 21401 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:35.779539 22053 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.653123 22058 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:35.855691 17998 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:35.856736 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.871246 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:35.871013 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.857424 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.787730 22040 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:35.863834 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:35.864168 17318 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:35.795795 21791 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:35.864727 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 178924us
I20260709 13:19:35.875620 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:35.858436 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:35.869083 17317 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:35.803478 21894 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:35.804281 22075 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.878610 17996 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:35.890556 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:35.894662 17216 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 9 to 12, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 12 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:19:35.855206 22046 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.803560 22044 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.897617 17314 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:35.897827 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:35.897899 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.803905 22081 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:35.866410 22066 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:35.904763 17471 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:35.867802 21401 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.909883 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.912644 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.859599 21861 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.878014 21894 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.906248 22025 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:35.923442 22069 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:19:35.923319 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:35.909451 21704 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:19:35.870976 22058 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:35.925772 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:35.930318 22044 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:35.926054 22060 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 13:19:35.906881 22050 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:19:35.935472 17997 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:35.938057 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:35.947654 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 161458us
I20260709 13:19:35.950793 17462 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
W20260709 13:19:35.960907 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 162660us
I20260709 13:19:36.035449 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:35.935207 21658 consensus_meta.cc:287] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.006s
I20260709 13:19:35.882256 22053 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.982057 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:35.973562 17216 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 7 to 9, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 9 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.915469 22071 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.009574 17316 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:36.011817 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:35.966271 22025 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.895825 21848 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:35.940869 21401 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.036929 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:35.941210 21961 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:35.967226 21894 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.033107 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:36.032271 22060 consensus_queue.cc:1243] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:36.042675 17319 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:36.034567 17993 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:35.934938 22057 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:36.008126 21866 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.007s	sys 0.000s
I20260709 13:19:35.940096 21804 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:36.048815 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 66867.5us
I20260709 13:19:36.097488 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:36.096598 17216 catalog_manager.cc:5697] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 4 to 9, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 9 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:36.045128 17990 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
W20260709 13:19:36.054018 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 178486us
W20260709 13:19:36.083946 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 545169us
I20260709 13:19:36.099363 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:35.927657 22075 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.105123 22098 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:36.105737 22098 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.106173 22098 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:36.038491 22091 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.056860 22025 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.049141 22074 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:36.110283 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 74306us
I20260709 13:19:36.054217 21833 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:35.969219 21861 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.079042 21919 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:36.127388 21919 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:36.127928 21919 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.130646 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:36.132054 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 95215.5us
I20260709 13:19:36.133311 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:36.135182 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:36.136246 17216 catalog_manager.cc:5697] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:19:36.133040 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.137882 17216 catalog_manager.cc:5697] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:19:36.098544 21866 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.008s	sys 0.000s
I20260709 13:19:36.156651 17389 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:36.131764 21956 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.117542 21759 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:36.114295 22043 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:36.096021 22067 raft_consensus.cc:2764] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:36.047699 21658 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:35.937644 22066 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.164463 17360 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:36.167359 17216 catalog_manager.cc:5697] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:36.162683 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:36.089685 21961 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.048466 22040 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:36.224707 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 60357.5us
I20260709 13:19:36.060885 21791 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.165671 21646 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:36.233911 17216 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 7 to 9, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 9 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.235201 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:36.252890 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 151685us
I20260709 13:19:36.256054 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.257556 17216 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 9 to 11, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 11 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.259759 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:36.241889 22071 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:36.155643 21833 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.284058 17996 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:36.188738 22081 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:36.212384 22043 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:36.238343 22039 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:36.212357 21950 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:36.261911 21956 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:36.157625 22074 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.231277 22092 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:36.297497 17216 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 8 to 10, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 10 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.287436 22091 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:36.334262 22058 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.335587 22058 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.335421 22043 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.341163 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:36.341922 17394 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:36.343796 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 87868.4us
I20260709 13:19:36.344894 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.284814 21646 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:19:36.297111 22039 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:36.359760 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.308300 22057 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:36.314373 22071 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.287719 22067 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:19:36.288692 22078 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:19:36.254931 21804 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.334050 22088 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:36.404552 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 44919.9us
I20260709 13:19:36.417184 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:36.422214 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 288986us
I20260709 13:19:36.387655 22092 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:36.401083 22039 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:36.425252 22106 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.250s	user 0.000s	sys 0.002s
I20260709 13:19:36.382556 21956 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:36.412298 21950 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:36.449249 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.452387 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.418330 21848 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.454523 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:36.444195 22085 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
W20260709 13:19:36.455927 17965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.018s	sys 0.016s
W20260709 13:19:36.459126 17965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.018s	sys 0.016s
I20260709 13:19:36.459980 17393 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:36.411803 22057 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.454432 22071 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:36.450789 22053 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:36.474025 22080 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:19:36.478348 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 756) took 1099 ms. Trace:
I20260709 13:19:36.479031 22098 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.481619 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.456714 22092 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:36.498175 21861 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.486773 22071 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:36.499289 22057 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.505151 17394 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:36.490991 17392 rpcz_store.cc:276] 0709 13:19:35.379331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.422584 (+ 43253us) service_pool.cc:224] Handling call
0709 13:19:35.428013 (+  5429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:35.464085 (+ 36072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.464133 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:35.492263 (+ 28130us) log.cc:844] Serialized 52 byte log entry
0709 13:19:36.008496 (+516233us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:36.112936 (+104440us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.113325 (+   389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.113468 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.478115 (+364647us) raft_consensus.cc:1685] finished
0709 13:19:36.478136 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.478288 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34105,"prepare.queue_time_us":233916,"prepare.run_cpu_time_us":9009,"prepare.run_wall_time_us":23792,"raft.queue_time_us":40629,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":21349,"thread_start_us":549610,"threads_started":2,"wal-append.queue_time_us":575524}
W20260709 13:19:36.513221 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 50509us
I20260709 13:19:36.516978 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:36.517786 17392 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:36.519734 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:36.500483 22092 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:36.511626 21961 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:36.513451 22071 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.534631 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 800) took 1821 ms. Trace:
I20260709 13:19:36.515549 21658 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:36.540218 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:36.541641 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1942) took 1091 ms. Trace:
I20260709 13:19:36.540969 17315 rpcz_store.cc:276] 0709 13:19:34.704803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.725069 (+ 20266us) service_pool.cc:224] Handling call
0709 13:19:35.011809 (+286740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.014177 (+  2368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.525820 (+1511643us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54003facd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:36.525992 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658461440}
I20260709 13:19:36.425962 22081 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.542865 17391 rpcz_store.cc:276] 0709 13:19:35.450554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.490584 (+ 40030us) service_pool.cc:224] Handling call
0709 13:19:35.502572 (+ 11988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:35.524251 (+ 21679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.524284 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.543239 (+ 18955us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.833170 (+289931us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:35.833232 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.833328 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.541415 (+708087us) raft_consensus.cc:1685] finished
0709 13:19:36.541442 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.541581 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18894,"raft.queue_time_us":19212,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":12765,"thread_start_us":227866,"threads_started":1,"wal-append.queue_time_us":657348}
I20260709 13:19:36.546507 17394 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 12 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:19:36.547500 22114 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.223s	user 0.001s	sys 0.001s
I20260709 13:19:36.548329 22074 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:36.549847 21971 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.550812 22078 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.551011 21971 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:36.551950 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1947) took 1055 ms. Trace:
I20260709 13:19:36.552332 17394 rpcz_store.cc:276] 0709 13:19:35.496224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.535264 (+1039040us) service_pool.cc:224] Handling call
0709 13:19:36.546252 (+ 10988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:36.551687 (+  5435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.551891 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:36.553718 17394 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:36.554811 22058 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.556695 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:36.544796 21961 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:36.572888 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 91329.1us
I20260709 13:19:36.558079 22091 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:36.555440 22078 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:19:36.576829 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3103) took 1184 ms. Trace:
I20260709 13:19:36.582832 17468 rpcz_store.cc:276] 0709 13:19:35.392309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.392467 (+   158us) service_pool.cc:224] Handling call
0709 13:19:35.392769 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:35.522907 (+130138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.576571 (+1053664us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540020fb54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:36.576770 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297716096}
W20260709 13:19:36.580331 21857 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.686s	user 0.004s	sys 0.004s
I20260709 13:19:36.590790 17391 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:36.562809 22057 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:36.559185 22066 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:36.592751 17963 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.968s (SENT) [suppressed 6 similar messages]
I20260709 13:19:36.601478 17313 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.602610 22088 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:36.616232 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 102256us
I20260709 13:19:36.622490 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:36.604825 21944 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:36.580354 21401 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.581197 22115 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:36.545501 22092 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.580770 21919 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.641392 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1943) took 1190 ms. Trace:
I20260709 13:19:36.646368 21919 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:36.636958 22046 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.722s	user 0.006s	sys 0.005s
I20260709 13:19:36.647506 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1945) took 1196 ms. Trace:
I20260709 13:19:36.647639 22046 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.647927 17388 rpcz_store.cc:276] 0709 13:19:35.451371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.844522 (+393151us) service_pool.cc:224] Handling call
0709 13:19:35.844996 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:36.061927 (+216931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.061973 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:36.087544 (+ 25571us) log.cc:844] Serialized 52 byte log entry
0709 13:19:36.289566 (+202022us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:36.289745 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.289813 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.647274 (+357461us) raft_consensus.cc:1685] finished
0709 13:19:36.647297 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.647448 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66276,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":21127,"thread_start_us":335859,"threads_started":2,"wal-append.queue_time_us":517506}
I20260709 13:19:36.650264 17388 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:36.653920 22127 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.654493 22115 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:36.655328 22115 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:36.657507 22133 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:36.658032 22133 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:36.659387 22107 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:19:36.659163 22133 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:36.661432 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.662161 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.663483 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:36.664319 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.665792 21857 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.666507 21857 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.669927 22128 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:36.675712 22025 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.001s
I20260709 13:19:36.675801 22071 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.676235 22025 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.641798 17397 rpcz_store.cc:276] 0709 13:19:35.450823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.842876 (+392053us) service_pool.cc:224] Handling call
0709 13:19:35.843352 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:35.873398 (+ 30046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.873441 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.935673 (+ 62232us) log.cc:844] Serialized 26 byte log entry
0709 13:19:36.159032 (+223359us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:36.159083 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.159161 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.641200 (+482039us) raft_consensus.cc:1685] finished
0709 13:19:36.641219 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.641338 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20165,"raft.queue_time_us":84004,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":31277,"spinlock_wait_cycles":1290624,"thread_start_us":132788,"threads_started":1,"wal-append.queue_time_us":645084}
I20260709 13:19:36.681725 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:36.683387 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:36.684605 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:36.685803 17388 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:36.696803 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:36.697470 17999 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:36.700459 17313 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:19:36.701254 17313 pending_rounds.cc:85] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 9
I20260709 13:19:36.701699 17313 pending_rounds.cc:107] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:19:36.701965 17313 raft_consensus.cc:2889] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:36.706341 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1670) took 2509 ms. Trace:
W20260709 13:19:36.707998 21964 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:19:36.708122 22089 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.684753 22098 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.708742 22089 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.710922 22089 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.711517 22135 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:36.712203 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:36.711632 21516 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.713198 21516 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.713862 22137 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:36.714459 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 750) took 1336 ms. Trace:
I20260709 13:19:36.715008 17396 rpcz_store.cc:276] 0709 13:19:35.377763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.415058 (+ 37295us) service_pool.cc:224] Handling call
0709 13:19:36.714237 (+1299179us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5400253354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:36.714375 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26992000}
I20260709 13:19:36.715901 17997 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:36.716693 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3099) took 1402 ms. Trace:
I20260709 13:19:36.716929 17994 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:36.706749 17313 rpcz_store.cc:276] 0709 13:19:34.196878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.197014 (+   136us) service_pool.cc:224] Handling call
0709 13:19:34.197292 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.601278 (+2403986us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b58006f7dd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627500aa 00007f7d627d2447 00007f7d627eafe7 00007f7d627ec7de 00007f7d627f6b49 00007f7d627f7416 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4
0709 13:19:36.705960 (+104682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.706282 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2517675776}
I20260709 13:19:36.717170 17469 rpcz_store.cc:276] 0709 13:19:35.314827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.319362 (+  4535us) service_pool.cc:224] Handling call
0709 13:19:35.319653 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.627312 (+307659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.716420 (+1089108us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400061654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:36.716616 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705730432}
I20260709 13:19:36.718374 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.719023 17994 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:19:36.719370 17994 pending_rounds.cc:85] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 7
I20260709 13:19:36.719586 17994 pending_rounds.cc:107] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:19:36.719767 21857 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.720144 17434 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.720439 21857 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:36.719830 17994 raft_consensus.cc:2889] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:36.720821 21857 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:36.721900 22136 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:19:36.721694 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:36.722075 21857 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.720965 22041 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:36.684341 22066 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.688989 22133 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.681214 22040 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:36.722677 22057 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:36.738485 22057 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:36.738799 22055 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.738977 22057 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:36.742292 22117 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.340s	user 0.000s	sys 0.002s
I20260709 13:19:36.745038 21845 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:36.745138 22040 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.745725 21845 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:36.746951 21845 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.747490 22040 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.717484 21735 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:36.748224 21845 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:36.733392 22046 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:36.714547 21401 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.748700 22129 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:36.734489 17994 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:19:36.749210 22129 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.734293 22025 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.749600 22129 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.725276 22092 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.751984 21868 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.748530 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1946) took 1282 ms. Trace:
I20260709 13:19:36.734038 22066 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.752526 21868 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.753690 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:36.752529 17392 rpcz_store.cc:276] 0709 13:19:35.465691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.527215 (+1061524us) service_pool.cc:224] Handling call
0709 13:19:36.527709 (+   494us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:36.542527 (+ 14818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.542571 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:36.556162 (+ 13591us) log.cc:844] Serialized 78 byte log entry
0709 13:19:36.620606 (+ 64444us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:36.636416 (+ 15810us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.636714 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.636856 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.748292 (+111436us) raft_consensus.cc:1685] finished
0709 13:19:36.748315 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.748472 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10886,"prepare.queue_time_us":20538,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":19012,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":29544,"thread_start_us":38713,"threads_started":1,"wal-append.queue_time_us":135749}
I20260709 13:19:36.754456 17322 raft_consensus.cc:2368] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:36.754510 22066 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.754820 21868 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:36.755760 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:36.755750 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:36.745736 22071 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:36.759896 17319 pending_rounds.cc:85] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 8
I20260709 13:19:36.760123 22058 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:36.700438 22115 consensus_queue.cc:1175] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7108577e5754060b7e468a43dfdcdeb" responder_term: 10 status { last_received { term: 8 index: 6 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:36.752676 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:36.762508 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.764243 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.764986 22013 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.765498 22013 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.765990 21866 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.766719 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.752949 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:36.725067 17999 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:19:36.768158 17318 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:36.760269 17319 pending_rounds.cc:107] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:19:36.768968 17319 raft_consensus.cc:2889] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:36.766222 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.770182 17463 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:36.767663 22013 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:36.772347 17320 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:36.774209 17320 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:36.775566 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:36.775676 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.776340 17313 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.778153 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:36.779929 22093 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:36.780148 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.780481 22093 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:36.784468 21894 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.000s
I20260709 13:19:36.785766 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:36.789016 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:36.790573 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:36.791594 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:36.792418 17322 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:36.795993 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:36.768905 21857 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.797389 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:36.808713 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:36.808826 21516 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.809396 21857 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.809553 22127 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:36.809902 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:36.810480 17994 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:36.810742 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:36.812100 22129 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.814253 22129 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:36.816013 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.818701 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.798755 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:36.799068 22128 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.821879 17320 raft_consensus.cc:2368] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:36.801429 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.823170 17470 raft_consensus.cc:2368] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:36.819288 17318 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:36.803402 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:36.805038 22103 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:36.805989 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.806798 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.824760 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:36.784750 22093 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.825816 17463 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:36.765645 22039 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.827657 17990 raft_consensus.cc:2368] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13.
I20260709 13:19:36.829280 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:36.829474 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 150045us
I20260709 13:19:36.839672 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.818712 17313 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:36.836398 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.837050 17392 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:36.847779 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:36.848641 17397 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.850270 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:36.851729 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.852629 17396 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:36.810505 22066 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.854929 17999 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:36.855330 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:36.860860 17318 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:36.858647 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:36.775868 21866 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.865164 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:36.866122 17471 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:36.789000 21894 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:36.839241 22040 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:36.875908 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:36.878680 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:36.880100 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:36.880473 17396 raft_consensus.cc:2410] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:19:36.880791 17990 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.833851 22057 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:36.855551 21971 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.886076 22057 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:36.888046 17390 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.889113 17997 raft_consensus.cc:2368] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13.
I20260709 13:19:36.890204 17315 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:36.891461 17468 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:36.898324 17996 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:36.879681 17991 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:36.902595 17964 leader_election.cc:400] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:36.905560 17964 leader_election.cc:403] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:36.907191 17321 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:36.908478 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:36.853605 21516 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:19:36.910442 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:36.928413 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:36.941484 17464 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 9: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:36.942245 17317 pending_rounds.cc:85] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 4
I20260709 13:19:36.942605 17317 pending_rounds.cc:107] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:19:36.951527 17317 raft_consensus.cc:2889] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:36.968758 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:36.972819 17316 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:36.973285 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:36.974313 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 852) took 1640 ms. Trace:
I20260709 13:19:36.974696 17995 rpcz_store.cc:276] 0709 13:19:35.334200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.334929 (+   729us) service_pool.cc:224] Handling call
0709 13:19:35.338519 (+  3590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.426551 (+ 88032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.958930 (+1532379us) spinlock_profiling.cc:243] Waited 87.3 ms on lock 0x7b54004583d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:36.974255 (+ 15325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200847232}
I20260709 13:19:36.866775 21521 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:19:36.889516 21905 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:36.980074 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:36.896380 22040 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:36.985630 17313 raft_consensus.cc:2410] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:36.875586 22089 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:19:36.992146 17322 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:19:36.942521 21722 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:19:36.997262 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 172398us
I20260709 13:19:36.868825 22066 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.000187 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:37.000335 17285 leader_election.cc:336] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.937s (SENT)
I20260709 13:19:36.942093 22129 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:37.004660 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.014741 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:36.981520 21868 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:36.909409 21971 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.023151 17396 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:36.978943 21848 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:37.027133 17287 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:37.020258 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:37.038559 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:37.039366 17995 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.039618 22066 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:37.042791 22141 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:19:37.046558 21866 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.047837 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:37.051838 21894 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.052337 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:37.052655 22040 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.059778 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1949) took 1550 ms. Trace:
I20260709 13:19:37.060314 17391 rpcz_store.cc:276] 0709 13:19:35.509784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.547011 (+1037227us) service_pool.cc:224] Handling call
0709 13:19:36.547271 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.593299 (+ 46028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.059477 (+466178us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b54002be154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:37.059705 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99579264}
I20260709 13:19:37.065915 17390 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:37.007690 22041 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:37.070468 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:37.069355 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:37.073141 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:37.073625 17962 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:37.073704 17322 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:19:37.077144 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 76811.8us
I20260709 13:19:37.078347 17962 leader_election.cc:400] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:37.078775 17962 leader_election.cc:403] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:37.024436 21868 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:37.079793 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:37.031973 22013 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:37.016605 21861 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:19:37.083668 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:36.833663 22103 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.089326 17322 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
W20260709 13:19:37.106407 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.031308 22090 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:37.107492 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:37.110126 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:37.086952 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:37.077404 22127 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:37.079916 22129 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:37.120023 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.123551 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:37.078279 22093 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:19:37.126303 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.076953 22133 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:19:37.100549 22071 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:37.132198 22132 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:37.136552 17314 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:37.136955 22143 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:19:37.138506 22081 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.139194 22081 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.139825 21793 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:37.140556 21793 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.145638 22111 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.138581 22143 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:37.146368 22111 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.151096 22081 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:37.152103 21971 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:37.153779 17396 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:37.154469 22071 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:37.155112 22071 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:37.147097 17394 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:37.165288 22039 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.172088 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:37.173005 17464 raft_consensus.cc:2410] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:19:37.173727 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:37.174306 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:37.177222 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:37.178028 17394 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
W20260709 13:19:37.178216 17466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1830) took 1538 ms (client timeout 1827 ms). Trace:
W20260709 13:19:37.178676 17466 rpcz_store.cc:269] 0709 13:19:35.639835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.639935 (+   100us) service_pool.cc:224] Handling call
0709 13:19:37.177992 (+1538057us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540016add4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:37.178156 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2771222784}
I20260709 13:19:37.179567 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:37.181348 22025 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:37.181845 22025 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.182266 22025 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:37.182505 22120 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:37.185566 21964 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:37.186031 21964 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:37.187096 21964 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.190814 21804 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.191376 21804 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.193890 21905 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.194289 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.194466 21905 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.195896 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.151111 22126 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.199796 22126 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.202085 22126 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:37.205464 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 1980) took 1381 ms. Trace:
I20260709 13:19:37.205865 17321 rpcz_store.cc:276] 0709 13:19:35.824507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.824713 (+   206us) service_pool.cc:224] Handling call
0709 13:19:35.857687 (+ 32974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.907758 (+1050071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.205222 (+297464us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003fc0d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:37.205405 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412763008}
I20260709 13:19:37.207321 17321 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:37.207835 21722 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:37.211653 22098 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.212209 22098 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.212872 22111 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:37.214344 22098 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.216079 22103 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.216964 22075 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:37.077751 22041 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.220961 22041 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:37.222474 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:37.075809 21848 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.224444 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.226778 17996 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:37.228868 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:37.241402 17995 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:37.242758 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:37.244956 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 113490us
I20260709 13:19:37.252292 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:37.245445 17466 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:37.247398 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:37.249116 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:37.250120 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.253890 17996 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:37.251368 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.256549 17322 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:37.260414 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:37.260913 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:37.261030 17996 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:37.268777 22092 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
W20260709 13:19:37.269577 22142 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
W20260709 13:19:37.258082 22146 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 13:19:37.257995 22103 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:37.258728 22153 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.093s	user 0.000s	sys 0.004s
I20260709 13:19:37.129345 22066 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:37.271658 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:37.258589 22145 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
W20260709 13:19:37.257948 22147 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
I20260709 13:19:37.272724 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:37.273355 17388 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.273891 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:37.224239 21919 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:37.258896 22151 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.102s	user 0.005s	sys 0.000s
I20260709 13:19:37.274751 21919 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.275390 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:37.276702 17471 raft_consensus.cc:2410] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:37.277563 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:37.278124 17394 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:37.278858 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:37.279367 17394 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:37.279592 17990 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:37.280046 22128 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:37.274443 17465 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:37.271993 17992 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:37.281642 17990 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:37.284169 17998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 912) took 1505 ms (client timeout 1876 ms). Trace:
W20260709 13:19:37.284669 17998 rpcz_store.cc:269] 0709 13:19:35.779107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.779287 (+   180us) service_pool.cc:224] Handling call
0709 13:19:37.283955 (+1504668us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b54006d1fd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:37.284090 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120367872}
W20260709 13:19:37.286197 22148 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:19:37.286295 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.286923 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.287367 17998 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 6: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:37.288727 17998 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:37.306226 17991 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:37.289783 17993 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:37.297063 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1948) took 1787 ms (client timeout 2165 ms). Trace:
W20260709 13:19:37.348867 17390 rpcz_store.cc:269] 0709 13:19:35.509414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.588694 (+ 79280us) service_pool.cc:224] Handling call
0709 13:19:37.296877 (+1708183us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540023cdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:37.296990 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2933659904}
I20260709 13:19:37.303160 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:37.299252 17388 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:37.352785 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:37.353547 17388 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:37.293529 17990 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:19:37.364740 17397 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
I20260709 13:19:37.365161 17397 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:37.366030 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:37.366717 17397 raft_consensus.cc:2368] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:37.367523 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:37.367986 17397 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:37.368427 17388 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:37.368558 17995 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:37.369896 17388 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:37.372665 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:37.396993 17462 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:19:37.249751 22143 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:37.389325 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 87354.8us
W20260709 13:19:37.298308 22099 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.895s	user 0.006s	sys 0.001s
W20260709 13:19:37.291651 22105 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.868s	user 0.010s	sys 0.003s
I20260709 13:19:37.393334 17996 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:37.372411 22098 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:37.398068 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.394502 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 91499us
I20260709 13:19:37.401286 17462 pending_rounds.cc:85] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 7
I20260709 13:19:37.441289 17462 pending_rounds.cc:107] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:19:37.441715 17462 raft_consensus.cc:2889] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:37.401969 17322 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:37.448242 17390 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 9.
I20260709 13:19:37.403246 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:37.291828 22055 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:37.408562 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:37.403684 22075 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:37.417236 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.263129 21905 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:37.427793 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.462198 17990 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:37.430248 17394 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
W20260709 13:19:37.376886 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 290024us
I20260709 13:19:37.465782 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:37.466549 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:37.433619 17464 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:37.393987 22066 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:37.415596 17397 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:37.402614 21759 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.397727 21484 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:37.457262 17390 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
W20260709 13:19:37.459897 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 51432.5us
I20260709 13:19:37.488112 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:37.489554 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:37.467499 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:37.473002 22093 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:37.498085 17397 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:37.474169 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:37.446947 21848 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:37.481534 17313 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:37.450356 22098 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.491484 17390 pending_rounds.cc:85] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 7
I20260709 13:19:37.484381 21484 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.439338 22044 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:19:37.513974 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1941) took 2063 ms. Trace:
I20260709 13:19:37.532184 17395 rpcz_store.cc:276] 0709 13:19:35.450275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.474798 (+ 24523us) service_pool.cc:224] Handling call
0709 13:19:35.475058 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:35.496642 (+ 21584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.496673 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.503182 (+  6509us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.985531 (+482349us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:35.985586 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.985680 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:37.297592 (+1311912us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:37.506363 (+208771us) raft_consensus.cc:1685] finished
0709 13:19:37.506391 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:37.513894 (+  7503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33822,"raft.queue_time_us":21862,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3918,"spinlock_wait_cycles":189572480,"thread_start_us":444301,"threads_started":1,"wal-append.queue_time_us":770466}
I20260709 13:19:37.469802 22055 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:37.470707 22021 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:37.485476 22128 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:37.451789 21569 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:19:37.497572 21905 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:37.496038 22093 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:19:37.524616 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 381022us
I20260709 13:19:37.517230 21919 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:37.540731 22021 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.498708 21759 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.544261 21919 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:37.535125 17390 pending_rounds.cc:107] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:19:37.554219 17390 raft_consensus.cc:2889] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:37.549095 21845 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.800s	user 0.014s	sys 0.000s
I20260709 13:19:37.545450 22093 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.546211 22128 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:37.553095 21919 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.598346 17469 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:37.602803 22128 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.611423 21919 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:37.591536 22071 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.615371 17999 raft_consensus.cc:2410] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:37.617059 22071 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.606546 21484 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.608743 17390 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:37.593339 22040 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:19:37.625083 22020 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.625083 21646 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:37.625813 22020 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:37.626742 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 179122us
W20260709 13:19:37.627175 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 48385.3us
I20260709 13:19:37.540299 22066 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.626472 22021 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.633724 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:37.635711 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:37.634518 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:37.643345 17391 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:37.633488 17360 leader_election.cc:400] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:37.642395 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:37.651665 17395 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:37.651237 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:37.651549 17360 leader_election.cc:403] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:37.646503 22103 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:37.676012 22021 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:37.680241 22098 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.680637 22021 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.681245 22098 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.681460 22021 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:37.635994 22111 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:19:37.685606 22111 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:37.685988 22111 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:37.686836 22111 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.688038 22111 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:37.688270 22025 consensus_meta.cc:287] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.000s
I20260709 13:19:37.697371 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:37.697697 22020 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.698274 17395 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:37.699560 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:37.700239 17391 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
W20260709 13:19:37.701197 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 143798us
I20260709 13:19:37.701052 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:37.704073 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:37.720477 17393 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:37.725313 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.725668 17321 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:37.639688 22055 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.727756 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:37.728650 17322 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:37.688697 22025 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:37.733696 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 244212us
I20260709 13:19:37.734592 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:37.731048 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:37.741184 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:37.722791 22075 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:37.746544 21894 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:37.747619 22075 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.748915 22167 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:19:37.750070 21759 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.750572 22167 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:37.750747 21759 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.751401 21759 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.752465 22160 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:37.753535 22160 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:37.754249 22025 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:37.754510 22160 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:37.754844 22025 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:37.754896 22160 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:37.755301 22025 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:37.755824 21924 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:37.756392 21924 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:37.756625 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:37.757285 17321 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
W20260709 13:19:37.758213 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.745193 22158 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:37.758937 22158 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:37.759268 22158 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:37.760056 22158 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.761122 17314 raft_consensus.cc:2368] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14.
I20260709 13:19:37.761184 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.761391 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.755856 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:37.762287 17993 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:37.744905 22041 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:37.729651 22103 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:37.768461 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:37.770460 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:37.769423 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:37.778038 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.778751 17998 raft_consensus.cc:2376] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12. Re-sending same reply.
I20260709 13:19:37.778803 21905 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:37.785609 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.786331 17998 raft_consensus.cc:2376] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12. Re-sending same reply.
I20260709 13:19:37.793522 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.795445 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.796265 17995 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:37.764227 22159 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:37.797840 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:37.773849 22103 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.729907 22021 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.802922 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:37.773486 21845 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:37.790628 22158 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.788053 22044 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:37.756134 22025 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.788883 21905 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:37.806377 22103 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:37.824388 22098 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12.
I20260709 13:19:37.826449 21759 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.827297 21905 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.757314 21924 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.851015 21759 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:37.820766 22044 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:37.808171 22168 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:19:37.855921 21759 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:37.884119 21793 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:37.885960 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1218) took 1165 ms. Trace:
I20260709 13:19:37.886493 17997 rpcz_store.cc:276] 0709 13:19:36.720491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.723672 (+  3181us) service_pool.cc:224] Handling call
0709 13:19:37.885731 (+1162059us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400246154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:37.885879 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291188608}
I20260709 13:19:37.888250 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:37.888978 17320 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:37.889863 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:37.890046 21833 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:37.890941 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:37.891870 17320 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:37.904778 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:37.957021 22134 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:37.921978 22044 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:37.966696 21868 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:37.982228 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 210255us
I20260709 13:19:37.992494 22065 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.998230 22065 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.011765 21868 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.028815 22066 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:38.021589 17464 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:38.042389 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:38.055945 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.058853 17285 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:38.058946 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3110) took 2380 ms. Trace:
I20260709 13:19:38.072949 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.066223 17467 rpcz_store.cc:276] 0709 13:19:35.678371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.678546 (+   175us) service_pool.cc:224] Handling call
0709 13:19:35.730314 (+ 51768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.730589 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:35.805321 (+ 74732us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.751314 (+945993us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b1800492b20. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f707522 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:19:37.647467 (+896153us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b1800492b20. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:19:37.816239 (+168772us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.058500 (+242261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:38.058570 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:38.058633 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.058720 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.058873 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73732,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":108,"raft.queue_time_us":37439,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":13406,"spinlock_wait_cycles":51636864,"thread_start_us":403988,"threads_started":2}
I20260709 13:19:38.079869 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:38.065558 21944 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.361s	user 0.014s	sys 0.002s
I20260709 13:19:38.048882 22075 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:38.081028 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.082808 22093 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:38.083531 22123 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.598s	user 0.000s	sys 0.007s
I20260709 13:19:38.077826 22021 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.059222 22168 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:38.059713 22066 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:38.090313 22161 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.442s	user 0.002s	sys 0.000s
I20260709 13:19:38.090739 22172 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:38.100807 22188 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.102440 21919 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.107154 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:38.086831 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.122941 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:38.139145 17997 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:19:38.094671 21944 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.394s	user 0.014s	sys 0.003s
I20260709 13:19:38.078325 21894 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:38.148109 17998 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:38.149856 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 212814us
I20260709 13:19:38.075630 22041 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:38.181757 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:38.115662 22020 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:38.185475 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:38.187814 17462 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:38.188374 17470 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:38.190362 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:38.193964 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:38.150471 21894 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:38.201154 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:38.183552 21793 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:38.142911 22168 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:38.120589 22075 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:38.146234 22172 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:38.192081 22180 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.201264 21894 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:38.149642 22188 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:38.238324 17470 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:38.244740 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.247324 17993 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:38.248138 17995 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:38.248663 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:38.214519 22055 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:38.207763 21759 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:38.288995 22065 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:38.244702 22193 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:38.298945 17471 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:38.315016 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:38.315490 22167 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
I20260709 13:19:38.299279 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:38.300464 21971 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.301532 22160 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.237283 22101 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.317101 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:38.316999 22101 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.318109 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:38.318603 22025 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.316300 21971 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:38.319289 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.320437 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:38.321141 21971 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:38.303647 22066 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.304898 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:38.318990 22101 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.321981 17997 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:38.322110 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 921) took 1426 ms. Trace:
I20260709 13:19:38.322535 22172 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:38.322583 17999 rpcz_store.cc:276] 0709 13:19:36.896107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.195622 (+299515us) service_pool.cc:224] Handling call
0709 13:19:38.321916 (+1126294us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400661054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:38.322055 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962323712}
I20260709 13:19:38.215559 22192 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:38.326277 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.328367 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.306388 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:38.306965 22111 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.618s	user 0.032s	sys 0.008s
I20260709 13:19:38.307376 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.214756 21833 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.310211 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:38.332000 17466 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:38.333354 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.333894 17963 leader_election.cc:400] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12.
I20260709 13:19:38.335223 17315 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:19:38.336051 22154 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.181s	user 0.001s	sys 0.001s
I20260709 13:19:38.336910 17466 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:38.337070 22065 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.337661 22065 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.339844 22065 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:38.312151 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.341586 17471 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:38.332093 21833 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.342840 17471 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:38.344326 17993 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:19:38.344703 17993 pending_rounds.cc:85] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 9
I20260709 13:19:38.344930 17993 pending_rounds.cc:107] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:19:38.346035 17993 raft_consensus.cc:2889] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.346179 22075 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:38.346391 17993 pending_rounds.cc:107] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:19:38.346657 17993 raft_consensus.cc:2889] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.304893 17470 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:19:38.346765 21804 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.349166 17467 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:38.316090 22167 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:38.345603 21833 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:38.347081 17470 pending_rounds.cc:85] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 5
I20260709 13:19:38.353763 17470 pending_rounds.cc:107] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:19:38.354238 17470 raft_consensus.cc:2889] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.318629 17316 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:38.352334 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:38.370622 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.217135 21793 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:38.384114 22065 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:38.393324 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2002) took 1498 ms. Trace:
I20260709 13:19:38.372632 21961 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:19:38.241163 22180 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:38.412942 17317 rpcz_store.cc:276] 0709 13:19:36.894736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.895379 (+   643us) service_pool.cc:224] Handling call
0709 13:19:36.942033 (+ 46654us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:36.978860 (+ 36827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.978889 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:36.979423 (+   534us) log.cc:844] Serialized 52 byte log entry
0709 13:19:37.077075 (+ 97652us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:37.077118 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.077184 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.335767 (+1258583us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b2400170dc8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f58d9c4 00007f7d5f58bacb 00007f7d5f746dc9 00007f7d5f746a55 00007f7d5f74609d 00007f7d6237810e 00007f7d6238f88c 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221
0709 13:19:38.384968 (+ 49201us) raft_consensus.cc:1685] finished
0709 13:19:38.384992 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.393249 (+  8257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16613,"raft.queue_time_us":23780,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4687,"spinlock_wait_cycles":172969728,"thread_start_us":67626,"threads_started":1,"wal-append.queue_time_us":163639}
I20260709 13:19:38.419647 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:38.421006 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.393697 22134 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:19:38.428040 17992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 859) took 1815 ms (client timeout 2159 ms). Trace:
I20260709 13:19:38.427933 17464 raft_consensus.cc:2410] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:19:38.428598 17992 rpcz_store.cc:269] 0709 13:19:36.613121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.613272 (+   151us) service_pool.cc:224] Handling call
0709 13:19:38.425489 (+1812217us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54001a8bd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:38.427974 (+  2485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491616640}
I20260709 13:19:38.431816 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.399875 22128 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:19:38.434845 17463 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:38.435987 17470 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:38.380014 22041 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.442260 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.418776 22044 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:38.423692 22065 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:38.450208 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.471349 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.476728 17470 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:38.447826 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:38.475106 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:38.443182 22093 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.482432 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:38.474020 21401 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.494782 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:38.491197 17998 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:38.497972 17286 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:38.497972 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:38.498531 17999 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:38.476109 21919 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.450209 22213 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:38.501896 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:38.482107 22217 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:38.497166 22187 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:19:38.509797 22213 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.473764 22044 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.505838 22167 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.499691 22169 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:38.502660 21868 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:19:38.502565 21633 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:38.539288 21633 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:38.539721 21633 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:38.541990 22103 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.697s	user 0.018s	sys 0.000s
I20260709 13:19:38.542456 22103 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.544549 22103 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.516266 22075 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:38.516764 22172 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:38.517587 21971 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:38.517448 22065 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.519105 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:38.505052 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:38.521421 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:38.524528 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:38.558039 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53087.1us
I20260709 13:19:38.559409 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:38.560187 17392 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:38.527117 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:38.517441 22066 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:19:38.530779 22213 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.532997 22044 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.502715 22111 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:38.536329 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:38.555339 22203 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.168s	user 0.001s	sys 0.001s
I20260709 13:19:38.494618 22210 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:38.546309 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.548175 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.549223 22169 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.550063 22039 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:38.557694 17389 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 9.
I20260709 13:19:38.621949 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:38.563531 21868 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:38.565140 22212 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:19:38.567291 21894 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.504366 21401 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.559196 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:38.609519 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:38.534915 22167 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.535745 22168 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:38.617496 17395 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:38.616139 17470 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:38.626704 17392 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
W20260709 13:19:38.637703 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 78618.9us
I20260709 13:19:38.638264 22167 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.630113 21868 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:38.660524 21868 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:38.616819 22111 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.683231 17392 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:38.637032 22188 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:38.697299 21793 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:38.706238 17287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.015s	sys 0.024s
I20260709 13:19:38.675366 22111 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:38.706677 17287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.015s	sys 0.024s
I20260709 13:19:38.688612 22210 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:38.713224 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 777) took 1410 ms. Trace:
I20260709 13:19:38.712466 22210 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:38.709581 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 515691us
I20260709 13:19:38.713704 17394 rpcz_store.cc:276] 0709 13:19:37.302473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.464628 (+162155us) service_pool.cc:224] Handling call
0709 13:19:37.495460 (+ 30832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.639299 (+143839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.639337 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.351263 (+711926us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b2c0005c228. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:19:38.372174 (+ 20911us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.495803 (+123629us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:38.495859 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.495957 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.712908 (+216951us) raft_consensus.cc:1685] finished
0709 13:19:38.712929 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.713159 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31247,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7143,"spinlock_wait_cycles":4907776,"thread_start_us":231574,"threads_started":2,"wal-append.queue_time_us":310099}
I20260709 13:19:38.716776 17287 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:38.634346 22039 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.724642 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:38.636036 22169 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:38.731812 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:38.712509 21894 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.719103 21646 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:38.745826 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:38.734171 22218 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:38.751874 17962 leader_election.cc:400] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14.
I20260709 13:19:38.751807 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:38.752418 17962 leader_election.cc:403] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:19:38.751853 22158 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.937s	user 0.017s	sys 0.004s
I20260709 13:19:38.750093 22021 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:38.765386 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:38.742274 22211 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:19:38.769948 21633 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:38.774179 22215 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:19:38.765731 21401 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.750629 22218 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:38.743924 22090 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:19:38.756392 22224 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:38.804646 17434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.004s	sys 0.012s
W20260709 13:19:38.810583 17434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.004s	sys 0.012s
I20260709 13:19:38.802831 22120 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:38.802649 22021 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:38.811094 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 620781us
I20260709 13:19:38.819283 17391 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:38.808434 22218 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:38.824282 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:38.842038 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:38.842980 17390 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:19:38.855537 17991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 924) took 1946 ms (client timeout 1785 ms). Trace:
W20260709 13:19:38.856089 17991 rpcz_store.cc:269] 0709 13:19:36.909515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.097773 (+188258us) service_pool.cc:224] Handling call
0709 13:19:38.855309 (+1757536us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54006815d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:38.855437 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245334272}
W20260709 13:19:38.857758 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 267160us
I20260709 13:19:38.851840 21401 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.860697 21401 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:38.861114 21401 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.861599 21633 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.848066 22232 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:38.869236 22169 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:38.872314 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:38.873615 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:38.871594 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:38.876526 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:38.880767 22169 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.882825 22169 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:38.885046 22169 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:38.889902 22214 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.410s	user 0.002s	sys 0.000s
I20260709 13:19:38.891729 22025 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:38.892226 22025 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:38.881186 21845 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:38.893244 22025 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:38.894636 22025 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:38.895241 22169 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.883283 22021 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.881805 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:38.877110 22039 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:38.884637 21924 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:38.876052 22232 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:38.867916 22167 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:38.939654 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1246) took 1177 ms. Trace:
I20260709 13:19:38.897521 22044 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:38.943070 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3118) took 1772 ms. Trace:
I20260709 13:19:38.953415 17468 rpcz_store.cc:276] 0709 13:19:37.171119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.172671 (+  1552us) service_pool.cc:224] Handling call
0709 13:19:37.172949 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.232573 (+ 59624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.232604 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:37.232644 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:37.232678 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.942794 (+1710116us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b540041fad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:38.942854 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.943003 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136656768}
I20260709 13:19:38.943770 17995 rpcz_store.cc:276] 0709 13:19:37.762674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.806303 (+ 43629us) service_pool.cc:224] Handling call
0709 13:19:38.247811 (+441508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.248547 (+   736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.939436 (+690889us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b540049a2d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:38.939570 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995752832}
I20260709 13:19:38.884454 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:38.956260 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 71901.8us
W20260709 13:19:38.972759 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.879532 22188 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:19:38.943936 21924 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.025063 17396 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:38.970692 21793 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:39.028290 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 263839us
I20260709 13:19:39.036223 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.037010 17315 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:39.024317 21924 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:39.029907 21857 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:19:39.045203 22232 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.049919 22167 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.054338 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 926) took 2138 ms. Trace:
I20260709 13:19:39.054841 17994 rpcz_store.cc:276] 0709 13:19:36.915769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.298923 (+383154us) service_pool.cc:224] Handling call
0709 13:19:37.299306 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.533998 (+1234692us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:38.534297 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.824455 (+290158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:38.824519 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:38.824577 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.054064 (+229487us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54007611d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:39.054122 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.054270 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20016,"prepare.queue_time_us":589,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":16546,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3361,"spinlock_wait_cycles":2847661696,"thread_start_us":281174,"threads_started":1,"wal-append.queue_time_us":467367}
I20260709 13:19:39.041152 17315 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:39.041613 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:39.065812 22120 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:39.066323 22120 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:39.069242 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1835) took 1027 ms. Trace:
I20260709 13:19:39.069648 17462 rpcz_store.cc:276] 0709 13:19:38.041942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.077894 (+ 35952us) service_pool.cc:224] Handling call
0709 13:19:39.069025 (+991131us) spinlock_profiling.cc:243] Waited 77.9 ms on lock 0x7b540020f654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:39.069174 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179186048}
I20260709 13:19:39.070371 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 867) took 1359 ms. Trace:
I20260709 13:19:39.070744 17996 rpcz_store.cc:276] 0709 13:19:37.710789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.710961 (+   172us) service_pool.cc:224] Handling call
0709 13:19:38.425735 (+714774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.607822 (+182087us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:38.607863 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:38.607917 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:38.607960 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.608035 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.070203 (+462168us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54001a8bd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:39.070317 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43864,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4636,"spinlock_wait_cycles":1642985344,"thread_start_us":181586,"threads_started":1}
I20260709 13:19:39.013113 22192 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:19:39.057816 21521 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:39.077814 21521 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:39.018648 22058 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:19:39.077322 22192 consensus_queue.cc:1243] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:19:39.040310 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.088660 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.081012 21845 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.078963 21521 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.116293 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:39.117311 21964 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.108078 21759 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:39.140501 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.137598 22058 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.142529 22058 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.147228 21759 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:39.149407 22235 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:19:39.118268 21845 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.171831 21401 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.144588 22058 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:39.115679 22101 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.114876 22132 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:39.152807 22234 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 13:19:39.167104 22155 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.611s	user 0.004s	sys 0.000s
I20260709 13:19:39.107338 22111 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:39.166380 22198 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.716s	user 0.000s	sys 0.008s
W20260709 13:19:39.242473 17469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3112) took 2480 ms (client timeout 1532 ms). Trace:
W20260709 13:19:39.242965 17469 rpcz_store.cc:269] 0709 13:19:36.762150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.768514 (+  6364us) service_pool.cc:224] Handling call
0709 13:19:39.242249 (+2473735us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b5400161f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:39.242379 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879817984}
W20260709 13:19:39.245489 22219 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.502s	user 0.008s	sys 0.000s
I20260709 13:19:39.167832 22167 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:39.168279 22211 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:39.165233 22169 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.256485 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:39.177904 21521 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:39.137568 21868 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.226853 21401 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.296119 17962 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:39.305421 17315 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:39.272496 21845 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:39.216533 22101 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:39.316819 17285 leader_election.cc:336] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.543s (SENT)
W20260709 13:19:39.332541 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 314321us
I20260709 13:19:39.299160 22230 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.230182 22132 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.302732 22134 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:39.310496 22070 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:39.311728 22224 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14.
I20260709 13:19:39.342569 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1694) took 1589 ms. Trace:
I20260709 13:19:39.343111 17319 rpcz_store.cc:276] 0709 13:19:37.753680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.892804 (+139124us) service_pool.cc:224] Handling call
0709 13:19:37.893158 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.893572 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.893616 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.894147 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.198060 (+303913us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:38.198119 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.198217 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.165645 (+967428us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:39.338837 (+173192us) raft_consensus.cc:1685] finished
0709 13:19:39.338868 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.342490 (+  3622us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57229,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":6245632,"thread_start_us":279077,"threads_started":1,"wal-append.queue_time_us":487518}
I20260709 13:19:39.287180 22167 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.310432 22225 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:19:39.367707 17463 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:39.338215 22134 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.344946 22070 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.397823 17465 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:19:39.403961 22218 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.558s	user 0.004s	sys 0.005s
I20260709 13:19:39.406105 22167 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.408715 22111 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:39.349016 22157 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:39.369151 22224 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.406131 22225 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:39.423738 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.340163 22230 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.399511 22134 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:39.412636 22169 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.412776 22070 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.404477 22218 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.447129 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:39.448082 17463 raft_consensus.cc:2368] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14.
I20260709 13:19:39.453837 17463 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:39.425134 22225 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:39.421331 22157 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.471237 22157 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:39.471442 21961 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:39.475071 21961 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:39.476346 22238 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.397s	user 0.000s	sys 0.011s
I20260709 13:19:39.475072 22180 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:39.477388 21759 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.478189 22211 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.478709 22211 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:39.484297 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.479079 21961 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:39.421561 22120 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.431223 22224 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.480752 22211 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:39.438578 21924 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.446436 22169 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:39.490563 22159 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.654s	user 0.019s	sys 0.018s
I20260709 13:19:39.500164 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.503749 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.504678 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.507459 17320 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:39.490000 21961 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.508433 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.512809 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.514518 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.515646 17314 raft_consensus.cc:2410] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:39.516731 17316 raft_consensus.cc:1217] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.9->[12.10-15.12]   Dedup: 12.10->[13.11-15.12]
I20260709 13:19:39.517454 17316 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: [12.10-15.12]
I20260709 13:19:39.518602 17318 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:39.519815 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.521852 17317 raft_consensus.cc:2410] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:19:39.506590 22159 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.686s	user 0.019s	sys 0.018s
W20260709 13:19:39.506225 17434 connection.cc:256] RPC call timeout handler was delayed by -1.020219515000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:19:39.525586 22225 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.526906 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:39.534337 17434 connection.cc:256] RPC call timeout handler was delayed by -1.0040991309999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 13:19:39.536374 17322 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:39.542424 21401 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:39.544661 22224 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:39.550091 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:39.550612 22230 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:39.551554 22246 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:39.552080 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:39.552628 17996 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.552938 22225 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.553092 22218 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.543040 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:39.535952 22159 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:39.563971 17996 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:39.547698 22132 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:39.565625 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:39.540292 22180 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:19:39.567369 22159 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.569125 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.570330 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.571446 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.572232 17320 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:19:39.522960 21961 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.576894 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:39.582245 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 935) took 1442 ms. Trace:
I20260709 13:19:39.547291 22101 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.582751 17999 rpcz_store.cc:276] 0709 13:19:38.140386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.324027 (+183641us) service_pool.cc:224] Handling call
0709 13:19:38.498365 (+174338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.499133 (+   768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.582014 (+1082881us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400084150. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:39.582177 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400174848}
I20260709 13:19:39.572932 22058 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:39.590615 17995 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:39.574218 21845 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:19:39.589077 22058 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.610491 22160 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.620100 21633 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.620952 21894 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.621534 21894 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.623747 21894 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.629171 22230 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.629844 22230 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.631345 17393 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:39.637610 22169 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.641511 21924 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.642165 21633 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.642409 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:39.643343 22041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.014s	sys 0.015s
I20260709 13:19:39.643524 22120 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:39.643715 22041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.014s	sys 0.015s
I20260709 13:19:39.644228 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3137) took 1559 ms. Trace:
I20260709 13:19:39.644378 17469 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:39.644696 22120 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:39.645404 22120 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:39.646574 22157 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.644600 17466 rpcz_store.cc:276] 0709 13:19:38.084457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.338365 (+253908us) service_pool.cc:224] Handling call
0709 13:19:38.831743 (+493378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.831971 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:39.097997 (+266026us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.433254 (+335257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.433327 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:39.433387 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.433474 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.644052 (+210578us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54001f0c50. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:39.644167 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":505775,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":103,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":1133535104,"thread_start_us":600596,"threads_started":2,"wal-append.queue_time_us":517414}
I20260709 13:19:39.647043 22157 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.628526 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1967) took 1112 ms. Trace:
I20260709 13:19:39.648931 22210 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:39.649909 22120 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.651672 22251 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:19:39.654194 21961 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:39.654690 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:39.654894 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:39.655519 17397 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:39.651120 22058 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:39.656028 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:39.656373 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:39.656994 17392 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:39.658507 22157 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:39.659582 22233 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.802s	user 0.002s	sys 0.008s
I20260709 13:19:39.662774 22224 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.663403 22224 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.650452 22230 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:39.649061 17396 rpcz_store.cc:276] 0709 13:19:38.516064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.518414 (+  2350us) service_pool.cc:224] Handling call
0709 13:19:39.628268 (+1109854us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400253354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:39.628444 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065193728}
I20260709 13:19:39.667971 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:39.668529 17392 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:39.669595 22224 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:39.665861 22135 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:39.670567 22135 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:39.673825 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 118109us
I20260709 13:19:39.678403 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:39.679114 17999 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.681373 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:39.681672 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:39.682124 17468 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.682253 17471 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.695245 17999 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:39.700801 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:39.757207 17394 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:39.702663 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.666352 21961 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.706697 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1971) took 1181 ms. Trace:
I20260709 13:19:39.761627 17395 rpcz_store.cc:276] 0709 13:19:38.525164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.525393 (+   229us) service_pool.cc:224] Handling call
0709 13:19:38.525740 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.662015 (+136275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.706428 (+1044413us) spinlock_profiling.cc:243] Waited 91.5 ms on lock 0x7b5400254754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:39.706621 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210425600}
I20260709 13:19:39.701974 21857 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.714231 21401 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.714361 22254 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:19:39.765338 21401 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.766917 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.714457 17392 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:39.716869 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.767745 17313 raft_consensus.cc:2410] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:39.713238 22224 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:19:39.721107 17319 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:19:39.727785 17316 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:39.727964 22070 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.718904 22192 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:19:39.738900 17471 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:39.719806 22217 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:39.774171 21964 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.797224 21964 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.797384 22217 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.798605 22229 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:39.799144 22229 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.799547 22217 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.799717 21964 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:39.753058 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:39.769006 21961 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.751530 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.801167 17315 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:39.797252 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:39.713380 22232 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:19:39.763824 17318 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:39.768117 17464 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:39.808009 17318 pending_rounds.cc:85] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 8
I20260709 13:19:39.719604 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.808367 17318 pending_rounds.cc:107] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:39.808791 17470 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 10: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:39.750357 21924 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.790035 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:39.814680 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.741856 17468 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:39.799407 22058 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.804103 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.760210 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:39.806176 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:39.806653 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:39.816282 17394 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.772289 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.749145 22135 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:39.833490 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:39.808787 17318 raft_consensus.cc:2889] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:39.835331 17999 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:19:39.810559 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:39.836728 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:39.811187 21961 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:39.812465 22229 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:39.816330 17397 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:39.807739 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.845443 17471 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:39.846253 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.847205 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.818069 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.818964 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.848704 17468 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:39.849684 17468 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:39.820086 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.825484 21868 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:39.827667 17393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 1969) took 1308 ms (client timeout 1711 ms). Trace:
W20260709 13:19:39.856551 17393 rpcz_store.cc:269] 0709 13:19:38.519100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.519222 (+   122us) service_pool.cc:224] Handling call
0709 13:19:39.827479 (+1308257us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540036fbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:39.827607 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2460799360}
I20260709 13:19:39.828510 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1845) took 1520 ms. Trace:
I20260709 13:19:39.829456 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:39.857429 17467 rpcz_store.cc:276] 0709 13:19:38.308492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.328069 (+ 19577us) service_pool.cc:224] Handling call
0709 13:19:39.828318 (+1500249us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5400383bd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:39.828427 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45149056}
I20260709 13:19:39.838132 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:39.839974 17314 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:39.827587 22225 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:39.866521 22225 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.871258 22134 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.851734 22218 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:39.873312 22218 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.882591 22192 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:39.884140 22058 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:39.813589 22111 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.885162 22111 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.888285 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:39.843233 22232 consensus_queue.cc:1243] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:39.843392 17465 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:39.813009 21924 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.843454 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:39.841184 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 81090.9us
I20260709 13:19:39.891692 21924 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:39.852236 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.892454 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:39.855185 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:39.893440 17394 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:39.893704 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:39.894030 17464 raft_consensus.cc:2393] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:39.807789 22210 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.894737 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:39.857793 17396 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:39.864439 17397 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:39.865692 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:39.896564 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:39.772733 21857 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:39.914386 17471 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:39.882736 22070 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:39.846403 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:39.894768 17392 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:39.840088 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:39.916975 17996 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:39.917208 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:39.918061 17997 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
W20260709 13:19:39.919107 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 72786.1us
I20260709 13:19:39.925580 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:39.902374 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:39.913759 17318 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:39.895525 21924 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.935403 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:39.926350 17997 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:39.852921 22248 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:39.933735 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.965938 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.966876 17318 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:39.939324 17360 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:39.930847 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:39.962814 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:39.968824 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 306517us
I20260709 13:19:39.974532 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:39.896133 22066 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.975402 17393 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:39.924160 22075 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.981599 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.913612 22169 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:39.987828 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:39.980108 17964 leader_election.cc:400] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14.
I20260709 13:19:39.984378 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.990638 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.932546 21971 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:39.991393 17313 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:19:39.929807 22229 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:39.996731 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:40.001135 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:40.002935 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:40.003713 17313 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:40.003863 17997 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:39.923564 22210 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:39.968780 22180 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:19:40.013716 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:40.015156 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:40.000077 22229 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.993650 22248 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:40.024209 17994 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:40.015415 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:39.985945 22066 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.037277 17313 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:39.994371 21924 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:19:40.010419 21971 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:39.998271 21961 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:40.000054 22255 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:19:39.990419 22075 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.046046 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:39.995941 22169 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.046792 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:40.047654 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:40.047572 17993 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:40.048326 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:40.056885 17992 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:19:40.057060 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:40.024974 22134 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:40.058590 17322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:40.059335 17322 raft_consensus.cc:606] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.059664 17322 raft_consensus.cc:614] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:40.035593 22229 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.059880 17318 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:19:40.052709 17995 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:40.064210 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:40.067972 21633 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:40.046248 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:40.069803 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.073377 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.073930 17471 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:40.078226 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:40.079276 21793 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:40.079720 21793 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:40.080554 21793 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:40.080560 17995 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:40.081750 21793 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.084030 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:40.085847 22249 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.596s	user 0.003s	sys 0.000s
I20260709 13:19:40.086344 17318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7601a632a565453b83b93c1020924101"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:40.086647 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:40.087260 17471 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:40.087565 22247 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.600s	user 0.002s	sys 0.000s
I20260709 13:19:40.092414 17464 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:40.093199 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3159) took 1401 ms. Trace:
I20260709 13:19:40.093580 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.094468 22041 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:40.095033 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.095144 17322 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:40.095345 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3161) took 1399 ms. Trace:
I20260709 13:19:40.083674 17997 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:40.093497 21633 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:40.096374 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:40.096473 21633 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:40.097518 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.097788 21401 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:40.098883 21633 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:40.095732 17390 rpcz_store.cc:276] 0709 13:19:38.695901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.849504 (+153603us) service_pool.cc:224] Handling call
0709 13:19:38.900715 (+ 51211us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:38.901867 (+  1152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.901928 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:38.902609 (+   681us) log.cc:844] Serialized 52 byte log entry
0709 13:19:39.322746 (+420137us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:39.350746 (+ 28000us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.351005 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.351099 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.664223 (+313124us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b1800093940. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f707522 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:19:40.087039 (+422816us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:40.095146 (+  8107us) raft_consensus.cc:1685] finished
0709 13:19:40.095166 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.095295 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22821,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":27533,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":23840,"spinlock_wait_cycles":34904704,"thread_start_us":319993,"threads_started":1,"wal-append.queue_time_us":491518}
I20260709 13:19:40.083495 22218 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:40.099802 22254 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:40.100665 22254 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:40.100980 22254 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:40.101801 22254 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.103168 22254 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:40.095075 22041 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:40.104666 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:40.105324 22041 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.105944 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:40.106662 22041 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:40.107084 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:40.107709 17315 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.093555 17391 rpcz_store.cc:276] 0709 13:19:38.691695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.849195 (+157500us) service_pool.cc:224] Handling call
0709 13:19:38.849572 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:38.902685 (+ 53113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.902733 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.970800 (+ 68067us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.415447 (+444647us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.415488 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.415557 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.085279 (+669722us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:40.092937 (+  7658us) raft_consensus.cc:1685] finished
0709 13:19:40.092957 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.093146 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1316,"raft.queue_time_us":1571,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":73,"spinlock_wait_cycles":7671040,"thread_start_us":381926,"threads_started":1,"wal-append.queue_time_us":430718}
I20260709 13:19:40.110031 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:40.096101 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.111372 17464 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:40.113107 22218 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:40.113510 22218 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.113839 22218 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.110107 22225 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:40.118851 22132 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:40.120069 22251 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:40.120539 22251 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:40.121685 22251 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.123484 22251 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.126919 22218 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.135622 17315 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
W20260709 13:19:40.044850 22088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.571s	user 0.003s	sys 0.025s
I20260709 13:19:40.138684 17962 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:40.017129 22232 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:19:40.036818 22070 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:40.153110 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:40.157296 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.157634 21857 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:40.158349 22169 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:40.159194 17464 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:40.162559 17471 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:40.163789 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:40.197515 17464 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.198062 22075 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:40.043128 21971 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:40.199028 21971 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:40.165634 22269 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:19:40.169082 22248 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.202423 22070 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:40.208066 22160 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 13:19:40.170536 22218 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:40.172457 22256 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:19:40.208887 17319 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
W20260709 13:19:40.175251 22260 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:19:40.189410 22134 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:40.210395 17313 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:40.191203 22210 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:40.123072 22229 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:40.216815 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 63773.4us
I20260709 13:19:40.226570 17464 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
W20260709 13:19:40.149121 22088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.698s	user 0.004s	sys 0.025s
I20260709 13:19:40.139561 22255 consensus_queue.cc:1243] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:40.233719 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:40.146795 22225 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:40.235133 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 336752us
I20260709 13:19:40.246582 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:40.248708 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:40.249553 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:40.237365 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:40.237854 17317 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.039s
W20260709 13:19:40.239748 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 387106us
I20260709 13:19:40.220150 22128 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:40.251935 17317 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.005s	sys 0.039s
W20260709 13:19:40.259192 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.252339 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:40.250376 17999 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:19:40.224236 22160 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:40.228273 22178 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.268970 17994 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:40.234545 22230 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:19:40.273052 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:40.271970 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:40.275315 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:19:40.275699 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 522685us
I20260709 13:19:40.277623 17993 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:40.279551 17315 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:40.258468 22132 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:40.241209 22192 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.242832 22134 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:40.258507 22128 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:40.270368 22160 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.235466 22218 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:19:40.288461 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:40.296558 17322 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:40.276432 22199 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:40.294113 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 354902us
I20260709 13:19:40.301717 22279 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:40.301352 22128 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.302188 22279 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.302589 22279 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:40.302717 22128 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.281922 22070 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:40.267848 22225 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.309268 17314 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:19:40.285828 21964 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.294341 22120 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.287402 22066 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:40.299610 22160 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.293919 22132 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:40.316100 17993 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:40.299027 21633 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.317906 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.312120 22199 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:40.321566 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:40.344066 17314 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.321763 17471 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:19:40.345572 17471 pending_rounds.cc:85] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 11
I20260709 13:19:40.345969 17471 pending_rounds.cc:107] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:19:40.346359 17471 raft_consensus.cc:2889] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:40.300782 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:40.327735 17997 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:19:40.348632 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 47964.8us
I20260709 13:19:40.349815 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:40.318858 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 388072us
I20260709 13:19:40.354221 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:40.356951 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 81696.2us
I20260709 13:19:40.363299 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:40.363981 17322 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
W20260709 13:19:40.364984 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.365118 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:40.362875 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.340126 22070 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.371253 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:40.374640 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:40.367534 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:40.354049 22066 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:40.378921 17321 raft_consensus.cc:2410] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:19:40.359659 22075 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.361740 22255 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:40.382452 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 109493us
I20260709 13:19:40.371696 21894 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:40.347852 22088 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:19:40.391096 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.382622 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.395504 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:40.395614 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.395750 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:40.391660 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.382570 22066 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.398968 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.368487 22254 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:40.402467 17286 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.403070 17360 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.404850 22267 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:40.405337 22267 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:40.405779 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:40.405956 22075 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:40.406554 17994 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:40.406728 22075 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.406298 22267 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.407110 22075 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:40.399437 22169 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.407630 22267 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.401813 22066 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.398993 22199 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.405422 17992 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:40.354336 22134 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.405407 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:40.401656 22172 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.399576 22294 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:40.416695 21868 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:40.417133 17360 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:40.384462 22283 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.417523 21868 consensus_queue.cc:1243] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:40.420584 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:19:40.421253 22266 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:19:40.421833 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:40.422124 17463 raft_consensus.cc:1217] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.9->[12.10-16.12]   Dedup: 12.10->[14.11-16.12]
W20260709 13:19:40.422650 22262 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:19:40.423156 22120 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:40.423547 22278 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:40.423866 22210 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:40.422776 21868 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:40.417219 22294 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.422720 17463 pending_rounds.cc:85] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 10
I20260709 13:19:40.415608 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.431159 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.439639 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.433091 17463 pending_rounds.cc:107] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:19:40.440346 17463 raft_consensus.cc:2889] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:40.440956 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.426445 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:40.433087 21971 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:40.442862 17471 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:19:40.438081 17314 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:40.445055 17471 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:40.445683 22275 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.445472 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:40.447748 17435 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:40.399386 21964 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:40.427471 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:40.451058 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.399523 22041 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:40.455914 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:40.457050 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.456759 17392 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:40.458199 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:40.399173 21894 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:40.461272 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:40.414059 22218 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.460363 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:40.464370 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:40.465073 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:40.468572 17394 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 6.
I20260709 13:19:40.403800 22273 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:40.457232 22041 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:40.474884 22041 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.475003 22225 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:40.475231 22272 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:19:40.450076 22294 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:40.476583 22270 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:19:40.467012 21964 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:40.477749 21964 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.450299 22217 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:40.481084 22217 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:40.481537 22217 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.423584 22120 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:40.449477 21924 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.450078 22282 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:40.508319 22282 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.450567 22180 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:40.452878 22283 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:40.485867 17392 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:40.392354 22132 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.520605 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:40.513201 22282 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:40.532598 22297 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:19:40.539305 21833 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:40.539819 21833 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:40.542774 17318 raft_consensus.cc:606] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:40.543229 17318 raft_consensus.cc:614] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:40.546365 17470 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:40.466863 22258 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.484506 22273 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.513733 22120 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.453928 22232 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:19:40.497545 22285 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:40.560287 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45459.8us
I20260709 13:19:40.519666 21971 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:40.561474 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 101186us
I20260709 13:19:40.565143 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.547767 21868 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:40.572506 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:40.554702 22258 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:40.556398 22273 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.524770 21857 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:19:40.617518 17990 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:40.512909 22188 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:40.547859 22180 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.556794 21924 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:19:40.559450 22075 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:40.618376 21971 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:40.540735 21833 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.610975 22258 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.629797 22232 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:40.647725 17990 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:19:40.639341 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 60719.7us
I20260709 13:19:40.561379 22303 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:19:40.624939 22288 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:40.639122 22276 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.253s	user 0.001s	sys 0.001s
W20260709 13:19:40.643678 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 76135.7us
W20260709 13:19:40.759898 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 106507us
W20260709 13:19:40.756388 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 285459us
W20260709 13:19:40.759923 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 194885us
W20260709 13:19:40.802462 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.575654 22295 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:19:40.802073 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:40.823453 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:40.773763 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.803233 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:40.820379 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:40.635766 22309 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:40.639356 22285 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.652855 22232 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.666821 22283 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:40.653535 21971 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:40.801295 21833 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.609835 21894 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:40.759407 22288 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:40.805343 22188 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:40.888358 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 840) took 1078 ms. Trace:
I20260709 13:19:40.639437 22305 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.249s
W20260709 13:19:40.894940 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 71596.6us
I20260709 13:19:40.878172 22232 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:40.648285 22312 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.244s
I20260709 13:19:40.890213 17316 rpcz_store.cc:276] 0709 13:19:39.810416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.828190 (+ 17774us) service_pool.cc:224] Handling call
0709 13:19:39.828648 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.839379 (+ 10731us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:39.839413 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.851585 (+ 12172us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.260054 (+408469us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:40.260101 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.260182 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.888153 (+627971us) raft_consensus.cc:1685] finished
0709 13:19:40.888171 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.888297 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6974,"raft.queue_time_us":10743,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":33163,"thread_start_us":389459,"threads_started":1,"wal-append.queue_time_us":481895}
I20260709 13:19:40.877458 22229 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:40.904609 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:40.917829 17360 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.919704 17360 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:40.889031 22303 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.891453 22188 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:40.957856 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 137581us
I20260709 13:19:40.873533 22309 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:40.894142 22285 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:40.962666 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:40.980297 17990 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:40.905030 22058 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.965998 17286 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:40.914239 22251 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.969945 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:40.971417 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 168252us
I20260709 13:19:40.833704 21868 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:40.892995 22320 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.913882 22293 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.924454 21521 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.963404 22111 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:41.023422 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 53554us
I20260709 13:19:40.959378 22315 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:40.981271 22291 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.420s	user 0.000s	sys 0.007s
W20260709 13:19:41.013626 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.016005 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:40.974041 22217 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:41.031806 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 112153us
I20260709 13:19:41.001837 22285 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:41.007259 22199 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:41.018536 22320 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:41.046304 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:41.021239 22058 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:41.041152 22287 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.411s	user 0.000s	sys 0.001s
I20260709 13:19:41.057053 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:41.023871 22323 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.064229 17964 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:41.066128 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:41.042258 22325 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:41.035151 21924 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:41.045464 22199 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:41.061600 22294 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.002s
I20260709 13:19:41.048594 22303 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:41.075719 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:41.017992 22251 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.050326 22075 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:41.076944 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 111052us
W20260709 13:19:41.056917 22304 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 13:19:41.010973 21971 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.080950 17318 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:40.983783 22288 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.056501 22180 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:41.053685 22058 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:41.048486 22320 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.054785 22322 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:41.085613 22199 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:41.017297 22283 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.108069 17286 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:41.106770 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 49829us
W20260709 13:19:41.117331 22317 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:19:41.120077 22309 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:41.083415 22229 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:41.123062 22251 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:41.109127 22285 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.126174 22088 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:41.126379 22075 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.077986 22254 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:41.023289 22293 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.040759 22315 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:41.106776 22172 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.689s	user 0.002s	sys 0.009s
I20260709 13:19:41.141043 22188 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.148331 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:41.104957 22303 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:41.107369 22134 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:41.152457 22025 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:41.149209 22101 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:41.079861 22225 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:19:41.072436 22324 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:19:41.084781 21924 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.149391 22210 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:41.104573 22294 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.171116 22303 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.157529 22309 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.153040 22326 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.175495 22188 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.157480 22088 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:41.195403 22088 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.196393 22088 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:41.197135 22294 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:41.197852 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:41.198377 17313 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:41.200428 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1855) took 1522 ms. Trace:
I20260709 13:19:41.164394 22288 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.160375 22075 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:41.169507 22172 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.168118 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:41.185657 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3156) took 3034 ms. Trace:
I20260709 13:19:41.186721 17392 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:19:41.188407 22160 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.848s	user 0.006s	sys 0.004s
I20260709 13:19:41.189031 22309 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.192281 22326 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:41.227716 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 59713.6us
W20260709 13:19:41.165572 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 121980us
I20260709 13:19:41.200750 17469 rpcz_store.cc:276] 0709 13:19:39.678391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.679942 (+  1551us) service_pool.cc:224] Handling call
0709 13:19:39.709726 (+ 29784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:40.322458 (+612732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.322506 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:40.328959 (+  6453us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.358940 (+ 29981us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.358973 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.200070 (+841097us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54001f3454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:41.200114 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.200158 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:41.200172 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.200373 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14956,"raft.queue_time_us":63845,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3982,"spinlock_wait_cycles":606850304,"thread_start_us":335477,"threads_started":2,"wal-append.queue_time_us":48243}
I20260709 13:19:41.206280 17388 rpcz_store.cc:276] 0709 13:19:38.151386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.151548 (+   162us) service_pool.cc:224] Handling call
0709 13:19:38.151905 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.368525 (+216620us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:38.396064 (+ 27539us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.646821 (+1250757us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b1800280f00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:19:40.390097 (+743276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.390156 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.390213 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.185395 (+795182us) spinlock_profiling.cc:243] Waited 99 ms on lock 0x7b540038d454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:41.185448 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.185601 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27199,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":2884,"raft.queue_time_us":21344,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8617,"spinlock_wait_cycles":232764544,"thread_start_us":742986,"threads_started":2,"wal-append.queue_time_us":1908271}
I20260709 13:19:41.206712 22075 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:41.212304 22041 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.737s	user 0.006s	sys 0.003s
I20260709 13:19:41.178684 22101 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.218163 22217 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:41.175001 22058 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.241773 22058 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.243345 21521 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.191314 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.237180 22172 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.245464 22172 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.245958 22172 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.238366 21924 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:41.176403 22025 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.228009 22160 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.249079 22041 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.250541 17465 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:41.251248 22273 consensus_meta.cc:287] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.002s
I20260709 13:19:41.251668 22273 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.253633 22273 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:41.254349 22101 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:41.255155 22315 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:41.255203 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.256222 22293 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:41.257073 22309 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:41.228260 22128 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.925s	user 0.005s	sys 0.008s
I20260709 13:19:41.256182 17389 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:41.257899 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.265806 17390 raft_consensus.cc:2410] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:19:41.266805 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.185566 22331 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:41.236748 22218 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.000s
I20260709 13:19:41.310782 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:41.236788 22120 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.000s
I20260709 13:19:41.316022 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.318365 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1266) took 1072 ms. Trace:
I20260709 13:19:41.318876 17997 rpcz_store.cc:276] 0709 13:19:40.246084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.246276 (+   192us) service_pool.cc:224] Handling call
0709 13:19:41.318155 (+1071879us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b54006cedd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:41.318294 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184776960}
I20260709 13:19:41.312557 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.312570 17393 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:41.313815 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.260000 22025 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:41.308763 22267 consensus_meta.cc:287] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.901s	user 0.010s	sys 0.003s
I20260709 13:19:41.257927 22326 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.330803 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.334379 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.322896 17389 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
W20260709 13:19:41.311170 22279 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.008s	user 0.013s	sys 0.000s
W20260709 13:19:41.313776 22066 consensus_meta.cc:287] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.905s	user 0.009s	sys 0.003s
I20260709 13:19:41.327669 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.316236 22218 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:41.350176 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:41.345497 22279 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.361610 22232 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.363879 22232 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:41.364754 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:41.364605 22199 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.365368 17313 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
W20260709 13:19:41.366726 22258 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 13:19:41.367153 22258 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.369006 17464 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:41.369217 22041 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:41.370169 22332 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:19:41.348126 22066 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.373597 22066 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:41.376111 22303 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.343096 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:41.384684 17318 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:41.385363 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:41.386394 17397 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:41.386859 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.335949 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:41.387274 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.344811 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:41.345160 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:41.381352 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:41.341972 22282 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.004s
I20260709 13:19:41.392545 22282 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.394728 22282 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:41.308594 22293 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:19:41.394886 17391 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:41.391927 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.405501 17393 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:41.406498 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.407260 17393 raft_consensus.cc:2410] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:19:41.340706 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.387275 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.389508 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:41.390261 17997 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:41.387651 17389 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:41.391178 17992 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:41.391888 22134 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:41.322350 22120 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.390196 22325 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:41.413355 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.462576 17397 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:41.463579 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:41.464221 17397 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.413398 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:41.465605 17998 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:41.465909 17995 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:41.413666 17321 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:41.416822 17996 pending_rounds.cc:85] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 7
I20260709 13:19:41.467607 17996 pending_rounds.cc:107] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 10.8
W20260709 13:19:41.557276 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 97826.9us
I20260709 13:19:41.557188 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:41.355629 22320 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.564519 17469 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:41.457530 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:41.453173 17466 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:41.455994 21401 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.424700 17313 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:19:41.566773 21401 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:41.441004 17395 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:41.460544 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:41.436195 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:41.425869 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:41.574505 17397 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
W20260709 13:19:41.574880 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 149093us
W20260709 13:19:41.461195 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 72957.1us
I20260709 13:19:41.575663 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:41.576782 17466 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:41.576987 17995 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:41.488545 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:41.574965 17994 raft_consensus.cc:2410] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:41.579376 17998 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:41.460614 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:41.460005 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:41.448877 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:41.415802 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.584527 17389 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:41.413141 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:41.436283 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:41.585729 17993 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 6.
I20260709 13:19:41.565776 17463 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:41.587567 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:41.588240 17463 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:41.423820 22284 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.850s	user 0.001s	sys 0.001s
I20260709 13:19:41.458295 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3142) took 2375 ms. Trace:
I20260709 13:19:41.432588 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:41.600557 17315 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:41.563616 17996 raft_consensus.cc:2889] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:41.602160 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:41.435864 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.449370 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:41.589401 17990 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:41.604192 17465 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:41.576166 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:41.605058 17397 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:41.607046 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:41.592869 17995 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:41.608948 21401 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:41.617726 17397 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:41.618705 17388 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:41.620151 17388 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:19:41.622388 17321 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:19:41.624742 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:41.625666 17321 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:41.450372 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:41.602748 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:41.635313 17994 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:41.419019 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:41.458125 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.650403 17388 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:41.601560 17462 rpcz_store.cc:276] 0709 13:19:39.083409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.083546 (+   137us) service_pool.cc:224] Handling call
0709 13:19:39.828929 (+745383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.860129 (+ 31200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.860163 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.860767 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.237601 (+376834us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.237653 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.238802 (+  1149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.307009 (+ 68207us) raft_consensus.cc:1685] finished
0709 13:19:40.307030 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.458071 (+1151041us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b5400383bd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:41.458241 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30815,"raft.queue_time_us":54272,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":1682095360,"thread_start_us":355235,"threads_started":1,"wal-append.queue_time_us":423434,"wal-append.run_cpu_time_us":1472,"wal-append.run_wall_time_us":1004024}
W20260709 13:19:41.429315 22316 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
W20260709 13:19:41.612103 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 123628us
I20260709 13:19:41.430907 22311 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:41.435596 22323 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:41.716219 17471 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:41.727388 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:41.717471 17319 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:19:41.457269 22041 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:41.734201 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 283887us
I20260709 13:19:41.447146 22303 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:41.420171 22134 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:41.720938 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:41.767117 17321 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:41.767119 17462 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:41.423894 22279 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:41.434713 22258 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:41.454608 21845 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:41.778822 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:41.728148 17317 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:41.782684 17321 raft_consensus.cc:2368] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15.
I20260709 13:19:41.728487 17396 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:41.729331 17397 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:19:41.729456 17285 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.027s	sys 0.107s
W20260709 13:19:41.572134 22274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.026s	sys 0.096s
W20260709 13:19:41.730047 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 76556.6us
I20260709 13:19:41.644763 17393 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:41.718384 22311 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:41.452486 22322 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:41.568578 22065 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.163s
W20260709 13:19:41.768340 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 161377us
I20260709 13:19:41.610069 22157 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:41.773885 17462 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:19:41.410079 22172 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.448462 22275 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.279s
I20260709 13:19:41.778959 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:41.440663 22188 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.295s
I20260709 13:19:41.408818 22075 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.613186 22267 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:41.773437 22128 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:41.589147 22111 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.194s
I20260709 13:19:41.718056 21833 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:41.735014 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:41.793656 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:41.829386 22088 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.000s
W20260709 13:19:41.794667 17285 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.032s	sys 0.108s
I20260709 13:19:41.782291 21845 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:41.852252 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 634007us
I20260709 13:19:41.797551 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:41.827106 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:41.828133 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 67018us
I20260709 13:19:41.767140 22041 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.856773 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:41.557008 22302 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.212s
I20260709 13:19:41.795807 17321 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:19:41.830145 17462 pending_rounds.cc:85] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 9
I20260709 13:19:41.857810 17462 pending_rounds.cc:107] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:19:41.858094 17462 raft_consensus.cc:2889] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:41.421875 22120 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:41.858831 17321 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:41.860414 17321 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:41.861974 17321 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:41.858896 22041 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:41.836668 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:41.777719 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:41.863745 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 86128.7us
I20260709 13:19:41.846657 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 872) took 2006 ms. Trace:
I20260709 13:19:41.864178 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:41.864439 17991 rpcz_store.cc:276] 0709 13:19:39.840156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.840318 (+   162us) service_pool.cc:224] Handling call
0709 13:19:39.840606 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.893113 (+ 52507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.893145 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.924444 (+ 31299us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.339184 (+414740us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:40.339245 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.339341 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.423275 (+1083934us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:41.836755 (+413480us) raft_consensus.cc:1685] finished
0709 13:19:41.836780 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.846572 (+  9792us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":14049,"spinlock_wait_cycles":47578496,"thread_start_us":351391,"threads_started":1,"wal-append.queue_time_us":488623}
I20260709 13:19:41.829941 22157 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.440598 22318 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.332s
I20260709 13:19:41.767715 22329 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:41.810515 21971 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.834656 17388 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:41.795595 22274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.026s	sys 0.096s
I20260709 13:19:41.865885 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:41.849045 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 55519.4us
I20260709 13:19:41.855576 17317 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:41.867918 17390 raft_consensus.cc:2393] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:41.760258 22169 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:19:41.874912 17392 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:41.909214 17393 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:41.910606 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:41.870433 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:41.843174 22267 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.905344 17360 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:41.912881 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:41.921039 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50715.5us
I20260709 13:19:41.881348 22128 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:41.854445 22325 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:41.878914 22157 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:41.936803 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:41.904172 21868 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:41.882323 22279 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:41.909222 21793 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:19:41.989370 22338 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:41.989478 22279 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.991937 22172 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:41.992254 22279 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:41.866042 21833 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.907766 22329 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:41.924021 22066 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:41.829185 22134 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.879990 22288 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.967886 22282 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:42.011094 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 89176.6us
I20260709 13:19:41.960638 22199 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:41.877768 21894 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:41.968561 22330 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:42.026557 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.965047 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 193026us
I20260709 13:19:41.950846 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:42.052780 22329 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:42.122888 21401 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:41.918859 22267 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:42.189257 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88946.3us
I20260709 13:19:42.193573 21401 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:42.194041 21401 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:42.195982 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:42.196363 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 72303us
I20260709 13:19:42.199398 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:41.933667 22258 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:42.200747 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.201215 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.201537 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.202802 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:42.203011 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:42.203413 17998 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.207643 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:41.934147 22323 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:42.208447 17468 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:41.810658 22218 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:42.073005 21857 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:42.198104 22172 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:42.081588 22293 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:42.216446 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.194839 21401 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.228262 21401 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.075281 22320 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:42.086556 22288 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.217181 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.215590 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:42.222095 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.187503 22041 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:42.255072 17997 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:42.253201 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.257925 17462 raft_consensus.cc:2410] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:19:42.198869 22065 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.213714 22066 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.259013 17465 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:42.204703 21894 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:42.271966 17999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:48172
I20260709 13:19:42.272601 17999 raft_consensus.cc:606] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:42.273026 17999 raft_consensus.cc:614] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:42.273417 17468 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:42.274310 17998 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:42.272432 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:42.297401 17996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.015s	sys 0.057s
I20260709 13:19:42.284562 17997 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
W20260709 13:19:42.297792 17996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.015s	sys 0.057s
W20260709 13:19:42.285287 22285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.051s	sys 0.055s
I20260709 13:19:42.226619 22188 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:19:42.248859 22218 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.993121 21868 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.064257 22325 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.286448 22199 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:42.214088 21857 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:42.288861 22341 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:19:42.289150 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 69403.2us
I20260709 13:19:42.186373 22282 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.254707 22293 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.265092 22288 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.271353 22320 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:42.346107 22320 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:42.346611 22320 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.347345 21857 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:42.305441 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 478385us
I20260709 13:19:42.349751 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:42.350454 21868 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:42.351415 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:42.351279 21894 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.267030 22088 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:19:42.308501 17316 consensus_meta.cc:287] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.001s
I20260709 13:19:42.233434 22172 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.334898 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:42.356210 22169 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:42.323032 22325 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:42.298983 22075 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:42.305321 22285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.051s	sys 0.056s
I20260709 13:19:42.232558 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:42.271217 22041 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.357261 17316 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:42.284911 22065 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.285125 22066 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.375309 17993 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.196996 22330 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.226372 22323 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:42.379052 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 163537us
I20260709 13:19:42.417378 17287 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:42.380314 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:42.354067 22088 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:42.362285 22326 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.015s	user 0.011s	sys 0.000s
I20260709 13:19:42.402390 17389 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:19:42.406687 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.434051 22326 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.434906 22066 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:42.399957 22279 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.356758 22172 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:42.425208 22293 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:42.426249 22301 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.547s	user 0.008s	sys 0.013s
I20260709 13:19:42.402108 22211 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:19:42.430374 22282 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:42.432817 22330 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:42.433367 22088 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:41.922334 22311 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:41.995772 22322 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.437582 22356 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:19:42.409858 22340 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 13:19:42.437048 21857 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.457901 22293 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:42.469563 22293 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:42.470110 22293 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.447635 21833 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:42.472697 22218 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:42.462585 22356 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:42.473867 22356 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.474350 22356 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.466241 22065 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:42.478747 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1717) took 1046 ms. Trace:
I20260709 13:19:42.457276 22355 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:42.481412 22355 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:42.481835 22355 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.408613 22041 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:42.422969 22342 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.435s	user 0.001s	sys 0.000s
I20260709 13:19:42.479197 17318 rpcz_store.cc:276] 0709 13:19:41.431878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.433802 (+  1924us) service_pool.cc:224] Handling call
0709 13:19:41.434120 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:41.593616 (+159496us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:41.593659 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:41.718531 (+124872us) log.cc:844] Serialized 26 byte log entry
0709 13:19:41.993876 (+275345us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:41.993919 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.993998 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:42.478500 (+484502us) raft_consensus.cc:1685] finished
0709 13:19:42.478521 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.478666 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217870,"raft.queue_time_us":174389,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":149642,"thread_start_us":176367,"threads_started":1,"wal-append.queue_time_us":573078}
I20260709 13:19:42.421249 21964 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:19:42.462152 21857 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:42.498919 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.499758 22041 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.500427 22041 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.502866 22041 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:42.510113 17993 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:42.510267 22323 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:42.510676 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2048) took 1412 ms. Trace:
I20260709 13:19:42.511068 17319 rpcz_store.cc:276] 0709 13:19:41.098286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.098434 (+   148us) service_pool.cc:224] Handling call
0709 13:19:41.098692 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:41.728884 (+630192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.510388 (+781504us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54001423d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:42.510616 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422202240}
I20260709 13:19:42.514953 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:42.515895 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:42.525784 17318 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:42.517220 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:42.496392 22157 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.530570 22065 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.535435 22065 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.538486 22065 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:42.539011 22065 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.539502 22065 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.541565 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 798) took 1215 ms. Trace:
I20260709 13:19:42.541993 17388 rpcz_store.cc:276] 0709 13:19:41.325855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.747541 (+421686us) service_pool.cc:224] Handling call
0709 13:19:41.747915 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.903402 (+155487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.541262 (+637860us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b54001397d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:42.541496 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197477632}
I20260709 13:19:42.542479 22157 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:42.480332 22288 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.543321 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 848) took 1087 ms. Trace:
I20260709 13:19:42.546332 22065 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:42.547065 22288 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:42.458715 22311 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.552687 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3184) took 1363 ms. Trace:
I20260709 13:19:42.553239 17395 rpcz_store.cc:276] 0709 13:19:41.189448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.189958 (+   510us) service_pool.cc:224] Handling call
0709 13:19:41.190237 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.567831 (+377594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.552364 (+984533us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54002bd754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:42.552608 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576220416}
I20260709 13:19:42.543882 17388 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:42.559893 17388 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:19:42.563989 22326 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:42.569928 22160 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:42.571596 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.572362 17467 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:42.573926 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:42.574741 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 783) took 1307 ms. Trace:
I20260709 13:19:42.574950 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:42.575157 17389 rpcz_store.cc:276] 0709 13:19:41.267127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.606841 (+339714us) service_pool.cc:224] Handling call
0709 13:19:41.607364 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.434101 (+826737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.574487 (+140386us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b5400253354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:42.574684 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1827726208}
I20260709 13:19:42.576126 17393 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:42.576609 17389 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:42.572424 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 793) took 1264 ms. Trace:
I20260709 13:19:42.580152 17392 rpcz_store.cc:276] 0709 13:19:41.308273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.318348 (+ 10075us) service_pool.cc:224] Handling call
0709 13:19:42.572206 (+1253858us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54004132d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:42.572362 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220742912}
I20260709 13:19:42.581419 17389 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:42.582837 17389 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:42.583359 22025 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:42.583856 22025 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:42.584981 22025 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.586417 22279 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:42.589793 22232 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:42.596930 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.597645 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.543867 17322 rpcz_store.cc:276] 0709 13:19:41.455738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.851668 (+395930us) service_pool.cc:224] Handling call
0709 13:19:41.880327 (+ 28659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.345319 (+464992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.345368 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.345433 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:42.345498 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.543010 (+197512us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b5400274f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:42.543074 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.543245 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068754176}
I20260709 13:19:42.611330 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:42.612214 17469 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.614866 22356 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.492697 21857 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:42.467563 22329 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.561445 22041 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:42.639278 17391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.007s	sys 0.023s
W20260709 13:19:42.639809 17391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.007s	sys 0.024s
I20260709 13:19:42.641144 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 784) took 1373 ms. Trace:
I20260709 13:19:42.641919 17391 rpcz_store.cc:276] 0709 13:19:41.267409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.606599 (+339190us) service_pool.cc:224] Handling call
0709 13:19:41.726950 (+120351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.727190 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:41.773869 (+ 46679us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.640629 (+866760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.640711 (+    82us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:42.640778 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.640900 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.641066 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51375,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":112,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":879,"thread_start_us":866109,"threads_started":1}
W20260709 13:19:42.641538 17320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.017s	sys 0.005s
I20260709 13:19:42.637862 22267 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.640362 22320 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:42.660181 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 387802us
W20260709 13:19:42.672748 17320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.018s	sys 0.005s
I20260709 13:19:42.682426 17962 leader_election.cc:400] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15.
I20260709 13:19:42.683341 17962 leader_election.cc:403] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:42.658900 22041 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:42.685340 22088 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15.
I20260709 13:19:42.685142 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1713) took 1340 ms. Trace:
I20260709 13:19:42.690590 17469 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
W20260709 13:19:42.692061 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.008s	sys 0.028s
I20260709 13:19:42.680735 22229 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:42.688506 17320 rpcz_store.cc:276] 0709 13:19:41.344814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.349527 (+  4713us) service_pool.cc:224] Handling call
0709 13:19:41.359252 (+  9725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.359462 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:41.791622 (+432160us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.684613 (+892991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.684689 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:42.684756 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.684881 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.685063 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54818,"prepare.queue_time_us":627290,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":3702,"thread_start_us":1269480,"threads_started":2}
W20260709 13:19:42.693634 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.008s	sys 0.028s
I20260709 13:19:42.695482 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:42.697124 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 746293us
I20260709 13:19:42.706243 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:42.706837 17362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.012s	sys 0.047s
I20260709 13:19:42.687963 22041 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:42.709429 17362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.012s	sys 0.047s
I20260709 13:19:42.689931 21857 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:42.711486 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 506039us
W20260709 13:19:42.710878 17286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.002s	sys 0.026s
W20260709 13:19:42.713508 17286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.003s	sys 0.026s
I20260709 13:19:42.715977 17360 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:42.720402 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:42.723462 17360 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:42.688400 22327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.019s	sys 0.016s
I20260709 13:19:42.690250 21971 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:42.733320 21971 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.735256 22295 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:42.735755 22295 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.736158 22295 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.740732 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:42.741353 17993 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.741813 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:42.689610 22356 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:42.742895 17999 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:19:42.747826 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:42.748435 17998 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:42.751212 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.752120 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:42.750804 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:42.753602 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:42.753834 17999 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:42.754236 17999 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:42.754235 17392 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
W20260709 13:19:42.738535 22327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.019s	sys 0.017s
I20260709 13:19:42.702859 22128 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:19:42.738651 22326 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:42.788403 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:42.789194 17391 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:42.737856 22362 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:42.770690 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 825) took 1209 ms. Trace:
I20260709 13:19:42.755251 17999 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.742518 22318 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:42.771268 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:42.771281 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 949) took 1193 ms. Trace:
I20260709 13:19:42.806108 17995 rpcz_store.cc:276] 0709 13:19:41.578059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.578169 (+   110us) service_pool.cc:224] Handling call
0709 13:19:41.592554 (+ 14385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.610968 (+ 18414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.771117 (+1160149us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b540045e7d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:42.771231 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32300416}
I20260709 13:19:42.807314 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:42.772346 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:42.775185 21401 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:42.711115 22311 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:19:42.775807 17998 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:42.810627 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:42.761953 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.786826 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:42.743559 22282 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:42.748333 22065 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.809686 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:42.793465 17999 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.707458 22258 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:42.814968 22218 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:42.815591 22172 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.815531 22258 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.794339 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3192) took 1353 ms. Trace:
I20260709 13:19:42.787894 22066 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:42.798738 22320 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:42.790426 22285 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.742259 21857 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.800865 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:42.801019 22157 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.761317 22279 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.761519 22088 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.801586 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.801637 22355 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.802354 21633 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:42.808542 21401 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:42.842231 21401 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.772374 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:42.753437 22313 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.822186 22326 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:42.775820 17434 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:42.867156 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 91407.6us
I20260709 13:19:42.793212 17471 rpcz_store.cc:276] 0709 13:19:41.561639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.561773 (+   134us) service_pool.cc:224] Handling call
0709 13:19:41.562064 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.734230 (+172166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.770471 (+1036241us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540020fdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:42.770624 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353770240}
I20260709 13:19:42.812985 17992 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.813124 17469 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:42.704861 22229 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.747371 22335 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:19:42.794766 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.816787 17393 rpcz_store.cc:276] 0709 13:19:41.440633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.964396 (+523763us) service_pool.cc:224] Handling call
0709 13:19:42.575935 (+611539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.576550 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.794102 (+217552us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54004132d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:42.794268 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404722944}
I20260709 13:19:42.838449 22058 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:42.875831 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:42.810380 22362 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.819377 17397 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 13:19:42.747560 22288 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:19:42.821817 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:42.820338 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:42.887624 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 67370.8us
I20260709 13:19:42.827694 17391 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.827095 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:42.829069 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.766047 17993 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:42.821817 22065 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.891800 17994 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.835558 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:42.778894 22232 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:19:42.810214 22329 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:42.847159 17991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.008s	sys 0.030s
W20260709 13:19:42.896811 17991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.009s	sys 0.030s
I20260709 13:19:42.850492 22088 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.830031 22285 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:42.835741 17361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.015s	sys 0.039s
W20260709 13:19:42.900224 17361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.016s	sys 0.039s
I20260709 13:19:42.811859 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:42.837558 22157 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.863271 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:42.869544 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:42.876739 17393 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
W20260709 13:19:42.818534 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 791) took 1547 ms (client timeout 1702 ms). Trace:
I20260709 13:19:42.889552 22188 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:42.905630 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 485686us
W20260709 13:19:42.877593 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.014s	sys 0.014s
I20260709 13:19:42.897078 22356 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:42.878103 22325 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.005s
I20260709 13:19:42.872328 22275 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:42.879276 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 458462us
I20260709 13:19:42.835412 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.918685 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:42.921113 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:42.828655 22066 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.920789 17995 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:42.895862 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:42.901115 17998 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:42.915323 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:42.940414 17391 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:42.905337 22075 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.861843 17999 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:19:42.947130 17999 pending_rounds.cc:85] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 9
I20260709 13:19:42.947407 17999 pending_rounds.cc:107] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:19:42.905418 22267 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:42.850108 22330 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:19:42.842821 22279 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.833786 22041 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:42.907075 17390 rpcz_store.cc:269] 0709 13:19:41.271494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.310984 (+ 39490us) service_pool.cc:224] Handling call
0709 13:19:42.818296 (+1507312us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54004105d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:42.818468 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251471616}
I20260709 13:19:42.895394 22311 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:42.878024 22292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.419s	user 0.015s	sys 0.013s
W20260709 13:19:42.910296 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.014s	sys 0.014s
I20260709 13:19:42.914678 17389 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:42.864658 22313 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:42.917451 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48003.6us
W20260709 13:19:42.889954 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 62956.6us
I20260709 13:19:42.915151 22356 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:42.918550 22325 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:42.990127 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 638783us
I20260709 13:19:42.993350 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.994263 17471 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:42.996724 17963 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:42.997577 17360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 1.503s (SENT) [suppressed 15 similar messages]
I20260709 13:19:42.994282 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.957047 17992 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:42.972759 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 883) took 1561 ms. Trace:
W20260709 13:19:42.997762 22292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.539s	user 0.017s	sys 0.016s
I20260709 13:19:42.876885 21401 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:42.871227 22327 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:42.905710 21894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.005s	sys 0.013s
I20260709 13:19:42.945305 17391 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:42.924106 22188 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.905452 22367 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.947670 17999 raft_consensus.cc:2889] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.882077 22058 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:42.940793 17993 raft_consensus.cc:2368] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15.
I20260709 13:19:42.963166 22066 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:42.901618 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 66120.6us
I20260709 13:19:42.941213 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:43.042310 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:43.043162 17998 raft_consensus.cc:2410] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:43.043659 17318 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:42.957024 22275 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:42.899682 21633 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:19:42.974879 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:42.971948 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3191) took 1554 ms. Trace:
I20260709 13:19:43.053654 17397 rpcz_store.cc:276] 0709 13:19:41.418057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.792829 (+374772us) service_pool.cc:224] Handling call
0709 13:19:42.819075 (+1026246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.881683 (+ 62608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.971718 (+ 90035us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004105d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:42.971884 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359237504}
I20260709 13:19:42.999437 17996 rpcz_store.cc:276] 0709 13:19:41.411171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.412964 (+  1793us) service_pool.cc:224] Handling call
0709 13:19:41.416628 (+  3664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:41.612302 (+195674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.612330 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:41.612751 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.298304 (+685553us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:42.298347 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.305872 (+  7525us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:42.808264 (+502392us) raft_consensus.cc:1685] finished
0709 13:19:42.808280 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.972463 (+164183us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b54001a8bd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:42.972673 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7739264,"thread_start_us":571422,"threads_started":1,"wal-append.queue_time_us":1015994}
I20260709 13:19:42.922981 17287 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:42.940176 22329 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:42.946774 22160 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:43.007359 21401 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:43.007643 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:43.007970 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:42.982048 22358 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:19:42.983242 22352 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:43.111533 21401 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:43.014019 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:43.019279 22311 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:43.128165 17992 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:42.940096 22366 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:43.018784 17396 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 7: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:43.019353 17467 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.020360 17315 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:42.982241 22134 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.943053 22335 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:42.972115 22229 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:42.957094 22288 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:43.022676 17993 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:42.970446 21845 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:43.001279 22356 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.030148 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:43.035982 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.042029 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:42.906792 22360 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:43.045730 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:43.050880 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.043181 17999 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:43.051687 22322 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:42.952009 22075 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:43.015790 22267 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:43.144488 22372 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.234282 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3197) took 1360 ms. Trace:
I20260709 13:19:43.156831 22120 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:43.113756 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:42.960394 22293 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:43.118729 22025 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.124119 21793 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:43.045253 21833 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.011s	sys 0.026s
I20260709 13:19:43.061740 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:43.008823 22318 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:19:43.061313 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:43.334594 17320 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:43.059711 17322 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:43.059512 22275 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:43.059118 22302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.011s	sys 0.031s
I20260709 13:19:43.146376 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:43.342046 17468 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:43.342952 17467 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:43.151520 17994 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:42.970467 22295 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:42.942004 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:43.158737 17321 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:19:43.127355 22274 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.016s	sys 0.045s
I20260709 13:19:43.181114 17317 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.171962 17998 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:43.137576 22355 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:43.127099 22369 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:43.052811 21894 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
W20260709 13:19:43.106240 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.380911 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 458010us
W20260709 13:19:43.381979 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.382418 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.112267 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 104465us
I20260709 13:19:43.384085 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:43.385939 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:43.234768 17396 rpcz_store.cc:276] 0709 13:19:41.874230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.883392 (+  9162us) service_pool.cc:224] Handling call
0709 13:19:43.234045 (+1350653us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b5400015754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:43.234200 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170567424}
W20260709 13:19:43.235599 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 189923us
I20260709 13:19:43.388160 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:42.916226 22326 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:43.236110 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:43.363720 22302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.482s	user 0.012s	sys 0.032s
I20260709 13:19:43.238271 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:43.238519 17471 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:43.236141 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:43.402304 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:43.161001 22160 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:43.320996 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
W20260709 13:19:43.321439 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 323881us
I20260709 13:19:43.414872 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:43.323035 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:43.417848 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:43.233433 22229 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.233359 22366 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.162s
I20260709 13:19:43.230985 22021 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:43.364609 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:43.365850 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 328437us
I20260709 13:19:43.369190 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:43.324235 21833 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.011s	sys 0.034s
I20260709 13:19:43.231343 22065 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:43.376036 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 434125us
I20260709 13:19:43.245492 22232 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:43.378180 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:43.166313 22288 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:43.233727 22371 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.154114 21857 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:43.252153 21793 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:43.166157 22363 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.199s
I20260709 13:19:43.394673 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:43.394662 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:43.395946 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:43.399034 17469 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:19:43.237936 22362 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:43.235183 22267 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:43.238709 22360 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:43.247571 22303 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:43.161948 22282 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 12 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:43.041528 22367 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:43.370496 22274 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.016s	sys 0.046s
I20260709 13:19:43.418808 17360 leader_election.cc:400] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15.
I20260709 13:19:43.421567 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:43.231455 22329 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:43.409343 22364 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.489s	user 0.001s	sys 0.000s
I20260709 13:19:43.442477 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:43.394608 21868 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:43.265446 22120 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:43.382300 22088 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:43.254897 22372 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:43.398844 22311 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:43.444134 17317 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:43.608258 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:44.045459 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 2063) took 1011 ms. Trace:
I20260709 13:19:44.046095 17317 rpcz_store.cc:276] 0709 13:19:43.034115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.035405 (+  1290us) service_pool.cc:224] Handling call
0709 13:19:44.045130 (+1009725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.047101 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:44.047430 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:44.048164 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:43.466300 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:44.049360 17320 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:44.048636 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:44.051574 17320 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:44.053649 17360 leader_election.cc:403] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:43.508821 17396 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:19:43.523716 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 135654us
I20260709 13:19:44.056078 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2027) took 1008 ms. Trace:
W20260709 13:19:43.850419 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.057236 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:44.057438 17467 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:44.060006 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:44.056529 17396 rpcz_store.cc:276] 0709 13:19:43.047909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.446890 (+398981us) service_pool.cc:224] Handling call
0709 13:19:43.508515 (+ 61625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:44.055346 (+546831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.055816 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.060459 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 832) took 1068 ms. Trace:
I20260709 13:19:44.062677 17466 rpcz_store.cc:276] 0709 13:19:42.991933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.992079 (+   146us) service_pool.cc:224] Handling call
0709 13:19:42.992478 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.992921 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.992991 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.993496 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:19:43.251750 (+258254us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:43.251794 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.251863 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.059779 (+807916us) raft_consensus.cc:1685] finished
0709 13:19:44.059839 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.060212 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11926,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":257900,"threads_started":1,"wal-append.queue_time_us":859558}
I20260709 13:19:44.064248 17316 raft_consensus.cc:606] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:44.064890 17316 raft_consensus.cc:614] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:44.066284 17468 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:44.068233 17468 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:44.070396 17468 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:19:44.070815 17468 pending_rounds.cc:85] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 5
I20260709 13:19:44.071121 17468 pending_rounds.cc:107] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:19:44.071460 17468 raft_consensus.cc:2889] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.072253 17389 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:43.816402 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.074651 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:43.890677 17464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.004s	sys 0.004s
I20260709 13:19:44.075904 17287 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:44.079546 17464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.004s	sys 0.004s
I20260709 13:19:44.076589 17397 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:19:43.444911 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:43.835806 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1874) took 1264 ms. Trace:
I20260709 13:19:44.081792 17465 rpcz_store.cc:276] 0709 13:19:42.571719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.573647 (+  1928us) service_pool.cc:224] Handling call
0709 13:19:43.835506 (+1261859us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002d4454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:43.835716 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2767866112}
I20260709 13:19:44.083643 17396 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:44.078524 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:44.064745 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:44.038370 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:44.089802 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:44.091346 17316 raft_consensus.cc:606] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:44.092811 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:44.094692 17467 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.085644 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:44.094794 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:44.102391 17468 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:44.111379 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 833) took 1119 ms. Trace:
I20260709 13:19:44.110522 17214 catalog_manager.cc:5697] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 4 to 12. New cstate: current_term: 12 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:44.111833 17469 rpcz_store.cc:276] 0709 13:19:42.992300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.993995 (+  1695us) service_pool.cc:224] Handling call
0709 13:19:44.111050 (+1117055us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b5400200654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:44.111219 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920209664}
W20260709 13:19:43.942754 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.115418 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.114884 17214 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:43.952608 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 957) took 1256 ms. Trace:
W20260709 13:19:43.643293 21971 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.909s	user 0.004s	sys 0.006s
I20260709 13:19:44.124258 21971 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:44.123579 17997 rpcz_store.cc:276] 0709 13:19:42.696617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.697772 (+  1155us) service_pool.cc:224] Handling call
0709 13:19:42.698228 (+   456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:42.698703 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.698745 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:42.706306 (+  7561us) log.cc:844] Serialized 52 byte log entry
0709 13:19:43.115950 (+409644us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:43.116531 (+   581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.117506 (+   975us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.952269 (+834763us) raft_consensus.cc:1685] finished
0709 13:19:43.952302 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.952526 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4134,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":1404,"thread_start_us":352804,"threads_started":1,"wal-append.queue_time_us":1211982}
I20260709 13:19:44.127288 21401 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:44.129496 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:44.130002 21971 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:44.130771 17994 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:44.131086 21793 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:44.131793 21868 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:44.132300 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:44.132784 21793 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.133282 17993 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.133519 21971 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.134369 21971 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:44.427980 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 320194us
W20260709 13:19:44.557825 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.428160 21401 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:44.423241 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 345735us
I20260709 13:19:44.129649 21857 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.558911 17467 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
W20260709 13:19:44.506738 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 1.08797e+06us
I20260709 13:19:44.124257 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:44.578863 17993 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 7.
W20260709 13:19:44.584685 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.136755 21971 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:43.975360 22356 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.792s	user 0.010s	sys 0.000s
I20260709 13:19:43.412423 22285 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:43.417191 22322 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:44.143038 22066 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:44.189985 22318 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:43.417349 22157 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:44.186008 21868 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:44.422452 22403 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.242s
I20260709 13:19:44.159474 22199 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.505s
I20260709 13:19:44.619131 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:44.678037 17996 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
W20260709 13:19:44.651021 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 81570.9us
W20260709 13:19:44.646732 17392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.013s	sys 0.008s
I20260709 13:19:44.693816 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1878) took 1979 ms. Trace:
I20260709 13:19:44.670181 17313 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:44.133301 21964 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:44.158424 22211 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:19:43.860093 22381 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:19:43.788692 22283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.006s	sys 0.002s
W20260709 13:19:44.692924 17471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.008s	sys 0.006s
W20260709 13:19:43.640115 22373 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 13:19:43.398720 22355 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:43.640583 22374 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
W20260709 13:19:43.639860 22388 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:19:43.645133 22370 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
W20260709 13:19:43.807827 22134 consensus_meta.cc:287] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.002s
I20260709 13:19:44.158396 22258 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.807s
I20260709 13:19:43.432873 22330 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:45.044167 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 92355.2us
W20260709 13:19:45.051702 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 480881us
W20260709 13:19:44.830739 17392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.414s	user 0.015s	sys 0.009s
W20260709 13:19:45.006228 17995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.012s	sys 0.015s
W20260709 13:19:45.064251 17995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.013s	sys 0.016s
I20260709 13:19:44.715884 17464 rpcz_store.cc:276] 0709 13:19:42.714177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.714459 (+   282us) service_pool.cc:224] Handling call
0709 13:19:42.714773 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.715027 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:43.181886 (+466859us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.557361 (+1375475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:44.580283 (+ 22922us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:44.693375 (+113092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.693500 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.693749 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28969,"prepare.queue_time_us":730567,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":9122,"raft.queue_time_us":110081,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"thread_start_us":1693526,"threads_started":3,"wal-append.queue_time_us":775560}
W20260709 13:19:44.984686 17315 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.940s	user 0.009s	sys 0.006s
W20260709 13:19:44.982868 17363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.023s	sys 0.067s
I20260709 13:19:44.659950 22232 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.065240 17315 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
W20260709 13:19:44.665292 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.167s	user 0.001s	sys 0.017s
I20260709 13:19:43.820816 22041 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.006304 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:43.433068 22387 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:44.671720 22372 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:43.548640 22396 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:44.680187 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 1.23755e+06us
W20260709 13:19:44.982430 17391 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.009s	sys 0.022s
I20260709 13:19:44.994483 17287 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:44.979239 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 589667us
I20260709 13:19:44.995743 17390 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:43.543098 22313 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:45.066910 17363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.023s	sys 0.072s
I20260709 13:19:45.085496 17468 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:19:44.663537 22360 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:44.705504 22318 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:44.668956 22329 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:44.983079 17286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.784s	user 0.025s	sys 0.026s
W20260709 13:19:44.619274 21833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.002s	sys 0.011s
I20260709 13:19:44.651966 22421 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.581207 22218 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:43.775568 22320 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:44.670583 21894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.010s	sys 0.006s
I20260709 13:19:44.987994 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 1999) took 3428 ms. Trace:
W20260709 13:19:45.076481 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.684s	user 0.004s	sys 0.028s
W20260709 13:19:45.076663 17471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.529s	user 0.014s	sys 0.011s
W20260709 13:19:43.434775 22357 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.433s	user 0.000s	sys 0.001s
I20260709 13:19:44.735446 21964 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:44.684602 22327 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.668s	user 0.008s	sys 0.008s
I20260709 13:19:43.563584 22188 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:44.670392 22326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.012s	sys 0.040s
I20260709 13:19:43.497365 22279 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:43.437256 22021 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:44.679296 17216 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49282 (request call id 328) took 24932 ms (client timeout 15000 ms). Trace:
I20260709 13:19:43.528029 22302 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.638752 22075 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:44.922881 21971 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.689004 22267 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:45.094004 17391 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.012s	sys 0.024s
I20260709 13:19:43.839370 22275 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:44.982229 22322 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.641167 22295 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:44.654119 22288 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:43.639775 22111 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:45.079550 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.048827 21793 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:45.101176 17315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1734) took 1704 ms (client timeout 1928 ms). Trace:
W20260709 13:19:45.120963 22326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.496s	user 0.020s	sys 0.046s
I20260709 13:19:44.997021 22371 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:43.632925 22293 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.006963 22362 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:45.179661 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 60350.9us
I20260709 13:19:43.643790 22325 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.080874 22232 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.660516 21857 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.197160 22320 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.198747 21857 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.014643 22363 consensus_queue.cc:1243] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:45.201012 22134 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:45.178988 21793 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.201318 17214 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 9 to 13, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 13 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:45.203305 17214 catalog_manager.cc:5697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:45.112829 17467 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:43.547770 22393 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 1.578s
I20260709 13:19:45.101861 22318 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.001586 21401 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:45.215229 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.665098 22377 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.596s
I20260709 13:19:45.107764 17394 rpcz_store.cc:276] 0709 13:19:41.559913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.200640 (+640727us) service_pool.cc:224] Handling call
0709 13:19:42.225786 (+ 25146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.226056 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.226097 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.256034 (+ 29937us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.690009 (+433975us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:42.690048 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.690152 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.987329 (+2297177us) raft_consensus.cc:1685] finished
0709 13:19:44.987380 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.987719 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":433640,"threads_started":1,"wal-append.queue_time_us":639670}
W20260709 13:19:45.121486 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.122807 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.217981 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.122916 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 116764us
I20260709 13:19:45.123148 22120 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:44.657332 22418 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.458s
I20260709 13:19:43.441784 22229 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.226032 17318 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:45.227075 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.123654 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.229215 17462 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:45.231279 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:43.601817 22058 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.124719 22414 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.233228 22414 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:45.233529 22274 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:45.233798 22414 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.234059 22274 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:45.125399 22021 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.235354 22274 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.237259 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:45.238199 17998 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:45.239367 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:45.238827 17214 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:45.207823 22157 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.240041 17998 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
W20260709 13:19:45.240895 17992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.007s	sys 0.011s
I20260709 13:19:45.240514 22157 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:45.241242 17992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.007s	sys 0.012s
I20260709 13:19:45.126250 22327 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:45.241830 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1283) took 1123 ms. Trace:
I20260709 13:19:45.242108 22327 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:45.126933 17434 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:45.242322 17995 rpcz_store.cc:276] 0709 13:19:44.118425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.123064 (+  4639us) service_pool.cc:224] Handling call
0709 13:19:44.134862 (+ 11798us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:44.135563 (+   701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:44.135593 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:44.136382 (+   789us) log.cc:844] Serialized 52 byte log entry
0709 13:19:45.011332 (+874950us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b4800041ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:19:45.064892 (+ 53560us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:45.094489 (+ 29597us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.094865 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.095025 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.095103 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.241584 (+146481us) raft_consensus.cc:1685] finished
0709 13:19:45.241605 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.241749 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72636,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":26697,"raft.queue_time_us":389709,"raft.run_cpu_time_us":1490,"raft.run_wall_time_us":459443,"spinlock_wait_cycles":24661504,"thread_start_us":928023,"threads_started":1,"wal-append.queue_time_us":1044265}
W20260709 13:19:45.128175 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 1.74402e+06us
W20260709 13:19:45.245069 22313 consensus_queue.cc:1175] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c23a664ebf3347a4934dee377c8b5101" responder_term: 12 status { last_received { term: 9 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: [11.9-11.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:45.245775 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:45.233577 22058 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.129665 21971 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.180079 22322 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.250659 21971 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:44.688066 22282 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:45.112088 21894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.667s	user 0.015s	sys 0.014s
W20260709 13:19:45.113636 21833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.594s	user 0.017s	sys 0.041s
I20260709 13:19:44.662149 22303 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.134502 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2001) took 3533 ms. Trace:
I20260709 13:19:45.134980 21633 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.134884 22396 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.135526 22335 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.134914 22248 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:45.271411 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3190) took 1872 ms. Trace:
I20260709 13:19:45.137305 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3189) took 1739 ms. Trace:
I20260709 13:19:45.244443 22258 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:45.271842 17466 rpcz_store.cc:276] 0709 13:19:43.399223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.065185 (+665962us) service_pool.cc:224] Handling call
0709 13:19:44.065763 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.066433 (+   670us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:44.067156 (+   723us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.010290 (+943134us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b18004ec220. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:19:45.047057 (+ 36767us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.217254 (+170197us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.255527 (+ 38273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.255574 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:45.261842 (+  6268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.261906 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.271348 (+  9442us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324465,"prepare.queue_time_us":371898,"prepare.run_cpu_time_us":182,"prepare.run_wall_time_us":10265,"raft.queue_time_us":675464,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":19319,"spinlock_wait_cycles":17254272,"thread_start_us":461529,"threads_started":2,"wal-append.queue_time_us":921731}
I20260709 13:19:45.275566 22258 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:44.988399 22356 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.276809 22396 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.277105 22335 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.277936 22356 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:45.101447 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 192474us
I20260709 13:19:45.278404 17463 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:45.279749 22335 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.280369 22248 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.114439 22372 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:45.282214 22372 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:45.282858 22248 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:45.283354 22372 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.283792 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:45.284817 17321 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:45.256579 17395 rpcz_store.cc:276] 0709 13:19:41.600807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.554529 (+953722us) service_pool.cc:224] Handling call
0709 13:19:42.554963 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.556350 (+  1387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.556395 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.608350 (+ 51955us) log.cc:844] Serialized 26 byte log entry
0709 13:19:43.056418 (+448068us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:43.056476 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.056571 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.133958 (+2077387us) raft_consensus.cc:1685] finished
0709 13:19:45.134010 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.134282 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13671,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":416501,"threads_started":1,"wal-append.queue_time_us":997957}
I20260709 13:19:45.285972 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:45.171130 22387 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:45.255952 17360 connection.cc:256] RPC call timeout handler was delayed by -2.1709999310000967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:19:45.168823 17315 rpcz_store.cc:269] 0709 13:19:43.379065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.394401 (+ 15336us) service_pool.cc:224] Handling call
0709 13:19:45.076418 (+1682017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.695878 22367 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.116029 21964 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:45.136715 22025 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.813s	user 0.010s	sys 0.009s
I20260709 13:19:45.179114 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:45.106742 17286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.963s	user 0.028s	sys 0.027s
I20260709 13:19:45.183632 22111 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:45.185226 22218 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:45.124672 22402 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.201769 22134 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.201323 22362 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.204856 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 953) took 3146 ms. Trace:
I20260709 13:19:45.206957 22355 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:45.174412 22421 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.123467 22302 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.207795 22411 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.604447 22323 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:45.310565 22411 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.311228 22302 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.271625 22414 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.313133 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2023) took 2552 ms. Trace:
I20260709 13:19:45.313271 22323 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:45.313611 22414 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.298440 17991 rpcz_store.cc:276] 0709 13:19:42.060448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.060717 (+   269us) service_pool.cc:224] Handling call
0709 13:19:42.187540 (+126823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.199226 (+ 11686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.199258 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.199775 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.897312 (+697537us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:42.897366 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.897435 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.141154 (+2243719us) raft_consensus.cc:1685] finished
0709 13:19:45.169950 (+ 28796us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.204667 (+ 34717us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11259,"raft.queue_time_us":20029,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":11610,"thread_start_us":672009,"threads_started":1,"wal-append.queue_time_us":947818}
I20260709 13:19:45.313542 17393 rpcz_store.cc:276] 0709 13:19:42.760151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.907292 (+147141us) service_pool.cc:224] Handling call
0709 13:19:42.907776 (+   484us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:42.908198 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.908241 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:42.918857 (+ 10616us) log.cc:844] Serialized 52 byte log entry
0709 13:19:43.320822 (+401965us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:43.320892 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.320981 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.260718 (+1939737us) raft_consensus.cc:1685] finished
0709 13:19:45.287616 (+ 26898us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.312943 (+ 25327us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41311,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":295874,"threads_started":1,"wal-append.queue_time_us":497780}
I20260709 13:19:45.273351 17471 rpcz_store.cc:276] 0709 13:19:43.397870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.416492 (+ 18622us) service_pool.cc:224] Handling call
0709 13:19:43.417759 (+  1267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.418173 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.418214 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.451277 (+ 33063us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.122125 (+1670848us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:45.136953 (+ 14828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.137040 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.137078 (+    38us) raft_consensus.cc:1685] finished
0709 13:19:45.137088 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.137252 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21852,"raft.queue_time_us":23974,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":21998,"thread_start_us":1560610,"threads_started":1,"wal-append.queue_time_us":1183861}
I20260709 13:19:45.314636 22323 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.315219 22232 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.317718 22218 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.322471 22293 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.322619 22232 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:45.323170 22293 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.324913 22330 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:45.325747 22355 consensus_queue.cc:1243] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:45.320462 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:45.327719 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:45.227264 22229 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.123571 22285 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:43.581024 22160 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:45.244478 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 117713us
I20260709 13:19:45.255119 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:45.363394 17993 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:45.248472 22371 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.243665 22157 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.236738 22274 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.138182 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3206) took 2243 ms. Trace:
I20260709 13:19:45.138454 22329 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:45.287320 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.288719 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2025) took 2226 ms. Trace:
I20260709 13:19:45.295426 17214 catalog_manager.cc:5697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:45.297482 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:45.256024 22432 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:45.302932 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:45.273919 21633 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.310231 17464 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.555313 22292 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:45.200506 22320 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:45.119728 17216 rpcz_store.cc:269] 0709 13:19:19.753952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.776187 (+ 22235us) service_pool.cc:224] Handling call
0709 13:19:44.678974 (+24902787us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:36.968122 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:37.117656 (+149534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:37.145955 (+ 28299us) write_op.cc:435] Acquired schema lock
0709 13:19:37.145987 (+    32us) tablet.cc:662] Decoding operations
0709 13:19:37.158718 (+ 12731us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:37.158815 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:37.158845 (+    30us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:19:37.283260 (+124415us) tablet.cc:701] Row locks acquired
0709 13:19:37.283327 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:19:37.395160 (+111833us) write_op.cc:270] Start()
0709 13:19:37.446534 (+ 51374us) write_op.cc:276] Timestamp: P: 1783603177363709 usec, L: 0
0709 13:19:37.457272 (+ 10738us) op_driver.cc:348] REPLICATION: starting
0709 13:19:37.531074 (+ 73802us) log.cc:844] Serialized 9344 byte log entry
0709 13:19:38.429952 (+898878us) op_driver.cc:464] REPLICATION: finished
0709 13:19:39.143445 (+713493us) write_op.cc:301] APPLY: starting
0709 13:19:39.143633 (+   188us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:39.634806 (+491173us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:39.634961 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:40.161782 (+526821us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:40.162196 (+   414us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:19:40.162251 (+    55us) write_op.cc:312] APPLY: finished
0709 13:19:40.162760 (+   509us) log.cc:844] Serialized 212 byte log entry
0709 13:19:40.357089 (+194329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.357358 (+   269us) write_op.cc:454] Released schema lock
0709 13:19:40.357448 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:40.357857 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.357885 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":481,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":652691,"apply.run_cpu_time_us":51374,"apply.run_wall_time_us":1242560,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104447,"num_ops":24,"prepare.queue_time_us":256398,"prepare.run_cpu_time_us":31321,"prepare.run_wall_time_us":900449,"raft.queue_time_us":399736,"raft.run_cpu_time_us":77597,"raft.run_wall_time_us":597919,"replication_time_us":957300,"thread_start_us":1063072,"threads_started":5,"wal-append.queue_time_us":714004,"wal-append.run_cpu_time_us":28674,"wal-append.run_wall_time_us":2891200}]]}
W20260709 13:19:45.304050 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 2.24559e+06us
I20260709 13:19:45.287358 22120 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.383015 22120 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:45.384289 17360 connection.cc:256] RPC call timeout handler was delayed by -1.0941926100001638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:19:45.385419 22120 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:45.358201 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 59393.7us
I20260709 13:19:45.359434 22425 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.386384 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:45.387753 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:45.369989 22232 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:19:45.388938 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:45.389796 17321 raft_consensus.cc:2410] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:45.390130 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:45.390690 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:45.309870 22111 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.359855 22311 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:45.360229 22283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.985s	user 0.011s	sys 0.020s
I20260709 13:19:45.362468 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:45.308807 17314 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
W20260709 13:19:45.344125 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 212272us
W20260709 13:19:45.365533 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60134.1us
I20260709 13:19:45.309348 22421 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.376981 22293 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.379523 22285 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:45.382387 22066 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.001s
I20260709 13:19:45.390240 22232 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.367046 22323 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:45.269695 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1284) took 1150 ms. Trace:
I20260709 13:19:45.394160 17320 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.276885 22258 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.375185 22302 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:45.408480 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.357499 22402 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.379648 22157 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.406515 17315 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:45.412981 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.369861 17392 rpcz_store.cc:276] 0709 13:19:43.047345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.344959 (+297614us) service_pool.cc:224] Handling call
0709 13:19:43.345419 (+   460us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:43.348421 (+  3002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.348466 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:43.349282 (+   816us) log.cc:844] Serialized 52 byte log entry
0709 13:19:43.814755 (+465473us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4800002958. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:19:45.119488 (+1304733us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:45.180348 (+ 60860us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.213058 (+ 32710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.255829 (+ 42771us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.255895 (+    66us) raft_consensus.cc:1685] finished
0709 13:19:45.268375 (+ 12480us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.273606 (+  5231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":358222,"prepare.queue_time_us":170503,"raft.queue_time_us":57002,"raft.run_cpu_time_us":3507,"raft.run_wall_time_us":444679,"spinlock_wait_cycles":78584320,"thread_start_us":1691306,"threads_started":2,"wal-append.queue_time_us":1042104}
I20260709 13:19:45.367570 17391 rpcz_store.cc:276] 0709 13:19:42.894375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.026281 (+131906us) service_pool.cc:224] Handling call
0709 13:19:43.044470 (+ 18189us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:43.113031 (+ 68561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.113072 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:43.113647 (+   575us) log.cc:844] Serialized 52 byte log entry
0709 13:19:43.416337 (+302690us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:43.673502 (+257165us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.137718 (+1464216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.137857 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.137928 (+    71us) raft_consensus.cc:1685] finished
0709 13:19:45.137939 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.138130 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":410894,"prepare.queue_time_us":68033,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":483005,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":54467,"thread_start_us":1483775,"threads_started":3,"wal-append.queue_time_us":434514,"wal-append.run_cpu_time_us":2990,"wal-append.run_wall_time_us":1386956}
I20260709 13:19:45.414820 22292 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:45.419070 22430 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:19:45.419572 22292 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.421461 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1282) took 1303 ms. Trace:
W20260709 13:19:45.421654 17318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1733) took 2049 ms (client timeout 2217 ms). Trace:
W20260709 13:19:45.422084 17318 rpcz_store.cc:269] 0709 13:19:43.372404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.421239 (+ 48835us) service_pool.cc:224] Handling call
0709 13:19:45.421454 (+2000215us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001419d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:45.421595 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2703892864}
I20260709 13:19:45.421902 17999 rpcz_store.cc:276] 0709 13:19:44.117948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.123521 (+  5573us) service_pool.cc:224] Handling call
0709 13:19:44.124043 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:44.124827 (+   784us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:44.574524 (+449697us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.099693 (+525169us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.171814 (+ 72121us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.172077 (+   263us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:45.173021 (+   944us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.214122 (+ 41101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.214233 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.421118 (+206885us) raft_consensus.cc:1685] finished
0709 13:19:45.421137 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.421285 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40745,"prepare.queue_time_us":872593,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":69,"raft.queue_time_us":344321,"raft.run_cpu_time_us":683,"raft.run_wall_time_us":167515,"thread_start_us":594779,"threads_started":2,"wal-append.queue_time_us":346621}
I20260709 13:19:45.424974 22413 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.425217 22330 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.425905 22442 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.426151 22021 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.426587 22442 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.427989 17317 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:19:45.372704 22414 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:45.432802 17316 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 7: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:45.435657 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:45.432876 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.405241 22232 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.408993 17992 rpcz_store.cc:276] 0709 13:19:44.118896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.120242 (+  1346us) service_pool.cc:224] Handling call
0709 13:19:44.120872 (+   630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.121428 (+   556us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:44.505858 (+384430us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.261043 (+755185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.261101 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:45.261137 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.261200 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.269611 (+  8411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56665,"prepare.queue_time_us":830989,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":14822,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":17804,"thread_start_us":1045761,"threads_started":2,"wal-append.queue_time_us":680885}
I20260709 13:19:45.405404 22066 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15.
I20260709 13:19:45.437192 17991 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:45.437736 22111 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.438807 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:45.439823 22365 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.440465 21793 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:45.440986 22320 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.441965 17994 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:45.380055 22267 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.429502 17214 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 8 to 14, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 14 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:45.405392 22282 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.448930 22292 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.413043 22293 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.448410 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.452287 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:45.514875 17999 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.457216 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:45.460091 22322 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:45.470419 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 150171us
I20260709 13:19:45.428467 22021 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:45.474602 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.446113 22232 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:45.478816 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 79855.1us
I20260709 13:19:45.479018 17991 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:19:45.479480 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1884) took 2679 ms (client timeout 2217 ms). Trace:
I20260709 13:19:45.480196 22350 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:45.534085 22350 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:45.534629 22282 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:45.529443 17463 rpcz_store.cc:269] 0709 13:19:42.800145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.835081 (+ 34936us) service_pool.cc:224] Handling call
0709 13:19:45.479212 (+2644131us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b54003840d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:45.479397 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5417874304}
I20260709 13:19:45.535197 22350 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.536062 22322 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.536379 22350 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.481345 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:45.481703 22134 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.483357 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:45.457788 22360 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:45.484921 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 97248.7us
I20260709 13:19:45.485579 22058 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:45.486136 22438 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.543745 17214 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 8 to 10, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 10 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:45.488859 22157 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.494330 22303 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.442584 22311 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.495613 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 963) took 2697 ms. Trace:
I20260709 13:19:45.496328 17993 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:45.499352 17320 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:19:45.504971 21845 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.506542 22437 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:45.506920 17388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 2018) took 2747 ms (client timeout 1866 ms). Trace:
I20260709 13:19:45.507572 22362 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.469174 22414 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.508644 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 887) took 3591 ms. Trace:
I20260709 13:19:45.510710 17998 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 13:19:45.446609 22442 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.519832 17464 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:19:45.521618 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:45.523097 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.522584 17462 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:45.529933 17317 raft_consensus.cc:1217] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Deduplicated request from leader. Original: 10.9->[11.10-13.11]   Dedup: 13.11->[]
I20260709 13:19:45.532974 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.533538 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:45.408049 22432 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:45.547565 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.551246 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:45.549491 17996 rpcz_store.cc:276] 0709 13:19:42.798371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.056541 (+258170us) service_pool.cc:224] Handling call
0709 13:19:43.056872 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.926946 (+1870074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.495298 (+568352us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400600ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:45.495553 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3726835584}
W20260709 13:19:45.554051 17388 rpcz_store.cc:269] 0709 13:19:42.758929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.974567 (+215638us) service_pool.cc:224] Handling call
0709 13:19:45.506569 (+2532002us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54002bd754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:45.506727 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4895784704}
I20260709 13:19:45.563948 17317 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:19:45.554920 22320 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.572005 22320 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.572520 22437 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.574901 17393 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:45.581300 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:45.582465 17997 raft_consensus.cc:2410] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:45.584586 17318 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:45.578797 17991 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:45.558565 17990 rpcz_store.cc:276] 0709 13:19:41.916989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.917117 (+   128us) service_pool.cc:224] Handling call
0709 13:19:41.923515 (+  6398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.203289 (+3279774us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:45.203340 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.203383 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:45.203415 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.508282 (+304867us) spinlock_profiling.cc:243] Waited 3.19 s on lock 0x7b54006de554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:45.508330 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.508477 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42579,"raft.queue_time_us":69953,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":202,"spinlock_wait_cycles":7337783552}
I20260709 13:19:45.563848 22360 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.583283 22320 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 13:19:45.590175 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 68689.4us
I20260709 13:19:45.590437 22414 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.591714 22360 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.592149 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:45.592914 17395 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.593103 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:45.595322 22402 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:45.595643 17471 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:45.598507 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:45.598896 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:45.600378 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:45.541926 22387 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.601086 22058 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:19:45.603189 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.607551 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:45.606915 22424 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:45.610467 22414 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:45.610626 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:45.611784 22438 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:45.576812 22367 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:45.611830 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:45.612929 22441 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:19:45.615305 22448 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:19:45.617266 17469 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:45.605708 22157 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:45.602654 22322 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:19:45.636607 22211 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.645386 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:45.624610 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:45.537108 22293 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.476325 22365 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.616535 22303 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:19:45.652498 22169 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.651666 17396 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:45.632382 22442 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.635130 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:45.631238 22424 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:45.655431 22442 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:45.652423 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.658073 22442 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.629428 22414 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:45.643361 17464 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:45.659973 22293 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.653661 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.632797 17321 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:45.637305 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.634905 22437 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.652032 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:45.650841 17466 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.528492 22413 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.648578 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.655786 22424 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:45.628585 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59881.6us
I20260709 13:19:45.607432 22362 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.606117 22282 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.637210 22372 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:19:45.652958 22438 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:19:45.634654 22160 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:45.697322 17463 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:45.697634 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45716.6us
I20260709 13:19:45.689141 17996 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:45.681330 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56847.7us
W20260709 13:19:45.577538 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 174377us
W20260709 13:19:45.732746 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.697469 17395 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:45.636421 22134 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:45.738648 17999 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:19:45.733552 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.674491 22437 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:45.678566 22402 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:45.754928 17994 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:45.637476 22302 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:19:45.712168 21868 raft_consensus.cc:993] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:19:45.674975 22432 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.686182 22218 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.732293 22303 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.697465 22285 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.699934 22452 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:45.754019 22134 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.689579 22413 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:45.770969 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 55731.2us
W20260709 13:19:45.773876 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 173599us
I20260709 13:19:45.680428 22362 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.759550 22402 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.780333 17360 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:45.776152 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:45.782439 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:45.763411 22421 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.785823 22279 raft_consensus.cc:1081] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:19:45.775774 22303 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.788465 17999 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:45.791776 17466 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:45.680558 22367 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.763818 21964 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.774992 22160 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:45.800154 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:45.801330 22275 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.802872 22362 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.793385 22402 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.796640 22303 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.806077 21894 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:45.822227 17469 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:19:45.809816 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.808192 22318 consensus_meta.cc:287] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.001s
I20260709 13:19:45.779479 22356 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:19:45.817883 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:45.823683 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.827353 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.821996 17285 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:45.836849 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 56577.5us
I20260709 13:19:45.839617 22350 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.811054 22437 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:45.821033 22111 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:45.845795 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:45.846536 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:45.821873 21894 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:45.796237 22452 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.849316 22313 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:45.833985 22318 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.851572 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:45.852528 22160 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.844516 22111 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.857257 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:45.860934 17470 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:45.809228 22421 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:45.879079 17314 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1728) took 2641 ms (client timeout 1995 ms). Trace:
I20260709 13:19:45.866492 17393 raft_consensus.cc:2410] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:19:45.878754 17389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 2030) took 1808 ms (client timeout 1997 ms). Trace:
I20260709 13:19:45.870242 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:45.893898 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 51106.4us
I20260709 13:19:45.878270 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1736) took 2476 ms. Trace:
W20260709 13:19:45.862649 22434 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.680s	user 0.004s	sys 0.000s
I20260709 13:19:45.910969 17321 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:45.904219 17314 rpcz_store.cc:269] 0709 13:19:43.237759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.237981 (+   222us) service_pool.cc:224] Handling call
0709 13:19:45.878890 (+2640909us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54003e21d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:45.879002 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4374732032}
I20260709 13:19:45.906064 17319 rpcz_store.cc:276] 0709 13:19:43.401990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.050509 (+648519us) service_pool.cc:224] Handling call
0709 13:19:44.051254 (+   745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.277724 (+1226470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.277758 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.277820 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:45.277853 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.877956 (+600103us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400368b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:45.877995 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.878094 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2819992064}
W20260709 13:19:45.905007 17389 rpcz_store.cc:269] 0709 13:19:44.073638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.078149 (+  4511us) service_pool.cc:224] Handling call
0709 13:19:45.878534 (+1800385us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540038d454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:45.878682 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2769089792}
I20260709 13:19:45.842114 22293 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
W20260709 13:19:45.913406 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 67691.3us
I20260709 13:19:45.914958 17285 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:45.913491 22366 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.917197 17465 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:45.893110 21894 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.915418 17997 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:45.866209 22211 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:45.916141 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45949.4us
I20260709 13:19:45.920069 22452 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:45.925635 17395 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:45.860050 21633 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.926337 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:45.927084 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:45.927798 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:45.896709 22371 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:45.935356 21964 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.881628 22365 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:45.847769 22275 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:45.856810 22232 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:45.868381 22267 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:45.914614 22454 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:19:45.998167 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:45.940954 17287 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:45.906672 22111 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.842195 22350 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:45.946445 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.938292 22421 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.914624 22318 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.944602 22292 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:45.961378 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:45.942410 21845 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:45.954756 22371 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:45.965724 22444 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.518s	user 0.004s	sys 0.000s
I20260709 13:19:45.975308 22376 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:45.939723 22293 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:19:46.042855 22293 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:46.043216 22293 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:46.044607 17467 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:45.950260 22199 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:19:45.984653 22134 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:45.986341 22424 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.047669 22424 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:45.997220 17388 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:46.048576 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.005791 17468 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:19:46.009542 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:46.044137 22293 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.016420 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.018344 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:46.018790 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 107162us
W20260709 13:19:46.019512 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.027674 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:46.060568 17396 raft_consensus.cc:2410] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 16 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:19:46.024363 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.030169 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:46.031980 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.041246 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.041906 22376 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:45.990950 21894 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.039005 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:46.071115 17990 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:19:46.071583 22451 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:19:46.059114 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.062054 17462 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:46.063079 17463 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:46.012758 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 71927.6us
W20260709 13:19:46.063642 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.037338 22371 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.064427 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.069372 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:46.070176 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 70681.1us
I20260709 13:19:46.026278 21845 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:46.075752 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:46.023666 22211 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:46.091624 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.079013 17313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 858) took 2646 ms (client timeout 1658 ms). Trace:
I20260709 13:19:46.094364 22437 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:46.094909 22437 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:46.094815 22425 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:46.095939 22437 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.096231 22402 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.097222 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 856) took 2683 ms. Trace:
I20260709 13:19:46.097558 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3203) took 3310 ms. Trace:
I20260709 13:19:46.097831 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:46.092221 17313 rpcz_store.cc:269] 0709 13:19:43.433045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.037376 (+604331us) service_pool.cc:224] Handling call
0709 13:19:46.078846 (+2041470us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b540010ca54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:46.078947 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1334154624}
I20260709 13:19:46.097929 17390 rpcz_store.cc:276] 0709 13:19:42.787646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.004830 (+217184us) service_pool.cc:224] Handling call
0709 13:19:43.009292 (+  4462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.111043 (+2101751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.082682 (+971639us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400012554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:46.097500 (+ 14818us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4567278336}
I20260709 13:19:46.103559 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.104043 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.110939 17990 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:46.083351 22432 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:46.115548 17397 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:46.088166 21845 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:46.121975 22293 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.121870 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:46.130859 17464 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.123417 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:46.123953 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:46.124627 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.132040 17395 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.125625 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.126120 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:46.115994 22211 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:46.129217 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.143311 17462 raft_consensus.cc:2410] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:19:46.089946 22292 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:46.146675 17394 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:19:46.147090 17394 pending_rounds.cc:85] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 12
I20260709 13:19:46.147363 17394 pending_rounds.cc:107] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:19:46.147614 17394 raft_consensus.cc:2889] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.148708 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:46.149389 17388 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:46.129845 22432 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.153234 22432 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:46.153479 22232 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:46.157342 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:46.157982 17389 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:46.163141 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:46.165658 22211 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.052830 22414 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:46.169559 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 44001.4us
I20260709 13:19:46.170667 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.171772 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.172282 17463 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:46.173154 22157 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.173513 22285 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:46.173995 22285 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:46.173764 22157 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.174393 22285 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.175980 22157 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:46.173175 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:46.177771 17397 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:46.177871 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:46.178788 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:46.179107 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:46.180007 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:46.180603 17388 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:46.181841 17389 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:46.181924 21964 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:46.182731 21964 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:46.098335 22402 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:46.185230 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:46.183584 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.190192 17360 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.189654 17394 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.097566 17322 rpcz_store.cc:276] 0709 13:19:43.413380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.052307 (+638927us) service_pool.cc:224] Handling call
0709 13:19:44.052875 (+   568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.326563 (+1273688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.326592 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.327114 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.453650 (+126536us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:45.453696 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.944867 (+491171us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:45.986526 (+ 41659us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003facd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:45.986582 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.096900 (+110318us) raft_consensus.cc:1685] finished
0709 13:19:46.096920 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.097062 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29766,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":1913,"spinlock_wait_cycles":2986822272,"thread_start_us":63880,"threads_started":1,"wal-append.queue_time_us":81722}
I20260709 13:19:46.228256 17395 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:46.229923 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.232172 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:46.173151 22292 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.189631 22021 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:46.244957 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:46.243317 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:46.253376 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:46.239063 17471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:19:46.233402 22363 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:46.184674 22303 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.256242 17471 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.265213 17471 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.257995 21894 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:46.250765 22367 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:46.241268 22292 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.256210 22120 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:46.190577 22421 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:19:46.267855 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 97647us
I20260709 13:19:46.243502 22279 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:46.265513 17434 connection.cc:256] RPC call timeout handler was delayed by -2.2097000300000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:19:46.276801 17434 connection.cc:256] RPC call timeout handler was delayed by -1.7237111209999512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:19:46.277245 17434 connection.cc:256] RPC call timeout handler was delayed by -1.4933111210000334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260709 13:19:46.277607 17434 connection.cc:256] RPC call timeout handler was delayed by -1.2647111210001185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
I20260709 13:19:46.252200 22330 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:46.239697 22362 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:19:46.262251 22412 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:46.270114 22402 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.276352 22279 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:46.302280 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.287721 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:46.289428 17391 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:46.296420 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.286808 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.284801 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.320091 17464 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:19:46.314493 17990 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:46.321108 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:46.330070 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45380.1us
I20260709 13:19:46.250427 22376 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.331825 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.336952 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.338105 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:46.334444 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.339581 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.273818 22363 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.306205 22279 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.288650 22330 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:46.347110 21401 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.349853 21401 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:46.350314 21401 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.329892 22438 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:19:46.355962 22463 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:46.361500 22303 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:46.364037 22432 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.288702 22111 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.366293 22432 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:46.366497 22111 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:46.298861 22160 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:19:46.351639 22330 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.368211 22160 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:46.300719 22402 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.373181 22318 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:46.373561 21845 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.375242 22363 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:46.375600 21845 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:46.345274 22211 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:46.377116 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:46.377198 22211 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.377825 22211 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.378479 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:46.379103 17990 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:46.380240 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 93516.3us
I20260709 13:19:46.380990 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.383536 17389 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:46.384452 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:46.384989 17389 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:46.385721 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.386670 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.338610 21857 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:46.345068 22412 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:46.389408 22058 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:46.340718 22377 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:46.302794 22120 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:19:46.391964 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.368587 22160 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:46.403095 22160 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.389861 22412 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.404803 22160 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.405059 22412 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:46.411496 22218 consensus_meta.cc:287] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.000s
I20260709 13:19:46.415675 22412 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.351177 22403 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:46.417111 22403 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.417495 22403 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:46.396519 22377 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.425119 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:46.426106 22424 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:46.433508 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:46.434142 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:46.434932 17995 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:46.435074 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:46.435772 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:46.436182 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:46.436532 17995 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:46.400957 21857 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:46.437493 21857 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.438225 22402 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:46.402026 22318 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:46.449855 22318 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:46.450929 22318 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.452447 22318 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.459872 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:46.425374 22377 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.465071 22329 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.469985 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3184) took 4259 ms. Trace:
I20260709 13:19:46.473435 22285 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.474136 22279 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.475956 22285 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:46.476819 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.478188 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.479511 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.470506 17470 rpcz_store.cc:276] 0709 13:19:42.210132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.219573 (+  9441us) service_pool.cc:224] Handling call
0709 13:19:42.219943 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.903684 (+3683741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.469640 (+565956us) spinlock_profiling.cc:243] Waited 3.64 s on lock 0x7b54000514d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:46.469898 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8371407360}
I20260709 13:19:46.436295 17990 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:46.428630 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:46.396008 17394 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:19:46.398341 17464 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:46.397337 22438 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:46.448225 22411 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:46.479468 22330 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:46.500749 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 75709.9us
I20260709 13:19:46.502820 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.490098 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.503113 17471 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.509392 17990 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:19:46.512358 22258 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:46.512879 22258 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:46.513301 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.513913 22258 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.514600 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.515234 17394 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.515462 22258 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:46.516919 22120 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:46.517249 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.517658 22120 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:46.518201 17462 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:46.519156 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.518913 22120 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.520344 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.522679 22292 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.525710 22330 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:46.525889 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.526854 17391 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:46.531594 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.532289 17464 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:19:46.532863 17462 raft_consensus.cc:2410] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:46.505594 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.537191 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:46.538594 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.507380 21401 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.542519 17471 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:46.543851 21401 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:46.544020 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.544701 17996 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:46.497413 22438 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.549574 22275 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:46.549703 22438 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.550477 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.551671 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:46.553040 22293 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:46.554195 22366 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:46.554258 22402 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:46.554626 22366 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:46.554730 22402 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.555161 22402 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.544431 22058 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:19:46.557185 22058 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:46.557516 22058 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:46.536585 22274 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:46.558007 22274 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:46.558326 22058 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.559346 17470 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:46.558943 22274 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.559935 22274 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.558949 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.561360 22452 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:46.561934 22452 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:46.561476 22366 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.562187 17464 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:46.562879 22366 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.562821 22452 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.563400 17464 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:46.563455 22371 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.564317 22452 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.543596 22424 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:46.569965 22424 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:46.570742 21894 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:46.560667 17470 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:46.573248 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:46.595793 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.598377 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.599951 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.602002 17462 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:46.594352 22292 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:46.562148 22058 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.622525 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.622797 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:46.626947 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:46.632105 17470 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:46.633996 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:46.633898 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60760.2us
I20260709 13:19:46.635478 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.638108 17462 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:46.623463 22279 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:46.640821 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:46.570928 22424 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.672381 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.630522 22377 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.678984 22402 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.682137 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3214) took 1038 ms. Trace:
I20260709 13:19:46.682578 17468 rpcz_store.cc:276] 0709 13:19:45.643380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.643519 (+   139us) service_pool.cc:224] Handling call
0709 13:19:45.643865 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.051952 (+408087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.681862 (+629910us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540016add4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:46.682072 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820346752}
I20260709 13:19:46.684046 17468 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:46.685248 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:46.688755 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.689975 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.690122 22377 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:46.691004 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:46.692484 17468 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:46.695021 17468 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:46.698586 22403 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.691524 17391 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.705704 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:46.707031 17394 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:46.709234 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:46.710623 17469 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:46.597360 22211 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.641965 22387 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:19:46.710423 22169 raft_consensus.cc:2764] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:46.748204 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.705061 22403 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:46.767350 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:46.769917 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.711735 22467 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:46.779186 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.781008 17394 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:46.728204 22371 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:46.764750 22279 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.775543 22134 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:46.777542 22442 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:46.781152 22157 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:46.797482 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.781618 22402 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:46.786993 22411 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:46.804975 22425 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:46.816408 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:46.795184 22442 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:46.834118 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.019s
I20260709 13:19:46.834589 17394 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:19:46.834630 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.000s	sys 0.019s
I20260709 13:19:46.840744 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:46.785713 22467 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.846508 17991 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.821475 22267 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:46.799496 22279 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.836823 22442 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.870133 17360 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.853080 22387 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:46.882418 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.902113 22267 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:46.901643 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:46.835620 22425 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:46.920781 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.913231 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49258.5us
W20260709 13:19:46.958412 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.959102 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 54465.4us
I20260709 13:19:46.967576 22232 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:46.955435 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.968802 22232 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:46.969334 22232 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:46.970479 22232 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:46.972299 22452 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:46.932006 22387 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.978659 17964 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:46.934762 22211 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:46.977402 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:46.973841 22232 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.991966 22414 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:46.992367 22329 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.003s
I20260709 13:19:46.994292 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:46.980829 22120 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:46.999853 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:47.000756 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.001521 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.001989 22467 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:47.002332 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.003122 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.031895 17316 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:47.003856 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.004608 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.032635 17320 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:47.032951 17317 raft_consensus.cc:2393] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:47.007771 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:47.014720 17991 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:46.960240 21857 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:47.025772 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1303) took 1013 ms. Trace:
I20260709 13:19:47.030501 17321 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:47.028548 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 2066) took 1061 ms. Trace:
I20260709 13:19:46.948292 22438 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:46.977242 22387 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:47.039867 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:47.040514 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 61935.8us
I20260709 13:19:47.037675 17318 rpcz_store.cc:276] 0709 13:19:45.966744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.951608 (+984864us) service_pool.cc:224] Handling call
0709 13:19:47.028470 (+ 76862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:47.041420 17320 raft_consensus.cc:2410] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:19:47.036108 17993 rpcz_store.cc:276] 0709 13:19:46.012328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.022481 (+ 10153us) service_pool.cc:224] Handling call
0709 13:19:47.024703 (+1002222us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:19:47.025015 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.025283 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.025327 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:47.025392 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:47.025443 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.025522 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.025688 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4744448}
I20260709 13:19:47.016799 22437 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:47.057700 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1889) took 2044 ms. Trace:
I20260709 13:19:47.058619 17316 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:47.058141 17465 rpcz_store.cc:276] 0709 13:19:45.012926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.047061 (+ 34135us) service_pool.cc:224] Handling call
0709 13:19:45.083721 (+ 36660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.941933 (+858212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.056638 (+1114705us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b5400162454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:47.056821 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911779584}
I20260709 13:19:47.059437 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:47.063071 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.065287 17321 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:47.035858 21857 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.065864 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.076072 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.080255 17313 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:47.080334 17317 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:47.080361 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:47.080878 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:47.081306 17464 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.081528 17469 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.077759 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:47.081025 17465 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:47.084107 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:47.046419 22387 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.085233 17319 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 13. (term mismatch)
I20260709 13:19:47.084754 17462 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.085630 17319 pending_rounds.cc:85] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 12
I20260709 13:19:47.085919 17319 pending_rounds.cc:107] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 12.13
I20260709 13:19:47.086164 17319 raft_consensus.cc:2889] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:47.087088 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:47.087685 17471 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.089699 17463 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:47.091326 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.092116 21401 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.092608 21401 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:47.093407 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.098744 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:47.099936 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:47.057358 22402 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.048424 22467 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.071694 22211 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.082234 21857 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:47.114430 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:47.122792 17465 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:47.127946 17391 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:19:47.133375 22495 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:19:47.102149 22367 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:47.139838 22318 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.001s
W20260709 13:19:47.141578 22487 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:19:47.143502 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:47.144479 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:47.144740 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:47.145392 17990 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.145529 17994 raft_consensus.cc:2410] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:47.146464 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:47.147594 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:47.148116 17994 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.148824 22425 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:47.149219 22279 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:47.150053 22471 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.472s	user 0.004s	sys 0.001s
I20260709 13:19:47.151233 22438 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:47.155257 22303 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:47.155864 22303 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:47.161464 22470 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.490s	user 0.002s	sys 0.000s
I20260709 13:19:47.163513 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2041) took 1083 ms. Trace:
I20260709 13:19:47.081790 22437 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.164065 17396 rpcz_store.cc:276] 0709 13:19:46.080596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.088992 (+  8396us) service_pool.cc:224] Handling call
0709 13:19:46.107580 (+ 18588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.173339 (+ 65759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.173370 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.173910 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.309097 (+135187us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:46.309135 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.309204 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.160597 (+851393us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:47.163082 (+  2485us) raft_consensus.cc:1685] finished
0709 13:19:47.163127 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.163430 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34151,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":68030336,"thread_start_us":134774,"threads_started":1,"wal-append.queue_time_us":459748}
I20260709 13:19:47.167424 22437 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:47.167609 22303 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:47.171195 22274 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.611s	user 0.013s	sys 0.000s
I20260709 13:19:47.048668 22120 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.171044 22303 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.175071 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.175685 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:47.176285 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.176489 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.175089 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 975) took 1013 ms. Trace:
I20260709 13:19:47.177541 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:47.174176 22476 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:47.178133 17996 rpcz_store.cc:276] 0709 13:19:46.161977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.565233 (+403256us) service_pool.cc:224] Handling call
0709 13:19:46.565628 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.566058 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.566096 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.566650 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.837890 (+271240us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:46.837959 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.838030 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.174867 (+336837us) raft_consensus.cc:1685] finished
0709 13:19:47.174888 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.175031 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1765,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":269684,"threads_started":1,"wal-append.queue_time_us":562658}
I20260709 13:19:47.180907 17996 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:47.181802 17319 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:47.184989 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 972) took 1024 ms. Trace:
W20260709 13:19:47.185693 22486 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:19:47.189285 22258 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.673s	user 0.016s	sys 0.000s
I20260709 13:19:47.189360 17990 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:47.192256 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:47.192987 17468 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:19:47.194136 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:47.194820 17466 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.199368 17314 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
W20260709 13:19:47.115331 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 245265us
I20260709 13:19:47.206904 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:47.209348 17466 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:47.214082 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:47.214958 17388 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:47.218497 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:47.219291 17997 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:47.220033 17462 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:47.222873 17467 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
W20260709 13:19:47.120939 22482 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:19:47.185527 17995 rpcz_store.cc:276] 0709 13:19:46.160989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.502835 (+341846us) service_pool.cc:224] Handling call
0709 13:19:46.529233 (+ 26398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.529732 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:46.844569 (+314837us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.962338 (+117769us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.984682 (+ 22344us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.984821 (+   139us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:46.984880 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.984959 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.184752 (+199793us) raft_consensus.cc:1685] finished
0709 13:19:47.184774 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.184932 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":426933,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":4847,"raft.queue_time_us":4960,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":41046,"thread_start_us":405908,"threads_started":2,"wal-append.queue_time_us":323080}
W20260709 13:19:47.209745 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.222796 17994 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:47.229424 17391 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:47.236646 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:47.237042 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:47.239800 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.240370 17463 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:47.213855 22274 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:47.248660 17397 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:47.248823 17389 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:47.253314 17995 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:47.256165 17471 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:47.257712 17317 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:47.110100 22402 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.259086 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:47.263479 17388 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:47.264178 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 57357.3us
I20260709 13:19:47.259683 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.260931 21401 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:47.171566 22350 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:47.274525 17318 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:19:47.277863 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.281416 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.281596 22295 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:19:47.282195 17397 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:47.282873 22120 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:47.265519 22285 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:19:47.286914 21964 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:47.288861 22058 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.001s
I20260709 13:19:47.289026 22292 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:47.290498 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53533.4us
I20260709 13:19:47.291311 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:47.292433 21868 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:47.247951 22366 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.293579 22366 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.256964 22438 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:19:47.298290 22371 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:47.298914 22371 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.299598 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:47.300691 17396 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:47.301272 22479 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.302554 17997 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:47.117820 22211 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.303658 17999 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:47.292913 21868 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.308104 17464 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:47.299960 22371 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.308511 17388 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:47.317752 17391 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:47.296481 22366 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:47.240811 22413 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:19:47.329280 17995 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:47.331341 22412 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:47.332273 22402 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:47.337707 22490 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:19:47.338379 21857 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.343680 22387 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.346071 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.348207 17393 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:47.327590 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:47.350411 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 903) took 1049 ms. Trace:
I20260709 13:19:47.350853 17992 rpcz_store.cc:276] 0709 13:19:46.301334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.567804 (+266470us) service_pool.cc:224] Handling call
0709 13:19:46.568083 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.568475 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.568514 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.594797 (+ 26283us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.853506 (+258709us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:46.853547 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.853612 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.350115 (+496503us) raft_consensus.cc:1685] finished
0709 13:19:47.350145 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.350336 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18904,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":221500,"threads_started":1,"wal-append.queue_time_us":463338}
I20260709 13:19:47.353787 17991 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:47.355885 17322 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:47.320128 22120 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:47.273408 22025 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:19:47.370618 17994 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:47.368964 17318 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.381151 17964 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:47.382404 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:47.383510 17314 raft_consensus.cc:2410] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:47.382409 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.384780 17322 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:47.389814 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:47.399304 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:47.345543 22279 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:19:47.383244 21857 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:47.369457 22442 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.400082 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:47.407015 17463 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:47.407446 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.409781 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:47.408402 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:47.415982 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.415362 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:47.431861 17470 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:47.399601 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:47.401991 17469 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:47.444232 17314 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:47.444180 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:47.445531 17322 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:47.444358 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.445992 17322 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.442734 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:47.451620 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:47.453224 17322 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.488615 17322 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:47.410660 22211 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:47.443356 22402 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.408133 21868 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.483265 22365 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.511226 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.511901 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:47.512063 17320 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:47.512929 17314 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:47.524554 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:47.525452 17316 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
W20260709 13:19:47.519744 22424 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.011s	sys 0.017s
I20260709 13:19:47.409150 22425 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:47.529664 17317 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:19:47.535161 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:47.536381 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 298395us
I20260709 13:19:47.491058 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:47.543037 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 203927us
W20260709 13:19:47.531128 22424 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.011s	sys 0.018s
W20260709 13:19:47.534143 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 242907us
W20260709 13:19:47.539146 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 48667.2us
I20260709 13:19:47.550431 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:47.533459 22387 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:47.552188 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.555616 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:47.558034 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:47.540089 22425 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:47.542495 22232 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:47.566591 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.568090 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 287417us
I20260709 13:19:47.569278 17995 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:47.569205 17360 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:47.574314 22058 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.574978 22058 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.586323 22376 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.589581 22058 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:47.590154 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1312) took 1135 ms. Trace:
I20260709 13:19:47.591368 17318 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:47.592674 17313 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:47.593089 22232 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:47.594185 22232 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.590813 17996 rpcz_store.cc:276] 0709 13:19:46.454399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.181705 (+727306us) service_pool.cc:224] Handling call
0709 13:19:47.182019 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.187236 (+  5217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.187268 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.187788 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.401102 (+213314us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:47.401162 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.409868 (+  8706us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.589839 (+179971us) raft_consensus.cc:1685] finished
0709 13:19:47.589876 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.590061 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":785,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":86,"thread_start_us":212875,"threads_started":1,"wal-append.queue_time_us":342633}
W20260709 13:19:47.601444 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.602556 17360 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:47.603407 22513 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.555751 22211 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:19:47.550108 22507 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:19:47.607234 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:47.608392 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50474.6us
I20260709 13:19:47.608947 17994 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:47.608155 22267 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.609193 17285 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:47.601374 22514 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:47.604563 22387 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:47.614555 22274 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:47.617774 22274 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:47.618037 22425 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.618731 22274 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.620137 22274 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.614424 22467 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:47.621191 22512 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:47.621371 22467 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.621863 22512 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.622922 22512 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.623941 22467 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:47.624780 22514 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.625835 22514 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:47.632364 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 63375.9us
I20260709 13:19:47.613189 22366 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:47.634479 22025 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:19:47.633644 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:47.635905 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 70194us
I20260709 13:19:47.633256 22442 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:47.646893 22366 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.647039 22025 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:47.647850 22025 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.648288 22025 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:47.648226 22366 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.653532 22279 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.654129 22279 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.655110 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 966) took 1643 ms. Trace:
I20260709 13:19:47.655539 17999 rpcz_store.cc:276] 0709 13:19:46.011500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.022560 (+ 11060us) service_pool.cc:224] Handling call
0709 13:19:47.016187 (+993627us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b58001e6398. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:19:47.303421 (+287234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.304226 (+   805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.654904 (+350678us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54006d1fd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:47.655049 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672658048}
I20260709 13:19:47.657719 22211 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.658237 22211 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.658536 22518 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:47.659912 22372 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:47.660300 22372 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.660477 22211 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:47.661044 22218 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:47.614385 22267 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.661247 22372 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.664423 22518 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:47.676002 22218 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.683743 22218 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:47.670387 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.667383 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:47.676136 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:47.604161 17360 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:47.684407 22267 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:47.685915 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:47.699641 17991 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:47.702392 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:47.703202 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:47.704183 17999 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:19:47.704651 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 100562us
W20260709 13:19:47.666920 22414 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.002s
I20260709 13:19:47.706175 17462 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13. Ops: [11.7-12.8]
I20260709 13:19:47.656737 22279 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:47.709065 17322 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:19:47.715510 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:47.718117 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.731130 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:47.731508 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:47.733063 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:47.686761 22466 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.981s	user 0.005s	sys 0.000s
I20260709 13:19:47.736505 17464 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:47.737936 17391 raft_consensus.cc:1217] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 10.9->[11.10-13.11]   Dedup: 13.11->[]
I20260709 13:19:47.738081 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.738620 17391 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:19:47.739876 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.740283 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:47.740640 17391 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:47.741096 17388 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:47.742964 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:47.743832 17467 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:19:47.746588 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:47.748076 17466 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:19:47.751116 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.694554 22366 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.686884 22311 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:47.756424 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 186051us
I20260709 13:19:47.714030 22421 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:47.757615 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:47.712502 22432 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:47.763393 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.764077 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:47.767961 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.727876 22518 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:47.760558 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:47.760713 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:47.761771 17391 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:47.725945 22412 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:47.795861 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:47.794649 17465 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:47.750586 22279 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:47.754551 22211 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:47.725653 21964 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:19:47.771552 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:47.770660 22372 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.833906 17392 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:47.830411 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1304) took 1817 ms. Trace:
I20260709 13:19:47.833626 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:47.842734 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:47.837817 17998 rpcz_store.cc:276] 0709 13:19:46.012677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.022374 (+  9697us) service_pool.cc:224] Handling call
0709 13:19:46.053568 (+ 31194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.068421 (+ 14853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.068449 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.111854 (+ 43405us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.332238 (+220384us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:46.746987 (+414749us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.747301 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.747400 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.807290 (+ 59890us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4800041ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:19:47.680648 (+873358us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:47.830134 (+149486us) raft_consensus.cc:1685] finished
0709 13:19:47.830161 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.830343 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2653,"prepare.queue_time_us":551666,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":30511,"raft.run_cpu_time_us":3519,"raft.run_wall_time_us":735003,"spinlock_wait_cycles":17460352,"thread_start_us":589171,"threads_started":2,"wal-append.queue_time_us":502681}
I20260709 13:19:47.813130 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.813668 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:47.762979 22366 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:47.825670 22523 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:19:47.828999 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.812901 22218 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:47.851008 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 90383us
I20260709 13:19:47.805226 22412 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.847754 21401 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:47.865968 21401 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:47.853286 22058 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:47.801510 22518 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.853703 22232 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:47.859201 22507 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:47.860096 17464 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:47.798731 22311 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:19:47.878141 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:47.879174 17391 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:47.834477 22432 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:47.834822 22479 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.867274 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2056) took 1320 ms. Trace:
I20260709 13:19:47.872323 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.890753 17393 rpcz_store.cc:276] 0709 13:19:46.546769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.007176 (+460407us) service_pool.cc:224] Handling call
0709 13:19:47.007496 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.348664 (+341168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.867026 (+518362us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400410ad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:47.867215 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777944320}
I20260709 13:19:47.875654 22279 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.881312 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:47.754791 22350 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.901669 17397 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:47.875953 22540 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:47.914139 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:47.865003 22160 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:19:47.876384 22421 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.923229 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.883380 22432 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:47.934122 21401 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:47.931586 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50350.1us
I20260709 13:19:47.934710 17397 raft_consensus.cc:2410] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:19:47.933439 17393 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:47.935106 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:47.915397 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.938398 21401 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:47.938609 17391 raft_consensus.cc:2368] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15.
I20260709 13:19:47.939953 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.914319 21964 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:47.941985 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:47.943256 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.914634 22058 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.918994 22540 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.945168 21401 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:47.935073 22513 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.936225 22432 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.944681 22412 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:47.946878 22531 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:19:47.958774 22279 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.947819 22421 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.935813 22424 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:19:47.945235 21964 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.954879 22366 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:47.957235 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.994400 17393 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:47.947402 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.962616 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:47.995127 17990 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.959883 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:47.965055 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:47.923971 22414 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:47.956964 22160 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.934711 22211 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:47.970484 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:48.014025 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 43615.3us
I20260709 13:19:48.015034 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.015842 21401 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:47.966713 22540 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.961763 22518 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.908766 22479 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:47.993300 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:47.996253 17995 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:19:47.967438 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.995860 17397 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:47.998427 17998 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:19:47.999204 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 68057.9us
W20260709 13:19:48.007207 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.077816 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.010756 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:47.977789 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.080665 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.033744 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.972810 22413 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:48.026895 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.031874 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:48.093267 17391 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:47.996672 21964 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.095314 17314 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:48.094242 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:47.991540 22025 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.031468 22058 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:19:48.053030 22425 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:48.054389 17963 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.577s (SENT) [suppressed 31 similar messages]
I20260709 13:19:48.012971 22414 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.099963 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:48.057628 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:48.059691 21868 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.029806 22424 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.070075 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:48.111708 17466 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:48.111788 17360 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:48.112720 22311 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:48.113193 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:48.071097 17469 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:48.083779 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:48.114142 22372 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:48.088258 17320 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:48.094439 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 67627.9us
I20260709 13:19:48.116001 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:48.116300 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:48.117532 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:48.118227 22515 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:48.118458 22232 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.118848 17434 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.119196 22232 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:48.119632 21857 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.120585 22111 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:48.122879 22387 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:48.125106 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:47.989096 22274 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:19:48.101656 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:48.101756 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47397us
I20260709 13:19:48.101878 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:48.097929 22413 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.101601 22513 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.101501 22425 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:48.132506 22475 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 1.199s	user 0.000s	sys 0.004s
I20260709 13:19:48.106012 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:48.100163 22547 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.106598 22025 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.105352 22058 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:48.137436 22058 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:48.137234 22547 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.137842 22211 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.138401 22058 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.139505 17314 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:48.139586 22058 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.133926 17465 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:48.105675 21401 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:48.141129 21401 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.141466 21401 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.142181 22414 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.105774 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:48.143712 17318 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.145058 22432 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.108052 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.109157 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.110205 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.151809 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:48.113251 22311 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:48.153575 21401 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.073805 17999 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:48.155755 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.156356 17396 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:48.127570 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:48.163112 17360 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:48.102391 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.020632 22160 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.094664 22285 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.094863 22169 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:48.166733 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.102006 22536 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.167542 17391 raft_consensus.cc:2410] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:48.097255 22218 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.132712 22413 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.156720 22535 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.195782 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.135375 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.135978 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:48.196944 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.197041 17462 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:48.198247 17462 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:19:48.198958 17318 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:19:48.134302 22513 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.150079 17393 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:48.098775 22539 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.117699 22502 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.154323 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.163970 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.206664 17396 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:48.168162 22414 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:48.165494 21401 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:48.167883 22303 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.134084 17434 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.156596 22311 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.193953 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:48.166437 22302 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:48.200039 17391 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:48.131279 17990 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:19:48.201154 17395 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:48.159360 22425 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.202697 17322 raft_consensus.cc:2410] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:48.207701 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.164232 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:48.208351 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:48.225934 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.230928 17997 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:48.231081 17469 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:48.231396 17393 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:48.227835 21401 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:48.229633 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.199707 22232 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:48.240612 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 46749.6us
I20260709 13:19:48.229131 22302 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.245277 22302 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.249181 22303 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:48.250751 22513 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.201531 22218 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.210023 22267 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:48.208158 22432 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.254065 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.197667 22169 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.256807 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.259764 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:48.261122 22218 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.262374 22502 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:48.261125 22160 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.264770 22160 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:48.265332 22160 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.267254 22160 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.193544 22285 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.268415 22513 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:48.270645 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.276038 17397 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:48.285845 17319 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:48.286945 17313 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
W20260709 13:19:48.287446 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 120619us
I20260709 13:19:48.293310 17469 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:19:48.193789 22536 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.254617 22387 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:48.298358 17360 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:48.308252 22169 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.301199 22432 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:48.309429 22432 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:48.310412 22432 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:48.338518 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 111895us
I20260709 13:19:48.301400 22414 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:19:48.305727 22303 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:48.394508 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 53980us
I20260709 13:19:48.399384 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:48.427160 17360 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:48.433413 17316 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:48.340852 22285 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.440974 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:48.444406 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:48.447705 17313 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:48.450274 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:48.451135 17319 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:48.451078 17997 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:19:48.458480 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 304208us
W20260709 13:19:48.459316 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.460194 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:48.440462 22555 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:19:48.461745 17320 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:48.340865 22302 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:48.463107 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 70612.5us
I20260709 13:19:48.466218 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:48.467795 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:48.456499 22502 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:48.474725 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:48.475414 17320 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:48.478343 17963 leader_election.cc:400] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15.
I20260709 13:19:48.478722 17963 leader_election.cc:403] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:48.479868 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:48.479861 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:48.482366 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.480585 17468 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:48.471230 17360 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:48.486806 17287 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:48.486896 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:48.490324 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:48.491182 17468 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:48.473407 22285 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:48.495335 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 361341us
I20260709 13:19:48.496623 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.482216 22372 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:48.499868 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:48.502130 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:48.502118 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.498759 22425 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.502749 22285 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:48.505728 22564 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.483384 22267 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15.
I20260709 13:19:48.483738 22120 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:19:48.499468 22387 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:48.510728 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:48.525724 22285 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.508680 22274 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:19:48.498255 22502 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:48.501010 22513 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:19:48.501565 22025 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:48.534389 22560 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:48.534718 22111 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:48.525595 22372 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:48.498528 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:48.545828 22267 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.499425 22414 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
W20260709 13:19:48.566036 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 65341us
I20260709 13:19:48.624397 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.626086 17393 raft_consensus.cc:2410] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:48.571015 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:48.626629 17464 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.619840 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:48.558193 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.563081 22058 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:48.508538 22561 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 13:19:48.628698 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 130067us
I20260709 13:19:48.567062 22387 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:48.621887 22371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.287s	user 0.011s	sys 0.036s
I20260709 13:19:48.575330 22560 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.573027 22025 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.617882 22111 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.617931 22502 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:48.620193 22515 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:48.639071 22554 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.633910 22285 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:48.661644 22285 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.661360 22554 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.662070 22285 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.663836 22554 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:48.664443 22554 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:48.638916 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.665908 17393 raft_consensus.cc:2410] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:19:48.666857 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.666900 22502 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.668150 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:48.669298 17393 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:48.633543 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:48.634187 21401 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:19:48.651676 17963 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.654918 22387 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:48.656908 21964 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.553s	user 0.003s	sys 0.007s
I20260709 13:19:48.659291 22311 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.650329 22025 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.652737 22111 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.622946 22536 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.675854 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:48.673105 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:48.692492 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.647282 17464 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:48.676106 22425 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.687311 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:48.645172 22570 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.093s	user 0.000s	sys 0.007s
I20260709 13:19:48.694692 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:48.640533 22371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.302s	user 0.012s	sys 0.037s
I20260709 13:19:48.634307 22414 consensus_queue.cc:1243] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:19:48.709617 17470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 858) took 2067 ms (client timeout 1550 ms). Trace:
W20260709 13:19:48.733779 22497 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.403s	user 0.007s	sys 0.002s
I20260709 13:19:48.714504 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:48.736038 22424 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:48.736333 17318 raft_consensus.cc:2376] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12. Re-sending same reply.
I20260709 13:19:48.736593 22424 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:48.737514 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:48.737706 22424 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.738834 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:48.739403 17318 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.740310 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.723964 22302 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.726519 17391 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:48.743438 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.744038 17391 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:48.744376 22350 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:48.745126 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.745734 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:48.713179 22565 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.254s	user 0.003s	sys 0.000s
I20260709 13:19:48.645933 22560 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:48.733578 17470 rpcz_store.cc:269] 0709 13:19:46.641957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.684901 (+ 42944us) service_pool.cc:224] Handling call
0709 13:19:48.709365 (+2024464us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400384ad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:48.709515 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1389082368}
I20260709 13:19:48.754212 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:48.744908 22350 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.768720 22350 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:48.772529 21868 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.643s	user 0.004s	sys 0.008s
I20260709 13:19:48.767807 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:48.680035 21964 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.778469 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:48.778492 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 143908us
I20260709 13:19:48.779644 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.776953 22564 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:48.782998 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.781741 17391 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:48.791790 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:48.775101 22425 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:48.830264 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 273731us
I20260709 13:19:48.833082 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:48.766135 22211 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:48.833328 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 50416us
I20260709 13:19:48.837450 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:48.837900 17320 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:19:48.838361 17990 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:48.784052 22562 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:48.848872 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:48.849687 17997 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:48.776688 22160 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:19:48.745225 22372 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.831277 22371 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:48.845405 22565 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:48.851151 22564 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:48.847142 22562 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.779321 22058 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:48.877709 22573 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:19:48.884734 22575 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:19:48.890133 17318 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:48.872989 22562 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:48.911024 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 123508us
I20260709 13:19:48.913091 17321 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:48.903162 22513 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.920251 17389 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:48.920701 17389 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:48.923141 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 230755us
I20260709 13:19:48.924129 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:48.917279 22540 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.882s	user 0.008s	sys 0.004s
I20260709 13:19:48.921519 22311 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.933404 22564 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:48.938593 22547 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.939759 22267 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.920238 22513 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.918550 22285 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.945362 22285 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.942732 22058 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.946169 17393 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:19:48.946995 22111 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.955085 22515 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.955554 22350 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.955669 22515 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.958098 17999 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:19:48.958268 22515 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.960542 22424 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.954301 22285 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:48.961404 22285 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.963724 22285 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.965312 22025 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:48.966274 22111 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.966948 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:48.967501 17391 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.968961 22350 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:48.973260 17319 raft_consensus.cc:2368] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14.
I20260709 13:19:48.975274 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:48.926931 17389 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:48.982071 17995 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:48.968066 22025 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.986490 17389 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:48.987598 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 63553.9us
I20260709 13:19:48.991837 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:48.993229 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.995110 22583 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.985419 22311 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:48.994613 22537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.007s	sys 0.003s
I20260709 13:19:49.010614 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.021502 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.028107 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.029793 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:48.995460 21964 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:48.953974 22540 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:49.025638 22537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.007s	sys 0.003s
I20260709 13:19:49.048695 17391 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:49.051508 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1757) took 2053 ms. Trace:
I20260709 13:19:49.052078 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:49.052341 17286 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:49.024441 22350 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.051885 17315 rpcz_store.cc:276] 0709 13:19:46.998558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.048032 (+ 49474us) service_pool.cc:224] Handling call
0709 13:19:47.071377 (+ 23345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.260351 (+188974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.260387 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.278138 (+ 17751us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.522180 (+244042us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:47.522239 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.034008 (+1511769us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54000c9ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:49.034061 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.034104 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:49.034122 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.051443 (+ 17321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433967360,"thread_start_us":203046,"threads_started":1,"wal-append.queue_time_us":258281,"wal-append.run_cpu_time_us":1974,"wal-append.run_wall_time_us":1040653}
I20260709 13:19:49.054179 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2068) took 1213 ms. Trace:
I20260709 13:19:49.034435 22367 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:49.060377 17317 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:49.029647 22267 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:49.056861 17395 rpcz_store.cc:276] 0709 13:19:47.838016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.271458 (+433442us) service_pool.cc:224] Handling call
0709 13:19:48.300062 (+ 28604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.300368 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:48.945587 (+645219us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b180037ec40. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf 00007f7d6280e038
0709 13:19:48.995000 (+ 49413us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.051460 (+ 56460us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:49.051507 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:49.051545 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.051605 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.051709 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12530,"prepare.queue_time_us":646479,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":5833,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":24604,"spinlock_wait_cycles":2361600,"thread_start_us":100953,"threads_started":2}
I20260709 13:19:49.054706 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:49.045176 22584 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:49.073122 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:49.025310 22311 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.077800 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:49.078387 17391 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.058666 22025 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:49.057422 22564 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.061719 22350 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:49.087060 22581 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:49.087743 22540 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:49.088296 22587 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:49.085479 22350 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.097105 22564 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.106400 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 807) took 1262 ms. Trace:
I20260709 13:19:49.106863 17397 rpcz_store.cc:276] 0709 13:19:47.844187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.095651 (+251464us) service_pool.cc:224] Handling call
0709 13:19:49.106163 (+1010512us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540038e854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:49.106314 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276465536}
I20260709 13:19:49.108137 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:49.110809 17471 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:19:49.111274 17471 pending_rounds.cc:85] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 11
I20260709 13:19:49.111524 17471 pending_rounds.cc:107] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:19:49.111783 17471 raft_consensus.cc:2889] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:49.114862 17397 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:49.116111 17397 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:49.116379 17397 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:49.118927 22311 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:49.020236 22583 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.119310 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3236) took 2667 ms. Trace:
I20260709 13:19:49.119655 17394 rpcz_store.cc:276] 0709 13:19:46.452236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.865683 (+413447us) service_pool.cc:224] Handling call
0709 13:19:46.880398 (+ 14715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.432103 (+1551705us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18002e0120. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d627ec060 00007f7d627ecbfb 00007f7d627f764b
0709 13:19:48.432360 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:48.947660 (+515300us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.061209 (+113549us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.061380 (+   171us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.061816 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.061944 (+   128us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:49.061989 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.062109 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.119108 (+ 56999us) raft_consensus.cc:1685] finished
0709 13:19:49.119129 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.119258 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":515505,"prepare.queue_time_us":541458,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":67,"raft.queue_time_us":99240,"raft.run_cpu_time_us":475,"raft.run_wall_time_us":48421,"spinlock_wait_cycles":33056384,"thread_start_us":245808,"threads_started":2,"wal-append.queue_time_us":154850}
I20260709 13:19:49.103361 22025 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:49.122292 22025 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.125253 17391 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:19:49.126238 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.062175 22330 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:49.128193 17397 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.128499 22562 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.129325 17389 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:49.131390 22582 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:49.132110 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.132290 22501 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:19:49.132534 22582 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.131640 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3243) took 1914 ms. Trace:
I20260709 13:19:49.134259 17389 rpcz_store.cc:276] 0709 13:19:47.217072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.263198 (+ 46126us) service_pool.cc:224] Handling call
0709 13:19:47.285261 (+ 22063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.920155 (+1634894us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540032fda0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d6276bdc0 00007f7d627f61c0 00007f7d627f7231 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c
0709 13:19:49.131003 (+210848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.131580 (+   577us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742183168}
I20260709 13:19:49.134951 17397 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.121209 22583 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:49.134690 22330 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.145193 22582 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:49.134106 22540 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:49.144227 22553 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:19:49.159682 22583 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.163462 22425 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.177553 22562 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:49.183706 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:49.184244 17395 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:49.160310 22560 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.167964 22583 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.191929 22583 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:49.193621 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.194540 17993 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:49.196626 22479 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:49.200060 22560 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:49.200451 22583 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:49.201149 17321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 2089) took 1750 ms (client timeout 1808 ms). Trace:
W20260709 13:19:49.201591 17321 rpcz_store.cc:269] 0709 13:19:47.451104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.451298 (+   194us) service_pool.cc:224] Handling call
0709 13:19:49.200995 (+1749697us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540035c0d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:49.201092 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038083456}
I20260709 13:19:49.202207 22318 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:49.196767 22330 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:49.202787 22318 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:49.203985 22318 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:49.206190 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.241931 22318 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.242839 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1758) took 1159 ms. Trace:
I20260709 13:19:49.243319 17322 rpcz_store.cc:276] 0709 13:19:48.083250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.083435 (+   185us) service_pool.cc:224] Handling call
0709 13:19:49.237421 (+1153986us) spinlock_profiling.cc:243] Waited 87.5 ms on lock 0x7b54001423d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:49.242783 (+  5362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201322368}
I20260709 13:19:49.214902 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3248) took 1118 ms. Trace:
I20260709 13:19:49.244678 17467 rpcz_store.cc:276] 0709 13:19:48.096077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.099694 (+  3617us) service_pool.cc:224] Handling call
0709 13:19:48.124098 (+ 24404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.124474 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.124507 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.125050 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.484324 (+359274us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:48.484389 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.484490 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.511372 (+ 26882us) raft_consensus.cc:1685] finished
0709 13:19:48.511392 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.214648 (+703256us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b54002e2f50. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:49.214844 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6485,"raft.queue_time_us":4751,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2942,"spinlock_wait_cycles":55395072,"thread_start_us":358864,"threads_started":1,"wal-append.queue_time_us":384401}
I20260709 13:19:49.228436 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3254) took 1034 ms. Trace:
I20260709 13:19:49.249090 17471 rpcz_store.cc:276] 0709 13:19:48.194336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.194460 (+   124us) service_pool.cc:224] Handling call
0709 13:19:48.224866 (+ 30406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.112282 (+887416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.228048 (+115766us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400200b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:49.228344 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036482944}
I20260709 13:19:49.250830 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 816) took 1393 ms. Trace:
I20260709 13:19:49.251197 17396 rpcz_store.cc:276] 0709 13:19:47.857149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.296788 (+439639us) service_pool.cc:224] Handling call
0709 13:19:48.297222 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.338741 (+ 41519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.338786 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:48.338842 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:48.338887 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.250605 (+911718us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b54003020d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:49.250660 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.250780 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89991424}
I20260709 13:19:49.252355 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:49.263500 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:49.222443 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:49.277328 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 54996.9us
I20260709 13:19:49.238531 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1762) took 1153 ms. Trace:
I20260709 13:19:49.201185 22583 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.267957 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2073) took 1277 ms. Trace:
I20260709 13:19:49.271315 17395 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:49.290351 17393 rpcz_store.cc:276] 0709 13:19:47.990212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.703599 (+713387us) service_pool.cc:224] Handling call
0709 13:19:48.704095 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.946608 (+242513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.267742 (+321134us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540023d2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:49.267906 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556092288}
I20260709 13:19:49.290987 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:49.291653 17321 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:49.279490 17317 rpcz_store.cc:276] 0709 13:19:48.084689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.085272 (+   583us) service_pool.cc:224] Handling call
0709 13:19:48.085665 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.072372 (+986707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.238286 (+165914us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b540036a454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:49.238472 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241212672}
I20260709 13:19:49.293407 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:49.295217 17322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:49.295717 17322 raft_consensus.cc:606] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:49.289673 22438 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:49.297060 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:49.220992 17397 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:49.300997 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:49.301759 17319 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:19:49.302860 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:49.304383 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:49.307938 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:49.309653 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:49.305985 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:49.312458 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:49.314347 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:49.314347 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50924.3us
I20260709 13:19:49.315120 17318 raft_consensus.cc:2376] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11. Re-sending same reply.
I20260709 13:19:49.315366 17434 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:49.315557 17393 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:49.317227 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.317890 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:49.318460 17321 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.319516 17397 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:49.319921 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:49.315919 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:49.322036 17434 leader_election.cc:400] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14.
I20260709 13:19:49.303864 22560 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.334473 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.322631 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:49.328006 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:49.336210 17393 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:49.296872 22438 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:49.345136 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:49.345788 17395 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:49.346685 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:49.347817 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:49.304198 22479 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.310388 22432 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:49.321491 21857 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.360045 17321 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:49.361680 17321 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:49.332508 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:49.340211 22285 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:49.362599 17315 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:49.362870 22437 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:49.363278 22437 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:49.363759 17315 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:49.364182 22437 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.299042 22558 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:49.300187 22414 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:49.365656 22414 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:49.366111 22414 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.366194 22425 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.366892 17318 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:49.366765 22425 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.321219 22232 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:49.333776 22402 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:49.362883 17321 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:49.321408 22540 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:19:49.351814 22582 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:49.350303 22274 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.348922 22598 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:49.371343 22558 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:49.386847 22582 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.354773 22479 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.368938 21857 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.391597 22058 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.379550 22232 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.394682 22583 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:49.400758 22598 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.436249 22232 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:49.409286 22582 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:49.442759 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.391358 22438 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.424456 22414 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.444819 22438 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.445726 17396 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:49.447242 22414 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:49.447846 22582 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.449894 22582 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:49.455430 22513 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:49.458117 21857 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:49.460003 22479 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:49.463243 22572 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.689s	user 0.000s	sys 0.002s
I20260709 13:19:49.467850 22558 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.371057 22432 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.472734 17999 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:49.473371 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1767) took 1385 ms. Trace:
I20260709 13:19:49.473769 17314 rpcz_store.cc:276] 0709 13:19:48.088200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.099723 (+ 11523us) service_pool.cc:224] Handling call
0709 13:19:49.473199 (+1373476us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b54000ca3d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:49.473316 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89160448}
W20260709 13:19:49.476418 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 131405us
I20260709 13:19:49.477259 17995 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:19:49.479877 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 161387us
I20260709 13:19:49.480582 17360 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:49.481199 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:49.483873 17992 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.482885 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:49.484730 17993 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.486706 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:49.487306 17991 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.487759 22120 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.488272 22120 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.488721 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.495687 17998 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:49.489573 17999 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:49.490072 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.497188 17990 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:49.490520 22218 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.490743 22564 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:49.494840 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.492686 17992 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:49.501088 17993 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
W20260709 13:19:49.513305 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.510667 22501 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:49.514660 22479 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:49.515793 22479 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:49.516142 22120 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:49.516306 22479 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:49.517377 22479 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.518849 22479 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.520978 22218 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.523788 22218 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:49.511049 17996 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:49.525812 17389 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:49.526312 17389 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:49.527242 17389 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.527784 17394 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:49.528115 17389 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.534152 17992 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:49.534371 22350 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:49.536104 22598 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:49.538667 17434 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.540077 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:49.541342 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1763) took 1455 ms. Trace:
I20260709 13:19:49.541358 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:49.541889 17316 rpcz_store.cc:276] 0709 13:19:48.086426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.086974 (+   548us) service_pool.cc:224] Handling call
0709 13:19:48.098435 (+ 11461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.439831 (+341396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.541132 (+1101301us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400368b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:49.541281 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769788800}
I20260709 13:19:49.504137 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:49.545248 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:49.545799 17992 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.546979 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.548216 17389 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:19:49.548666 17389 pending_rounds.cc:85] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 7
I20260709 13:19:49.548919 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:49.549124 17322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:49.549515 17314 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:49.549870 17322 raft_consensus.cc:606] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:49.550850 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:49.548933 17389 pending_rounds.cc:107] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:19:49.555050 17389 raft_consensus.cc:2889] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:49.558686 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.568046 17999 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:19:49.475485 22610 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:49.569795 17996 pending_rounds.cc:85] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 7
I20260709 13:19:49.592778 17996 pending_rounds.cc:107] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:19:49.593086 17996 raft_consensus.cc:2889] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:49.593928 22330 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:49.594172 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:49.577628 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.595330 17994 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:49.595510 17390 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:49.579012 17317 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:19:49.580534 22560 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:49.581259 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:49.599745 17998 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:49.581496 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.591629 17992 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:49.599713 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:49.581933 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:49.582602 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:49.582940 17467 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:49.584713 22501 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:49.569226 22612 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:49.585179 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.605546 17990 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:49.585865 22425 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:49.586805 22303 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:49.604902 22501 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:49.611209 22501 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:49.611778 22535 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:49.600068 22311 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:19:49.612188 22535 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:49.599459 22543 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:19:49.613240 22535 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.614856 22535 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:49.590651 17285 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.589154 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.589213 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:49.621423 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.579654 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:49.597110 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.593192 22120 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:19:49.597811 22387 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:49.596421 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:49.605449 22560 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.600521 17997 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:49.600003 17463 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:49.605966 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.609150 22612 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:49.615098 22432 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:49.634037 22403 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:49.635172 17997 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:19:49.589047 17392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3211) took 3745 ms (client timeout 2123 ms). Trace:
I20260709 13:19:49.623955 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.592921 22258 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:49.619371 22504 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:49.631297 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:49.631327 17991 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:49.591233 22218 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:19:49.599366 21964 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:19:49.635921 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:49.635926 17392 rpcz_store.cc:269] 0709 13:19:45.843521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.843663 (+   142us) service_pool.cc:224] Handling call
0709 13:19:49.580811 (+3737148us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b540023c3d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:49.588977 (+  8166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4191099264}
I20260709 13:19:49.638233 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:49.658756 17393 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:49.599862 22330 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:19:49.664157 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.628459 22365 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:49.629914 22425 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.606679 22513 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:19:49.671643 17991 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:49.628312 22387 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:49.632220 22560 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.723292 17467 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:49.688792 17463 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:19:49.725476 17463 pending_rounds.cc:85] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 8
I20260709 13:19:49.725786 17463 pending_rounds.cc:107] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:19:49.726086 17463 raft_consensus.cc:2889] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:49.690321 17468 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:49.699499 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:49.728130 17466 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:49.694916 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:49.636415 22556 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:49.731572 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:49.732605 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 346457us
I20260709 13:19:49.733474 17471 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:49.662149 22504 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:49.729789 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:49.669553 22564 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:49.708597 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.632516 22350 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:19:49.634128 22554 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:19:49.674546 22258 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:49.696081 22582 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:49.696754 22559 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:49.696401 22598 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:49.751829 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:49.762173 17463 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:49.741206 22610 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:19:49.703580 21857 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.743423 22504 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.766899 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:49.731977 22562 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:19:49.749176 22425 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:49.775772 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.750010 22580 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:49.703251 22232 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:19:49.750409 22402 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:49.785043 17471 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:49.785997 17994 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:49.778689 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:49.795387 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.848273 17991 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:49.758906 22574 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:19:49.807758 22568 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.137s
I20260709 13:19:49.808480 22611 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:49.758903 22387 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.787042 22580 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.809314 22258 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.873723 22580 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:49.777707 22559 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:49.875631 22559 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.778172 22425 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.877494 22425 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.812996 22274 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.814177 22615 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.814414 22365 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:49.881390 22615 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:49.816993 22521 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:19:49.822162 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3228) took 3652 ms. Trace:
I20260709 13:19:49.882570 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.882645 17390 rpcz_store.cc:276] 0709 13:19:46.169561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.182884 (+ 13323us) service_pool.cc:224] Handling call
0709 13:19:49.589742 (+3406858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.595842 (+  6100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.821908 (+226066us) spinlock_profiling.cc:243] Waited 3.41 s on lock 0x7b540023c3d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:49.822093 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7834266368}
I20260709 13:19:49.749516 22564 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.883626 22615 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:49.830436 22501 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.886430 22501 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:49.832335 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 199320us
I20260709 13:19:49.887228 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:49.887669 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:49.888585 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.777252 22612 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.892653 22218 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:49.893167 22218 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.893565 22218 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:49.895642 17313 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:19:49.897055 22025 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:49.898277 22536 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:49.789611 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:49.839422 17470 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:49.843799 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:49.900568 17469 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:49.756311 22582 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:49.849975 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:49.862907 17997 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:49.777392 21857 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.871536 22568 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:49.881796 17466 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.815865 22402 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:49.906917 17463 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:49.862841 22513 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:49.864540 22438 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:49.866281 22611 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:49.943872 17468 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:49.903867 22437 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.954864 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:49.955992 17997 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:49.904755 22582 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.905296 22568 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:49.903018 22614 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:49.941318 22387 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.906589 22560 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:50.033918 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:50.041558 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:49.946154 22438 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:49.944326 22513 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:50.049057 17465 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:50.057125 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:50.043437 22598 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:50.061429 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:50.061765 22414 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:50.065598 22515 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:50.066044 22515 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.066395 22515 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.000185 22614 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:50.071863 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:50.083858 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:50.093407 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:50.007937 17466 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:50.062354 21857 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:50.123472 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 410050us
W20260709 13:19:50.197664 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 502768us
I20260709 13:19:50.095781 22414 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:50.114624 22412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.014s	sys 0.019s
I20260709 13:19:50.045367 22611 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:50.123483 22303 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.121344 22311 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:50.096999 22608 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:50.203644 22414 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.090971 22501 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:50.280580 17436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.018s	sys 0.014s
W20260709 13:19:50.296406 17436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.018s	sys 0.014s
W20260709 13:19:50.274159 22412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.017s	sys 0.022s
I20260709 13:19:50.069797 22521 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.210s
W20260709 13:19:50.295902 17996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.008s	sys 0.003s
W20260709 13:19:50.305651 17996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.008s	sys 0.003s
I20260709 13:19:50.120980 22330 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.165s
I20260709 13:19:50.299758 22414 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.294842 22058 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:50.060465 22568 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:50.345817 17320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.010s	sys 0.017s
W20260709 13:19:50.346349 17320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.011s	sys 0.018s
W20260709 13:19:50.322000 17315 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.004s	sys 0.011s
W20260709 13:19:50.348024 17315 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.004s	sys 0.011s
W20260709 13:19:50.318136 22558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.008s	sys 0.003s
W20260709 13:19:50.348912 22558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.008s	sys 0.003s
I20260709 13:19:50.293830 22303 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:50.298849 22502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.011s	sys 0.016s
W20260709 13:19:50.346642 17319 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.004s	sys 0.024s
W20260709 13:19:50.386366 17319 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.004s	sys 0.024s
I20260709 13:19:50.309480 22611 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.315634 22608 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:50.303720 22501 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:50.399865 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.325110 22058 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:50.493430 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.006s	sys 0.006s
W20260709 13:19:50.493813 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.006s	sys 0.006s
W20260709 13:19:50.385933 22502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.011s	sys 0.016s
I20260709 13:19:50.349844 22232 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.612293 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 762354us
W20260709 13:19:50.390487 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.000s	sys 0.014s
W20260709 13:19:50.618569 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.000s	sys 0.016s
W20260709 13:19:50.618945 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 870350us
I20260709 13:19:50.620586 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:50.383579 22615 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.352262 21857 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.385241 22258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.006s
I20260709 13:19:50.389462 22580 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.483175 22535 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.856s	user 0.007s	sys 0.005s
W20260709 13:19:50.622857 22366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.017s	sys 0.042s
I20260709 13:19:50.488488 22568 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:50.497388 22560 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:50.695227 17318 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.003s	sys 0.017s
W20260709 13:19:50.695643 17318 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.003s	sys 0.017s
W20260709 13:19:50.564199 22403 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.002s	sys 0.011s
W20260709 13:19:50.630761 22618 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.586s	user 0.004s	sys 0.006s
I20260709 13:19:50.664345 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:50.493172 22536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.014s
W20260709 13:19:50.649866 22504 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.870s	user 0.016s	sys 0.004s
I20260709 13:19:50.717751 22504 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:50.670768 22258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.009s	sys 0.006s
I20260709 13:19:50.637552 22274 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:50.721350 22274 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.721836 22274 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.720604 22504 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:50.674674 22556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.013s	sys 0.048s
W20260709 13:19:50.682798 22366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.017s	sys 0.043s
W20260709 13:19:50.733816 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 75892.9us
I20260709 13:19:50.738811 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:50.709869 22025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.004s	sys 0.013s
W20260709 13:19:50.702651 22403 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.002s	sys 0.011s
I20260709 13:19:50.564028 22608 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:50.731969 22536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.000s	sys 0.015s
I20260709 13:19:50.690078 22521 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:50.631356 22232 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:50.759266 22616 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:50.735976 22556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.014s	sys 0.049s
I20260709 13:19:50.700702 22438 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:50.694902 21857 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:50.691218 22553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.003s	sys 0.012s
W20260709 13:19:50.787729 22625 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:50.690256 22580 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:50.677202 22615 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:50.798997 17362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.058s	sys 0.086s
W20260709 13:19:50.856005 17362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.071s	sys 0.108s
W20260709 13:19:50.782228 17962 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.015s	sys 0.042s
W20260709 13:19:50.856544 17962 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.015s	sys 0.042s
W20260709 13:19:50.818879 17434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.010s	sys 0.008s
W20260709 13:19:50.856986 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 786235us
W20260709 13:19:50.857260 17434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.012s	sys 0.008s
W20260709 13:19:50.770725 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.818763 17998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.013s
W20260709 13:19:50.859541 17998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.001s	sys 0.014s
I20260709 13:19:50.766582 22614 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:50.818470 21868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.000s	sys 0.018s
W20260709 13:19:50.863847 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.865468 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.850701 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 111983us
W20260709 13:19:50.865902 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.839972 22621 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
I20260709 13:19:50.783107 22650 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.848575 22553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.004s	sys 0.013s
I20260709 13:19:50.798025 22536 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:50.780071 22504 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:50.842967 22556 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:50.845302 22025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.006s	sys 0.013s
I20260709 13:19:50.847231 22628 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:50.894538 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:50.892648 22645 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.856145 22258 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:50.923758 22608 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:50.923758 22615 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:50.919407 22504 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:50.947100 22504 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:50.948583 21857 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:50.949438 22629 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:50.950555 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1000) took 1255 ms. Trace:
I20260709 13:19:50.950947 17999 rpcz_store.cc:276] 0709 13:19:49.695425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.701766 (+  6341us) service_pool.cc:224] Handling call
0709 13:19:49.738094 (+ 36328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.738382 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.738418 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.739107 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.138329 (+399222us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:50.138380 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.138476 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.950335 (+811859us) raft_consensus.cc:1685] finished
0709 13:19:50.950353 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.950491 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":398785,"threads_started":1,"wal-append.queue_time_us":1045808}
I20260709 13:19:50.952520 22232 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:50.902489 22616 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:19:50.900480 22536 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:50.957273 22620 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:19:50.957442 22536 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:50.958698 22536 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:50.960805 22556 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:50.901937 17997 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.017s	sys 0.022s
W20260709 13:19:50.962175 17997 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.017s	sys 0.022s
W20260709 13:19:50.962455 22634 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:19:50.865314 21868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.000s	sys 0.020s
I20260709 13:19:50.797823 22521 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:50.889814 22438 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.965741 22438 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:50.898211 17287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.008s	sys 0.009s
W20260709 13:19:50.961534 22636 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:19:50.942215 22350 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.968384 17287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.008s	sys 0.009s
I20260709 13:19:50.967908 22350 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:50.973163 22619 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 13:19:50.973986 22421 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:50.974411 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3281) took 1499 ms. Trace:
I20260709 13:19:50.974498 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:50.974859 17391 rpcz_store.cc:276] 0709 13:19:49.474844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.474994 (+   150us) service_pool.cc:224] Handling call
0709 13:19:49.475280 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.475584 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.475611 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.479410 (+  3799us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.902297 (+422887us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:49.902336 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.902397 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.974201 (+1071804us) raft_consensus.cc:1685] finished
0709 13:19:50.974223 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.974353 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2715,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7180,"thread_start_us":422506,"threads_started":1,"wal-append.queue_time_us":835677}
I20260709 13:19:50.975908 22543 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:50.976441 22543 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:50.977972 22501 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:50.978677 22648 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:50.979233 22648 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:50.980728 22627 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.982120 22627 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:50.983397 22644 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:50.974572 22421 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:50.984786 22641 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:50.985411 22641 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:50.927884 22622 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
I20260709 13:19:50.740664 22058 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.015494 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.015611 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:50.927579 22649 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:50.918545 22025 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:51.033254 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.006888 21868 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:51.038029 17288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.004s	sys 0.012s
W20260709 13:19:51.049626 17288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.004s	sys 0.012s
I20260709 13:19:51.060292 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3269) took 1331 ms. Trace:
I20260709 13:19:51.081310 17468 rpcz_store.cc:276] 0709 13:19:49.729240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.729476 (+   236us) service_pool.cc:224] Handling call
0709 13:19:51.060076 (+1330600us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400281754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:51.060203 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478910336}
I20260709 13:19:51.082652 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:51.089514 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:51.099241 22632 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.099887 22632 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.102175 22632 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:51.115935 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.116858 22632 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.117488 22632 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.119565 22424 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.119953 22632 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:51.126633 22303 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.120151 22424 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.138797 22424 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.142407 22598 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.143189 22598 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.099279 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.145619 17468 raft_consensus.cc:2410] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:19:51.039537 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:51.154903 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.156215 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.161670 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:51.063647 22624 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.416s	user 0.000s	sys 0.000s
I20260709 13:19:51.163491 22564 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.080363 17462 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:51.164278 22564 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:50.928196 22628 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.165118 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.165755 17462 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:51.080828 17470 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13. Ops: [11.7-12.8]
I20260709 13:19:51.166589 22628 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.167191 22628 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.167521 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.167670 22628 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.168198 17470 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:51.166610 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.169826 17462 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:51.170636 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.171453 17462 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:19:51.172482 17462 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:51.169827 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.174166 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.175365 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.176441 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.180771 22513 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.181619 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.182919 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.184266 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.175904 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:51.152113 22366 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:51.185472 22366 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:51.187438 22623 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.348s	user 0.001s	sys 0.001s
I20260709 13:19:51.187898 22366 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.189265 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:51.189429 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45632 (request call id 46) took 1640 ms. Trace:
I20260709 13:19:51.189881 17994 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.189832 17322 rpcz_store.cc:276] 0709 13:19:49.548857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.548975 (+   118us) service_pool.cc:224] Handling call
0709 13:19:49.829959 (+280984us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b540019c920. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d62771520 00007f7d627ee652 00007f7d677bc60a 00007f7d60d427d4 00007f7d60d42762 00007f7d60d42691 00007f7d60d4260c 00007f7d60d418c2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:51.189214 (+1359255us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b4c000fef40. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d60ac0a20 00007f7d60ad1a29 00007f7d60a97644 00007f7d60abef2d 00007f7d60abeb93 00007f7d627eec92 00007f7d627ee84a 00007f7d677bc60a 00007f7d60d427d4 00007f7d60d42762 00007f7d60d42691
0709 13:19:51.189339 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109310080}
I20260709 13:19:51.191303 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:51.191843 17322 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.164784 22564 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.195832 22628 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.197598 22539 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:51.198196 22539 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.200500 22539 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:51.209988 22539 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:51.210562 22539 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.213339 22539 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.183007 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.162883 17463 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
W20260709 13:19:51.202106 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.203928 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 874) took 1504 ms. Trace:
I20260709 13:19:51.147296 22598 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:51.206910 22583 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.229683 17465 rpcz_store.cc:276] 0709 13:19:49.699396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.699509 (+   113us) service_pool.cc:224] Handling call
0709 13:19:51.203725 (+1504216us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54001c02d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:51.203868 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721037184}
I20260709 13:19:51.230463 22583 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.230911 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:51.232065 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:51.206314 22365 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.208958 22535 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.179916 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:51.219859 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.232774 22583 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:51.201655 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.235442 17315 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:19:51.224711 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3278) took 1932 ms. Trace:
I20260709 13:19:51.226487 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:51.236420 17388 rpcz_store.cc:276] 0709 13:19:49.292827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.294900 (+  2073us) service_pool.cc:224] Handling call
0709 13:19:49.313531 (+ 18631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.471820 (+158289us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:49.472558 (+   738us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.773147 (+300589us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:49.773197 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:49.773238 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.224475 (+1451237us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400015754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:51.224523 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.224653 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10493,"prepare.queue_time_us":255,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":3459,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3978,"spinlock_wait_cycles":363244416,"thread_start_us":300228,"threads_started":1,"wal-append.queue_time_us":490092}
I20260709 13:19:51.238004 17462 raft_consensus.cc:2376] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15. Re-sending same reply.
I20260709 13:19:51.233192 22365 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.239125 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.239768 17462 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:19:51.240617 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.233422 22535 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.241729 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.242347 17462 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:51.243108 22535 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.208400 17469 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:51.244925 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.247356 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.240828 22365 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.248826 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.247427 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:51.249835 17469 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:51.250756 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.251418 17469 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:51.252463 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.253652 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.254546 17469 raft_consensus.cc:2410] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:51.255268 17465 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:51.257036 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 127428us
I20260709 13:19:51.271653 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.273360 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.028090 22543 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.283926 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.243135 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:51.284759 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.284988 17462 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:51.286213 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.287043 17471 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:19:51.038792 17320 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.003s	sys 0.011s
W20260709 13:19:51.038369 17996 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.002s	sys 0.010s
W20260709 13:19:51.288753 17996 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.002s	sys 0.010s
I20260709 13:19:51.289705 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 915) took 1756 ms. Trace:
I20260709 13:19:51.290093 17996 rpcz_store.cc:276] 0709 13:19:49.532949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.544203 (+ 11254us) service_pool.cc:224] Handling call
0709 13:19:49.569539 (+ 25336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.593914 (+ 24375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.593946 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.594350 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.305992 (+711642us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:51.289157 (+983165us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.289384 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.289459 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.289511 (+    52us) raft_consensus.cc:1685] finished
0709 13:19:51.289524 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.289647 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13321,"thread_start_us":1620417,"threads_started":2,"wal-append.queue_time_us":1211249}
W20260709 13:19:51.291754 17320 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.004s	sys 0.012s
I20260709 13:19:51.292331 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1790) took 1701 ms. Trace:
I20260709 13:19:51.281152 17322 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:51.281759 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3271) took 1528 ms. Trace:
I20260709 13:19:51.281945 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.293641 17466 rpcz_store.cc:276] 0709 13:19:49.753801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.753973 (+   172us) service_pool.cc:224] Handling call
0709 13:19:51.281532 (+1527559us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54003845d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:51.281682 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252296576}
I20260709 13:19:51.299362 17468 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:51.299964 17317 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:51.312988 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.322881 17994 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:51.327884 17317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:51.328794 17317 raft_consensus.cc:606] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:51.329277 17317 raft_consensus.cc:614] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:51.042622 22058 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:51.292649 17320 rpcz_store.cc:276] 0709 13:19:49.591346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.591487 (+   141us) service_pool.cc:224] Handling call
0709 13:19:49.591799 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.592027 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:49.617945 (+ 25918us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.292088 (+1674143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.292132 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:51.292161 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.292208 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.292290 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87359,"prepare.queue_time_us":35849,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":539317,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7132,"thread_start_us":1673736,"threads_started":2,"wal-append.queue_time_us":1398622}
I20260709 13:19:50.900892 22650 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.343884 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.353598 17471 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:19:51.339533 17993 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.010s	sys 0.026s
I20260709 13:19:51.350826 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.354343 17467 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:51.044237 22502 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.006469 22645 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.353401 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.364138 17320 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:51.356935 17993 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.011s	sys 0.027s
W20260709 13:19:51.346922 17318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.011s	sys 0.027s
W20260709 13:19:51.367205 17318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.012s	sys 0.027s
I20260709 13:19:51.372542 17468 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:19:51.339745 22632 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.379138 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.043644 21868 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.345537 22330 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:51.386430 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 95151.9us
I20260709 13:19:51.261749 17217 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 6 to 9, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 9 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.355535 22501 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.350713 22432 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.355703 22438 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.410184 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1792) took 1814 ms. Trace:
I20260709 13:19:51.032073 22649 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.360268 22311 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:51.360999 22513 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.370196 22580 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:51.389134 22653 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.421245 17467 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:19:51.445590 17467 pending_rounds.cc:85] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 7
W20260709 13:19:51.432582 17965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.005s	sys 0.028s
W20260709 13:19:51.407223 22634 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:51.355474 22303 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:51.429857 17318 rpcz_store.cc:276] 0709 13:19:49.595925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.596060 (+   135us) service_pool.cc:224] Handling call
0709 13:19:49.596342 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.596548 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:50.696059 (+1099511us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.409766 (+713707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.409828 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:51.409890 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.409991 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.410118 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61005,"prepare.queue_time_us":85000,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":21738,"raft.queue_time_us":49095,"thread_start_us":1744027,"threads_started":2}
I20260709 13:19:51.445863 17467 pending_rounds.cc:107] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:19:51.408685 22648 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:51.446233 17965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.006s	sys 0.028s
I20260709 13:19:51.446514 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:51.452459 17468 raft_consensus.cc:2376] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14. Re-sending same reply.
I20260709 13:19:51.423736 22512 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:51.449512 17467 raft_consensus.cc:2889] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:51.416775 22641 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.365932 22502 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.453445 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.418561 22350 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:51.456359 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:51.417145 22521 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.457855 22628 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.458936 22650 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:51.461421 22640 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:19:51.462399 22655 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:19:51.463986 22536 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.000s
I20260709 13:19:51.437759 22438 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.501403 22438 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.503957 22438 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.464665 22303 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.438355 22311 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.361301 22025 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:51.466120 22274 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.744s	user 0.005s	sys 0.007s
W20260709 13:19:51.466605 22387 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.434s	user 0.007s	sys 0.005s
W20260709 13:19:51.467032 22515 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.400s	user 0.006s	sys 0.006s
W20260709 13:19:51.467450 22437 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.506s	user 0.010s	sys 0.002s
I20260709 13:19:51.449772 22653 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.454926 22574 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:51.433980 22627 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:51.448092 22218 consensus_meta.cc:287] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.554s	user 0.009s	sys 0.005s
I20260709 13:19:51.406813 22365 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:19:51.442312 22535 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:51.507695 22311 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.455564 22598 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.493223 22502 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.493703 22649 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.494644 22645 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.495524 21868 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.496129 22564 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:51.443465 22513 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.497080 22658 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:19:51.419633 22330 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.431574 22501 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.435176 22432 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:51.498976 22582 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 1.499s	user 0.005s	sys 0.005s
I20260709 13:19:51.499454 22628 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.448633 22120 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:19:51.505416 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:51.450515 21894 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:19:51.468652 22425 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.591s	user 0.012s	sys 0.002s
I20260709 13:19:51.506523 22303 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:51.504828 22611 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.113s	user 0.007s	sys 0.000s
I20260709 13:19:51.522609 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.409582 22632 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:51.524744 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.677752 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.505005 22350 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:51.513346 22650 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.522655 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.548803 22553 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
W20260709 13:19:51.491899 22638 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:19:51.692026 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:51.481923 22648 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:19:51.536254 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 80312us
I20260709 13:19:51.536996 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:51.513481 22562 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:19:51.521240 22504 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:51.563469 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.568830 17313 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:19:51.583961 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.585408 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.586768 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.725668 17396 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:51.517907 22274 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.729117 22274 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:51.588625 22402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.005s	sys 0.038s
I20260709 13:19:51.635244 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:51.684614 22662 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.639436 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.634797 17434 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:51.738281 17962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.014s	sys 0.001s
I20260709 13:19:51.741600 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.738238 17314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:51.742589 17314 raft_consensus.cc:606] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:51.744395 17287 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:51.524251 22574 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.742311 17393 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
W20260709 13:19:51.675844 17321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.000s	sys 0.019s
I20260709 13:19:51.529196 22535 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.531091 22218 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.686573 17467 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:51.517580 22608 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.688158 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.559391 22598 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.587952 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:51.519061 22515 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.756625 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:51.690286 22507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.299s	user 0.011s	sys 0.013s
W20260709 13:19:51.757238 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 122620us
W20260709 13:19:51.739898 22402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.006s	sys 0.039s
I20260709 13:19:51.733122 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.600031 22582 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:51.635031 17997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.026s	sys 0.077s
W20260709 13:19:51.763787 17997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.036s	sys 0.086s
W20260709 13:19:51.647676 17998 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.006s	sys 0.014s
W20260709 13:19:51.738221 22540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.015s
I20260709 13:19:51.748497 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:51.749069 17321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.000s	sys 0.019s
I20260709 13:19:51.749864 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.675248 22425 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.767643 17393 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:51.768750 17320 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:19:51.760622 22598 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:51.761051 22507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.372s	user 0.011s	sys 0.014s
I20260709 13:19:51.690230 22350 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:51.741214 22612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.000s	sys 0.016s
I20260709 13:19:51.757946 22658 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:51.766736 22540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.001s	sys 0.015s
I20260709 13:19:51.747581 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:51.764462 17998 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.007s	sys 0.014s
I20260709 13:19:51.757447 17391 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:51.767347 17465 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:51.760495 22501 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.771473 17390 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:51.761335 22661 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:19:51.773994 17392 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:19:51.806422 17392 pending_rounds.cc:85] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 7
I20260709 13:19:51.806747 17392 pending_rounds.cc:107] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:19:51.807073 17392 raft_consensus.cc:2889] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:51.775628 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.807667 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.776602 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.808435 17391 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:19:51.808691 17389 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:51.774665 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.809791 17394 raft_consensus.cc:2410] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:19:51.805599 22558 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.810690 22558 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.772130 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.812692 22558 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:51.783422 17999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.007s	sys 0.015s
W20260709 13:19:51.815594 17999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.008s	sys 0.015s
I20260709 13:19:51.817373 17392 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:19:51.783728 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.002s	sys 0.020s
W20260709 13:19:51.821883 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.002s	sys 0.020s
W20260709 13:19:51.784056 17992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.005s	sys 0.017s
W20260709 13:19:51.824823 17992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.005s	sys 0.017s
W20260709 13:19:51.741847 17962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.014s	sys 0.001s
I20260709 13:19:51.786918 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.787809 17317 raft_consensus.cc:2368] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16.
I20260709 13:19:51.695210 22650 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.828368 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.829654 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.829988 22650 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.732487 17995 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:51.831027 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.831607 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:51.832084 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.832386 17995 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:51.833657 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:51.834952 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:51.835573 17995 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:51.836350 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.837419 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.837909 17466 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:19:51.838625 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.839512 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:51.756338 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 418675us
I20260709 13:19:51.841456 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:51.792936 17464 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:51.842006 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.797400 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:51.842830 17467 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:51.843027 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.843765 17392 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:51.737879 22504 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.844424 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.765556 22365 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:51.845070 22365 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.845129 22598 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.845701 22365 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.845991 22598 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.849506 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:51.850339 22649 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.850526 22598 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.851048 22649 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.851563 22598 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.852267 22598 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.854175 22649 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.855296 22650 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:51.855868 22650 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.858530 22650 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:51.782801 22559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.655s	user 0.019s	sys 0.005s
I20260709 13:19:51.804360 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 931) took 1749 ms. Trace:
I20260709 13:19:51.805581 17990 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:19:51.861775 17962 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:51.861181 17998 rpcz_store.cc:276] 0709 13:19:50.055080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.058570 (+  3490us) service_pool.cc:224] Handling call
0709 13:19:50.058962 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.059352 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.059391 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.091039 (+ 31648us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.865474 (+774435us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:51.796592 (+931118us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.803986 (+  7394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.804085 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.804137 (+    52us) raft_consensus.cc:1685] finished
0709 13:19:51.804148 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.804294 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6330,"prepare.queue_time_us":630298,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":234499,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3587,"thread_start_us":1503668,"threads_started":2,"wal-append.queue_time_us":904664}
I20260709 13:19:51.863675 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:51.865043 22650 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.865872 22650 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.869045 22650 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.850323 17995 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
W20260709 13:19:51.792577 22612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.000s	sys 0.016s
I20260709 13:19:51.768352 21964 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:51.911209 22218 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:51.912657 22665 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:19:51.915145 22432 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.916287 22598 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.917053 22598 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:51.921309 22507 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:51.921636 22535 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.922037 22507 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.924345 22515 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.924706 22507 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.926329 22507 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.926591 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1795) took 2308 ms. Trace:
I20260709 13:19:51.926918 22507 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:51.927052 17319 rpcz_store.cc:276] 0709 13:19:49.617926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.618095 (+   169us) service_pool.cc:224] Handling call
0709 13:19:49.618479 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:49.619447 (+   968us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:50.387025 (+767578us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.903219 (+516194us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:50.919572 (+ 16353us) log.cc:844] Serialized 52 byte log entry
0709 13:19:50.919727 (+   155us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:50.919763 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.919835 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.926349 (+1006514us) raft_consensus.cc:1685] finished
0709 13:19:51.926372 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.926519 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33283,"prepare.queue_time_us":169664,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":49206,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":2892,"thread_start_us":940976,"threads_started":2,"wal-append.queue_time_us":967551}
I20260709 13:19:51.929694 22507 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.930085 22582 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.931010 22513 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.777422 22512 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:51.931723 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.931871 22512 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.932354 17394 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:19:51.933715 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.933777 17217 catalog_manager.cc:5697] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:51.865374 22559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.742s	user 0.020s	sys 0.005s
W20260709 13:19:51.770112 22616 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.005s	sys 0.013s
I20260709 13:19:51.757825 22608 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:51.761969 22536 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:51.875856 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.876107 22632 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.876407 22521 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:51.877547 17316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:19:51.877538 22658 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:51.878926 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1796) took 2258 ms. Trace:
I20260709 13:19:51.966219 17321 rpcz_store.cc:276] 0709 13:19:49.620712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.620865 (+   153us) service_pool.cc:224] Handling call
0709 13:19:49.623404 (+  2539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.623779 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.623805 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.624252 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.051513 (+1427261us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b1800411220. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:19:51.767110 (+715597us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:51.767165 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.767259 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.878532 (+111273us) raft_consensus.cc:1685] finished
0709 13:19:51.878563 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.878829 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":694,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3892,"spinlock_wait_cycles":3308800,"thread_start_us":715389,"threads_started":1,"wal-append.queue_time_us":2159733}
I20260709 13:19:51.880532 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:51.968631 17397 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 10: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:19:51.896828 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55480.2us
I20260709 13:19:51.897660 22501 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:51.900179 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1352) took 1701 ms. Trace:
I20260709 13:19:51.970148 17997 rpcz_store.cc:276] 0709 13:19:50.198822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.201603 (+  2781us) service_pool.cc:224] Handling call
0709 13:19:50.282682 (+ 81079us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:50.288798 (+  6116us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:50.962548 (+673750us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.764387 (+801839us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.766259 (+  1872us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:51.766777 (+   518us) log.cc:844] Serialized 52 byte log entry
0709 13:19:51.766914 (+   137us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:51.766946 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.767008 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.899871 (+132863us) raft_consensus.cc:1685] finished
0709 13:19:51.899903 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.900096 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14648,"prepare.queue_time_us":1143462,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":9357,"raft.queue_time_us":30849,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":36065,"spinlock_wait_cycles":23921408,"thread_start_us":1450907,"threads_started":2,"wal-append.queue_time_us":817103}
I20260709 13:19:51.969467 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:51.752350 22662 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:51.874186 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 74413.6us
W20260709 13:19:51.973694 17388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.009s	sys 0.021s
I20260709 13:19:51.870496 22650 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:51.951025 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:51.951781 22653 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:51.951993 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:51.949365 22616 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.005s	sys 0.014s
I20260709 13:19:51.953778 17394 raft_consensus.cc:2410] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:51.954674 22330 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:51.806435 22647 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.956795 17390 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:51.961910 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:51.793926 22553 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.154s
I20260709 13:19:51.872548 22543 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:51.965099 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:51.971297 22058 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.001s
I20260709 13:19:51.947039 22641 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:19:51.974664 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:51.987649 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.018987 17470 raft_consensus.cc:2410] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:19:52.024073 17462 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.008s	sys 0.011s
I20260709 13:19:51.983340 17466 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
W20260709 13:19:52.027007 17462 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.009s	sys 0.011s
I20260709 13:19:52.019218 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.027621 17390 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
W20260709 13:19:52.025290 17991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.016s	sys 0.032s
W20260709 13:19:52.019964 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 58124.7us
W20260709 13:19:51.974140 17388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.009s	sys 0.021s
W20260709 13:19:52.029886 17991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.016s	sys 0.032s
W20260709 13:19:52.033701 17993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.015s	sys 0.008s
W20260709 13:19:52.035853 17993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.015s	sys 0.008s
I20260709 13:19:51.997404 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:52.038357 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:52.094827 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 56572.8us
I20260709 13:19:52.095782 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:52.096637 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:52.104576 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.106766 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 141755us
I20260709 13:19:52.108063 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:52.023804 22556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.000s	sys 0.019s
I20260709 13:19:52.120931 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.240413 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:52.243795 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:52.123960 17469 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.026s	sys 0.045s
W20260709 13:19:52.245168 17469 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.033s	sys 0.056s
I20260709 13:19:51.999734 22608 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:52.263350 17468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.031s	sys 0.060s
W20260709 13:19:52.264045 17468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.031s	sys 0.060s
I20260709 13:19:52.268430 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.270074 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.123383 22412 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:52.123303 22583 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:52.017602 22543 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:52.301283 17395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.020s	sys 0.024s
I20260709 13:19:52.301857 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:52.304430 17395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.020s	sys 0.024s
I20260709 13:19:52.016563 22669 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.263s
I20260709 13:19:52.310873 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:52.312443 17390 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:51.982792 22632 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:51.983947 22515 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:51.985983 22521 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:52.031273 22628 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:52.297611 22583 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.294224 22574 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:52.345744 17389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.038s
W20260709 13:19:52.347715 17434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.002s	sys 0.010s
W20260709 13:19:52.126754 22556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.000s	sys 0.020s
I20260709 13:19:52.094129 22627 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:52.349610 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 375002us
I20260709 13:19:52.123940 22651 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.268s
I20260709 13:19:52.354868 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:52.355407 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.365181 17389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.008s	sys 0.039s
I20260709 13:19:52.366209 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:52.367129 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:52.365149 17434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.002s	sys 0.010s
I20260709 13:19:52.118633 22558 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:52.337867 22425 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:52.246953 22658 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:52.440431 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 576838us
I20260709 13:19:52.467271 17466 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:52.456051 17463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.066s	sys 0.029s
W20260709 13:19:52.468312 17463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.067s	sys 0.030s
I20260709 13:19:52.479772 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3282) took 1107 ms. Trace:
W20260709 13:19:52.421782 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44803.7us
I20260709 13:19:52.482059 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:52.009690 22647 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:52.486773 17463 rpcz_store.cc:276] 0709 13:19:51.372600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.373649 (+  1049us) service_pool.cc:224] Handling call
0709 13:19:51.373995 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.374241 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:51.783126 (+408885us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.479433 (+696307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.479485 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:52.479526 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.479601 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.479719 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":981182,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":856,"thread_start_us":1061227,"threads_started":2}
W20260709 13:19:52.466010 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 708064us
W20260709 13:19:52.476876 17396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.022s	sys 0.076s
W20260709 13:19:52.496106 17396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.022s	sys 0.076s
I20260709 13:19:52.367136 22437 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:52.427742 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:52.484030 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:52.506426 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 78779.3us
I20260709 13:19:52.507011 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:52.507234 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:52.495548 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:52.425191 22515 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:52.445636 22662 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:52.468463 17997 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:52.371944 22583 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.487752 17962 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:52.486392 22432 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:52.552120 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 64478.5us
W20260709 13:19:52.422498 22414 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 2.071s	user 0.011s	sys 0.003s
I20260709 13:19:52.538416 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.494707 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:52.544061 17998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.012s	sys 0.024s
I20260709 13:19:52.493909 22425 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:52.505492 22580 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.594748 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:52.596527 17998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.012s	sys 0.029s
I20260709 13:19:52.378050 22574 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:52.596786 17471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.012s	sys 0.006s
W20260709 13:19:52.574110 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.522984 22501 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:52.369053 22521 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:52.528631 22582 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:52.529582 22330 raft_consensus.cc:2764] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 13:19:52.552429 22678 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.405s	user 0.000s	sys 0.000s
I20260709 13:19:52.621210 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:52.593040 22616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.019s	sys 0.025s
W20260709 13:19:52.664799 17471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.013s	sys 0.006s
I20260709 13:19:52.683847 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3277) took 1312 ms. Trace:
I20260709 13:19:52.684604 17471 rpcz_store.cc:276] 0709 13:19:51.370918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.375827 (+  4909us) service_pool.cc:224] Handling call
0709 13:19:51.376195 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.376454 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:51.941067 (+564613us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.681424 (+740357us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.681504 (+    80us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:52.681568 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.681678 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.683716 (+  2038us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75491,"prepare.queue_time_us":1110772,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":35,"thread_start_us":1197144,"threads_started":2}
I20260709 13:19:52.659456 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1359) took 1048 ms. Trace:
I20260709 13:19:52.542299 22437 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:52.679368 17997 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.694533 17389 raft_consensus.cc:2410] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:19:52.695122 17998 rpcz_store.cc:276] 0709 13:19:51.610755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.868421 (+257666us) service_pool.cc:224] Handling call
0709 13:19:51.868733 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.659026 (+790293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.659060 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.659110 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:52.659151 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.659227 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.659395 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48844,"thread_start_us":789839,"threads_started":1}
I20260709 13:19:52.729658 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:52.700299 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:52.701690 17391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.007s	sys 0.044s
W20260709 13:19:52.705389 17467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.007s	sys 0.018s
I20260709 13:19:52.726078 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:52.741046 17391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.007s	sys 0.044s
I20260709 13:19:52.728622 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:52.741101 17467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.009s	sys 0.020s
I20260709 13:19:52.652938 22662 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:52.730657 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.731956 17466 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:52.732743 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:52.732543 17287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.008s	sys 0.012s
W20260709 13:19:52.752197 17287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.008s	sys 0.012s
W20260709 13:19:52.752521 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 723177us
W20260709 13:19:52.753839 17469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.010s	sys 0.061s
I20260709 13:19:52.681370 22432 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:19:52.754207 17469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.010s	sys 0.062s
I20260709 13:19:52.754037 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.755278 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.656085 22425 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:52.761320 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.743948 17998 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:52.697825 22437 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:52.652701 22414 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:52.733196 22025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.007s	sys 0.030s
I20260709 13:19:52.764345 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.803803 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.766887 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.671157 22580 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:52.771456 17285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.000s	sys 0.014s
W20260709 13:19:52.808218 17285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.000s	sys 0.016s
I20260709 13:19:52.808164 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:52.808660 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 705768us
I20260709 13:19:52.723896 22616 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.808811 17322 raft_consensus.cc:2376] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17. Re-sending same reply.
W20260709 13:19:52.782701 17465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.024s	sys 0.028s
W20260709 13:19:52.810186 17465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.024s	sys 0.028s
W20260709 13:19:52.782582 17462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.022s	sys 0.029s
I20260709 13:19:52.788705 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:52.810899 17462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.022s	sys 0.029s
I20260709 13:19:52.811672 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.812279 17390 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 7.
I20260709 13:19:52.813089 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.676599 22574 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:52.814800 17390 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:52.791778 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.794214 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.794597 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:52.749480 22562 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.011s	sys 0.023s
I20260709 13:19:52.752669 22628 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:52.782514 22512 consensus_meta.cc:287] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.850s	user 0.014s	sys 0.000s
I20260709 13:19:52.815583 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.817283 17313 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:19:52.774096 22437 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.821650 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.783209 22543 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:52.824673 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:52.811496 22025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.009s	sys 0.036s
W20260709 13:19:52.814160 22365 consensus_meta.cc:287] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.968s	user 0.013s	sys 0.001s
I20260709 13:19:52.829530 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:52.853181 22670 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:19:52.752744 22515 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:52.821547 22627 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:52.756119 22662 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:52.853410 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.854503 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:52.856477 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 339987us
I20260709 13:19:52.859483 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:52.857148 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:52.846989 17390 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:52.865777 17318 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:19:52.871263 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:52.864581 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 357656us
I20260709 13:19:52.886238 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:52.821365 22616 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:52.884758 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.890750 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:52.858217 22647 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:52.892167 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1004) took 1848 ms. Trace:
I20260709 13:19:52.892652 17999 rpcz_store.cc:276] 0709 13:19:51.043415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.043604 (+   189us) service_pool.cc:224] Handling call
0709 13:19:51.043952 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.044331 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.044367 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.044904 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.816007 (+771103us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:51.816058 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.820725 (+  4667us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.891915 (+1071190us) raft_consensus.cc:1685] finished
0709 13:19:52.891935 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.892097 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119783,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":770813,"threads_started":1,"wal-append.queue_time_us":1382893}
W20260709 13:19:52.879319 22683 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.217s	user 0.004s	sys 0.000s
I20260709 13:19:52.920197 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:52.920897 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:52.848531 22512 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:52.929891 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:52.930958 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:52.926602 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:52.933318 17390 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:52.876966 22414 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:52.919940 22686 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:19:52.947098 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:52.875159 22365 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:52.926111 22677 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:52.964303 22521 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:52.965476 22414 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:52.958889 22058 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:52.886286 22627 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:52.967281 22616 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:52.967751 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 932) took 2339 ms. Trace:
I20260709 13:19:53.021788 17993 rpcz_store.cc:276] 0709 13:19:50.628873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.629018 (+   145us) service_pool.cc:224] Handling call
0709 13:19:50.676023 (+ 47005us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.366168 (+690145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.366207 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.366704 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.036229 (+669525us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:52.036273 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.036342 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.967522 (+931180us) raft_consensus.cc:1685] finished
0709 13:19:52.967544 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.967692 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":207905,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":27131,"thread_start_us":1358965,"threads_started":2,"wal-append.queue_time_us":1170564}
W20260709 13:19:52.968168 22673 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:19:52.969167 22695 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:19:52.970000 22513 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:52.970057 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2087) took 1240 ms. Trace:
I20260709 13:19:53.027064 17396 rpcz_store.cc:276] 0709 13:19:51.730075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.737603 (+  7528us) service_pool.cc:224] Handling call
0709 13:19:51.737884 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.738084 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.738108 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.757692 (+ 19584us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.496553 (+738861us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:52.496614 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.496688 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.969854 (+473166us) raft_consensus.cc:1685] finished
0709 13:19:52.969876 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.970001 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":737940,"threads_started":1,"wal-append.queue_time_us":1036469}
I20260709 13:19:53.027832 22582 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:53.029212 17396 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:53.029101 22582 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:52.954326 22687 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:19:52.947229 22330 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.973601 22711 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:52.948385 22699 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:52.974086 21964 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:52.975811 22580 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:52.944955 22432 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:52.919435 22628 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:52.950240 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3280) took 1578 ms. Trace:
I20260709 13:19:52.981346 17997 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:52.982072 17320 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:52.952704 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:52.984934 17390 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:53.055998 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 942) took 1063 ms. Trace:
I20260709 13:19:53.056177 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3298) took 1121 ms. Trace:
I20260709 13:19:52.945077 22501 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.988878 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:53.056529 17997 rpcz_store.cc:276] 0709 13:19:51.992239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.538272 (+546033us) service_pool.cc:224] Handling call
0709 13:19:53.055915 (+517643us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:52.969194 22690 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:19:52.957015 22680 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:52.980091 22574 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:52.946621 22684 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:19:52.983870 22662 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.031865 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1947) took 1948 ms. Trace:
W20260709 13:19:53.068639 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 143246us
W20260709 13:19:53.032280 17286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.004s	sys 0.007s
W20260709 13:19:53.020234 22701 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.160s	user 0.001s	sys 0.001s
I20260709 13:19:53.029909 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3300) took 1094 ms. Trace:
I20260709 13:19:53.072125 17396 rpcz_store.cc:276] 0709 13:19:51.935297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.028624 (+1093327us) service_pool.cc:224] Handling call
0709 13:19:53.028915 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.029644 (+   729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.029858 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.033732 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3296) took 1125 ms. Trace:
I20260709 13:19:53.062237 22414 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:53.048044 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.009s
W20260709 13:19:53.077783 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.006s	sys 0.009s
W20260709 13:19:53.078522 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 571311us
I20260709 13:19:53.079454 17360 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:53.056413 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 103743us
I20260709 13:19:53.081426 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:53.056602 17390 rpcz_store.cc:276] 0709 13:19:51.934577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.957257 (+1022680us) service_pool.cc:224] Handling call
0709 13:19:52.982400 (+ 25143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.055930 (+ 73530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.056128 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.083923 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3302) took 1148 ms. Trace:
I20260709 13:19:53.053470 17462 rpcz_store.cc:276] 0709 13:19:51.371959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.374618 (+  2659us) service_pool.cc:224] Handling call
0709 13:19:51.374953 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.375169 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:52.032334 (+657165us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.949832 (+917498us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.949889 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:52.949933 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.950070 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.950188 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88710,"prepare.queue_time_us":988663,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":36,"raft.queue_time_us":162123,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":1501560,"threads_started":3,"wal-append.queue_time_us":784524}
I20260709 13:19:53.033401 22507 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.030310 22513 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:53.055250 22412 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.758s	user 0.011s	sys 0.000s
I20260709 13:19:53.052383 21964 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.070842 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:53.049695 22711 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:53.048689 22699 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:53.126267 22699 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:53.138118 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:53.139470 22693 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:19:53.140661 22676 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.874s	user 0.000s	sys 0.003s
I20260709 13:19:53.140756 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2100) took 1364 ms. Trace:
W20260709 13:19:53.141709 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 256272us
I20260709 13:19:53.068703 17469 rpcz_store.cc:276] 0709 13:19:51.083852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.255399 (+171547us) service_pool.cc:224] Handling call
0709 13:19:51.255777 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.255998 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:52.245513 (+989515us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.754788 (+509275us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.031396 (+276608us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.031464 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:53.031532 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.031615 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.031757 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9900,"prepare.queue_time_us":1042272,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":6333,"raft.queue_time_us":435248,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"spinlock_wait_cycles":8275840,"thread_start_us":1773282,"threads_started":3,"wal-append.queue_time_us":688499}
W20260709 13:19:53.070742 17286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.004s	sys 0.007s
I20260709 13:19:53.071559 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:19:52.989287 22654 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.003s
I20260709 13:19:53.073817 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3301) took 1138 ms. Trace:
I20260709 13:19:53.084389 17390 rpcz_store.cc:276] 0709 13:19:51.935748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.082910 (+1147162us) service_pool.cc:224] Handling call
0709 13:19:53.083279 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.083483 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.083535 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.083593 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:53.083637 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.083711 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.083854 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.066598 22680 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:53.109041 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 934) took 1652 ms. Trace:
I20260709 13:19:53.157501 17396 rpcz_store.cc:276] 0709 13:19:51.935515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.073011 (+1137496us) service_pool.cc:224] Handling call
0709 13:19:53.073297 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.073480 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.073510 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.073550 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:53.073589 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.073649 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.073759 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.109783 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 885) took 1739 ms. Trace:
I20260709 13:19:53.109548 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:53.165658 17317 rpcz_store.cc:276] 0709 13:19:51.370093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.378258 (+  8165us) service_pool.cc:224] Handling call
0709 13:19:53.109535 (+1731277us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54003e1cd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:53.109680 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880529792}
I20260709 13:19:53.074209 17465 rpcz_store.cc:276] 0709 13:19:51.908419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.928667 (+ 20248us) service_pool.cc:224] Handling call
0709 13:19:51.935776 (+  7109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.936431 (+   655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.936465 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.936962 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.810538 (+873576us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:52.810579 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.810639 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.033527 (+222888us) raft_consensus.cc:1685] finished
0709 13:19:53.033548 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.033678 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":993024,"thread_start_us":873172,"threads_started":1,"wal-append.queue_time_us":942416}
W20260709 13:19:53.166335 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 94849.4us
I20260709 13:19:53.116603 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3285) took 1739 ms. Trace:
I20260709 13:19:53.167064 17468 rpcz_store.cc:276] 0709 13:19:51.377529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.532240 (+154711us) service_pool.cc:224] Handling call
0709 13:19:51.532680 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.533119 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.533164 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.533728 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.264411 (+730683us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:52.264462 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.264528 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.116340 (+851812us) raft_consensus.cc:1685] finished
0709 13:19:53.116367 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.116532 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":12831,"thread_start_us":684277,"threads_started":1,"wal-append.queue_time_us":1130307}
I20260709 13:19:53.168659 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.169806 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.170105 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:53.170327 17468 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:53.171167 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.119004 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:53.112465 22432 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:53.120680 22513 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.157347 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3299) took 1196 ms. Trace:
I20260709 13:19:53.125788 22711 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:53.142738 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 1.03294e+06us
I20260709 13:19:53.142936 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.177086 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.178134 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.178848 17469 raft_consensus.cc:2410] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:19:53.179471 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.180358 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.141276 17395 rpcz_store.cc:276] 0709 13:19:51.775910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.776019 (+   109us) service_pool.cc:224] Handling call
0709 13:19:51.776306 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.776629 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.776663 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.777385 (+   722us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.305739 (+528354us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:52.305787 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.305861 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.140512 (+834651us) raft_consensus.cc:1685] finished
0709 13:19:53.140538 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.140697 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":379,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":527922,"threads_started":1,"wal-append.queue_time_us":1146387}
I20260709 13:19:53.147295 22699 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.148195 17316 raft_consensus.cc:606] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:53.140663 22656 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:53.181449 17469 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:53.181782 22656 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:53.182186 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.182760 17469 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:53.183517 22699 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.182629 22656 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.061082 22501 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.187739 22501 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.153265 22504 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:53.153528 22708 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:19:53.115433 22521 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:53.155349 22627 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.142098 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 937) took 1672 ms. Trace:
I20260709 13:19:53.066464 22628 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:53.163763 17994 rpcz_store.cc:276] 0709 13:19:51.457172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.470096 (+ 12924us) service_pool.cc:224] Handling call
0709 13:19:51.470477 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.470883 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:51.470919 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.471464 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.809558 (+338094us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:51.809612 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.809734 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.108796 (+1299062us) raft_consensus.cc:1685] finished
0709 13:19:53.108818 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.108970 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64405,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":337667,"threads_started":1,"wal-append.queue_time_us":1382341}
I20260709 13:19:53.190382 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.191167 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:53.189605 17996 rpcz_store.cc:276] 0709 13:19:51.469494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.800544 (+331050us) service_pool.cc:224] Handling call
0709 13:19:51.800916 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.874414 (+ 73498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.874459 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.874522 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:51.874566 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.141884 (+1267318us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b54001a8bd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:53.141929 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.142048 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168484736}
I20260709 13:19:53.191749 17994 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:53.124899 22412 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:53.150080 22658 raft_consensus.cc:993] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:19:53.189220 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 841) took 1852 ms. Trace:
I20260709 13:19:53.192415 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:53.173604 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3305) took 1237 ms. Trace:
I20260709 13:19:53.201730 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:53.201882 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:53.176669 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:53.174227 17471 rpcz_store.cc:276] 0709 13:19:51.960694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.727545 (+766851us) service_pool.cc:224] Handling call
0709 13:19:52.727814 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.728119 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.728146 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.728558 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.030567 (+302009us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:53.060421 (+ 29854us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.150785 (+ 90364us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b18004ead80. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:19:53.151008 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.151087 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.157085 (+  5998us) raft_consensus.cc:1685] finished
0709 13:19:53.157160 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.157293 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3369,"prepare.queue_time_us":30700,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":49,"raft.queue_time_us":332670,"spinlock_wait_cycles":38275712,"thread_start_us":210010,"threads_started":1,"wal-append.queue_time_us":315013}
W20260709 13:19:53.196622 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 87199.2us
I20260709 13:19:53.202198 17396 rpcz_store.cc:276] 0709 13:19:51.936625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.172558 (+1235933us) service_pool.cc:224] Handling call
0709 13:19:53.172977 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.173195 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.173232 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.173287 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:53.173333 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.173400 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.173531 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4992}
I20260709 13:19:53.203368 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.204051 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:53.204169 17471 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:53.201756 17388 rpcz_store.cc:276] 0709 13:19:51.336932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.337773 (+   841us) service_pool.cc:224] Handling call
0709 13:19:51.360140 (+ 22367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.029297 (+669157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.029330 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.116437 (+ 87107us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.803840 (+687403us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:52.803912 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.804031 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.188981 (+384950us) raft_consensus.cc:1685] finished
0709 13:19:53.189011 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.189166 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4352,"raft.queue_time_us":144060,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":102,"thread_start_us":1100301,"threads_started":2,"wal-append.queue_time_us":662373}
I20260709 13:19:53.205555 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.201826 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:53.206830 17993 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:19:53.195686 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.191340 17469 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:53.208412 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:53.200093 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:53.157282 22654 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.007s	sys 0.003s
I20260709 13:19:53.198263 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:53.210515 17468 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
W20260709 13:19:53.197280 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 78436.1us
I20260709 13:19:53.212566 17317 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:53.213258 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.213699 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:53.214318 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:53.172411 22583 consensus_meta.cc:287] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:19:53.216806 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:53.211658 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:53.220018 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:53.220763 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:53.222759 17315 raft_consensus.cc:2410] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:19:53.205596 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:53.224252 17318 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:53.224466 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:53.173256 22680 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.193899 22574 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:53.232138 17434 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:53.233415 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.202659 22501 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.235312 17471 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:53.236516 17465 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:53.242992 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.140713 21964 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.243580 17471 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:53.240589 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:53.237464 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:53.244421 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.239022 22512 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.212704 22521 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:53.245479 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:53.235258 17468 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:19:53.212459 22504 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:53.220491 22627 raft_consensus.cc:1081] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:19:53.234985 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:53.237471 22658 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:53.250613 17362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 2.631s (SENT) [suppressed 18 similar messages]
I20260709 13:19:53.223798 22706 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:53.230803 22608 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:53.236910 22716 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:19:53.254180 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:53.237932 22725 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:53.236928 22558 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.236722 22717 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.281353 22717 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.283771 22717 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:53.259747 22608 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.240352 22432 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:53.249222 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:53.234447 22712 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:53.246435 22556 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.238370 22574 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:53.251365 22424 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:53.226616 22583 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.278204 21964 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.251231 22366 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:53.191346 22628 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.251121 22365 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:53.296586 22421 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:53.297516 17394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3297) took 1364 ms (client timeout 1812 ms). Trace:
I20260709 13:19:53.297354 22437 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.298144 22718 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:19:53.259931 22706 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:53.311198 22574 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:53.269758 22725 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.271324 22512 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:53.309417 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 60301.1us
I20260709 13:19:53.315610 22366 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.343866 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:53.344997 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3304) took 1408 ms. Trace:
I20260709 13:19:53.345109 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:53.346321 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:53.347764 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:53.348536 22649 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:53.348965 22714 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:53.349050 22649 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.349542 22714 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.349740 22649 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.350045 22714 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:53.310595 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56515.2us
I20260709 13:19:53.312039 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1932) took 2264 ms. Trace:
I20260709 13:19:53.350906 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:53.350770 17464 rpcz_store.cc:276] 0709 13:19:51.040194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.077631 (+ 37437us) service_pool.cc:224] Handling call
0709 13:19:51.077952 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.842353 (+764401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.304430 (+1462077us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54002e2554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:53.304646 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643785600}
I20260709 13:19:53.312664 17465 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:19:53.313738 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 68367.1us
I20260709 13:19:53.313282 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3300) took 1352 ms. Trace:
I20260709 13:19:53.264853 22656 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:53.352674 22656 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:53.353169 22656 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.317018 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3297) took 1365 ms. Trace:
I20260709 13:19:53.318248 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1355) took 2223 ms. Trace:
I20260709 13:19:53.305538 22432 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.305334 22608 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:53.320789 17394 rpcz_store.cc:269] 0709 13:19:51.933364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.933469 (+   105us) service_pool.cc:224] Handling call
0709 13:19:53.297288 (+1363819us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5400253d54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:53.297455 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44219136}
I20260709 13:19:53.259267 22723 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.305934 22712 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:53.311404 22424 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.363336 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:53.363934 17464 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:53.289364 22558 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.313412 22616 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:53.340093 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 85718.9us
I20260709 13:19:53.372823 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:53.349752 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:53.356031 17990 rpcz_store.cc:276] 0709 13:19:51.095076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.226490 (+131414us) service_pool.cc:224] Handling call
0709 13:19:51.226798 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.861979 (+635181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.318004 (+1456025us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54006d1fd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:53.318191 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1330513152}
I20260709 13:19:53.374207 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:53.374753 17990 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:53.342990 22725 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.358119 17466 rpcz_store.cc:276] 0709 13:19:51.961353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.759799 (+798446us) service_pool.cc:224] Handling call
0709 13:19:52.760174 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.945707 (+185533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.945749 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.947072 (+  1323us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.255092 (+308020us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:53.255148 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.255237 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.313046 (+ 57809us) raft_consensus.cc:1685] finished
0709 13:19:53.313072 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.313223 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":212715,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"thread_start_us":442584,"threads_started":2,"wal-append.queue_time_us":307291}
I20260709 13:19:53.260674 22734 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:53.330922 22706 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.365978 17471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:19:53.390731 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:53.390872 17471 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:53.391415 17471 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.367235 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:53.345804 22366 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.374557 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:53.355927 17463 rpcz_store.cc:276] 0709 13:19:51.951866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.595951 (+644085us) service_pool.cc:224] Handling call
0709 13:19:52.596282 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.610110 (+ 13828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.610148 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.665180 (+ 55032us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.007894 (+342714us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:53.007956 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.008053 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.316797 (+308744us) raft_consensus.cc:1685] finished
0709 13:19:53.316815 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.316956 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91610,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":17095,"thread_start_us":269072,"threads_started":1,"wal-append.queue_time_us":379056}
I20260709 13:19:53.386335 22740 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:53.389698 22583 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:53.358213 22432 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.358482 22580 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:53.402264 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:53.364499 22424 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:53.411679 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 161047us
I20260709 13:19:53.412917 17990 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:53.417223 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:53.364691 22712 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.376317 22616 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:53.423753 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46546us
I20260709 13:19:53.327967 22521 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.392338 22723 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:53.426359 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46922.7us
I20260709 13:19:53.389990 22680 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:53.424405 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 51544.9us
W20260709 13:19:53.427157 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 63889.6us
I20260709 13:19:53.434405 17471 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.401458 22740 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.438375 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:53.403527 22699 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.403295 22580 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.377640 22645 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:19:53.445477 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:53.400709 21964 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:19:53.425858 22616 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:53.452715 17471 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:53.437104 22723 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:53.466439 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 64272.3us
I20260709 13:19:53.440873 22740 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:53.473409 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:53.447007 22580 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.448432 22421 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:53.483122 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58500.6us
I20260709 13:19:53.483280 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:53.486734 22734 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:53.494685 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:53.504155 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:53.438586 22739 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:19:53.474102 22723 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:53.451869 22649 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.475361 22699 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.475147 22651 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:19:53.489993 22746 raft_consensus.cc:2764] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:53.522421 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:53.486415 22330 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.474769 22747 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:53.501085 22750 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.509956 22760 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:53.542676 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:53.543704 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:53.555989 17395 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
I20260709 13:19:53.487579 22421 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.538317 22699 raft_consensus.cc:2764] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:19:53.578464 22649 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.533599 22710 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:53.581194 22710 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:53.581619 22710 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:53.582743 22737 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:19:53.584765 22421 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:53.585112 22741 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:19:53.585701 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:53.533435 22437 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.588678 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:53.589540 17990 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:53.591053 22753 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.593398 22736 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.593314 22760 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:53.594210 22736 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:53.594797 22650 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:53.594910 22736 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:53.595268 22650 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:53.595533 22736 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:53.562651 22747 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.596201 22650 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:53.602538 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 157194us
I20260709 13:19:53.603492 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:53.604645 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:53.605765 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:53.565320 22746 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:53.600656 22748 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:19:53.613546 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 850) took 1267 ms. Trace:
I20260709 13:19:53.618263 17389 rpcz_store.cc:276] 0709 13:19:52.346433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.508399 (+161966us) service_pool.cc:224] Handling call
0709 13:19:53.605905 (+1097506us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b54001397d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:53.613471 (+  7566us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222606208}
I20260709 13:19:53.587908 22414 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:53.611099 22690 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:53.626350 22366 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.630009 22706 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.631198 22656 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.632017 22424 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.612951 22558 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.596453 22736 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.646227 22366 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.640177 22706 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.653227 22612 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:53.650000 22680 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.654291 22424 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.644490 22711 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.668803 22414 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:53.670334 22564 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.675400 22350 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.679816 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:53.680472 17388 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:53.681725 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:53.683017 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:53.668390 22612 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:53.602588 22734 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.686735 22350 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.694448 22750 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.694227 22714 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.695588 22723 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.695950 22712 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.697645 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:53.698632 22725 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.700830 17394 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:53.704694 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45632 (request call id 49) took 1827 ms. Trace:
I20260709 13:19:53.705089 17316 rpcz_store.cc:276] 0709 13:19:51.877239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.877404 (+   165us) service_pool.cc:224] Handling call
0709 13:19:53.704542 (+1827138us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400211e54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627ee853 00007f7d677bc60a 00007f7d60d427d4 00007f7d60d42762 00007f7d60d42691 00007f7d60d4260c 00007f7d60d418c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:53.704636 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2723533568}
I20260709 13:19:53.706683 21894 raft_consensus.cc:993] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:19:53.707159 21894 raft_consensus.cc:1081] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:19:53.684554 22437 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:53.708335 22437 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.706278 22580 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.712675 22437 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.713091 22365 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:53.713228 22747 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.713701 22365 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:53.715193 22580 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.714874 22365 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.687562 22414 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.722446 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:53.685132 22677 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.725034 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:53.725869 17394 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.728619 17388 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:53.667241 22608 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:53.733196 22608 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.733814 22564 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:53.734567 22672 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.418s	user 0.006s	sys 0.000s
I20260709 13:19:53.711400 22432 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.736086 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1353) took 2660 ms. Trace:
I20260709 13:19:53.737259 22432 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.736567 17992 rpcz_store.cc:276] 0709 13:19:51.075614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.078669 (+  3055us) service_pool.cc:224] Handling call
0709 13:19:51.078997 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.079241 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.079270 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.079765 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.825331 (+745566us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:51.825387 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.825483 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.733855 (+1908372us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:53.735678 (+  1823us) raft_consensus.cc:1685] finished
0709 13:19:53.735705 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.735996 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40951040,"thread_start_us":745175,"threads_started":1,"wal-append.queue_time_us":940362}
I20260709 13:19:53.738556 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1360) took 2007 ms. Trace:
I20260709 13:19:53.744439 17394 raft_consensus.cc:2410] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:19:53.739014 17995 rpcz_store.cc:276] 0709 13:19:51.731436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.870192 (+138756us) service_pool.cc:224] Handling call
0709 13:19:51.870519 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.597266 (+1726747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.597296 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.597333 (+    37us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:53.597363 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.738323 (+140960us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400590454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:53.738375 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.738490 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67771,"raft.queue_time_us":53620,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":64699,"spinlock_wait_cycles":3936736640}
I20260709 13:19:53.701138 22725 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.711959 22714 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.770160 22414 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.704178 22616 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.772517 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:53.774284 22723 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.795341 22425 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:53.799548 22743 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.278s	user 0.000s	sys 0.000s
I20260709 13:19:53.345534 17390 rpcz_store.cc:276] 0709 13:19:51.936231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.172511 (+1236280us) service_pool.cc:224] Handling call
0709 13:19:53.172788 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.173101 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:53.304028 (+130927us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.344642 (+ 40614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.344694 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:53.344735 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.344796 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.344942 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":358,"raft.queue_time_us":20296,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":26968,"thread_start_us":121450,"threads_started":2}
W20260709 13:19:53.818571 22658 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.002s
I20260709 13:19:53.838073 22658 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.853880 22711 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:53.809140 22710 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.855935 17993 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:53.864421 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:53.867715 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:53.896396 22366 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.897012 22366 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.898458 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:53.899062 22366 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.900189 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:53.900939 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:53.901156 17319 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:53.901314 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:53.902107 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:53.902195 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:53.902727 17319 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:53.902835 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:53.904385 17316 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:53.904414 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:53.903039 17319 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:53.906972 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:53.907720 17317 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:53.855406 22656 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.911912 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:53.913975 17214 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 219) took 28235 ms (client timeout 15000 ms). Trace:
W20260709 13:19:53.857898 22574 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.001s
W20260709 13:19:53.915050 22694 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.970s	user 0.007s	sys 0.007s
I20260709 13:19:53.916401 22574 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.918099 17994 raft_consensus.cc:2410] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:19:53.839217 22740 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:53.926192 22616 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.929306 22740 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:53.931142 22574 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.907423 17319 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:54.054571 17319 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.937556 22710 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:53.938668 22627 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:54.058933 22627 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:53.941372 22697 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.052s	user 0.003s	sys 0.000s
W20260709 13:19:53.943658 22702 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.110s	user 0.002s	sys 0.005s
I20260709 13:19:53.936739 22058 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.958318 17317 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:19:53.958431 22612 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:53.914526 17214 rpcz_store.cc:269] 0709 13:19:25.678476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.683856 (+  5380us) service_pool.cc:224] Handling call
0709 13:19:26.746749 (+1062893us) spinlock_profiling.cc:243] Waited 83.2 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275e090 00007f7d627fcf3a 00007f7d685b31cc 00007f7d686b137e 00007f7d66b722a4 00007f7d66b72232 00007f7d66b72161 00007f7d66b720dc 00007f7d66b71392 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:53.913887 (+27167138us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:46.181354 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:46.182006 (+   652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:46.182053 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:19:46.182070 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:46.183022 (+   952us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:46.183110 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:46.183143 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:19:46.261265 (+ 78122us) tablet.cc:701] Row locks acquired
0709 13:19:46.261318 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:19:46.261535 (+   217us) write_op.cc:270] Start()
0709 13:19:46.261699 (+   164us) write_op.cc:276] Timestamp: P: 1783603186261448 usec, L: 0
0709 13:19:46.261733 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:19:46.343241 (+ 81508us) log.cc:844] Serialized 3252 byte log entry
0709 13:19:47.416067 (+1072826us) spinlock_profiling.cc:243] Waited 958 us on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627efe28 00007f7d6622a581 00007f7d66229d58 00007f7d6622e9f1 00007f7d6622e9a9 00007f7d6622e939 00007f7d6622e901 00007f7d6622db2d 000000000038f354 000000000038f199
0709 13:19:48.125406 (+709339us) spinlock_profiling.cc:243] Waited 9.81 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:48.521022 (+395616us) op_driver.cc:464] REPLICATION: finished
0709 13:19:48.776050 (+255028us) write_op.cc:301] APPLY: starting
0709 13:19:48.783732 (+  7682us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:48.963133 (+179401us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:48.963173 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:48.969293 (+  6120us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:48.969625 (+   332us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:19:48.969696 (+    71us) write_op.cc:312] APPLY: finished
0709 13:19:48.970116 (+   420us) log.cc:844] Serialized 81 byte log entry
0709 13:19:48.970970 (+   854us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:48.971097 (+   127us) write_op.cc:454] Released schema lock
0709 13:19:48.971158 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:48.994598 (+ 23440us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:48.995158 (+   560us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":194936,"reported_tablets":36,"spinlock_wait_cycles":191284352,"child_traces":[["op",{"apply.queue_time_us":181169,"apply.run_cpu_time_us":14044,"apply.run_wall_time_us":221566,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37567,"num_ops":8,"prepare.queue_time_us":369241,"prepare.run_cpu_time_us":19098,"prepare.run_wall_time_us":1234978,"raft.queue_time_us":210684,"raft.run_cpu_time_us":13138,"raft.run_wall_time_us":150973,"replication_time_us":2233578,"spinlock_wait_cycles":24776192,"thread_start_us":677400,"threads_started":4,"wal-append.queue_time_us":481128,"wal-append.run_cpu_time_us":53072,"wal-append.run_wall_time_us":3121793}]]}
W20260709 13:19:53.963069 22705 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.111s	user 0.001s	sys 0.011s
W20260709 13:19:53.964996 17470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 1940) took 2883 ms (client timeout 2631 ms). Trace:
W20260709 13:19:54.100852 17469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.000s	sys 0.033s
W20260709 13:19:53.966988 22698 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.117s	user 0.006s	sys 0.006s
I20260709 13:19:53.983050 22513 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:53.985097 17313 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:53.993232 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1001) took 3134 ms. Trace:
W20260709 13:19:54.101285 17469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.000s	sys 0.033s
I20260709 13:19:54.102250 17991 rpcz_store.cc:276] 0709 13:19:50.858648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.858786 (+   138us) service_pool.cc:224] Handling call
0709 13:19:50.861168 (+  2382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.383067 (+521899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.383101 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.408893 (+ 25792us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.035752 (+626859us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:52.035812 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.992648 (+1956836us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b540057a8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:53.992715 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.992784 (+    69us) raft_consensus.cc:1685] finished
0709 13:19:53.992806 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.993147 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":503,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":29296,"spinlock_wait_cycles":1199291136,"thread_start_us":589429,"threads_started":1,"wal-append.queue_time_us":1079971,"wal-append.run_cpu_time_us":10525,"wal-append.run_wall_time_us":1458687}
I20260709 13:19:54.022809 22712 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:54.030934 17964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.004s	sys 0.044s
W20260709 13:19:54.109668 17964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.005s	sys 0.044s
W20260709 13:19:54.110096 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 600070us
I20260709 13:19:54.110895 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:54.112162 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:54.032308 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 172359us
W20260709 13:19:54.052580 17962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.013s	sys 0.017s
W20260709 13:19:54.115060 17962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.013s	sys 0.017s
W20260709 13:19:54.115805 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 677448us
W20260709 13:19:54.057199 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.015s	sys 0.012s
W20260709 13:19:54.118039 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.015s	sys 0.012s
W20260709 13:19:54.118366 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 875037us
W20260709 13:19:54.100257 17470 rpcz_store.cc:269] 0709 13:19:51.081703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.179621 (+ 97918us) service_pool.cc:224] Handling call
0709 13:19:53.964683 (+2785062us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b5400281254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:53.964905 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1794181888}
I20260709 13:19:53.970585 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1011) took 2143 ms. Trace:
I20260709 13:19:54.119455 17998 rpcz_store.cc:276] 0709 13:19:51.827313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.817744 (+990431us) service_pool.cc:224] Handling call
0709 13:19:52.827805 (+ 10061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.927997 (+100192us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:53.072140 (+144143us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.253790 (+181650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.253837 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:53.253876 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.952807 (+698931us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b5400640354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:53.970302 (+ 17495us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.970501 (+   199us) inbound_call.cc:177] Queueing success response
0709 13:19:53.981312 (+ 10811us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b180034de60. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
Metrics: {"mutex_wait_us":415643,"prepare.queue_time_us":274009,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2663,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":426077,"spinlock_wait_cycles":236111360,"thread_start_us":303853,"threads_started":2,"wal-append.queue_time_us":185256}
I20260709 13:19:54.124406 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:54.129243 22710 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.133646 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.133905 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.134266 17994 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.134613 17993 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:54.117748 22574 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:54.136999 22616 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:54.138773 22402 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:54.139130 22402 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:54.139577 22365 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.141069 22723 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:54.144783 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.145469 17996 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:54.143985 17994 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:54.148952 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3294) took 2342 ms. Trace:
I20260709 13:19:54.150665 17998 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:54.149492 17467 rpcz_store.cc:276] 0709 13:19:51.806340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.843579 (+ 37239us) service_pool.cc:224] Handling call
0709 13:19:51.843967 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.920043 (+ 76076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.920162 (+   119us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.920733 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.742679 (+821946us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:52.742739 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.742835 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.966497 (+1223662us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b240004b9f8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f58d9c4 00007f7d5f58bacb 00007f7d5f746dc9 00007f7d5f746a55 00007f7d5f74609d 00007f7d6237810e 00007f7d6238f88c 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221
0709 13:19:54.148568 (+182071us) raft_consensus.cc:1685] finished
0709 13:19:54.148598 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.148878 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75586,"raft.queue_time_us":80744,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"spinlock_wait_cycles":5481216,"thread_start_us":821559,"threads_started":1,"wal-append.queue_time_us":887634}
I20260709 13:19:54.139962 22402 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:54.100376 22058 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.153522 22402 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.153534 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3285) took 2341 ms. Trace:
I20260709 13:19:54.156044 17391 rpcz_store.cc:276] 0709 13:19:51.812154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.813999 (+  1845us) service_pool.cc:224] Handling call
0709 13:19:51.814373 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.877223 (+ 62850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.877251 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.877865 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.741669 (+863804us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:52.741740 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.741841 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.940560 (+1198719us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:19:54.153189 (+212629us) raft_consensus.cc:1685] finished
0709 13:19:54.153224 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.153463 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62427,"raft.queue_time_us":63586,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":67636992,"thread_start_us":863455,"threads_started":1,"wal-append.queue_time_us":975805}
I20260709 13:19:54.159444 17996 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:19:54.160053 17391 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:19:54.160398 17391 pending_rounds.cc:85] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 8
I20260709 13:19:54.160597 17391 pending_rounds.cc:107] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:19:54.160893 17391 raft_consensus.cc:2889] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:54.162669 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.165341 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.166951 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:54.167296 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:54.167800 17388 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:54.169247 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.170310 17993 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:54.173902 17998 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:54.145942 22650 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.131498 17434 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:54.177824 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 46407.4us
I20260709 13:19:54.178722 17434 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:54.187633 17315 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:54.189706 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:54.193831 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.194690 17395 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.197975 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.199201 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.200130 17397 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:54.200332 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.201706 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.205403 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.206436 17991 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:54.209936 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:54.210587 17394 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:54.129796 22710 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:54.211992 17388 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:54.207791 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.214372 17397 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:54.220916 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.225524 17463 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:54.228226 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:54.228998 17998 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:54.233453 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.238859 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.195355 22712 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.194447 22612 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.201814 22723 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:54.242116 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.246213 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.249607 17395 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:54.225929 22710 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.250285 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.211615 22718 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:54.252099 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.060292 22627 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:54.264750 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.271137 17466 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:54.269021 17464 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:54.268700 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.271894 17470 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:54.273986 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.250042 17317 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:54.268435 22718 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.278569 22718 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.278612 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.281052 22723 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:54.280458 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:54.283959 17993 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:54.239012 22755 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:19:54.290673 22755 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:54.291179 22755 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:54.304011 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.314297 17991 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.303258 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.315653 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.316301 17467 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.316942 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:54.323067 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.326659 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:54.331845 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.337391 17319 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:54.344692 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.345571 17465 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.349077 22580 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:54.349128 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.339829 22723 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:54.302917 22627 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.350814 17466 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:54.354333 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.361274 17463 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:19:54.365618 17995 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:19:54.375183 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.292392 22755 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:54.380992 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:54.389537 17468 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.010s	sys 0.016s
W20260709 13:19:54.390272 17363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.023s	sys 0.060s
W20260709 13:19:54.390395 17468 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.010s	sys 0.016s
I20260709 13:19:54.385135 17465 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:54.393316 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.394356 17464 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:54.393558 17466 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.394768 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:54.396483 17462 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.009s	sys 0.017s
W20260709 13:19:54.397055 17462 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.009s	sys 0.017s
W20260709 13:19:54.390656 17363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.023s	sys 0.060s
I20260709 13:19:54.402019 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.403120 17464 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:54.405438 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.406193 17464 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:54.408020 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.041s	sys 0.067s
W20260709 13:19:54.408469 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.041s	sys 0.067s
W20260709 13:19:54.408821 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 865119us
I20260709 13:19:54.397913 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3302) took 2436 ms. Trace:
I20260709 13:19:54.423302 17465 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:54.425034 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:54.425287 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.425045 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:54.434826 17396 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:19:54.436540 17388 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:54.439589 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:54.440114 17321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.005s	sys 0.022s
W20260709 13:19:54.440559 17321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.005s	sys 0.022s
I20260709 13:19:54.438441 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:54.449131 17286 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.019s	sys 0.008s
W20260709 13:19:54.449493 17286 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.019s	sys 0.008s
W20260709 13:19:54.449820 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 722159us
I20260709 13:19:54.450116 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:54.421473 17462 rpcz_store.cc:276] 0709 13:19:51.961889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.112305 (+1150416us) service_pool.cc:224] Handling call
0709 13:19:53.112737 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:53.224088 (+111351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.224118 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:53.224692 (+   574us) log.cc:844] Serialized 52 byte log entry
0709 13:19:53.362773 (+138081us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:53.391146 (+ 28373us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.397477 (+1006331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.397578 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.397643 (+    65us) raft_consensus.cc:1685] finished
0709 13:19:54.397666 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.397839 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134877,"prepare.queue_time_us":62784,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":965,"raft.queue_time_us":195654,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":13996,"thread_start_us":1094672,"threads_started":2,"wal-append.queue_time_us":194891}
I20260709 13:19:54.454828 17467 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:54.391142 22763 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.474943 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.486119 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.455706 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:54.448941 22556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.023s	sys 0.049s
I20260709 13:19:54.396428 22720 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:54.475785 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:54.476372 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.476699 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:54.478298 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 44959.3us
I20260709 13:19:54.489806 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.453183 22515 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.555541 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:54.557704 17287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.062s	user 0.023s	sys 0.028s
W20260709 13:19:54.558176 17287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.023s	sys 0.028s
W20260709 13:19:54.533762 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.001s	sys 0.037s
W20260709 13:19:54.563380 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.001s	sys 0.038s
I20260709 13:19:54.566483 17463 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
W20260709 13:19:54.473346 22628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.021s	sys 0.019s
I20260709 13:19:54.501120 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.460103 22507 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:54.562405 22501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.008s	sys 0.031s
I20260709 13:19:54.512777 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:54.515560 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:54.421172 22744 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:19:54.622131 17319 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:54.479789 22755 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.463263 22719 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:19:54.540657 17993 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:54.638440 17390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:19:54.639055 17390 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:54.639451 17390 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:54.640360 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.641196 17993 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:54.534842 17393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.009s	sys 0.029s
I20260709 13:19:54.459635 22669 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:54.508893 22632 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:54.498994 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 43773.1us
I20260709 13:19:54.650429 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:54.494169 17991 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:54.575911 17317 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:54.578687 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:54.579051 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:54.580262 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 974485us
W20260709 13:19:54.588877 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.588944 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:54.589979 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:54.592747 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:54.495662 22763 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:54.524902 22712 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.570889 22679 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:19:54.603488 22720 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:54.607570 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:54.607766 22765 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:19:54.568502 22556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.029s	sys 0.049s
I20260709 13:19:54.608986 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:54.612686 17389 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:54.714748 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 105879us
I20260709 13:19:54.613081 17285 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:54.614042 17397 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:19:54.716881 17471 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:54.718580 17397 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:54.509426 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.723709 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 110709us
I20260709 13:19:54.618285 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:54.629529 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.631814 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:54.632081 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.730790 17997 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:54.629025 17464 raft_consensus.cc:2410] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:19:54.606082 22628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.023s	sys 0.019s
I20260709 13:19:54.629612 17394 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:54.630010 22734 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.020s	sys 0.008s
W20260709 13:19:54.649025 17393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.010s	sys 0.029s
W20260709 13:19:54.620365 22736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.006s	sys 0.047s
W20260709 13:19:54.742588 22736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.007s	sys 0.048s
I20260709 13:19:54.743831 22507 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:54.630975 22501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.009s	sys 0.032s
I20260709 13:19:54.545032 22058 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:54.747622 22720 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:54.749593 17470 raft_consensus.cc:2368] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15.
I20260709 13:19:54.750779 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:54.688666 17217 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.000s	sys 0.063s
W20260709 13:19:54.752286 17217 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.006s	sys 0.064s
I20260709 13:19:54.664793 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:54.753384 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 88659.8us
I20260709 13:19:54.754360 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.630087 22402 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:19:54.755122 17464 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.666242 22612 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:19:54.698264 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:54.688490 17466 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:54.571251 22515 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:54.719147 22766 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:54.726269 17993 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
W20260709 13:19:54.732702 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 114505us
I20260709 13:19:54.778587 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:54.649528 22504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.006s	sys 0.019s
I20260709 13:19:54.781615 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:54.665499 22763 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:54.690114 22744 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:54.689532 22669 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:54.820020 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:54.663761 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:54.776381 22365 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.004s
I20260709 13:19:54.763139 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:54.828998 17471 raft_consensus.cc:2410] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:19:54.738294 22734 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.020s	sys 0.009s
I20260709 13:19:54.660948 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:54.757781 22540 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:19:54.768755 22767 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:54.770936 22515 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:54.774689 22513 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.000s
I20260709 13:19:54.747670 22058 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:54.752583 22632 raft_consensus.cc:2764] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:19:54.775586 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3305) took 1545 ms. Trace:
I20260709 13:19:54.849956 17469 rpcz_store.cc:276] 0709 13:19:53.230712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.232572 (+  1860us) service_pool.cc:224] Handling call
0709 13:19:53.232883 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:53.239351 (+  6468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.239396 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:53.240079 (+   683us) log.cc:844] Serialized 52 byte log entry
0709 13:19:54.104370 (+864291us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:54.104428 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.104521 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.775379 (+670858us) raft_consensus.cc:1685] finished
0709 13:19:54.775398 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.775533 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6658,"raft.queue_time_us":12575,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9647,"thread_start_us":819633,"threads_started":1,"wal-append.queue_time_us":1381905}
I20260709 13:19:54.744445 22507 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:54.851851 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:54.777096 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:54.780706 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:54.855032 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 74389.9us
I20260709 13:19:54.811388 17466 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:54.855674 17467 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
W20260709 13:19:54.831094 22646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.302s	user 0.004s	sys 0.026s
I20260709 13:19:54.735186 22768 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:54.787102 22504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.008s	sys 0.021s
I20260709 13:19:54.717231 22712 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:54.830725 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 169855us
I20260709 13:19:54.872684 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:54.832403 17997 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:54.826539 22611 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.527s	user 0.019s	sys 0.060s
I20260709 13:19:54.821477 22765 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:54.852125 22218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.003s	sys 0.025s
I20260709 13:19:54.822454 22744 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:54.818722 22582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.035s	sys 0.019s
I20260709 13:19:54.812011 22766 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:54.857638 22681 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:54.880590 22611 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.581s	user 0.019s	sys 0.060s
W20260709 13:19:54.866726 22646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.344s	user 0.004s	sys 0.027s
W20260709 13:19:54.887549 22218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.254s	user 0.004s	sys 0.025s
I20260709 13:19:55.022688 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:55.138240 17314 raft_consensus.cc:2368] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 16. Current term is 17.
I20260709 13:19:54.759964 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2134) took 1602 ms. Trace:
I20260709 13:19:54.771448 17388 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:55.029711 17395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.001s	sys 0.014s
I20260709 13:19:54.754349 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:55.143419 17395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.002s	sys 0.014s
W20260709 13:19:55.145680 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 391281us
I20260709 13:19:55.146703 22632 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.147553 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:54.817786 17464 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:55.157341 22765 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:55.157930 22765 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:55.158397 22765 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:55.160945 22723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.003s	sys 0.024s
W20260709 13:19:55.161644 22723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.003s	sys 0.024s
W20260709 13:19:55.162977 17999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 1014) took 1993 ms (client timeout 1614 ms). Trace:
W20260709 13:19:55.163564 17999 rpcz_store.cc:269] 0709 13:19:53.169756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.169870 (+   114us) service_pool.cc:224] Handling call
0709 13:19:55.162348 (+1992478us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400600ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:55.162666 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3644642688}
W20260709 13:19:55.038956 17994 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.016s	sys 0.035s
W20260709 13:19:55.165230 17994 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.016s	sys 0.036s
W20260709 13:19:55.039696 17998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.008s	sys 0.016s
W20260709 13:19:55.166860 17998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.008s	sys 0.017s
I20260709 13:19:55.044668 17467 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:55.045596 17468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.000s	sys 0.015s
W20260709 13:19:55.170648 17468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.000s	sys 0.016s
I20260709 13:19:55.172046 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3313) took 1793 ms. Trace:
I20260709 13:19:54.841677 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:55.173625 17470 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:55.047590 17992 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.005s	sys 0.018s
W20260709 13:19:54.891090 22582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.035s	sys 0.019s
W20260709 13:19:55.177276 17992 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.007s	sys 0.018s
I20260709 13:19:54.854116 22647 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:19:54.893724 22669 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:55.199395 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.200982 22712 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:55.203847 22507 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:55.206543 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 59376.9us
I20260709 13:19:54.894976 22681 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:55.219085 17392 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:54.911005 22711 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:55.221619 22711 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:55.223634 22711 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:54.898900 22710 consensus_meta.cc:287] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.001s
I20260709 13:19:55.225770 22710 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:54.916710 22718 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.000s
I20260709 13:19:55.229691 22718 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:55.231681 17465 raft_consensus.cc:2368] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14.
I20260709 13:19:54.889113 22744 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:54.904024 22761 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:55.237349 22761 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:55.237825 22761 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:55.239398 22627 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.874s	user 0.008s	sys 0.019s
I20260709 13:19:54.957015 22766 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:54.887838 22768 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:54.903577 22771 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:55.267339 22771 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:54.911465 22781 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:55.099273 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3286) took 3280 ms. Trace:
W20260709 13:19:55.108397 22562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.304s	user 0.009s	sys 0.105s
W20260709 13:19:55.110044 22521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.443s	user 0.034s	sys 0.077s
W20260709 13:19:55.112577 22616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.002s	sys 0.030s
W20260709 13:19:55.113260 22650 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.910s	user 0.008s	sys 0.010s
W20260709 13:19:55.113498 22580 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.006s	sys 0.013s
W20260709 13:19:55.113826 17996 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.003s	sys 0.010s
I20260709 13:19:55.117956 17466 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:55.143290 22365 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:55.037679 17962 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.001s
W20260709 13:19:55.191129 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.922910 22646 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.270s
I20260709 13:19:55.191996 22719 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:55.266393 22768 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:55.279901 22718 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:55.280741 22710 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:55.281100 17392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3295) took 3453 ms (client timeout 2005 ms). Trace:
I20260709 13:19:55.282660 22711 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:55.326188 22580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.006s	sys 0.014s
W20260709 13:19:55.327616 17996 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.003s	sys 0.010s
W20260709 13:19:55.293049 17390 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.653s	user 0.015s	sys 0.006s
I20260709 13:19:55.302958 17470 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:19:55.277494 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:55.315405 22781 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.315284 17393 rpcz_store.cc:276] 0709 13:19:51.815708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.820882 (+  5174us) service_pool.cc:224] Handling call
0709 13:19:51.821274 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.906649 (+ 85375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.906692 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.907366 (+   674us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.745282 (+1837916us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b18001941a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:19:54.740723 (+995441us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:54.740781 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.740887 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.032567 (+291680us) raft_consensus.cc:1685] finished
0709 13:19:55.032611 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.095040 (+ 62429us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84905,"raft.queue_time_us":85059,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":8382848,"thread_start_us":995214,"threads_started":1,"wal-append.queue_time_us":3025358}
W20260709 13:19:55.321843 22562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.533s	user 0.009s	sys 0.106s
W20260709 13:19:55.326064 17962 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.002s	sys 0.001s
I20260709 13:19:55.331665 17995 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:55.172514 17468 rpcz_store.cc:276] 0709 13:19:53.379051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.379162 (+   111us) service_pool.cc:224] Handling call
0709 13:19:53.421633 (+ 42471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.421863 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:54.391197 (+969334us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.171361 (+780164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:55.171475 (+   114us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:55.171610 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.171727 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.171964 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6017,"prepare.queue_time_us":63628,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":5821,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":299,"thread_start_us":1727260,"threads_started":2,"wal-append.queue_time_us":576991}
I20260709 13:19:55.141057 17321 rpcz_store.cc:276] 0709 13:19:53.157777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.159375 (+  1598us) service_pool.cc:224] Handling call
0709 13:19:53.159685 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.160033 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.160062 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:53.194674 (+ 34612us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.710262 (+515588us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18003b9e00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:19:54.441050 (+730788us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:54.441111 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.441202 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.749148 (+307946us) raft_consensus.cc:1685] finished
0709 13:19:54.749176 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.759881 (+ 10705us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18237,"raft.queue_time_us":90,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":30163,"spinlock_wait_cycles":26052992,"thread_start_us":730522,"threads_started":1,"wal-append.queue_time_us":1546760}
W20260709 13:19:55.325860 17392 rpcz_store.cc:269] 0709 13:19:51.827386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.844232 (+ 16846us) service_pool.cc:224] Handling call
0709 13:19:53.154117 (+1309885us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b54002545a8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685d1924 00007f7d677ba227 00007f7d677b9ab8 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:55.280737 (+2126620us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b5400254754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:55.280953 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4904827520}
W20260709 13:19:55.337476 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 801870us
W20260709 13:19:55.324467 22521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.675s	user 0.035s	sys 0.077s
W20260709 13:19:55.331898 22616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.003s	sys 0.030s
I20260709 13:19:55.332026 17390 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.297881 22771 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:55.335805 22781 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:55.382340 17434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.058s	sys 0.163s
W20260709 13:19:55.382336 17993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.017s	sys 0.042s
W20260709 13:19:55.388944 17993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.018s	sys 0.042s
I20260709 13:19:55.389290 17388 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
W20260709 13:19:55.389820 17434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.058s	sys 0.163s
I20260709 13:19:55.390058 22582 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:55.390646 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.390812 22582 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:55.394117 22771 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.394727 17466 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:55.400334 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.011s	sys 0.015s
W20260709 13:19:55.395656 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 186902us
I20260709 13:19:55.397271 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:55.401489 17316 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.398525 22710 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:55.399159 17391 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.009s	sys 0.016s
W20260709 13:19:55.412081 17391 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.009s	sys 0.017s
W20260709 13:19:55.399641 17320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.002s	sys 0.024s
I20260709 13:19:55.394984 17390 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:55.400717 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.011s	sys 0.015s
I20260709 13:19:55.384392 22723 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:55.417981 17286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.000s	sys 0.039s
I20260709 13:19:55.420074 17316 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:55.421777 17990 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:55.421957 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:55.420742 17320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.003s	sys 0.024s
W20260709 13:19:55.423529 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.422922 22768 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:55.424576 17286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.000s	sys 0.039s
I20260709 13:19:55.409965 22650 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:55.428982 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:55.420356 22723 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:55.376430 22719 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:55.381467 22761 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.382561 22365 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:55.440397 22540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.011s	sys 0.036s
W20260709 13:19:55.440512 17436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.012s	sys 0.027s
W20260709 13:19:55.441017 17436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.012s	sys 0.028s
W20260709 13:19:55.436476 17463 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.003s	sys 0.022s
W20260709 13:19:55.441044 17285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.010s	sys 0.030s
W20260709 13:19:55.438859 17997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.019s
I20260709 13:19:55.435743 22723 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:55.437405 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 680197us
W20260709 13:19:55.447418 17285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.011s	sys 0.030s
W20260709 13:19:55.448994 17463 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.003s	sys 0.023s
W20260709 13:19:55.449523 17997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.007s	sys 0.020s
I20260709 13:19:55.448421 17318 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:55.457193 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:55.449254 22540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.012s	sys 0.036s
W20260709 13:19:55.468636 22645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.007s	sys 0.013s
W20260709 13:19:55.468578 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 718422us
I20260709 13:19:55.423027 22781 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:55.476594 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.476559 17287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.013s	sys 0.014s
I20260709 13:19:55.457203 22582 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:55.486539 17287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.013s	sys 0.014s
I20260709 13:19:55.444444 22710 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:55.481573 22645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.008s	sys 0.013s
W20260709 13:19:55.501659 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 721483us
I20260709 13:19:55.501716 22681 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:55.475003 22521 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:55.513514 22521 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.500476 22765 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:55.527143 17467 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:55.472113 22650 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:55.543668 22611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.048s	sys 0.031s
I20260709 13:19:55.563907 17318 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
W20260709 13:19:55.543835 22775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.006s	sys 0.009s
W20260709 13:19:55.550895 22679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.001s	sys 0.017s
I20260709 13:19:55.557257 22521 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:55.563035 22771 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:19:55.577293 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 690435us
I20260709 13:19:55.577502 22771 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.578496 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:55.579401 22799 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:55.580044 22799 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:55.580387 22771 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:55.586187 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3320) took 1081 ms. Trace:
W20260709 13:19:55.575243 22679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.001s	sys 0.018s
W20260709 13:19:55.574189 22611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.048s	sys 0.032s
W20260709 13:19:55.576577 22775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.007s	sys 0.010s
I20260709 13:19:55.586499 17388 rpcz_store.cc:276] 0709 13:19:54.500062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.500739 (+   677us) service_pool.cc:224] Handling call
0709 13:19:55.570977 (+1070238us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540036fbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:55.581215 (+ 10238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379769088}
W20260709 13:19:55.587394 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 152894us
W20260709 13:19:55.593401 22815 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:19:55.595700 22807 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 13:19:55.603701 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.602447 22720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.019s	sys 0.036s
I20260709 13:19:55.590191 22612 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.600849 22781 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:55.602320 22785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.015s	sys 0.047s
W20260709 13:19:55.625528 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 216321us
I20260709 13:19:55.618017 22813 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:55.603303 22627 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:19:55.618957 22720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.019s	sys 0.036s
I20260709 13:19:55.629773 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:55.602691 22807 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:19:55.637055 17471 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:55.631048 22785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.015s	sys 0.048s
I20260709 13:19:55.629572 22627 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:55.630021 22365 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:55.639138 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:55.640875 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 114858us
I20260709 13:19:55.645746 17462 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:55.646389 22775 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:55.647228 22807 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:55.647732 22807 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:55.646027 22627 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.659288 22804 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.640401 22817 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:19:55.659145 22801 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:55.660158 22804 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.663165 22801 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.659332 22805 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:55.603082 22811 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:19:55.662184 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 307512us
W20260709 13:19:55.678251 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 54945.4us
I20260709 13:19:55.679039 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:55.679673 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:55.665870 22804 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:55.678484 22799 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:55.681078 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:55.660193 22650 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:55.684019 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:55.672173 22801 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:55.690670 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1026) took 1255 ms. Trace:
I20260709 13:19:55.676726 22812 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:55.671854 22813 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.701573 22817 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:19:55.708665 22817 consensus_queue.cc:1243] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:55.648924 22807 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:55.709851 22813 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:55.687033 22824 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:55.709311 22817 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:55.710512 22669 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:55.742643 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45862.6us
W20260709 13:19:55.747068 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 119136us
W20260709 13:19:55.741343 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47977us
I20260709 13:19:55.694388 17996 rpcz_store.cc:276] 0709 13:19:54.432245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.432390 (+   145us) service_pool.cc:224] Handling call
0709 13:19:54.477695 (+ 45305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.477968 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:55.328309 (+850341us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.629261 (+300952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:55.640225 (+ 10964us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:55.669032 (+ 28807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.676338 (+  7306us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.687427 (+ 11089us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":488556,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":9294,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":6719,"thread_start_us":1117100,"threads_started":2,"wal-append.queue_time_us":344514}
I20260709 13:19:55.752707 22799 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:55.752386 22824 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.755790 22824 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:55.719376 22817 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:55.756002 22804 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:55.757280 22804 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:55.757885 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 179535us
I20260709 13:19:55.759936 22804 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:55.760232 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:55.760825 22824 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:55.761389 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 107728us
I20260709 13:19:55.762136 22824 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.762933 22799 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:55.764935 22807 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:55.766448 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1823) took 1174 ms. Trace:
I20260709 13:19:55.767930 22824 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:19:55.769964 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.774721 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 78173.8us
I20260709 13:19:55.685627 22805 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.857710 22805 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:55.768115 17320 rpcz_store.cc:276] 0709 13:19:54.591524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.591665 (+   141us) service_pool.cc:224] Handling call
0709 13:19:54.609187 (+ 17522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.609402 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:54.609691 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.746506 (+1136815us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.759548 (+ 13042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:55.759686 (+   138us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:55.759797 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.760252 (+   455us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.765977 (+  5725us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22587,"prepare.queue_time_us":518,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3825,"raft.queue_time_us":17506,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":33363,"thread_start_us":1004060,"threads_started":2,"wal-append.queue_time_us":895688}
W20260709 13:19:55.800729 22820 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
I20260709 13:19:55.802497 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 951) took 1224 ms. Trace:
I20260709 13:19:55.922329 17990 rpcz_store.cc:276] 0709 13:19:54.578244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.578391 (+   147us) service_pool.cc:224] Handling call
0709 13:19:55.791102 (+1212711us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54007611d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:55.802419 (+ 11317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643766016}
I20260709 13:19:55.802680 22562 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:55.923489 22562 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:55.924103 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:55.924635 22562 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.925110 22669 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:55.926249 22562 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:55.928027 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 54089.7us
I20260709 13:19:55.803344 22761 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:55.803979 22719 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:55.928946 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:55.805434 22765 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:55.930279 22765 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:55.930523 17434 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:55.930850 22765 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:55.807371 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3328) took 1046 ms. Trace:
I20260709 13:19:55.808617 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 1992) took 1358 ms. Trace:
I20260709 13:19:55.809610 22754 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:55.933035 22754 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:55.933259 22801 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:55.934087 22801 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.934309 22754 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:55.936399 22754 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.809929 22710 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:55.811468 22627 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:55.937513 22616 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:55.938078 22616 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:55.932101 17462 rpcz_store.cc:276] 0709 13:19:54.449777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.468261 (+ 18484us) service_pool.cc:224] Handling call
0709 13:19:54.468660 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.646323 (+1177663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.808276 (+161953us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001699d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:55.808558 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2692994304}
I20260709 13:19:55.939075 22616 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:55.811849 22819 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:19:55.812532 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:55.817384 22501 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:55.944517 22501 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:55.944638 17996 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:55.936391 22801 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:55.945583 22501 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.946110 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:55.946444 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 94338.2us
I20260709 13:19:55.817842 22646 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.947304 22646 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:55.824167 22767 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.825112 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:55.826642 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:55.828852 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:55.735093 22775 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.860364 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3329) took 1145 ms. Trace:
W20260709 13:19:55.777058 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 97580.4us
I20260709 13:19:55.931921 22765 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:55.946911 17996 raft_consensus.cc:2393] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:19:55.846493 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.866264 22826 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.158s	user 0.000s	sys 0.003s
I20260709 13:19:55.835855 22744 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:55.853714 22821 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:19:55.842960 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:55.931555 17471 rpcz_store.cc:276] 0709 13:19:54.761109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.879090 (+117981us) service_pool.cc:224] Handling call
0709 13:19:55.098082 (+218992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.638974 (+540892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.807085 (+168111us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540041f5d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:55.807306 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238341504}
W20260709 13:19:55.882745 22755 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.231s	user 0.009s	sys 0.009s
I20260709 13:19:55.909204 22679 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:55.909240 22799 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:55.909906 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 145604us
I20260709 13:19:55.911550 22766 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:55.912168 22804 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.914410 22781 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:55.914978 22768 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:55.916059 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1025) took 1723 ms. Trace:
W20260709 13:19:55.916002 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 156023us
I20260709 13:19:55.917913 22824 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:55.995065 22679 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:55.960309 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.884663 22711 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.000s
I20260709 13:19:55.948760 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:55.956404 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:55.946763 22501 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:55.998404 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.016266 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 278292us
I20260709 13:19:56.004217 22681 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.961755 22710 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.949949 22646 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:55.964952 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 96316.2us
I20260709 13:19:56.009155 17321 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:19:56.003144 22669 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.003925 17992 rpcz_store.cc:276] 0709 13:19:54.192293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.192420 (+   127us) service_pool.cc:224] Handling call
0709 13:19:54.192706 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.193137 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:54.262178 (+ 69041us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b18004f38a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf 00007f7d6280e038
0709 13:19:55.178141 (+915963us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.755236 (+577095us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.915589 (+160353us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:55.915669 (+    80us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:55.915721 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.915841 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.915993 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164586,"prepare.queue_time_us":969867,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":86,"raft.queue_time_us":219141,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":11417,"spinlock_wait_cycles":16821120,"thread_start_us":1442526,"threads_started":3,"wal-append.queue_time_us":460473}
I20260709 13:19:56.031523 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:56.031394 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1367) took 1858 ms. Trace:
I20260709 13:19:56.037658 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:56.016498 22799 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:56.023765 17318 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:19:56.003446 22781 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:56.013235 22627 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:55.983067 17389 rpcz_store.cc:276] 0709 13:19:54.714664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.732400 (+ 17736us) service_pool.cc:224] Handling call
0709 13:19:54.737543 (+  5143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:55.030458 (+292915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:55.030563 (+   105us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:55.031573 (+  1010us) log.cc:844] Serialized 26 byte log entry
0709 13:19:55.449762 (+418189us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:55.449802 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.859636 (+409834us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54004123d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:55.859707 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.859779 (+    72us) raft_consensus.cc:1685] finished
0709 13:19:55.859798 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.860139 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49440,"raft.run_cpu_time_us":618,"raft.run_wall_time_us":18448,"spinlock_wait_cycles":670626688,"thread_start_us":417555,"threads_started":1,"wal-append.queue_time_us":558009}
I20260709 13:19:56.028139 17993 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:56.040269 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:55.965472 22774 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:56.043583 17471 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.044167 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:56.039305 22507 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.047919 22804 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:56.051692 22723 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.006s
I20260709 13:19:56.052158 22723 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.015055 22824 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.053674 22628 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.057022 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.058130 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3332) took 1234 ms. Trace:
I20260709 13:19:56.061883 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:55.957456 22817 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.014576 22767 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.066658 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3326) took 1401 ms. Trace:
I20260709 13:19:56.064131 17313 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:56.040871 22799 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:56.045470 22781 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:56.076705 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 128066us
I20260709 13:19:56.068698 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:19:56.080224 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 48894.7us
I20260709 13:19:56.081301 22679 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.082472 22679 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:56.083530 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.084913 17469 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:56.030855 22681 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.064579 17464 rpcz_store.cc:276] 0709 13:19:54.823478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.155791 (+332313us) service_pool.cc:224] Handling call
0709 13:19:55.156439 (+   648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:55.329949 (+173510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:55.329995 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:55.364933 (+ 34938us) log.cc:844] Serialized 26 byte log entry
0709 13:19:55.627959 (+263026us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:55.627999 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.628093 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.057807 (+429714us) raft_consensus.cc:1685] finished
0709 13:19:56.057832 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.057972 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12324,"raft.queue_time_us":10663,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":18730,"thread_start_us":240579,"threads_started":1,"wal-append.queue_time_us":315384}
I20260709 13:19:56.073473 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:56.087859 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:56.037760 17994 rpcz_store.cc:276] 0709 13:19:54.173312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.173425 (+   113us) service_pool.cc:224] Handling call
0709 13:19:54.173730 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.173930 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:55.165878 (+991948us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.992954 (+827076us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.998922 (+  5968us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:56.006095 (+  7173us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:56.017057 (+ 10962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.022139 (+  5082us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.031331 (+  9192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20166,"prepare.queue_time_us":976832,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":87,"raft.queue_time_us":55330,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":8516,"spinlock_wait_cycles":32640,"thread_start_us":1742129,"threads_started":3,"wal-append.queue_time_us":464938}
I20260709 13:19:56.095491 17388 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
W20260709 13:19:56.090057 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 43535.6us
I20260709 13:19:56.065826 22507 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:19:56.097536 17395 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:56.098595 17393 pending_rounds.cc:85] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 12
I20260709 13:19:56.099115 17393 pending_rounds.cc:107] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:19:56.099458 17393 raft_consensus.cc:2889] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:56.101909 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3316) took 1481 ms. Trace:
I20260709 13:19:56.102408 17463 rpcz_store.cc:276] 0709 13:19:54.620933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.628024 (+  7091us) service_pool.cc:224] Handling call
0709 13:19:54.628344 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.696864 (+ 68520us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:55.477397 (+780533us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.996416 (+519019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:55.996502 (+    86us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:56.000812 (+  4310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.100324 (+ 99512us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b18004ea960. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419
0709 13:19:56.101544 (+  1220us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b54001f3454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:56.101617 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.101830 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12823,"prepare.queue_time_us":50107,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":37,"raft.queue_time_us":5866,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6215,"spinlock_wait_cycles":163624192,"thread_start_us":1166530,"threads_started":2,"wal-append.queue_time_us":555132}
W20260709 13:19:56.106184 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.117341 22804 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:56.121840 17316 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
I20260709 13:19:56.066231 22646 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.034298 22768 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.072430 22774 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:56.070473 17391 rpcz_store.cc:276] 0709 13:19:54.675549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.676162 (+   613us) service_pool.cc:224] Handling call
0709 13:19:54.676628 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:55.423891 (+747263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:55.423940 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:55.443842 (+ 19902us) log.cc:844] Serialized 26 byte log entry
0709 13:19:55.692229 (+248387us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:56.041864 (+349635us) log.cc:844] Serialized 14 byte log entry
0709 13:19:56.045711 (+  3847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.061129 (+ 15418us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.061172 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:56.061183 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.066599 (+  5416us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39443,"prepare.queue_time_us":141157,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":60,"raft.queue_time_us":104877,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":55074,"thread_start_us":1227105,"threads_started":3,"wal-append.queue_time_us":279606}
W20260709 13:19:56.126266 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 57650.1us
I20260709 13:19:56.075241 22761 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:56.133272 17470 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:56.057101 22669 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.134377 22723 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:56.135967 22669 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:56.134037 22817 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.059082 22766 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.129385 22805 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:56.077175 22710 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.153352 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:56.154668 22710 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:56.154856 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:56.155952 17315 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:56.158030 22365 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.147635 22767 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:56.147717 22824 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:56.157521 22799 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.166420 22799 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.142940 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:56.171424 22766 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:56.172402 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:56.173310 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.174077 17993 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:56.174019 17316 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 10.
I20260709 13:19:56.174376 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.174707 17314 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:56.175558 22645 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:56.175978 22645 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.176308 22645 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:56.185001 22771 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:56.187666 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:56.162122 22774 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.148234 22811 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:56.192656 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 49792.8us
I20260709 13:19:56.174013 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:56.148337 22805 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:56.205140 17390 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:56.158510 22365 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:56.210381 22365 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.225358 17993 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:56.228991 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:56.229983 17390 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
W20260709 13:19:56.230252 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56336.4us
I20260709 13:19:56.230406 22562 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:56.231042 22562 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:56.232162 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:56.232064 22562 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.234200 22754 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:56.234282 22645 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.235880 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:56.236285 22754 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:56.237011 22710 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.237509 22710 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.238410 22744 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:56.241504 22754 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:56.241773 17285 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:56.243628 22754 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:56.236517 22645 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:56.201341 22711 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:56.250155 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3323) took 1530 ms. Trace:
I20260709 13:19:56.209444 22805 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.248826 17434 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:56.252741 17469 rpcz_store.cc:276] 0709 13:19:54.720207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.852052 (+131845us) service_pool.cc:224] Handling call
0709 13:19:55.040544 (+188492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:56.085371 (+1044827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.246828 (+161457us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54001f1154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:56.250073 (+  3245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209633024}
I20260709 13:19:56.201730 22807 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:56.252625 22711 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:56.245581 22754 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:56.284076 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:56.285451 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:56.278571 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.287449 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:56.266111 22767 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:56.271129 22719 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:56.273132 22771 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:56.292332 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60330.6us
I20260709 13:19:56.260092 22811 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.295874 22754 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.285089 22645 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 13:19:56.297183 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 61469.9us
I20260709 13:19:56.288755 22711 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.301796 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:56.277805 22744 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:19:56.303754 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.302819 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 142338us
I20260709 13:19:56.276126 22627 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:19:56.277290 22824 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:19:56.291918 22719 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.297889 22761 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:56.302047 22767 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:56.320500 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:56.313616 22719 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:56.325878 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:19:56.333653 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 52865.6us
I20260709 13:19:56.318086 22775 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.335300 17990 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 8: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:56.334188 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:56.337185 22775 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:56.333442 22540 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:19:56.317806 22765 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:56.337863 22775 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.338382 22774 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:56.341123 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 48947.4us
I20260709 13:19:56.347579 17471 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:56.344655 17434 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:56.355104 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:56.355866 17997 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
W20260709 13:19:56.349418 22827 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.608s	user 0.004s	sys 0.000s
I20260709 13:19:56.356878 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:56.357616 17995 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:56.349341 22580 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:19:56.360456 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:56.362006 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:56.320614 22761 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.362752 17463 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:56.372095 22767 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.339107 22562 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:19:56.375818 22681 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:56.363574 22718 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:56.377218 22718 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.377591 22718 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.382062 22740 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:56.382601 22740 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:56.381916 22645 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:56.369508 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:56.394766 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 85426.9us
I20260709 13:19:56.345430 22774 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:56.407768 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:56.339735 22744 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.420320 22811 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:56.386606 22765 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
W20260709 13:19:56.424050 22843 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.079s	user 0.000s	sys 0.003s
I20260709 13:19:56.416628 22501 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:56.425854 22501 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.428352 22501 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:56.412564 22771 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:56.410761 22628 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.429253 17996 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:56.429762 22628 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.432176 22628 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:56.433240 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:56.451188 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 43956.3us
I20260709 13:19:56.410602 22768 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:56.383538 22740 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.387353 22781 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:56.458765 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 73455.3us
I20260709 13:19:56.414345 22824 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:56.411139 22616 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:56.473308 22824 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.474941 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:56.475732 17397 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:56.476521 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:56.477299 17996 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:19:56.477963 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.478267 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.478719 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.482131 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.483295 17314 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:56.487066 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:56.489077 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.483346 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:56.493289 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:56.493963 22744 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:56.494093 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:56.493294 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:56.494871 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:56.473909 22845 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:19:56.466917 17997 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:19:56.450871 22771 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:56.495462 17396 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:56.515009 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:56.515132 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:56.460877 22861 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:56.524319 17993 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:56.518353 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:56.518672 22710 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:56.521122 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:56.521579 22771 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.523000 22740 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:56.523161 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.523552 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:56.530141 17316 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:56.464059 22562 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:56.516000 17397 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:56.530637 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.531633 17468 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:56.534786 17316 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:56.536355 17314 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:19:56.536530 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 126622us
I20260709 13:19:56.537797 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.461300 22860 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:56.541034 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.535187 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:56.537598 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:56.549968 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 180371us
I20260709 13:19:56.551573 17392 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:56.551857 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.550176 17315 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:56.524459 22861 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:56.557832 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:56.558917 17397 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 8: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:56.558900 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.463132 22811 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:19:56.539793 22562 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:56.539992 22628 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.552186 22860 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.513177 22616 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.558005 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:56.566193 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:56.557792 22744 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.570061 17316 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:56.576399 17467 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 17: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:56.575553 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:56.564324 22628 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.585656 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.537086 22774 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.569111 22860 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:56.595455 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.574570 22824 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:56.597517 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:56.572497 22744 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.590493 22628 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:56.597289 22848 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:19:56.631254 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:56.632182 17990 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:56.613754 22744 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.627143 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:56.638351 17392 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:56.636596 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:56.634032 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:56.594519 22719 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.619622 22761 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:56.648902 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.651561 17317 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:56.653069 22719 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:56.653813 22562 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.657101 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:56.666422 22710 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:56.668052 22616 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:56.669485 22865 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:19:56.670266 22775 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.670401 22805 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.671422 17321 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:19:56.674711 22711 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.675814 17470 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:19:56.676589 17466 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:56.678476 22365 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.680454 17467 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:56.681437 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:56.643671 22862 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:19:56.695612 17462 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:56.695791 17464 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:56.696055 17393 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:56.708175 17397 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:56.709564 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:56.708029 17962 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:56.709425 17467 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:56.714710 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:56.716219 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:56.672602 22805 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:56.719792 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.721284 17992 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:56.615315 22861 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:56.738752 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47308.9us
I20260709 13:19:56.738796 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:19:56.736631 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.739841 17467 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:19:56.746222 17320 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:56.733623 22824 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:56.755035 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 144602us
I20260709 13:19:56.757233 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:56.735591 22718 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:56.750665 22681 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.672534 22775 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:56.777396 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 63572.7us
I20260709 13:19:56.756079 22861 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:56.787878 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.780301 17471 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:56.754115 22809 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:56.781230 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:56.760545 22365 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:56.750509 22645 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:19:56.800109 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:56.804483 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:56.805698 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.806564 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:56.815250 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:56.817876 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 128003us
I20260709 13:19:56.812322 22761 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:56.810868 22775 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.810758 22813 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:56.838992 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:56.821676 22681 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:56.851631 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 47267.4us
I20260709 13:19:56.831933 22761 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:56.862708 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:56.863776 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:56.835233 22813 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:56.865229 22874 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:19:56.824117 22501 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:19:56.823688 22809 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:56.863826 17992 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:19:56.874187 22872 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:19:56.884294 17463 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:56.886283 17471 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:19:56.886677 17471 pending_rounds.cc:85] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 7
I20260709 13:19:56.886932 17471 pending_rounds.cc:107] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:19:56.887179 17471 raft_consensus.cc:2889] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:56.860957 22761 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:56.888625 17467 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:19:56.891122 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.891701 22852 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.554s	user 0.001s	sys 0.002s
I20260709 13:19:56.894282 17391 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:56.857223 22645 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:56.920352 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:56.921245 17470 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:56.917454 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 91568.3us
I20260709 13:19:56.866282 22813 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:56.918352 22845 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:56.907853 22645 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:19:56.944525 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.966068 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.948467 22501 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:56.976419 22718 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:56.976994 22501 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:56.993767 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:56.979017 22893 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:57.006796 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 147761us
I20260709 13:19:57.007551 22824 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:57.008183 22824 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.008952 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:57.009084 17360 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:57.009533 17317 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.010388 22824 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.011651 22809 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:57.005493 22645 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.014492 22501 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.015791 22501 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:57.150291 22895 raft_consensus.cc:2764] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:19:57.151178 22895 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:57.152406 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.153378 17314 raft_consensus.cc:2410] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:19:57.154325 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.157202 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.157125 22813 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.154891 17362 leader_election.cc:400] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14.
I20260709 13:19:57.158733 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.159044 17362 leader_election.cc:403] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:57.159556 17322 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:19:57.159809 22813 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.160772 22903 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.160991 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:57.161502 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 328036us
I20260709 13:19:57.162220 17285 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:57.162479 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:57.163264 22740 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:57.163645 22740 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.163754 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:57.164044 22740 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.166131 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:57.167330 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.168459 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.169094 17316 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
W20260709 13:19:57.192024 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.160666 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.156520 22812 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:57.170384 17471 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:57.171471 22740 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.200485 22711 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:57.197961 22812 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:57.201694 22740 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:57.171988 22771 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.172158 22718 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.202220 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:57.201871 22812 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.202931 17321 raft_consensus.cc:2368] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14.
I20260709 13:19:57.172755 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:57.154505 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:57.176023 22562 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:57.202978 22812 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.172935 17469 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:57.177789 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.161028 22681 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:19:57.178126 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.179203 22863 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:57.179122 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.204037 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:57.222339 17321 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.205054 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.182008 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.226511 22646 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:57.226825 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.227413 22646 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:57.227767 22646 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:57.228024 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.182946 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.228538 22646 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.184695 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.188164 22899 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:57.230387 17320 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:57.230504 22646 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.231001 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:57.153386 22902 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:57.231549 17320 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:57.199115 22627 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:57.231990 22902 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:19:57.155339 22744 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:19:57.202669 22718 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.233800 22645 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.234808 22718 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:57.172678 22754 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.204255 22861 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:19:57.235622 22754 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.205714 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:57.237510 17389 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.237679 22754 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.238484 22902 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.231616 17393 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 11.
I20260709 13:19:57.206256 22809 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:19:57.241374 22809 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:57.241716 22809 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:57.242501 22809 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.243700 22809 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:57.199738 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.245324 22902 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.245617 17471 raft_consensus.cc:2368] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13.
I20260709 13:19:57.233098 22744 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.246465 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.247026 17471 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:57.247784 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.248291 17471 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:57.248520 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.248638 22744 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:57.249966 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.181349 17317 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:57.253947 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:57.191305 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 172256us
I20260709 13:19:57.207484 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.210887 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:57.263252 17391 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:57.211939 17462 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:19:57.221434 17318 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:57.210479 17392 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:57.207935 17470 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:57.209446 17394 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:57.212486 17463 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:57.267942 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:57.264173 17469 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:57.264674 17314 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:57.210876 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:57.268915 17391 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 10.
W20260709 13:19:57.271579 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 61594.3us
I20260709 13:19:57.267481 17394 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:57.267830 17465 raft_consensus.cc:2376] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13. Re-sending same reply.
W20260709 13:19:57.275949 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.287150 17994 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:57.304260 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.209156 22681 consensus_queue.cc:1243] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:57.208937 22876 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:57.304280 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.306277 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:57.306593 17462 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:57.307467 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.308272 17465 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:19:57.212107 22863 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:57.310288 17391 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:57.313802 17998 raft_consensus.cc:2368] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19.
I20260709 13:19:57.217885 22896 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.345736 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.303494 22857 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:57.303628 17394 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.349072 17319 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:19:57.358877 17463 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:57.302801 22628 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.008s
W20260709 13:19:57.304953 22900 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.148s	user 0.000s	sys 0.007s
I20260709 13:19:57.354043 17471 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:57.357852 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.356158 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:57.361177 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.203563 22771 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.305790 22768 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.152637 22761 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.373306 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.381265 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.382157 17471 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:57.382864 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.383512 17471 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:57.384150 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.340883 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.377372 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.379194 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:57.389891 17993 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.391114 17434 leader_election.cc:400] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14.
I20260709 13:19:57.391571 17434 leader_election.cc:403] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:57.384753 17320 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:19:57.345618 22812 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:57.410485 22812 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.412475 22812 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:57.372550 22857 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:57.413566 22857 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.345991 22681 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:19:57.416788 22899 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:57.418092 22774 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.419699 22899 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.420332 22899 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.421936 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:57.423916 22899 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.372478 22896 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.426887 22896 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:57.438761 22744 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14.
W20260709 13:19:57.439715 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48782.7us
I20260709 13:19:57.440804 22744 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:57.442356 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:57.443496 22580 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:57.444559 22580 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:19:57.445137 22781 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.445780 22781 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:57.445758 22580 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.448280 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:57.448988 17395 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:57.449361 17396 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:57.450182 17395 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:57.396548 17321 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:57.398089 22898 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.398149 22887 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.142s	user 0.000s	sys 0.009s
I20260709 13:19:57.398526 17394 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:57.398243 22863 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.399690 17995 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:19:57.400323 22860 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.001s
I20260709 13:19:57.400573 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:57.403023 22765 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:57.484273 22863 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:57.405494 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.486085 22740 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:57.486603 22740 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:57.487493 22740 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:57.490563 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 90069.5us
I20260709 13:19:57.406299 17465 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:57.409708 22761 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.469558 22898 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.517792 22898 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.475689 22812 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:57.518591 22812 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:57.519660 22812 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:57.524928 22901 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.151s	user 0.000s	sys 0.005s
I20260709 13:19:57.458061 17471 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:57.452854 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:57.528482 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 75714.9us
W20260709 13:19:57.458841 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 198160us
I20260709 13:19:57.529871 17993 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:57.460448 17463 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:19:57.473905 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.532500 17462 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:57.474507 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.461431 17469 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:19:57.462976 17466 raft_consensus.cc:2376] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16. Re-sending same reply.
I20260709 13:19:57.405365 22903 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14.
I20260709 13:19:57.493870 17389 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:19:57.503268 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.503611 22771 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:57.473762 22860 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.394299 22768 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.548923 22876 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:57.530587 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:57.543797 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.550519 22768 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.550777 17471 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:19:57.551739 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.545972 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.374338 22628 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.552744 17471 raft_consensus.cc:2410] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:19:57.558110 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.559260 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.561797 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:57.562400 17396 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:57.566761 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.570353 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.547295 22898 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:57.577001 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.581379 17313 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:57.582034 17470 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:19:57.582834 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 52330.6us
W20260709 13:19:57.593451 22888 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:19:57.594813 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3341) took 1101 ms. Trace:
I20260709 13:19:57.595182 17468 rpcz_store.cc:276] 0709 13:19:56.493153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.557890 (+ 64737us) service_pool.cc:224] Handling call
0709 13:19:56.566128 (+  8238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:56.744175 (+178047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.744220 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:56.752218 (+  7998us) log.cc:844] Serialized 26 byte log entry
0709 13:19:56.815090 (+ 62872us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:56.815176 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.815265 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:57.594569 (+779304us) raft_consensus.cc:1685] finished
0709 13:19:57.594590 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.594756 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1755,"raft.queue_time_us":27681,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":9926,"thread_start_us":185286,"threads_started":2,"wal-append.queue_time_us":238710}
W20260709 13:19:57.597494 22897 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 13:19:57.598075 17470 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:57.598670 22910 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:57.599216 22910 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.599599 22910 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:57.606976 17397 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
W20260709 13:19:57.610282 22892 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:57.611626 17315 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:19:57.612465 22860 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.616338 22628 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.542898 22863 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
W20260709 13:19:57.619110 22775 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.769s	user 0.007s	sys 0.004s
I20260709 13:19:57.619709 22775 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:57.584882 22898 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.622141 22898 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:57.630036 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.586565 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:57.639434 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 52969us
I20260709 13:19:57.638664 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:57.648090 17471 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:57.652321 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:57.655735 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.655922 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:57.662174 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:57.663038 17396 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.666719 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:57.671790 17462 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:57.673321 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:57.634586 22645 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.647111 22646 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:57.677500 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.649668 22903 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:57.682222 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.682703 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.682952 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:57.683375 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.683720 17471 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 11: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:57.679998 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:57.684682 17999 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:57.686599 17995 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:19:57.677353 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.688856 17318 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8.
I20260709 13:19:57.667685 22562 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.693910 17998 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:57.710947 17462 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:19:57.694587 17962 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.076s	sys 0.112s
W20260709 13:19:57.711825 17962 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.077s	sys 0.112s
W20260709 13:19:57.712180 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 556758us
W20260709 13:19:57.703486 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.706931 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.716639 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:57.719686 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:57.683996 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:57.681236 22646 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.727713 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:57.733675 17318 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:19:57.728013 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 44113.4us
W20260709 13:19:57.728710 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 301044us
I20260709 13:19:57.684991 22903 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:57.742762 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:57.743623 17993 raft_consensus.cc:2368] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14.
I20260709 13:19:57.744431 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:57.746543 17285 leader_election.cc:400] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19.
I20260709 13:19:57.692204 22893 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:57.749616 17285 leader_election.cc:403] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:57.754593 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:57.726400 22768 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:57.687515 22645 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.774003 17962 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:57.776634 22824 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:57.777007 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:57.777117 22824 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:57.777237 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:57.777707 22824 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.781304 22768 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:57.782094 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:57.784417 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:57.786022 22876 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:57.785178 22768 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:57.787032 22768 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:57.787503 22768 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:57.777781 17993 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:57.789256 22771 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.789963 22771 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:57.792251 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.792811 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.793639 17318 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:19:57.786448 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:57.795260 22627 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19.
I20260709 13:19:57.796285 22771 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:57.801249 17991 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:57.737445 22646 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:57.803370 22768 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.808187 22768 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.810046 22645 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:57.815855 22809 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
I20260709 13:19:57.816016 22768 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:57.743798 22562 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.819718 22562 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.817206 22824 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:57.826339 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.826923 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 171103us
W20260709 13:19:57.828083 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.828752 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:57.830286 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:57.831357 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:57.830790 22824 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:57.837808 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.740027 22903 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.844259 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:57.773857 22711 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.853082 17321 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:19:57.855342 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 80928.2us
I20260709 13:19:57.855847 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:57.856377 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.774955 22774 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:19:57.859206 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.859741 17462 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.861931 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:57.904877 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.908749 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.862396 22914 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:57.863471 22802 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.848958 22893 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:57.937463 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 54227.8us
I20260709 13:19:57.945010 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:57.863881 22628 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:57.940773 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:57.948639 17467 raft_consensus.cc:2368] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19.
W20260709 13:19:57.949023 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62232.3us
I20260709 13:19:57.949829 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:57.864496 22824 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:57.852119 22711 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:57.956519 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:57.967671 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.960633 17360 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:57.972612 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 919) took 1311 ms. Trace:
I20260709 13:19:57.976372 17467 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:57.973031 17314 rpcz_store.cc:276] 0709 13:19:56.660784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.204057 (+543273us) service_pool.cc:224] Handling call
0709 13:19:57.260291 (+ 56234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.269569 (+  9278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.972430 (+702861us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b54003facd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:57.972561 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128536832}
I20260709 13:19:57.955969 22896 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.089115 22896 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:58.089694 22896 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.975142 22914 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.090869 22914 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:58.091354 22914 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.093631 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:58.094487 17467 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:19:58.095513 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:58.096386 17467 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:58.097440 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:57.975695 22916 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.098820 22711 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:58.105384 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:19:58.106961 22893 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:58.112066 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:58.064239 22915 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:19:58.066709 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:58.070698 22646 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:57.958495 22824 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:19:58.119901 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 159324us
I20260709 13:19:58.194628 22809 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.195016 22616 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.195202 22809 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.195508 22616 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.197163 22718 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.198161 22809 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:58.198387 17467 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:58.191823 17462 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:19:58.197849 22718 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.203269 22718 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:58.192528 17396 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 13:19:58.223791 17396 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:57.972121 22902 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.968974 22628 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:58.226167 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:58.228149 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:58.222761 22580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.040s	sys 0.036s
I20260709 13:19:58.242065 17388 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
W20260709 13:19:58.230015 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 443612us
W20260709 13:19:58.242822 22910 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.005s
I20260709 13:19:58.252238 22910 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.254482 22910 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:58.235469 17397 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:19:58.227771 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 383570us
I20260709 13:19:58.258911 17964 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:58.230362 22775 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:58.261564 22775 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:58.262668 22775 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:58.237874 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:58.265548 17319 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:19:58.197510 22616 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:58.269161 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 2182) took 1416 ms. Trace:
W20260709 13:19:58.226599 22898 consensus_meta.cc:287] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.004s
I20260709 13:19:58.197558 22774 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:19:58.247272 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 463606us
I20260709 13:19:58.232096 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:58.269584 17313 rpcz_store.cc:276] 0709 13:19:56.824967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.163447 (+338480us) service_pool.cc:224] Handling call
0709 13:19:58.241139 (+1077692us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400367c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:58.241309 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940334336}
I20260709 13:19:58.274534 17396 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:58.227057 22681 raft_consensus.cc:2764] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:58.287631 17397 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:19:58.271232 17394 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:58.222507 22824 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.272540 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:58.278165 22916 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.276043 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:58.252261 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.228410 22893 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:58.239670 22802 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:58.294275 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:58.297585 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:58.240132 22911 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:58.313762 17395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.020s
W20260709 13:19:58.314239 17395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.007s	sys 0.020s
W20260709 13:19:58.251186 22580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.040s	sys 0.036s
I20260709 13:19:58.298758 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:58.276724 22501 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:19:58.330150 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.352406 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:58.353875 17469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.021s	sys 0.056s
W20260709 13:19:58.356015 17469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.022s	sys 0.056s
I20260709 13:19:58.349670 22627 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:58.368659 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:58.367179 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:58.299043 22893 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.275957 22898 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:58.427976 17392 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:19:58.428303 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:58.350826 22501 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:58.440858 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:58.315552 22910 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:58.357738 22627 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:58.453310 22923 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:19:58.420944 17360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 2.240s (SENT) [suppressed 24 similar messages]
W20260709 13:19:58.457757 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 626459us
I20260709 13:19:58.459657 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.316550 22774 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:58.351537 22911 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:58.468377 17397 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:19:58.471606 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:58.472782 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:19:58.473150 17318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.016s	sys 0.025s
W20260709 13:19:58.473498 17318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.016s	sys 0.025s
I20260709 13:19:58.474771 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.459024 22627 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.471984 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:58.479633 17396 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:19:58.481946 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:58.475903 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:58.482640 17396 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:58.430704 22893 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:58.484357 22920 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:19:58.484709 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:58.484380 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:58.496619 17397 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:19:58.496742 17997 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:19:58.501133 17990 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:58.480809 22925 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.494275 22895 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:58.517685 17315 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 909) took 1959 ms (client timeout 1728 ms). Trace:
I20260709 13:19:58.481549 22924 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:58.521226 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3358) took 1153 ms. Trace:
I20260709 13:19:58.532817 17463 rpcz_store.cc:276] 0709 13:19:57.368027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.634681 (+266654us) service_pool.cc:224] Handling call
0709 13:19:57.664064 (+ 29383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.670011 (+  5947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.670063 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.670676 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.955014 (+284338us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:57.955070 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.955163 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.521012 (+565849us) raft_consensus.cc:1685] finished
0709 13:19:58.521034 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.521171 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6402,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":6208,"thread_start_us":224078,"threads_started":1,"wal-append.queue_time_us":607910}
I20260709 13:19:58.460675 22910 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.471123 22927 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:58.530514 17315 rpcz_store.cc:269] 0709 13:19:56.558091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.558237 (+   146us) service_pool.cc:224] Handling call
0709 13:19:58.517487 (+1959250us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b540035b1d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:58.517614 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2289263488}
I20260709 13:19:58.539407 22927 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.539986 22927 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:58.523788 22913 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.680s	user 0.004s	sys 0.031s
I20260709 13:19:58.531622 22930 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:58.541569 22930 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:58.541980 22930 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.546224 17315 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:19:58.536033 17390 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:58.538406 22646 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:58.458565 22628 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.553846 17389 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:19:58.561576 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 309409us
I20260709 13:19:58.562687 17962 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:58.523125 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.007s	sys 0.018s
W20260709 13:19:58.579643 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.007s	sys 0.018s
W20260709 13:19:58.580031 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 629392us
I20260709 13:19:58.580936 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.600699 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3362) took 1189 ms. Trace:
W20260709 13:19:58.601341 22931 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:19:58.601230 17469 rpcz_store.cc:276] 0709 13:19:57.410887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.651228 (+240341us) service_pool.cc:224] Handling call
0709 13:19:57.679051 (+ 27823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.718950 (+ 39899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.718999 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.742875 (+ 23876us) log.cc:844] Serialized 26 byte log entry
0709 13:19:58.357073 (+614198us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:58.357109 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.357183 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.600437 (+243254us) raft_consensus.cc:1685] finished
0709 13:19:58.600461 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.600622 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3385,"raft.queue_time_us":27843,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":5947,"thread_start_us":511152,"threads_started":1,"wal-append.queue_time_us":718981}
I20260709 13:19:58.603291 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2023) took 1080 ms. Trace:
I20260709 13:19:58.604096 22781 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.604774 22781 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.607532 22781 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:58.608247 22781 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:58.616240 22914 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.003s
I20260709 13:19:58.620067 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1398) took 1314 ms. Trace:
I20260709 13:19:58.621699 22898 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:58.626314 22911 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:58.628412 22774 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:58.603634 17471 rpcz_store.cc:276] 0709 13:19:57.522847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.688165 (+165318us) service_pool.cc:224] Handling call
0709 13:19:57.725531 (+ 37366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.734715 (+  9184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.734747 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.776081 (+ 41334us) log.cc:844] Serialized 26 byte log entry
0709 13:19:58.312557 (+536476us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:58.312605 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.312684 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.603057 (+290373us) raft_consensus.cc:1685] finished
0709 13:19:58.603077 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.603233 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":460306,"threads_started":1,"wal-append.queue_time_us":630167}
I20260709 13:19:58.630824 22681 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:58.631333 22681 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.631726 22681 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:58.620643 17994 rpcz_store.cc:276] 0709 13:19:57.347687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.348274 (+   587us) service_pool.cc:224] Handling call
0709 13:19:57.348579 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.411647 (+ 63068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.411690 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:57.411748 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:57.411792 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.619708 (+1207916us) spinlock_profiling.cc:243] Waited 62.7 ms on lock 0x7b5400472a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:58.619776 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.619983 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144301312}
I20260709 13:19:58.556365 22501 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.638851 22501 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.640280 22813 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:58.641433 22813 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.532967 22925 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:58.644387 22925 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:58.647203 17389 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:58.603987 22627 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.537093 22895 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.653250 22812 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:58.657538 22903 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.806s	user 0.011s	sys 0.000s
W20260709 13:19:58.658089 17362 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.008s	sys 0.032s
W20260709 13:19:58.704638 17362 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.009s	sys 0.033s
W20260709 13:19:58.705018 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 843790us
I20260709 13:19:58.659209 22910 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:58.649184 22914 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.589598 22580 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:58.667550 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 237090us
I20260709 13:19:58.674731 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.713172 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.714399 22711 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:58.715553 22711 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:58.717176 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.718117 22616 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:58.723628 22562 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.724138 22562 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:58.724716 22925 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.725258 22925 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.726228 22562 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:58.727265 22616 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:58.727849 22925 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:58.728461 17314 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:58.727977 22616 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.731261 22616 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:58.732143 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:58.733520 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 258830us
I20260709 13:19:58.735055 17314 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:19:58.735317 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 263384us
W20260709 13:19:58.739605 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.742108 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.743650 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:58.649425 22927 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.744606 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2136) took 1187 ms. Trace:
I20260709 13:19:58.745188 17393 rpcz_store.cc:276] 0709 13:19:57.557278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.557879 (+   601us) service_pool.cc:224] Handling call
0709 13:19:57.576323 (+ 18444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.627611 (+ 51288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.627661 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.628216 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.884556 (+256340us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:58.454605 (+570049us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.744268 (+289663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.744344 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.744388 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:58.744403 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.744532 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":653035,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":56,"raft.queue_time_us":174029,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"thread_start_us":1023337,"threads_started":3,"wal-append.queue_time_us":684393}
W20260709 13:19:58.747750 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 220268us
I20260709 13:19:58.748760 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.769518 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:58.777344 17360 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:58.785039 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:58.785717 17391 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.783785 17360 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:19:58.768698 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59036.2us
I20260709 13:19:58.789551 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:58.805109 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.806702 17287 leader_election.cc:400] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19.
I20260709 13:19:58.755923 22562 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.818279 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:58.707415 22903 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.814260 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:58.817113 17990 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:58.790802 17362 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:58.816625 22902 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 13:19:58.821305 22902 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.822181 22902 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.822331 22914 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:58.823143 22902 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.823657 22902 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:58.824141 22902 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.824357 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:58.825067 17995 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:58.829043 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 2139) took 1167 ms. Trace:
I20260709 13:19:58.829442 17394 rpcz_store.cc:276] 0709 13:19:57.661935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.681848 (+ 19913us) service_pool.cc:224] Handling call
0709 13:19:58.828815 (+1146967us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540023c8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:58.828977 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266238848}
I20260709 13:19:58.829535 22925 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:58.819785 17314 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:19:58.818858 17320 raft_consensus.cc:2376] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 8. Re-sending same reply.
I20260709 13:19:58.790906 22910 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.755936 22891 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:19:58.842535 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 97872us
I20260709 13:19:58.843719 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.846925 17395 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:58.849153 17391 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
W20260709 13:19:58.851912 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 2135) took 1496 ms (client timeout 1724 ms). Trace:
W20260709 13:19:58.854390 17391 rpcz_store.cc:269] 0709 13:19:57.355067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.784729 (+1429662us) service_pool.cc:224] Handling call
0709 13:19:58.851837 (+ 67108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:58.823952 22562 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:58.791507 22774 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:19:58.860659 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:58.862375 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:19:58.865233 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 74508.4us
I20260709 13:19:58.865660 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.866109 17362 leader_election.cc:400] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13.
I20260709 13:19:58.866533 17362 leader_election.cc:403] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:58.866998 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 304415us
I20260709 13:19:58.838717 22910 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.866014 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:58.871942 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:58.858227 22938 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.881111 22891 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 12. Current term is 13.
I20260709 13:19:58.882337 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:58.883673 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:58.885197 22891 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:58.885660 22891 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.886070 22891 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:58.880307 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:58.867944 22813 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:19:58.913501 22945 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:58.915341 22927 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:58.858575 22939 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:58.917675 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:58.925160 22914 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:58.925140 22943 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.858021 22616 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:58.928181 17996 raft_consensus.cc:1217] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.8->[13.9-14.10]   Dedup: 14.10->[]
I20260709 13:19:58.943738 17996 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: [13.9-14.10]
I20260709 13:19:58.874711 22910 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.929170 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1047) took 1155 ms. Trace:
I20260709 13:19:58.949841 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:58.950875 17990 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:19:58.856483 22861 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:19:58.921269 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:58.953383 17998 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:19:58.930660 22940 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:58.950003 17992 rpcz_store.cc:276] 0709 13:19:57.773622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.778972 (+  5350us) service_pool.cc:224] Handling call
0709 13:19:57.779228 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.779444 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:58.295988 (+516544us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.927782 (+631794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.927835 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:58.927884 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.927951 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.929109 (+  1158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62806,"prepare.queue_time_us":77379,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1670,"raft.queue_time_us":80051,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":48,"spinlock_wait_cycles":2816,"thread_start_us":1069205,"threads_started":3,"wal-append.queue_time_us":494517}
I20260709 13:19:58.956126 17995 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:19:58.957228 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1042) took 1239 ms. Trace:
I20260709 13:19:58.960340 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:58.937759 22944 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.965081 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:58.938747 22927 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:58.943255 22627 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:58.970103 17998 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
W20260709 13:19:58.980314 22937 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:19:58.985152 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:58.986085 17992 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
W20260709 13:19:58.987496 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 197792us
I20260709 13:19:58.989050 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:58.989815 17391 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.956497 22945 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:58.956535 22940 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:58.959678 22768 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:59.010931 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:59.011570 17394 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.012143 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.012809 17393 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:19:58.967440 22939 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:59.020138 17391 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:58.955047 22943 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:59.021689 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 204296us
I20260709 13:19:59.022595 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:58.961593 22616 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.987365 22775 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:59.027246 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:59.043207 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 159620us
I20260709 13:19:59.044737 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:19:59.019253 22824 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.000s
I20260709 13:19:59.046150 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.049770 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.051182 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.052397 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.053004 17471 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:19:59.054507 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.055171 17388 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:59.056032 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.061188 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.061843 17391 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
W20260709 13:19:59.067883 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 187654us
I20260709 13:19:59.020876 22939 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:59.019942 22895 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.074892 17467 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:59.077673 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.078357 17470 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:19:59.078871 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:59.083552 22616 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.085177 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:59.086860 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:59.087476 17389 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.093178 17998 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:59.095781 17389 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:59.073269 22939 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:59.105252 22949 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:59.070669 22824 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:58.960472 17999 rpcz_store.cc:276] 0709 13:19:57.724374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.733149 (+  8775us) service_pool.cc:224] Handling call
0709 13:19:57.770699 (+ 37550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.770931 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:19:57.843999 (+ 73068us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.638524 (+794525us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b1800383b60. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:19:58.956645 (+318121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.956697 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:58.956796 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.957021 (+   225us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.957164 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72272,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1719,"raft.queue_time_us":110,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":99,"spinlock_wait_cycles":4751104,"thread_start_us":317832,"threads_started":1}
I20260709 13:19:59.103024 17963 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:59.115293 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.115912 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:59.021380 22924 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:59.109931 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.111761 17997 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:19:59.043226 22948 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.015151 22945 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.045120 22775 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.115957 17471 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:59.021131 22744 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:19:59.120350 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:59.154649 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 137067us
I20260709 13:19:59.117571 17394 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:59.155709 17434 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:59.124424 22917 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:19:59.166272 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:19:59.150157 22781 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 13:19:59.169811 22781 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:59.170591 17994 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:59.171031 22965 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.171622 22965 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.174000 22965 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.174990 22861 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.175465 22861 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.177803 22861 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:19:59.178898 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.180800 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.182372 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.182952 17314 raft_consensus.cc:2376] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13. Re-sending same reply.
I20260709 13:19:59.184199 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:59.163007 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:59.148164 22812 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:59.146730 22950 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:59.128499 22863 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:59.119016 22893 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 13:19:59.147580 22903 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:19:59.194389 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 85420.1us
I20260709 13:19:59.191593 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:59.139277 22945 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.159138 22616 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:59.200213 17389 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:59.209579 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.157565 22891 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.124287 22681 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.145433 22824 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:59.130079 22943 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.208161 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:59.229913 17313 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:59.232354 22616 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.230788 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.216209 22958 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:59.211262 22910 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:59.201228 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 45612.7us
I20260709 13:19:59.235685 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3374) took 1395 ms. Trace:
W20260709 13:19:59.200563 22930 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.003s
I20260709 13:19:59.270463 22930 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.203337 22863 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.195724 22961 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:19:59.246212 22967 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:59.244985 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:59.272789 22967 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.274243 22863 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.203835 22812 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:59.274617 17395 rpcz_store.cc:276] 0709 13:19:57.840125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.550625 (+710500us) service_pool.cc:224] Handling call
0709 13:19:58.551232 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.857080 (+305848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.235331 (+378251us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54004128d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:59.235599 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679588224}
I20260709 13:19:59.275193 22967 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.275614 22812 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.221859 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.137425 22948 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.277067 22775 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.277153 22924 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.266806 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.268579 17287 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:59.285830 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 55144.6us
I20260709 13:19:59.207398 22744 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:59.284196 22910 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.278925 22948 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.122654 22940 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 7, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.283380 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:59.284348 22945 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:59.256570 22958 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.279794 17467 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:59.210551 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:59.237682 22903 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:59.289233 17392 raft_consensus.cc:2368] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13.
I20260709 13:19:59.289424 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.286969 22813 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:59.287621 22744 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:59.317163 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 106681us
W20260709 13:19:59.279083 22501 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.001s
I20260709 13:19:59.295794 22616 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.203603 22893 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.325125 22616 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:19:59.328596 22878 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:59.290813 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:59.300300 22895 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:59.329257 22878 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.321846 22910 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:59.329749 22878 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.328429 22616 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.331037 22962 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:59.331802 22616 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.331676 22962 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.333349 22947 raft_consensus.cc:2764] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 13:19:59.334542 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45229us
I20260709 13:19:59.335664 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.336723 22910 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:59.346087 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 55339.2us
I20260709 13:19:59.332199 17320 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:19:59.304574 22824 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:59.348057 17287 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:59.300464 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 97358us
I20260709 13:19:59.304064 22958 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.360770 17390 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:19:59.369760 17390 pending_rounds.cc:85] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 9
I20260709 13:19:59.370085 17390 pending_rounds.cc:107] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:19:59.370330 17390 raft_consensus.cc:2889] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:59.372733 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:59.361428 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 170860us
I20260709 13:19:59.378253 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.321074 22744 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:59.322805 22896 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.233s	user 0.014s	sys 0.000s
I20260709 13:19:59.375952 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.321007 22945 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:59.327272 22940 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.348119 22946 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:59.397461 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 127054us
I20260709 13:19:59.370947 22943 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:59.360888 22628 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:59.385581 22910 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.317854 22903 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.402624 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:59.321393 22813 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.412967 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.414297 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.417999 17467 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:19:59.421943 17468 raft_consensus.cc:2410] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:19:59.398223 22824 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.410997 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:19:59.409487 22902 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
I20260709 13:19:59.404767 22943 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.432428 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.409044 22501 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:59.408536 22946 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:59.393435 22896 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.429340 22898 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:59.443138 22943 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.416545 22628 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.474656 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:59.459141 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 83283.9us
I20260709 13:19:59.463037 22898 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.434350 22824 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.501673 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 2154) took 1647 ms. Trace:
I20260709 13:19:59.555450 17397 rpcz_store.cc:276] 0709 13:19:57.854184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.472542 (+618358us) service_pool.cc:224] Handling call
0709 13:19:59.501438 (+1028896us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b54002be154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:59.501584 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53026048}
I20260709 13:19:59.445175 22902 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.472124 22861 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:59.469440 22891 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.510452 22969 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.140s
I20260709 13:19:59.514803 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2151) took 1702 ms. Trace:
I20260709 13:19:59.515766 22934 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:59.574064 22934 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:59.574543 22934 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.516227 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:59.577172 17998 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:19:59.578226 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:59.578787 17998 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:59.591111 22968 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:59.591631 22968 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:19:59.517112 22959 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:59.593788 22962 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:59.602458 22934 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.605451 22768 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:59.606281 22896 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.607831 22903 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.608389 22893 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.608999 22934 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.610069 22813 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.553138 22946 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.616612 22930 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:59.626011 22628 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.482344 22980 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.537719 22974 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.505801 22945 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.627058 22980 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.627125 22974 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.506379 22681 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.629442 22974 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.533246 22967 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:59.592478 22968 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.630009 22967 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.630363 22968 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.535315 22895 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:59.631117 22895 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.569916 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:59.554659 22898 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.633169 17990 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:59.561414 22911 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:59.634447 22911 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:59.635324 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 973) took 1162 ms. Trace:
I20260709 13:19:59.635535 22911 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:19:59.631922 22939 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.527s	user 0.002s	sys 0.009s
I20260709 13:19:59.637518 22939 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.572717 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:59.685340 17999 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.564401 17390 rpcz_store.cc:276] 0709 13:19:57.834227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.552425 (+718198us) service_pool.cc:224] Handling call
0709 13:19:58.577448 (+ 25023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.383017 (+805569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.514528 (+131511us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b540009b5d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:19:59.514739 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800593152}
I20260709 13:19:59.606102 22768 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.691749 22768 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:59.490995 22501 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:59.630424 22967 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.571198 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:19:59.554960 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.698256 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:59.699674 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:59.701422 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:59.701783 17963 leader_election.cc:400] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13.
I20260709 13:19:59.702273 17963 leader_election.cc:403] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:59.703387 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:59.705678 22501 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:59.706799 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:19:59.708626 17390 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:59.645219 22911 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.646762 22861 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:19:59.710392 22861 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.635910 17996 rpcz_store.cc:276] 0709 13:19:58.472871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.473421 (+   550us) service_pool.cc:224] Handling call
0709 13:19:58.928075 (+454654us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:58.949570 (+ 21495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.635041 (+685471us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54001de2d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:19:59.635243 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021748096}
I20260709 13:19:59.669076 22895 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.671095 22958 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.673120 22902 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.674089 17218 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 7 to 11, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 11 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.677647 22910 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:59.629313 22980 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.672600 22824 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.486121 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.718415 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.728371 17397 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:19:59.741132 17316 raft_consensus.cc:2368] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16.
W20260709 13:19:59.743351 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 257325us
I20260709 13:19:59.744622 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.722985 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.757923 17392 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:19:59.724417 17990 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:59.733208 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.758735 17390 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:59.747144 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:59.721975 17999 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:59.761142 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:59.775030 17360 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:59.729619 22895 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:59.787461 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:59.773607 22974 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:59.729822 22628 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:19:59.792461 22974 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.784049 22902 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:59.792956 22781 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:59.793608 22781 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:19:59.793665 22902 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:59.794934 22974 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:59.781035 22616 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:19:59.774070 22983 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:59.795922 22616 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.797911 22958 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.797833 17218 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.798521 22616 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:19:59.799292 22824 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:59.799993 22824 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:59.800499 22824 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.774238 22768 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13.
I20260709 13:19:59.780723 22968 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:19:59.781929 22910 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:59.801862 22968 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.802306 22910 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:19:59.803272 22910 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.803913 22968 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:19:59.805367 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:59.794634 22781 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.799350 17218 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:19:59.809619 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 381423us
I20260709 13:19:59.811846 17434 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:59.791023 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:59.816397 17218 catalog_manager.cc:5697] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.820878 17218 catalog_manager.cc:5697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.821204 17434 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:59.787400 22501 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:59.756774 22744 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.824175 22968 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:59.828192 22968 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.828625 22968 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:59.828305 17218 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 9 to 11, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 11 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.829949 17218 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.831562 17218 catalog_manager.cc:5697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 10 to 15, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 15 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:19:59.832419 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.820473 22768 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:59.834175 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 449174us
I20260709 13:19:59.837538 17218 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.841009 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.847926 17469 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:19:59.825338 22939 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:19:59.849746 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:19:59.850587 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 106089us
I20260709 13:19:59.839377 17962 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:19:59.794761 22902 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:19:59.819124 22878 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:19:59.860167 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.861184 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:19:59.863873 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.854530 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.852360 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.869343 17962 leader_election.cc:400] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16.
I20260709 13:19:59.866374 17468 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:19:59.873530 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.874328 17320 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:59.879017 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:59.879963 17314 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:19:59.881868 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.886660 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.887581 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.838604 22768 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:59.883535 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:19:59.886883 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:59.838640 22989 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:59.871657 17218 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 7 to 11, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 11 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.894347 17218 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 5 to 11, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 11 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.902833 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.903465 17316 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.902443 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:59.897652 17320 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 9.
I20260709 13:19:59.906183 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:19:59.888486 22924 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:59.888697 22765 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:59.893594 22768 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.909823 17218 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 10 to 14, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 14 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.911955 22895 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:59.911906 17218 catalog_manager.cc:5697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 8 to 12, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 12 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:59.917093 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62669.6us
I20260709 13:19:59.918787 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:19:59.919006 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.917824 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:19:59.907375 17217 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49282 (request call id 327) took 59982 ms (client timeout 15000 ms). Trace:
I20260709 13:19:59.929893 17218 catalog_manager.cc:5697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.942914 17218 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 14 to 18, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 18 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.944808 17218 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 11 to 14, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 14 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.946689 17218 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.916301 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.838397 22616 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:19:59.918249 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:19:59.868186 22945 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:59.949378 17313 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.891242 22774 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:59.885512 22948 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.948807 17218 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:19:59.957540 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:59.988757 17321 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:19:59.958629 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:19:59.960183 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 57345.2us
I20260709 13:19:59.960304 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:19:59.964962 22986 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:59.965464 22775 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:59.961055 22943 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:19:59.956079 22940 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.001s
I20260709 13:19:59.970207 17316 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:19:59.959408 22895 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:59.975422 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:00.031912 17467 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.976447 17462 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:00.032087 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.977277 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.949754 22924 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:19:59.977857 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59686us
I20260709 13:19:59.978226 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:00.038341 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.978387 22965 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:19:59.978713 22861 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.978901 22645 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:59.959981 22989 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:00.048390 22861 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.049666 22989 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.050990 22861 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:00.015672 22986 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:00.052101 22986 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.958796 22899 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:00.053129 22899 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.053596 22899 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:59.979279 22898 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.043764 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:19:59.980798 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:59.977612 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:00.058941 17468 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:19:59.982728 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:19:59.983036 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:59.983673 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:59.985911 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:19:59.986251 17313 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:19:59.863199 22967 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.011307 17391 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:59.994477 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:19:59.993991 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:19:59.992920 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.017678 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:00.022564 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:00.070019 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 47569.3us
I20260709 13:20:00.070107 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.024010 17397 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:00.068831 17314 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
W20260709 13:20:00.068637 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 108421us
I20260709 13:20:00.069058 17319 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:00.068111 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:00.073889 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:00.073925 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:19:59.887778 22930 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.088s
I20260709 13:19:59.917253 22681 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:00.032823 17388 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:00.036145 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.080628 17390 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.037211 17394 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:20:00.036166 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:00.081207 17394 pending_rounds.cc:85] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 10
I20260709 13:20:00.081524 17394 pending_rounds.cc:107] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:20:00.036208 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:00.043311 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:19:59.956620 22984 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.084410 17996 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:00.083671 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:19:59.974647 22824 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.021131 22809 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:00.088253 17315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:00.088959 22809 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.089393 17315 raft_consensus.cc:606] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:00.089607 22809 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.089973 17315 raft_consensus.cc:614] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:59.893302 22580 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:20:00.045322 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:00.093307 22987 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:00.046608 22965 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.047677 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:00.048406 22645 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.915828 22939 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:00.064581 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:00.025631 17396 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:00.067699 22774 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:00.070819 17393 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:20:00.077466 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:00.058862 22998 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:20:00.081835 17394 raft_consensus.cc:2889] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:59.977680 22765 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:20:00.045444 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:00.095569 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:00.052280 22968 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.034682 22501 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.120805 22775 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:20:00.124236 22775 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:00.124601 22775 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:00.125432 22775 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.126540 22775 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.027557 22948 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:00.120998 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44088us
I20260709 13:20:00.130388 22948 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.121162 22863 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.131023 22863 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.132984 22501 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:00.122414 22968 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:00.133988 22983 consensus_queue.cc:1175] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7108577e5754060b7e468a43dfdcdeb" responder_term: 13 status { last_received { term: 13 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 13 index: 9 } }
I20260709 13:20:00.142197 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:00.142848 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:00.079506 22895 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:00.115240 17396 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:00.081452 22940 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:00.080184 22681 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:00.103825 22645 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:00.133080 22863 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:00.143708 17993 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:00.111394 17391 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.106413 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:00.147745 17389 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
W20260709 13:20:00.233338 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 126991us
I20260709 13:20:00.234750 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:00.069790 22768 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:00.208683 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.218277 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.081671 22927 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:20:00.093716 22987 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:00.112581 22971 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:00.264259 17391 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:00.118368 22893 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:00.148686 22911 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:00.273718 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.168717 22681 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:00.101321 22984 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.155393 22950 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.127s
W20260709 13:20:00.291344 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.430500 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 113928us
I20260709 13:20:00.346128 17394 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:00.350018 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:00.311110 17390 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:00.437083 17391 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:19:59.920318 17217 rpcz_store.cc:269] 0709 13:18:59.843512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.899325 (+ 55813us) service_pool.cc:224] Handling call
0709 13:19:59.806353 (+59907028us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:54.957959 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:54.972138 (+ 14179us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:54.972190 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:19:54.972211 (+    21us) tablet.cc:662] Decoding operations
0709 13:19:54.972710 (+   499us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:54.972780 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:54.972811 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:19:54.973257 (+   446us) tablet.cc:701] Row locks acquired
0709 13:19:54.973285 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:19:54.973509 (+   224us) write_op.cc:270] Start()
0709 13:19:54.973657 (+   148us) write_op.cc:276] Timestamp: P: 1783603194973433 usec, L: 0
0709 13:19:54.973687 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:19:54.974632 (+   945us) log.cc:844] Serialized 923 byte log entry
0709 13:19:56.294617 (+1319985us) op_driver.cc:464] REPLICATION: finished
0709 13:19:56.430881 (+136264us) write_op.cc:301] APPLY: starting
0709 13:19:56.430999 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:56.523837 (+ 92838us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:56.523960 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:56.673285 (+149325us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:56.673568 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:19:56.673634 (+    66us) write_op.cc:312] APPLY: finished
0709 13:19:56.673976 (+   342us) log.cc:844] Serialized 33 byte log entry
0709 13:19:56.674156 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:56.674268 (+   112us) write_op.cc:454] Released schema lock
0709 13:19:56.674321 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:56.674768 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:56.674795 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4938050,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":135866,"apply.run_cpu_time_us":7151,"apply.run_wall_time_us":243903,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":1090819,"prepare.run_cpu_time_us":66206,"prepare.run_wall_time_us":728658,"raft.queue_time_us":360709,"raft.run_cpu_time_us":7341,"raft.run_wall_time_us":50459,"replication_time_us":1320631,"thread_start_us":1748208,"threads_started":4,"wal-append.queue_time_us":642684,"wal-append.run_cpu_time_us":17118,"wal-append.run_wall_time_us":2062376}]]}
I20260709 13:20:00.314111 17999 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:00.347914 17990 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:00.393762 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 263284us
W20260709 13:20:00.329474 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 245874us
I20260709 13:20:00.445621 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:00.447350 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:00.448390 17462 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:00.323796 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.449774 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:00.396904 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:00.231734 22939 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:00.457429 17391 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:20:00.459329 17318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7601a632a565453b83b93c1020924101"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:00.229442 22744 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:00.250669 22970 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:20:00.371121 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:00.225971 22765 consensus_queue.cc:1243] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:00.371351 22943 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.252996 22876 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:00.250806 22916 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.250603 22740 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:00.385656 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:00.531351 17993 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:00.519167 17318 raft_consensus.cc:606] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:00.522554 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:00.522895 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:00.520567 22997 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.380s	user 0.001s	sys 0.001s
I20260709 13:20:00.524739 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:00.537562 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 79058.8us
I20260709 13:20:00.537787 17466 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.524948 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:00.315143 22878 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.527767 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:00.527984 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:00.328483 22930 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:00.252681 22969 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.266s
I20260709 13:20:00.532582 17462 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
W20260709 13:20:00.523248 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 85131.5us
I20260709 13:20:00.483551 22893 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:00.533243 17463 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.009s
I20260709 13:20:00.517277 22940 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.541720 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:00.542182 17468 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:00.544236 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:00.521129 22967 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:00.458962 22911 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.281898 22971 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.523313 22965 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:00.459996 22863 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:20:00.552212 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:00.553161 17463 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.014s	sys 0.009s
I20260709 13:20:00.528601 22765 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:20:00.548502 22895 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:00.525794 22876 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.531006 22740 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.546738 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:00.571450 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.572563 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.626976 17396 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:20:00.627331 17391 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:00.627921 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.284299 22924 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.576161 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:00.630088 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 54030.1us
W20260709 13:20:00.576480 17467 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 13:20:00.370990 22987 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.255915 22774 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.577489 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:00.578169 17466 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:20:00.532410 23001 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:00.567256 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:00.562381 22984 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:00.590389 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.592528 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3386) took 1177 ms. Trace:
I20260709 13:20:00.563679 23013 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.594619 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:00.595844 23007 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:20:00.534689 22916 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.631208 17467 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:00.667178 17993 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:00.667484 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 119849us
I20260709 13:20:00.634864 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.637571 17994 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:00.645927 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.587280 22768 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.550532 22930 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.544708 22946 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:20:00.587548 22898 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:00.654623 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 87446.6us
I20260709 13:20:00.625944 22876 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.632156 17396 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:00.648190 23000 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:20:00.726068 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.651235 22974 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.665481 17470 rpcz_store.cc:276] 0709 13:19:59.415152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.415875 (+   723us) service_pool.cc:224] Handling call
0709 13:19:59.429783 (+ 13908us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:59.541364 (+111581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.541431 (+    67us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:59.548119 (+  6688us) log.cc:844] Serialized 52 byte log entry
0709 13:19:59.959563 (+411444us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:59.965398 (+  5835us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.982738 (+ 17340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.982817 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.592281 (+609464us) raft_consensus.cc:1685] finished
0709 13:20:00.592303 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.592462 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24941,"prepare.queue_time_us":5347,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":128304,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":4455,"thread_start_us":306956,"threads_started":2,"wal-append.queue_time_us":343516}
I20260709 13:20:00.716073 17388 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:00.645416 22967 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:00.632434 22740 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.581043 22968 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
W20260709 13:20:00.668033 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 123708us
I20260709 13:20:00.645622 22744 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:20:00.569820 22940 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.725975 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.726851 17394 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:00.651759 22580 consensus_queue.cc:1175] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c23a664ebf3347a4934dee377c8b5101" responder_term: 15 status { last_received { term: 13 index: 7 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:20:00.727713 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 61664.6us
I20260709 13:20:00.727739 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.730562 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.739645 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.740065 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.717798 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.740643 17396 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.740759 17397 raft_consensus.cc:2376] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13. Re-sending same reply.
W20260709 13:20:00.731135 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.668563 22962 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:00.745617 22962 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.748238 22962 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:00.725221 22946 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:00.748997 22946 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:00.750036 22946 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.751350 22946 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.665351 17392 raft_consensus.cc:2376] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15. Re-sending same reply.
I20260709 13:20:00.734903 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:00.740176 17388 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.757642 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.758049 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:00.759704 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:00.764309 17388 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:00.741698 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.765691 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.766413 17397 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:00.766925 22878 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:00.767125 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.767302 23019 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:00.672896 22863 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:00.768667 22863 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:00.769337 22971 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.769544 22863 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.771032 23016 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:00.770820 22895 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.742322 17391 raft_consensus.cc:2376] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14. Re-sending same reply.
W20260709 13:20:00.744766 23012 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:20:00.714907 23013 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.786396 17392 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:00.767714 22878 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.768137 23019 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:00.768242 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.774066 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.780823 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.733148 22967 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.788884 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:00.773934 22775 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.647s	user 0.006s	sys 0.006s
I20260709 13:20:00.728991 22989 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:00.799844 17391 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:00.773708 23004 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 13:20:00.788442 17320 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:00.807993 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:00.811880 17388 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:00.820466 17391 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
W20260709 13:20:00.820889 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.822129 17396 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:00.829638 17397 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:20:00.818413 22899 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.006s
I20260709 13:20:00.732616 22974 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.654788 23001 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.803004 22967 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:00.840770 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:00.723456 22893 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.828246 22768 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.852293 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.835276 22813 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.843385 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.853148 17394 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:00.798772 23017 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:20:00.817761 22989 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.869499 22916 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:00.843727 23013 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.842518 22899 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.886296 22878 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.888468 22781 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.889310 22930 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.892607 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:00.892814 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:00.893268 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:00.950892 17996 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:00.937232 17435 leader_election.cc:336] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.724s (SENT)
I20260709 13:20:00.918263 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:00.951854 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:00.841435 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 81814.2us
I20260709 13:20:00.961055 22968 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:00.956571 22898 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:20:00.872721 22645 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.002s
I20260709 13:20:00.967717 22898 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.967916 22645 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.969434 23025 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:00.969774 22940 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:00.888365 22974 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:00.857991 22768 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.972031 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:00.972654 22768 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:00.947187 23003 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.586s	user 0.000s	sys 0.002s
I20260709 13:20:00.970268 23025 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:00.910291 22986 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.858s	user 0.006s	sys 0.005s
W20260709 13:20:00.912767 22809 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.822s	user 0.002s	sys 0.008s
I20260709 13:20:00.947502 23019 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:00.966024 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:00.934549 22681 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:00.984747 22681 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.985267 17390 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:00.947841 22939 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:00.987268 22939 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.862149 22813 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.994589 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:00.973483 23001 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.995726 22645 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:01.008385 22898 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.980662 22809 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.009558 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.010407 17394 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:01.004262 22813 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:01.011281 22809 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:00.998592 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3393) took 1006 ms. Trace:
I20260709 13:20:01.013015 17389 rpcz_store.cc:276] 0709 13:19:59.992022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.992163 (+   141us) service_pool.cc:224] Handling call
0709 13:20:00.998429 (+1006266us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540038ed54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:00.998536 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250157824}
I20260709 13:20:01.001888 22989 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:01.004184 17395 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:01.005527 22876 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:01.006065 23025 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:00.981473 22986 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:00.979627 23019 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:01.006829 22740 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:01.016255 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:01.017553 17996 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:01.021775 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:01.018703 22580 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.027362 22501 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.043817 22580 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.046066 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3392) took 1054 ms. Trace:
I20260709 13:20:01.046331 22580 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:01.046514 17395 rpcz_store.cc:276] 0709 13:19:59.991721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.992281 (+   560us) service_pool.cc:224] Handling call
0709 13:20:01.045915 (+1053634us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b540009c4d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:01.046012 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2175427328}
W20260709 13:20:01.047428 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.048949 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3395) took 1184 ms. Trace:
I20260709 13:20:01.049180 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.049358 17465 rpcz_store.cc:276] 0709 13:19:59.867196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.867475 (+   279us) service_pool.cc:224] Handling call
0709 13:19:59.889795 (+ 22320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.890183 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.890213 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.986452 (+ 96239us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.083734 (+ 97282us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:00.094075 (+ 10341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.094157 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.946545 (+852388us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:01.048666 (+102121us) raft_consensus.cc:1685] finished
0709 13:20:01.048687 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.048895 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7167,"raft.queue_time_us":2436,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6041,"spinlock_wait_cycles":110145920,"thread_start_us":95727,"threads_started":1,"wal-append.queue_time_us":374372}
I20260709 13:20:01.053035 22893 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.054288 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:01.019138 22681 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:01.055142 17389 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.038097 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:01.056058 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.057200 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:01.057619 22927 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.059998 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:01.062183 17395 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.062458 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.065941 17962 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:01.073618 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.069805 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:01.077847 22616 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:01.082681 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:01.083330 17996 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.084723 17319 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:01.088876 17319 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:01.085865 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:01.087214 17389 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:01.109493 17996 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:01.065404 22946 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.063470 22893 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.128013 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:01.130152 17996 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:20:01.064975 22580 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.089871 22930 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:01.131861 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:01.133355 17319 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:01.135448 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:01.135874 17435 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.979s (SENT)
I20260709 13:20:01.136289 17315 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:01.067009 22924 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.136665 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:01.137248 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:01.078440 22813 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:01.138247 17313 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:01.140210 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:01.141871 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.080550 22974 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:01.143219 17467 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:01.145432 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.139286 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:01.144052 17316 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:01.146157 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:01.138733 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 70057.5us
I20260709 13:20:01.143234 17322 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:20:01.060628 22934 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:20:01.079671 22616 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:01.066447 22968 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:20:01.078660 23001 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:20:01.074788 22927 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.157639 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.158298 17463 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:01.156580 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.144640 22813 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.161549 17464 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:20:01.131646 22930 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.184157 17465 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:01.192706 23023 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:01.193660 23023 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:01.183290 22813 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.153445 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:01.203413 17470 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:01.209265 17994 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.154373 22974 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:01.160391 22958 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:01.135759 22967 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:01.219352 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 66009.1us
I20260709 13:20:01.220474 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:01.221725 17434 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.228044 17994 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:20:01.201303 22946 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:20:01.228477 22934 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:01.225420 22958 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:01.234071 23026 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:20:01.123119 23019 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.250345 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:01.231563 22744 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:01.231572 22501 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:01.252442 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:01.241750 22765 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.258033 22927 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:01.267877 17395 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:01.259310 22974 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.229755 22616 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:01.263818 23033 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:20:01.250100 22740 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:01.279536 22616 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.252714 22744 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.278475 22934 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:01.252712 23023 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:01.285869 22968 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:01.291194 22987 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:01.296546 23027 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.462s	user 0.006s	sys 0.000s
I20260709 13:20:01.297067 23019 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.299145 22925 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:01.299557 22925 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:01.300069 22924 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:01.300504 22930 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:01.304080 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:01.307888 17434 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:01.300405 22925 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:01.309294 22925 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:01.312734 17435 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.129s (SENT)
I20260709 13:20:01.287129 22744 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:01.320294 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.321205 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.321337 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.321903 17466 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:01.323242 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.322983 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.321847 17462 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.321724 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.323972 17471 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:20:01.303056 23001 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.325182 17468 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.326370 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.329398 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.330029 17464 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.324723 22962 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:01.330642 22962 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:01.331591 22962 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:01.337330 17462 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:20:01.341292 23010 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.818s	user 0.004s	sys 0.000s
I20260709 13:20:01.333274 22934 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:01.342366 22934 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:01.343338 22934 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.346710 22824 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:01.348875 22916 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:01.349368 22916 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:01.350066 22744 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.350273 22916 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.351254 17465 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:01.351693 22916 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.357318 22967 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:01.362071 17464 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:01.364598 22744 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:01.365378 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.370115 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.370334 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:01.371240 23042 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:01.371539 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:01.371966 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.372226 17395 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.373011 23043 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.375867 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.378021 22876 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:01.378947 17389 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:01.379426 22986 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:01.380417 22899 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:01.380975 17463 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:01.384449 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.384739 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.385161 17388 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:20:01.337548 17434 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:01.386077 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 48622.1us
I20260709 13:20:01.386571 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.387189 17388 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:01.387631 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.388300 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:01.389149 17321 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:01.389047 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.389887 17396 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:01.390542 17996 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:01.390980 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:01.391806 17434 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:01.393093 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:01.396353 17395 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:01.397083 17393 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:20:01.397282 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.397821 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:01.399705 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.388267 17397 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:20:01.403424 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:01.403563 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.404301 17397 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:01.406312 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.406870 23043 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:01.407505 23043 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.407903 23043 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.408140 22980 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:01.408643 22980 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.409029 22980 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.333073 23001 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.411162 22967 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:20:01.421279 22967 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:01.421705 22967 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:01.422161 23001 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:01.422991 17466 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:20:01.423349 17466 pending_rounds.cc:85] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 7
I20260709 13:20:01.423586 17466 pending_rounds.cc:107] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:20:01.411409 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.424048 17466 raft_consensus.cc:2889] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:01.424321 17463 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.425153 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.425796 17389 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:01.426800 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.413686 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.427712 17464 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
I20260709 13:20:01.428789 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.429307 22744 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:01.414563 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.430919 17469 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:01.431727 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.433223 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.433997 17392 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:01.434873 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.435489 17991 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:01.411721 22911 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:01.436517 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:01.437125 17993 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:01.434911 17995 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:20:01.415465 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.439374 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:01.426851 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.441829 17466 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.444438 22876 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:01.419961 22987 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:01.422674 22967 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:01.504314 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.506201 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:01.508519 17314 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:01.510326 17317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:01.510959 17317 raft_consensus.cc:606] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.511279 17317 raft_consensus.cc:614] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:01.511804 17394 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:01.513883 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:01.430157 22744 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.419212 22958 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.450564 22911 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:01.451421 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:01.401393 22962 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:01.521409 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 70047.7us
I20260709 13:20:01.523214 17395 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:01.451515 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:01.452867 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.500221 17468 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:01.432754 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:01.429414 17464 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.406949 17465 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:01.412577 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:01.404863 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:01.534238 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 129448us
I20260709 13:20:01.536123 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:01.459918 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55821.3us
I20260709 13:20:01.462800 17466 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:01.467777 17463 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:01.476532 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:01.516171 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:01.538694 17389 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.519411 17393 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:20:01.522327 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:01.541807 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:01.543486 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 92054.9us
I20260709 13:20:01.546844 22501 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:01.547468 22501 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:01.548046 22501 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.549101 22939 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:01.542210 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:01.557626 17468 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:01.562197 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.501919 22580 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:01.567678 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 91315.8us
I20260709 13:20:01.519589 22744 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:01.575371 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:01.579753 17464 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:01.580533 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.581653 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:01.552229 22939 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:01.585654 17389 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:01.553483 22781 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:01.578065 22628 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:01.588138 17287 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:01.588482 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:01.566051 23023 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:01.569989 22924 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:01.574582 22925 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:01.593111 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:01.577303 22974 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.576738 22899 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.581296 22969 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.586145 22967 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.576781 22893 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:01.591266 22711 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.621009 17320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:01.587659 23016 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:01.591055 22628 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.587477 22989 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.606360 22876 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:01.612330 22740 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:01.602223 22924 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.605963 22878 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:01.591584 22945 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:01.598662 22781 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:01.579341 22580 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.615279 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:01.597512 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:01.647011 22628 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.635310 22616 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:01.649314 23001 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:01.654136 22876 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:01.684439 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 69276.5us
I20260709 13:20:01.692152 17286 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:01.685885 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88498.5us
I20260709 13:20:01.624768 22899 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.671049 22740 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:01.695981 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:01.639277 22893 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:01.628033 22969 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:01.667148 22924 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:01.726213 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 137815us
I20260709 13:20:01.644779 23016 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.751032 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.753404 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:01.754654 23047 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:20:01.755338 23044 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.755672 22965 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:20:01.756065 23044 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:01.756714 23044 consensus_queue.cc:1243] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:01.757195 23044 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.757718 22781 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.766006 23016 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:01.768426 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.769438 22765 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:01.771080 17996 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:01.772257 22580 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:01.772643 17995 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:01.775457 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:01.776155 17991 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:01.752049 22983 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:01.777294 17435 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.768577 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:01.779326 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:01.682123 22878 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:01.783034 17320 raft_consensus.cc:606] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.785485 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:01.786546 17320 raft_consensus.cc:614] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:01.693307 22942 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:01.796115 17964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.020s	sys 0.027s
I20260709 13:20:01.788038 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:01.796494 17964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.020s	sys 0.027s
I20260709 13:20:01.693009 22616 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:01.694181 22876 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:01.781373 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 85471.5us
I20260709 13:20:01.798341 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:01.675369 22945 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.801600 17470 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:01.696303 22985 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:01.778007 23049 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:20:01.777248 22740 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:01.806023 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 657388us
I20260709 13:20:01.796736 22965 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:01.691733 22980 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:01.800175 22813 consensus_meta.cc:287] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.595s	user 0.002s	sys 0.009s
I20260709 13:20:01.808148 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:01.802090 22902 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:01.725273 22927 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.837745 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 245129us
I20260709 13:20:01.795432 22765 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.752863 22775 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:20:01.800580 23044 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.798640 22989 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:01.884270 22989 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:01.694705 23001 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:01.862941 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 54875.9us
I20260709 13:20:01.888854 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.890324 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.862249 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.837059 22985 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.862941 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:01.775518 22924 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.807403 22983 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:01.802543 23019 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:20:01.798880 23016 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:20:01.895236 23055 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:01.897644 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:01.836346 22809 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:20:01.906579 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:01.905552 22985 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.881294 23009 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:01.889093 22989 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.860199 22902 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:01.940521 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:01.917542 22925 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:01.865931 22927 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.919536 22768 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:01.953022 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.922828 22952 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.864982 22813 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.859836 22878 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:01.888324 23053 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:20:01.948235 23009 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:02.014463 22958 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.016618 22983 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.020902 23009 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:02.026022 23043 consensus_meta.cc:287] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 13:20:02.026456 23043 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.029650 23059 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:02.031199 23059 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:02.032155 22969 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.033185 23058 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:02.036409 17994 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:20:01.963539 22902 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.028585 23043 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:02.033867 23058 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:02.005446 22781 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:01.931766 22616 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.082839 22781 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.083696 22781 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.084496 23058 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.094440 17320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:02.095094 17320 raft_consensus.cc:606] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:02.095528 17320 raft_consensus.cc:614] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:02.100018 23009 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.043310 22899 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:02.102262 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 263361us
W20260709 13:20:02.095518 22962 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
W20260709 13:20:02.103483 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 305226us
W20260709 13:20:02.103623 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 207446us
I20260709 13:20:02.097097 22987 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:02.110653 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 171960us
I20260709 13:20:02.110024 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:02.108114 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:02.111521 17471 raft_consensus.cc:2410] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:20:02.109459 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:02.109640 17287 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:02.101907 22768 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:02.120055 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.120663 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:02.129374 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:02.131181 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:02.103098 23067 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:02.109297 22945 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.150767 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:02.112874 22893 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.160301 17466 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:02.150435 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:02.156023 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:02.154810 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:02.161610 17995 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:02.156895 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:02.161770 17464 raft_consensus.cc:2376] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15. Re-sending same reply.
I20260709 13:20:02.162343 17468 raft_consensus.cc:2368] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13.
I20260709 13:20:02.157738 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:02.112591 22987 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:02.164565 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:02.165475 17394 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.133880 22986 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:02.124162 23055 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:02.175781 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:02.177714 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46567us
I20260709 13:20:02.168674 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:02.133739 22983 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:02.136598 22980 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:02.197260 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:02.198088 17462 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:20:02.199193 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:02.170256 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:02.171465 17468 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:20:02.139554 22899 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:02.101408 22942 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:02.173064 22645 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:02.173398 23077 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.223591 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:02.173668 22958 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:02.159291 22580 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:02.154266 23067 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.115079 23044 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:20:02.174307 22911 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.174510 22987 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.148000 22916 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.175220 23009 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.207127 22986 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:02.182639 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:02.217963 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 47814.5us
I20260709 13:20:02.221557 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:02.227346 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:02.228209 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:02.230202 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:02.206665 22628 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:20:02.228458 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:02.240342 17995 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:20:02.242617 17394 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:20:02.184288 22824 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:02.233453 22813 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.196964 22983 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:02.250651 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:02.190093 17466 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:02.217228 22924 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.215849 22781 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:02.259317 17315 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:20:02.277196 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:02.247495 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:02.279245 17995 pending_rounds.cc:85] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 12
I20260709 13:20:02.454216 17995 pending_rounds.cc:107] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:20:02.278486 17992 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:20:02.281379 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 53045.2us
I20260709 13:20:02.454571 17995 raft_consensus.cc:2889] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:02.284543 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:02.457864 17468 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:02.233022 23077 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.288094 17393 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:02.303303 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:02.286124 22628 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.233498 22969 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:20:02.269027 22980 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:02.290760 22983 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.289682 23075 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:02.246665 22580 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.278050 22987 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:02.288666 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:02.471241 22967 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.836s	user 0.008s	sys 0.004s
I20260709 13:20:02.255934 22911 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.459565 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:02.243515 22899 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:02.460582 17465 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:02.273588 23016 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.258222 22645 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:02.463887 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 179586us
I20260709 13:20:02.511620 17964 leader_election.cc:400] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 12 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13.
I20260709 13:20:02.286640 22824 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:02.447665 23063 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 13:20:02.284584 23058 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.268503 22916 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:02.493587 23071 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.294s	user 0.004s	sys 0.004s
W20260709 13:20:02.501289 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 213448us
W20260709 13:20:02.484403 22501 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.934s	user 0.013s	sys 0.000s
W20260709 13:20:02.506045 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 46610.4us
I20260709 13:20:02.524065 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:02.512627 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:02.490962 23075 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:02.553105 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.499529 22878 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:20:02.477440 22924 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:20:02.523150 22985 consensus_meta.cc:287] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.004s
I20260709 13:20:02.313259 22942 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.565428 17397 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:02.526151 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:02.460399 22986 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.556269 23075 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.575379 17467 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
W20260709 13:20:02.578382 22744 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.988s	user 0.009s	sys 0.004s
W20260709 13:20:02.579370 23081 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:20:02.566412 22878 consensus_queue.cc:1243] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:02.518461 23016 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.560928 22501 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:02.626752 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 111334us
I20260709 13:20:02.628115 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:02.593185 22768 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:02.590379 22958 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:02.579720 22985 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.631726 22924 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:02.635890 23089 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:02.636765 23099 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:02.637447 23088 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:02.638482 23077 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:02.705251 22965 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.848s	user 0.008s	sys 0.004s
W20260709 13:20:02.645630 23091 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:20:02.761524 17321 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
W20260709 13:20:02.649554 23085 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:20:02.652369 23097 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:20:02.653465 23092 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:20:02.599540 22899 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:02.655506 23081 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:20:02.656453 22989 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.000s
I20260709 13:20:02.656796 23086 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:02.658468 22501 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:02.662475 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:02.772698 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 110352us
I20260709 13:20:02.663808 23059 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:20:02.667687 17218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 220) took 13092 ms (client timeout 15000 ms). Trace:
I20260709 13:20:02.670168 22893 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:02.670673 23068 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:02.670953 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1074) took 1364 ms. Trace:
I20260709 13:20:02.674072 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3422) took 1307 ms. Trace:
W20260709 13:20:02.675278 22902 consensus_meta.cc:287] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.001s
W20260709 13:20:02.676203 23066 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.563s	user 0.001s	sys 0.000s
I20260709 13:20:02.676453 22580 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:02.680807 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.681314 22628 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.684439 22916 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:02.690137 22824 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:02.589563 22744 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.694124 23058 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.601857 22645 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:02.694792 17471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3419) took 1328 ms (client timeout 1725 ms). Trace:
W20260709 13:20:02.820894 17471 rpcz_store.cc:269] 0709 13:20:01.365901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.412358 (+ 46457us) service_pool.cc:224] Handling call
0709 13:20:02.694565 (+1282207us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54001f7a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:02.694719 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328859392}
I20260709 13:20:02.632766 23083 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.632645 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 106640us
I20260709 13:20:02.641460 22911 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.822837 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:02.633489 23067 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:02.743450 17999 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:02.757346 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:02.756819 22876 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.950s	user 0.005s	sys 0.006s
I20260709 13:20:02.760092 22965 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:02.782454 17994 rpcz_store.cc:276] 0709 13:20:01.306915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.307121 (+   206us) service_pool.cc:224] Handling call
0709 13:20:01.307550 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.036819 (+729269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.670724 (+633905us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b5400246154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:02.670897 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675603712}
I20260709 13:20:02.781626 17467 rpcz_store.cc:276] 0709 13:20:01.366720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.415219 (+ 48499us) service_pool.cc:224] Handling call
0709 13:20:02.673872 (+1258653us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540041f5d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:02.673976 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2460614528}
I20260709 13:20:02.773363 22989 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.799913 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:02.804129 17315 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:02.806627 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:02.812332 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:02.852284 17396 raft_consensus.cc:2393] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:02.814275 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:02.855216 17317 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:02.781978 23088 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:02.824072 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:02.827904 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:02.797529 22809 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:02.800532 22987 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.832283 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:02.797011 22902 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:02.775151 17218 rpcz_store.cc:269] 0709 13:19:49.575284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.575562 (+   278us) service_pool.cc:224] Handling call
0709 13:20:02.667593 (+13092031us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:00.522942 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:00.590504 (+ 67562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:00.590557 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:20:00.590573 (+    16us) tablet.cc:662] Decoding operations
0709 13:20:00.737973 (+147400us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:00.753791 (+ 15818us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:00.753830 (+    39us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:20:00.755323 (+  1493us) tablet.cc:701] Row locks acquired
0709 13:20:00.755376 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:20:00.755551 (+   175us) write_op.cc:270] Start()
0709 13:20:00.755706 (+   155us) write_op.cc:276] Timestamp: P: 1783603200755482 usec, L: 0
0709 13:20:00.755729 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:20:00.756551 (+   822us) log.cc:844] Serialized 6990 byte log entry
0709 13:20:01.185670 (+429119us) op_driver.cc:464] REPLICATION: finished
0709 13:20:01.278968 (+ 93298us) write_op.cc:301] APPLY: starting
0709 13:20:01.279059 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:01.420478 (+141419us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:01.420600 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:01.751980 (+331380us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:01.758051 (+  6071us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:20:01.758099 (+    48us) write_op.cc:312] APPLY: finished
0709 13:20:01.758494 (+   395us) log.cc:844] Serialized 164 byte log entry
0709 13:20:01.758680 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:01.758836 (+   156us) write_op.cc:454] Released schema lock
0709 13:20:01.758887 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:01.759317 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:01.759345 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1124255,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":84536,"apply.run_cpu_time_us":25382,"apply.run_wall_time_us":480292,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":270111,"prepare.run_cpu_time_us":80027,"prepare.run_wall_time_us":542931,"raft.queue_time_us":146599,"raft.run_cpu_time_us":4797,"raft.run_wall_time_us":114344,"replication_time_us":398878,"spinlock_wait_cycles":120192,"thread_start_us":493567,"threads_started":4,"wal-append.queue_time_us":225902,"wal-append.run_cpu_time_us":30505,"wal-append.run_wall_time_us":1780062}]]}
I20260709 13:20:02.758548 23095 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:02.839409 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:02.863147 17397 raft_consensus.cc:2410] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:20:02.833938 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:02.868274 17393 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.763494 23099 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.865267 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:02.785709 22893 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.870996 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:02.873741 17471 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:02.876408 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:02.877173 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:02.878324 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:02.879354 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:02.880357 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:02.835564 23083 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.883154 17990 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:02.824014 22958 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.887065 23088 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:02.888155 23088 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.890143 22930 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.890633 22902 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:02.893028 23089 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:20:02.897193 23100 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:20:02.897187 22616 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:02.834741 22628 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:02.785924 23059 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.899395 17388 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:02.774812 23086 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.898926 17314 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:02.850842 22916 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:02.904469 17991 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: [15.12-16.13]
I20260709 13:20:02.911110 22744 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:02.915673 23001 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.917461 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 993) took 1147 ms. Trace:
I20260709 13:20:02.918780 23099 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:02.908537 23054 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:20:02.898044 22616 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.853453 22580 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.002677 17469 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:02.926180 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:02.867198 22824 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.808475 23068 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.933403 17313 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:02.872181 22924 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:20:02.964184 23110 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:02.957609 22934 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:20:02.964708 23079 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:03.013428 17465 pending_rounds.cc:85] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 7
I20260709 13:20:03.013833 17465 pending_rounds.cc:107] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:20:03.014127 17465 raft_consensus.cc:2889] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:03.014799 17393 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:02.965031 17394 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
W20260709 13:20:03.017108 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 90191.3us
I20260709 13:20:02.872247 22809 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.966109 17392 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:02.966198 23086 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:02.847785 22876 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:02.967118 17993 rpcz_store.cc:276] 0709 13:20:01.770164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.773568 (+  3404us) service_pool.cc:224] Handling call
0709 13:20:01.773893 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:01.774222 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.774245 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:01.774738 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:20:01.935431 (+160693us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:01.935474 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.935539 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:02.675420 (+739881us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:02.917168 (+241748us) raft_consensus.cc:1685] finished
0709 13:20:02.917192 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.917397 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68123,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":11714,"spinlock_wait_cycles":8140672,"thread_start_us":160336,"threads_started":1,"wal-append.queue_time_us":331381}
I20260709 13:20:02.904191 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:03.024243 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:02.999874 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:03.025761 17464 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:02.933138 23067 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.002185 23016 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:02.872434 22987 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:02.958514 23058 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:03.035755 22809 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.035642 23058 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.028483 22924 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.037060 22924 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.037873 23058 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.012105 23068 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:02.906026 23023 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:03.040805 23023 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:02.959028 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 55964.2us
I20260709 13:20:02.960006 22916 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.008185 22985 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.007534 22580 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.031498 22986 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:03.031589 23099 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:03.032456 22876 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.027163 22824 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:03.033455 22987 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.033874 17471 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.047430 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:03.051532 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:03.066702 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 48665us
I20260709 13:20:03.067180 17995 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:03.051779 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.053730 17392 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:20:03.028730 22983 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 13:20:03.027535 23096 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.061028 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.061767 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:03.080821 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:03.065217 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.082866 17991 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:03.019665 23110 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.094122 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.096868 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:03.030378 23067 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:03.098603 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 190223us
I20260709 13:20:03.137936 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.111511 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:03.141052 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.060174 23102 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:20:03.065949 22824 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:03.141727 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.151453 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:03.114323 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:03.141775 17471 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
W20260709 13:20:03.145042 23113 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:20:03.145658 23126 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:03.146754 23104 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:20:03.139424 17464 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:03.125311 22911 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.093644 23089 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:03.085620 23109 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.116499 22740 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.108s
I20260709 13:20:03.177085 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:03.236076 23109 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:03.183109 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 68964.9us
I20260709 13:20:03.067128 23099 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.140594 23054 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.115583 23108 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:03.108297 22989 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.099731 22986 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:03.224887 22911 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.116992 23016 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:20:03.094954 23096 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.116875 23058 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:20:03.234345 23110 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.235503 22916 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.085474 22934 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:20:03.098515 23068 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:03.084702 22974 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 13:20:03.157229 22924 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:03.157600 22902 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:03.085726 22983 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.251713 17962 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:03.217366 23095 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.228475 23067 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.257220 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.260414 22911 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.262187 23099 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.266094 22986 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.237365 22893 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.254743 23059 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.243840 23089 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:03.256166 22616 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:03.340512 23089 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.345595 22893 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.346305 22893 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:03.347069 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 208688us
W20260709 13:20:03.333482 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 81895us
I20260709 13:20:03.334061 22924 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:03.330945 23110 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.349440 23110 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.350970 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:03.351486 23118 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:20:03.331799 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:03.361006 17322 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:03.459825 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.460747 17992 raft_consensus.cc:2393] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:03.457818 22902 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.462397 22902 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.460757 23096 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.469029 23109 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.474946 23121 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.475867 23110 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.475646 23121 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.478456 23121 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:03.268317 22824 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.481072 22911 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.481880 22824 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.483249 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.483924 22911 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.483897 17991 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:03.486008 22893 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.459151 23023 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:03.301327 22876 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:03.493255 22876 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.495961 22876 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.256556 23054 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.506786 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.510392 17285 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:03.511485 23069 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.511935 23069 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.512353 23069 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.516741 22893 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.517350 22893 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.519835 22893 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.457796 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:03.510406 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3431) took 1316 ms. Trace:
I20260709 13:20:03.522918 17462 rpcz_store.cc:276] 0709 13:20:02.194184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.200172 (+  5988us) service_pool.cc:224] Handling call
0709 13:20:02.200511 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.565316 (+364805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.565346 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:02.565832 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:20:02.761807 (+195975us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:02.761848 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.509895 (+748047us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54002e2f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:03.509970 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.510035 (+    65us) raft_consensus.cc:1685] finished
0709 13:20:03.510054 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.510334 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":586,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":18671,"spinlock_wait_cycles":838144768,"thread_start_us":195695,"threads_started":1,"wal-append.queue_time_us":306930}
I20260709 13:20:03.508510 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.525578 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.527189 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.528951 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:03.529791 17997 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:03.521894 23069 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.532347 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.561561 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.609117 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.610147 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.610896 17319 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:03.612823 17999 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:20:03.601018 22930 consensus_meta.cc:287] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.710s	user 0.003s	sys 0.007s
I20260709 13:20:03.612542 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.608686 23089 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.666025 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:03.699461 22983 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.710827 17319 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:03.712639 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.721316 23069 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.725137 23107 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.725519 23089 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.726013 23107 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.727276 17994 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:20:03.711031 23075 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.111s	user 0.012s	sys 0.000s
I20260709 13:20:03.728750 23075 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.620971 22930 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:03.620942 23116 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:20:03.739312 17965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.028s	sys 0.027s
I20260709 13:20:03.741074 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:03.742189 17965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.029s	sys 0.027s
I20260709 13:20:03.742439 17998 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.740275 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.749140 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.750854 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.751571 17997 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:20:03.751799 17995 raft_consensus.cc:2410] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:20:03.737965 22899 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.761982 22899 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.748118 23107 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.766523 23075 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.745016 23116 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.775557 17360 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:03.776994 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.773281 22899 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.779443 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:03.780431 17319 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:03.781329 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.782047 17319 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:03.782811 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.783293 23116 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.778231 23107 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:03.783912 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.783962 23107 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.785171 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.785957 17319 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:03.787350 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.788235 17319 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:03.785327 23107 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.789706 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.790104 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:03.790829 17319 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:03.792476 17319 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:03.793313 23132 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.793807 23132 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.794179 23132 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.794637 23088 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:03.795405 23088 consensus_queue.cc:1243] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:03.797853 17998 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:03.804715 17285 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:03.808281 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:03.809034 17998 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:03.814360 23083 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:03.814554 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.815299 17991 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:03.815794 22768 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:03.807826 22924 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.816349 22768 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.816745 22924 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.817350 23132 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.818197 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2238) took 1008 ms. Trace:
I20260709 13:20:03.807740 23116 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:03.818949 17997 raft_consensus.cc:1217] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 13.11->[15.12-16.13]   Dedup: 15.12->[16.13-16.13]
I20260709 13:20:03.818581 17314 rpcz_store.cc:276] 0709 13:20:02.809867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.810053 (+   186us) service_pool.cc:224] Handling call
0709 13:20:02.810349 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.922712 (+112363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.817927 (+895215us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b54003fbbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:03.818119 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203297024}
I20260709 13:20:03.819644 17997 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: [15.12-16.13]
I20260709 13:20:03.822350 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:03.820945 23116 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:03.823215 22501 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.823800 22501 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.824221 22501 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.824120 23116 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.833354 23064 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:03.833861 23064 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:03.834035 23107 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.834761 23064 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.835913 23132 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:03.837198 23107 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.835932 23064 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.851979 22893 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.853638 22893 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.854663 22927 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.857378 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 942) took 1630 ms. Trace:
I20260709 13:20:03.858146 22893 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.857798 17321 rpcz_store.cc:276] 0709 13:20:02.226629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.229442 (+  2813us) service_pool.cc:224] Handling call
0709 13:20:02.229788 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.762115 (+532327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.857122 (+1095007us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540035b1d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:03.857315 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1222135168}
I20260709 13:20:03.852595 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:03.865487 17998 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.869016 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 997) took 1062 ms. Trace:
I20260709 13:20:03.869467 23107 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.868084 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:03.869524 17990 rpcz_store.cc:276] 0709 13:20:02.806269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.806400 (+   131us) service_pool.cc:224] Handling call
0709 13:20:03.868802 (+1062402us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b540049a2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:03.868954 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71931648}
I20260709 13:20:03.870272 23107 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.871191 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.874229 22924 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:03.874963 22924 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:03.875392 22924 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:03.875816 22924 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:03.880024 17997 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:03.881886 22942 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:03.887018 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1443) took 1645 ms. Trace:
I20260709 13:20:03.887516 17996 rpcz_store.cc:276] 0709 13:20:02.242036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.242134 (+    98us) service_pool.cc:224] Handling call
0709 13:20:02.242389 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.562222 (+319833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.562253 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:02.562298 (+    45us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:02.562329 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.886769 (+1324440us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400590454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:03.886824 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.886958 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735000960}
I20260709 13:20:03.889427 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2236) took 1086 ms. Trace:
I20260709 13:20:03.889869 17322 rpcz_store.cc:276] 0709 13:20:02.803090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.803201 (+   111us) service_pool.cc:224] Handling call
0709 13:20:02.807583 (+  4382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.361620 (+554037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.889225 (+527605us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54003fc0d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:03.889374 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272227712}
I20260709 13:20:03.895520 17392 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:03.896823 17992 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:03.897301 23107 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:03.901082 17395 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:03.901180 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:03.901921 17393 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:03.902065 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:03.902669 17395 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:03.903359 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.904320 17998 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:20:03.905505 22911 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.907032 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:03.907891 17396 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:03.908679 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:03.909472 17396 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:03.858916 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3427) took 1647 ms. Trace:
I20260709 13:20:03.913381 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 941) took 1687 ms. Trace:
I20260709 13:20:03.915303 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:03.916015 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:03.917222 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:03.912984 17389 rpcz_store.cc:276] 0709 13:20:02.211387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.211558 (+   171us) service_pool.cc:224] Handling call
0709 13:20:02.232950 (+ 21392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.800601 (+567651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.800642 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:02.801233 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:20:02.925823 (+124590us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:02.925858 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.858521 (+932663us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540038de54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:03.858567 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.858627 (+    60us) raft_consensus.cc:1685] finished
0709 13:20:03.858640 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.858857 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38363,"raft.queue_time_us":146086,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":47,"spinlock_wait_cycles":668381440,"thread_start_us":317780,"threads_started":2,"wal-append.queue_time_us":301742}
I20260709 13:20:03.913950 17317 rpcz_store.cc:276] 0709 13:20:02.226318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.229364 (+  3046us) service_pool.cc:224] Handling call
0709 13:20:02.252568 (+ 23204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.855706 (+603138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.913069 (+1057363us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54001428d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:03.913302 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385525120}
I20260709 13:20:03.919549 17395 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:03.920421 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:03.905993 22911 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.904234 22501 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.926445 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:03.926997 17396 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:03.929085 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 954) took 1056 ms. Trace:
I20260709 13:20:03.929638 17467 rpcz_store.cc:276] 0709 13:20:02.872476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.873082 (+   606us) service_pool.cc:224] Handling call
0709 13:20:02.874905 (+  1823us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:02.897348 (+ 22443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.897380 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:02.897907 (+   527us) log.cc:844] Serialized 52 byte log entry
0709 13:20:03.107539 (+209632us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:03.137490 (+ 29951us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.927958 (+790468us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b1800486040. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:20:03.928392 (+   434us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.928593 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.928684 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.928861 (+   177us) raft_consensus.cc:1685] finished
0709 13:20:03.928882 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.929019 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65813,"prepare.queue_time_us":32851,"prepare.run_cpu_time_us":5406,"prepare.run_wall_time_us":98489,"raft.queue_time_us":26747,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":16036,"spinlock_wait_cycles":16535424,"thread_start_us":184442,"threads_started":1,"wal-append.queue_time_us":432679}
I20260709 13:20:03.933401 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:03.936791 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:03.937990 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:03.938989 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:03.937318 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:03.939633 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:03.939893 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:03.941999 17393 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 11. Current term is 13. Ops: []
I20260709 13:20:03.942200 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:03.943645 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:03.944595 17394 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:03.942585 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1874) took 1018 ms. Trace:
I20260709 13:20:03.950111 17320 rpcz_store.cc:276] 0709 13:20:02.924588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.027122 (+102534us) service_pool.cc:224] Handling call
0709 13:20:03.939473 (+912351us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:20:03.942533 (+  3060us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8607488}
I20260709 13:20:03.919358 23016 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.953403 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:03.957281 17389 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.954811 17395 raft_consensus.cc:2368] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16.
I20260709 13:20:03.957849 22986 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:03.925714 22965 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:03.966823 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:03.960289 22616 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.967041 22939 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:20:03.956489 23110 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.988358 22616 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:03.989039 23110 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.989470 23110 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.978180 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:03.966076 23083 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:20:03.952924 23079 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:03.948732 23107 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.979645 23088 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:03.943218 22893 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:03.994422 17389 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:04.004658 17393 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:03.929374 22899 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:20:03.948896 22930 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:20:03.934762 22768 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:03.977932 22911 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.009235 22980 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:04.006464 22927 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:04.029517 17394 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:03.978631 23116 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:20:03.985849 22965 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.017572 22916 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.027462 22980 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:04.019047 23107 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:04.018855 22974 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.985152 23016 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.032385 22616 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:04.039808 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 93205.7us
I20260709 13:20:04.015290 23088 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.051069 17360 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:04.041143 22934 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:04.045113 23132 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:04.035061 22927 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.049697 23107 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:04.061474 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 119360us
I20260709 13:20:04.063508 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:04.064484 17997 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:04.055665 22893 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.045308 22916 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.081769 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.082576 17471 raft_consensus.cc:2410] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:04.084164 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:04.085886 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.086678 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.087008 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:04.052551 22974 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.074101 22616 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.091686 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:04.075850 23107 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:04.092831 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.077478 22930 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:04.099205 17997 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.075718 22911 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:04.141781 23058 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.090408 17467 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:04.090394 22968 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:04.078207 23057 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.101128 23149 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:04.086732 23133 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:20:04.106287 22927 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:04.060241 22934 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.116729 22967 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.117738 22711 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.204334 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.205554 17997 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:04.077013 22980 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.123656 23016 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:04.171413 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.207268 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.171945 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.209007 17466 raft_consensus.cc:2410] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:20:04.173699 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:04.086467 23077 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:20:04.175472 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:04.090011 22501 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.177464 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.087229 22893 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.142441 23058 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.121646 17389 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:04.181560 17469 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:04.213827 17470 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:04.167943 22930 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:04.125840 22616 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:04.222911 23056 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:20:04.223551 23153 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:20:04.222929 22927 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:20:04.224395 22974 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.224578 22616 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.225273 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 898) took 2855 ms. Trace:
I20260709 13:20:04.225370 23150 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:04.226583 23150 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:04.227680 23150 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.228330 22930 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.229489 23150 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.236258 22580 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.222080 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.237178 17469 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:04.212085 22711 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.237620 23132 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:04.238860 22902 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:04.239943 22711 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.238109 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:04.241387 17469 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.243614 22775 raft_consensus.cc:993] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:20:04.244228 22775 raft_consensus.cc:1081] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:20:04.245613 22775 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:04.246033 22775 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:04.247058 22775 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.249238 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:04.249603 23087 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:04.250068 23087 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:04.177363 22968 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.250955 23087 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.252049 23087 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:04.252686 22968 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.253585 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.225720 17390 rpcz_store.cc:276] 0709 13:20:01.369927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.372946 (+  3019us) service_pool.cc:224] Handling call
0709 13:20:01.373346 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:01.373711 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:01.582681 (+208970us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.803116 (+220435us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.998237 (+195121us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:02.072797 (+ 74560us) log.cc:844] Serialized 26 byte log entry
0709 13:20:02.073702 (+   905us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:02.073928 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.074155 (+   227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.075029 (+2000874us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b1800420e20. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:04.225046 (+150017us) raft_consensus.cc:1685] finished
0709 13:20:04.225068 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.225205 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4002,"prepare.queue_time_us":414145,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":102,"raft.queue_time_us":384026,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":39174,"spinlock_wait_cycles":9894144,"thread_start_us":604691,"threads_started":3,"wal-append.queue_time_us":412737}
I20260709 13:20:04.177804 23086 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:04.285300 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 68287.1us
I20260709 13:20:04.265156 17396 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:20:04.285802 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:04.286415 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:04.287075 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:04.178017 22924 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.304205 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3433) took 2083 ms. Trace:
I20260709 13:20:04.304723 17388 rpcz_store.cc:276] 0709 13:20:02.220921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.224870 (+  3949us) service_pool.cc:224] Handling call
0709 13:20:02.225136 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.907650 (+682514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.303901 (+1396251us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b5400012554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:04.304133 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550141824}
I20260709 13:20:04.306205 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.307127 17388 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:04.308106 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.311128 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.181654 23057 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.220029 22768 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.220314 23148 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.210698 22967 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.317798 22934 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.296253 23150 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:04.311151 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:04.288934 22775 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.238118 23132 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.333039 22628 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:04.333468 23088 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.319149 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.334753 22965 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.335896 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.336486 17390 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:04.331549 23074 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:04.337201 23074 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:04.337674 17390 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:04.337937 23074 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.339084 23074 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.321233 17998 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:04.330025 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 43648.4us
I20260709 13:20:04.343439 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.343748 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:04.344813 22934 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:04.313658 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:04.346232 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:04.308748 17388 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:20:04.346343 22934 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:04.345074 22974 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:04.346838 22934 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:04.347049 22974 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:04.347424 22916 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.347729 22934 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.347925 22974 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.349179 22934 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.350864 23150 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.351272 22902 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:04.351712 22902 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:04.352087 22902 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.318663 23158 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.353802 22968 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.354753 23058 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:04.354847 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2240) took 1529 ms. Trace:
I20260709 13:20:04.355352 17316 rpcz_store.cc:276] 0709 13:20:02.825648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.825798 (+   150us) service_pool.cc:224] Handling call
0709 13:20:04.354174 (+1528376us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b5800194198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:20:04.354370 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.354545 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.354569 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.354609 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:04.354638 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.354692 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.354795 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22046080}
W20260709 13:20:04.357503 23151 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
I20260709 13:20:04.333567 22628 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:04.358006 23132 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:04.358566 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.363776 17463 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:04.364039 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:04.330797 17469 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:04.367815 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.295632 23086 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.364873 22744 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:04.369980 17469 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:04.503060 23133 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.503032 22744 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.366212 23110 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.463436 22911 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:04.525770 23133 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.505409 23023 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:04.506620 22974 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:04.367808 22939 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:04.507108 23154 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:04.510025 22924 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.510846 23088 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.511317 23107 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.536327 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.515710 23057 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.536971 23110 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.531651 23023 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.537611 23107 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.513021 22768 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.538651 22768 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.539237 23023 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.513640 22948 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:04.552450 17388 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:04.553261 17991 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:04.358542 22628 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.503157 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.554322 17469 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:20:04.517308 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:04.518785 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:04.555305 17997 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:04.523579 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:04.524940 23077 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:04.525487 22967 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.526568 22911 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.535096 22974 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.535548 22968 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.540552 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.557049 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:04.564935 17471 raft_consensus.cc:2410] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:20:04.565353 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:04.536373 22744 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.569602 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:04.569849 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:04.558422 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:04.560092 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:04.545339 23154 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.573347 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:04.559340 23057 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:04.559096 22939 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:04.577381 17471 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:04.586398 17469 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:20:04.590720 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:04.551970 23088 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.562718 22934 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:20:04.577841 23107 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:04.624625 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:04.559005 22948 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.569980 23110 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:04.621619 22501 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:04.628711 22501 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.628479 22939 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.629055 23154 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.629174 22501 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:04.623684 22916 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:04.632582 22916 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.575096 23157 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:20:04.633620 23157 consensus_queue.cc:1243] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:04.634171 22974 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.634840 22916 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.639312 17391 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:04.639693 17391 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:04.592561 22968 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:04.642797 22968 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.643172 22968 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:04.645169 23086 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:04.645368 23162 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:20:04.646881 23150 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.646958 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.623932 22768 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:04.648392 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:04.649032 17389 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:04.649219 23133 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:04.567349 23077 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.649876 22948 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.640388 17391 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:04.651103 17391 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.651331 23077 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:04.626900 23168 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:04.654048 23168 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.656076 23168 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:04.659492 17389 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:04.660985 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.587242 23057 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.566642 23166 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:04.585748 23158 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.627792 23149 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:04.588801 22985 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:04.587304 23058 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:04.666253 23057 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:04.686894 23152 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.547s	user 0.001s	sys 0.000s
I20260709 13:20:04.592341 22902 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.688723 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.689479 17392 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:20:04.690050 23054 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.690409 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.691810 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.676777 22985 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:04.674005 23058 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:04.592706 23073 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:20:04.699842 23058 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.702502 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.715804 17394 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:04.696707 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.705050 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:04.717643 17316 raft_consensus.cc:2410] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:20:04.705708 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:04.707463 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:04.708086 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:04.708164 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:04.709369 17991 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:04.709059 22968 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.709451 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1457) took 1247 ms. Trace:
I20260709 13:20:04.710052 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:04.710839 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:04.711148 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.670856 23149 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:04.713339 17391 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:20:04.714109 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:04.704866 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.690645 22969 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:04.672773 23158 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:04.723031 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:04.774612 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.820703 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.916755 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.817952 17320 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:04.973626 17391 pending_rounds.cc:85] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 12
I20260709 13:20:04.974228 17391 pending_rounds.cc:107] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:20:04.974610 17391 raft_consensus.cc:2889] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:04.831808 17435 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.789s (SENT) [suppressed 19 similar messages]
I20260709 13:20:04.817669 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1454) took 1452 ms. Trace:
I20260709 13:20:04.817615 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:04.929432 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 304862us
I20260709 13:20:04.980180 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:04.866566 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1091) took 1262 ms. Trace:
I20260709 13:20:04.981875 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:04.700687 22893 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:04.983170 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:05.002200 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 288178us
I20260709 13:20:05.002601 17318 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.976948 17995 rpcz_store.cc:276] 0709 13:20:03.364832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.457469 (+ 92637us) service_pool.cc:224] Handling call
0709 13:20:04.714235 (+1256766us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400583ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:04.817593 (+103358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525796736}
W20260709 13:20:04.917529 23167 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:20:04.991626 17994 rpcz_store.cc:276] 0709 13:20:03.604109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.604257 (+   148us) service_pool.cc:224] Handling call
0709 13:20:03.614774 (+ 10517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.727666 (+112892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.866256 (+1138590us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400600ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:04.866489 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257939712}
I20260709 13:20:04.699482 22985 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.000763 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:05.015504 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:04.983385 17992 rpcz_store.cc:276] 0709 13:20:03.462544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.462671 (+   127us) service_pool.cc:224] Handling call
0709 13:20:03.462966 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.897387 (+434421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.709128 (+811741us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400600254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:04.709383 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996934528}
I20260709 13:20:05.011986 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:04.975446 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2198) took 1067 ms. Trace:
I20260709 13:20:05.017298 17391 rpcz_store.cc:276] 0709 13:20:03.907744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.942999 (+ 35255us) service_pool.cc:224] Handling call
0709 13:20:03.960480 (+ 17481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.639194 (+678714us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b54003299a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d6276bdc0 00007f7d627f61c0 00007f7d627f7231 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c
0709 13:20:04.975200 (+336006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.975391 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64533888}
I20260709 13:20:05.015565 17389 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:05.011801 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.021637 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:04.970836 23165 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.015936 17392 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:04.719151 23132 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:04.975332 22939 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.112223 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:05.124497 17394 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 12: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:04.990199 23149 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:05.001853 23019 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:20:04.927450 23088 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.122951 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:04.983651 22969 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.129841 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:05.116182 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.148267 17467 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:20:05.132154 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.011996 22899 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.022405 22924 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:05.129199 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.145207 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.155591 17313 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:20:05.144277 17391 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:20:04.920424 22501 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.111778 22930 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:05.164232 17318 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
W20260709 13:20:05.164798 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 196498us
I20260709 13:20:05.176106 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:05.142865 23132 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.185015 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:05.185832 17467 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:05.189442 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 357668us
I20260709 13:20:05.191022 17396 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:05.191553 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:05.195295 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.197165 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:05.199460 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:05.214761 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:05.216225 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.201066 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:05.223508 17962 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:05.228533 17394 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:05.179418 23089 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.158089 22899 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.141845 22939 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.180680 22930 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:05.165711 22924 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.250180 22628 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.234349 22989 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:05.130475 23165 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.235177 23174 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:05.204353 23132 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.248742 23016 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:05.256534 22628 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.269532 23016 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:05.273190 23170 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:20:05.273386 23016 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:05.275547 23145 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.064s	user 0.009s	sys 0.012s
I20260709 13:20:05.275738 22924 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.257146 22768 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:05.277240 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3437) took 1387 ms. Trace:
W20260709 13:20:05.278159 23171 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:05.273411 22501 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.281028 23058 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.283177 23058 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.284417 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 924) took 1219 ms. Trace:
I20260709 13:20:05.284812 17393 rpcz_store.cc:276] 0709 13:20:04.064970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.065383 (+   413us) service_pool.cc:224] Handling call
0709 13:20:04.088040 (+ 22657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.178946 (+ 90906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.179006 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.204327 (+ 25321us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.519768 (+315441us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:04.519827 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.519924 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.282116 (+762192us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b180031f0c0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:05.284125 (+  2009us) raft_consensus.cc:1685] finished
0709 13:20:05.284147 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.284357 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3828,"raft.queue_time_us":111776,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5035,"spinlock_wait_cycles":11441024,"thread_start_us":361145,"threads_started":2,"wal-append.queue_time_us":304411}
I20260709 13:20:05.291148 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.258121 22989 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.292167 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2048) took 1122 ms. Trace:
I20260709 13:20:05.285409 23148 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:05.293733 23148 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.294109 23148 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.277685 17397 rpcz_store.cc:276] 0709 13:20:03.889543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.890920 (+  1377us) service_pool.cc:224] Handling call
0709 13:20:03.891295 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:03.891688 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.891712 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:03.892292 (+   580us) log.cc:844] Serialized 52 byte log entry
0709 13:20:04.057752 (+165460us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:04.057822 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.057918 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.274984 (+1217066us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:05.276927 (+  1943us) raft_consensus.cc:1685] finished
0709 13:20:05.276951 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.277176 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6274,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":14225664,"thread_start_us":163499,"threads_started":1,"wal-append.queue_time_us":233984}
I20260709 13:20:05.292649 17462 rpcz_store.cc:276] 0709 13:20:04.169801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.290821 (+1121020us) service_pool.cc:224] Handling call
0709 13:20:05.292097 (+  1276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:05.306736 17314 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:05.315145 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 123666us
I20260709 13:20:05.292411 22989 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.255539 23088 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:20:05.326068 22985 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.329414 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1458) took 1865 ms. Trace:
I20260709 13:20:05.329845 17993 rpcz_store.cc:276] 0709 13:20:03.463629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.463762 (+   133us) service_pool.cc:224] Handling call
0709 13:20:03.884949 (+421187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.885380 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.885414 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.885950 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.041887 (+155937us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:04.042517 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.042606 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.110435 (+ 67829us) raft_consensus.cc:1685] finished
0709 13:20:04.110462 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.329092 (+1218630us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b540049a2d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:05.329335 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":732,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":968134272,"thread_start_us":155174,"threads_started":1,"wal-append.queue_time_us":202143,"wal-append.run_cpu_time_us":1726,"wal-append.run_wall_time_us":1025827}
I20260709 13:20:05.333211 17396 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:05.323348 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 138338us
I20260709 13:20:05.335680 17394 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:05.335757 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:05.336083 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:05.336884 17393 raft_consensus.cc:2368] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:05.335831 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:05.339371 17390 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:05.312074 22628 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.340592 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:05.343252 17396 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:05.347586 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:05.347661 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:05.348543 17467 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
W20260709 13:20:05.372222 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.371903 17393 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:05.374450 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:05.375435 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:05.376169 17390 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.377262 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:05.378014 17396 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:05.380203 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:05.340070 23089 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:05.380435 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 156994us
I20260709 13:20:05.389856 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:05.381721 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:05.390694 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:05.356935 23176 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:20:05.392871 17395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 2205) took 1476 ms (client timeout 1789 ms). Trace:
W20260709 13:20:05.395604 17395 rpcz_store.cc:269] 0709 13:20:03.916698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.920210 (+  3512us) service_pool.cc:224] Handling call
0709 13:20:05.392656 (+1472446us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b5400411ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:05.392794 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77239168}
I20260709 13:20:05.397194 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:05.398181 17395 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:05.341743 22968 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:05.350392 22985 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:05.401921 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:05.358174 23132 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.375604 23158 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.353114 23184 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:05.344820 22930 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.376730 23174 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.387502 22969 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.442049 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2057) took 1269 ms. Trace:
I20260709 13:20:05.442466 17463 rpcz_store.cc:276] 0709 13:20:04.172881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.254622 (+ 81741us) service_pool.cc:224] Handling call
0709 13:20:05.441887 (+1187265us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b54002607d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:05.441996 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119326464}
I20260709 13:20:05.445544 22980 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.450991 22899 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.451653 23158 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:05.452358 23158 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.387312 23058 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:05.430871 23180 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.439395 22989 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.453476 22939 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:05.388206 23089 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:05.407228 23088 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:05.435118 23183 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:05.462669 22968 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:05.475901 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.474987 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1012) took 1700 ms. Trace:
I20260709 13:20:05.464483 23184 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:05.440598 23174 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.477525 17990 rpcz_store.cc:276] 0709 13:20:03.774094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.872134 (+ 98040us) service_pool.cc:224] Handling call
0709 13:20:03.872444 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.872666 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:03.934189 (+ 61523us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.643725 (+709536us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b1800224740. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:20:05.474472 (+830747us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:05.474544 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:05.474603 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.474764 (+   161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.474917 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9682,"prepare.queue_time_us":61290,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4494,"raft.queue_time_us":162833,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":9553,"spinlock_wait_cycles":11328896,"thread_start_us":830438,"threads_started":2,"wal-append.queue_time_us":1343453}
I20260709 13:20:05.392266 23175 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:20:05.481532 22989 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:05.480093 23057 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.000s
I20260709 13:20:05.476183 22628 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:05.486842 23165 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:05.487706 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1471) took 1228 ms. Trace:
I20260709 13:20:05.488087 17998 rpcz_store.cc:276] 0709 13:20:04.259680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.259818 (+   138us) service_pool.cc:224] Handling call
0709 13:20:04.311418 (+ 51600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.341475 (+ 30057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.487464 (+1145989us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b5400590454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:05.487648 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22006144}
I20260709 13:20:05.488798 23174 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:05.483845 23184 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.491081 22628 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.463636 23158 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.491524 23184 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:05.492624 22902 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.493814 23158 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:05.494944 23148 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.479787 22968 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.467793 23180 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.485735 23057 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.520104 23180 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:05.566388 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 186216us
W20260709 13:20:05.566553 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 264188us
I20260709 13:20:05.570863 17286 leader_election.cc:400] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:05.571401 17286 leader_election.cc:403] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:05.574149 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:05.434238 17390 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:05.583417 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:05.585394 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 290476us
I20260709 13:20:05.587024 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:05.589648 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 374800us
I20260709 13:20:05.601738 17390 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:05.605757 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:05.608287 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:05.603243 17435 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:05.619879 22740 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:05.623188 22740 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:05.624320 22740 consensus_queue.cc:1243] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:05.626726 22740 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:05.628362 22899 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:05.629618 22899 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:05.630050 22899 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:05.631652 22899 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.635452 22899 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.528116 23149 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.646546 23189 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:05.650772 22968 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:05.652009 22968 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:05.652858 22980 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:05.653580 23175 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:05.653795 23148 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:05.654745 23186 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:05.655275 22968 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.654940 23175 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:05.655953 22968 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.656116 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 2211) took 1134 ms. Trace:
I20260709 13:20:05.657619 23175 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.659274 17391 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:05.497521 23089 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.672251 23089 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.667611 23175 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:05.668293 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 65373.7us
I20260709 13:20:05.668030 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:05.656649 17389 rpcz_store.cc:276] 0709 13:20:04.521941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.660612 (+138671us) service_pool.cc:224] Handling call
0709 13:20:05.655713 (+995101us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54004114d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:05.655914 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813503232}
I20260709 13:20:05.685570 17395 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:05.686379 17389 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:05.687369 17395 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:20:05.699712 17395 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:05.701464 17395 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:05.703409 17395 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:05.705250 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 100520us
I20260709 13:20:05.706983 17390 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:05.709798 23188 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.714810 23149 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:05.717003 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 115523us
I20260709 13:20:05.718400 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:05.724406 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 333639us
I20260709 13:20:05.725849 23165 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:05.724406 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:05.726504 23165 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.727234 23165 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:05.729861 17391 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:05.729956 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:05.711763 23188 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.735038 23194 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:05.736223 23188 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:05.736094 23194 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.739355 23095 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:05.744454 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.746274 17463 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:05.748310 17467 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:05.749655 23057 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:05.749399 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:05.753374 17395 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:05.726027 17360 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:05.763048 22974 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:05.757870 17468 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
W20260709 13:20:05.764446 17468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3447) took 1638 ms (client timeout 2071 ms). Trace:
W20260709 13:20:05.764976 17468 rpcz_store.cc:269] 0709 13:20:04.136430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.743567 (+1607137us) service_pool.cc:224] Handling call
0709 13:20:05.764333 (+ 20766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:05.766148 23149 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:05.770339 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.765723 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:05.772241 23194 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:05.772607 23149 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:05.775935 17468 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:05.777880 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:05.778348 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:05.778717 17462 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.779747 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.780579 17990 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:05.781046 17466 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:05.782698 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 52995.5us
I20260709 13:20:05.782892 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:05.784039 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:05.785207 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.785933 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:05.786830 17463 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.785470 22989 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.787187 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.787551 22989 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.788126 17469 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:05.789752 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 71636.4us
I20260709 13:20:05.791548 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:05.793521 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.793380 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.794322 17466 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:05.794543 17990 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:05.796515 23180 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:05.796583 22768 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:05.797305 22768 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.797798 22768 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.798578 23182 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:05.797411 23180 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.801115 23180 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.788091 22989 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.784567 22628 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.789839 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.813938 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:05.821292 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2066) took 1303 ms. Trace:
I20260709 13:20:05.821727 17470 rpcz_store.cc:276] 0709 13:20:04.517875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.273031 (+755156us) service_pool.cc:224] Handling call
0709 13:20:05.273369 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.498768 (+225399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.498815 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.584354 (+ 85539us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.680008 (+ 95654us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:05.755995 (+ 75987us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.790326 (+ 34331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.790470 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.820907 (+ 30437us) raft_consensus.cc:1685] finished
0709 13:20:05.820929 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.821086 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33129,"prepare.queue_time_us":59136,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":169286,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":21695,"thread_start_us":313336,"threads_started":2,"wal-append.queue_time_us":128173}
I20260709 13:20:05.789932 17467 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:05.825863 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:05.826341 22740 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:05.827319 22740 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.828550 17471 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:05.829258 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:05.829139 23095 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:05.830413 17468 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:05.831210 23095 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:05.831763 23095 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:05.833405 23095 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.834736 17393 pending_rounds.cc:85] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 10
I20260709 13:20:05.834882 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:05.835214 17393 pending_rounds.cc:107] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:20:05.835305 23095 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.835543 17393 raft_consensus.cc:2889] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:05.835722 17467 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.837105 23189 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:05.837599 23189 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.838057 23189 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.838339 23180 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.838522 23132 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.839149 22740 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:05.838999 23180 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.839319 23132 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.840979 17286 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:05.841130 22924 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:05.841701 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50150.8us
I20260709 13:20:05.842342 23164 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:05.842062 22924 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.846881 17462 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:05.848677 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.849568 17470 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
W20260709 13:20:05.852916 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.858657 23016 consensus_meta.cc:287] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.571s	user 0.004s	sys 0.021s
I20260709 13:20:05.859946 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:05.861698 23098 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:05.862646 23098 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.866389 23098 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:05.842833 23164 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.867655 22740 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:05.867857 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:05.867110 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:05.869285 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.870627 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.871999 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.872951 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:05.874194 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.874912 17469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7601a632a565453b83b93c1020924101"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:20:05.877511 17469 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:05.877972 17469 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.859345 23016 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.845896 23089 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:05.885675 17463 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:05.875869 23164 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:05.891918 17470 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:05.887372 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.851197 22628 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.897538 17468 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:05.902191 17466 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:05.903143 23016 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.903446 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.904166 17319 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:05.904778 17313 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:05.905036 17392 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:05.906313 23098 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:05.906927 23098 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:05.903712 17466 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:05.906857 17462 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:05.906927 17990 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:20:05.920024 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:05.922698 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:05.923661 17998 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:05.908355 23098 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.929237 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.929711 23132 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:05.930433 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 77498.8us
I20260709 13:20:05.931318 17434 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:05.936952 23057 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:05.937446 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.938254 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.933861 17469 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.943912 17318 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:05.948618 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:05.949397 17998 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:05.955020 22989 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.956991 23057 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:05.956650 17314 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:05.962050 23165 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.963819 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:05.966826 23016 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.967535 23016 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.968462 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:05.969499 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:05.969627 23016 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.972043 23165 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.974027 23149 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.989362 23180 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:05.959481 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:05.958513 23057 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:05.976974 22628 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.990770 23057 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:05.991963 23057 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:05.992633 22628 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:05.994134 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:05.994424 17470 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:05.994912 17389 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.978235 17317 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.930490 23089 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.989086 23149 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:05.975248 23058 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:05.994428 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:05.997179 17463 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:05.995215 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.002823 17469 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:06.009588 23201 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.008484 23016 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:20:06.005487 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:06.010993 23201 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:06.013630 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.013180 23201 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:06.015413 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.019958 17360 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:06.027706 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:06.028362 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 78922.9us
I20260709 13:20:06.021225 23194 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:06.021706 22989 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:06.028860 17964 connection.cc:256] RPC call timeout handler was delayed by -1.0295832230001452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:20:06.038790 17964 connection.cc:256] RPC call timeout handler was delayed by -1.0268832230001408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:20:06.035490 23194 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:06.046234 23195 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:06.057729 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.032160 23057 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.020459 22968 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.054917 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:06.057760 23194 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:06.041352 23089 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:06.062840 17462 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:06.081470 22768 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.084012 22768 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:06.057454 23195 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:06.100471 23019 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:06.029485 23201 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.103436 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.104305 17994 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:06.077018 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.077440 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.117252 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.124805 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.117389 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:06.074884 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.125777 17993 raft_consensus.cc:2410] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:20:06.125876 23016 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:06.076073 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.084862 23189 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.086220 17464 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:06.087466 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.087822 22968 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:06.088565 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.091912 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:06.095916 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.064518 17467 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:06.098428 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:06.099449 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 68656.1us
I20260709 13:20:06.100895 23195 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.073426 23149 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.099606 23089 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.101230 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.102110 22924 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:06.102098 23019 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.105607 23201 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:06.074409 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 158710us
I20260709 13:20:06.113481 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.114609 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.117285 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:06.130939 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.133001 17990 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:20:06.121345 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:06.136061 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.135977 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:06.145298 17462 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:06.141501 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.148577 17465 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:06.162235 17322 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:06.149201 17315 raft_consensus.cc:2410] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:20:06.148471 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.155388 17389 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:06.164686 17317 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:06.158419 17462 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:06.164152 17994 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
W20260709 13:20:06.166728 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49576.5us
I20260709 13:20:06.168370 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.168217 23102 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:06.148803 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.147145 23019 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.182734 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.183472 17467 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:06.178413 17314 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:06.187294 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.189692 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:06.146854 23089 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.174851 22974 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:06.190384 17463 raft_consensus.cc:2376] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15. Re-sending same reply.
I20260709 13:20:06.193104 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:06.145501 23164 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.195546 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.196170 17471 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:06.199541 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.202221 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.201416 17466 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
W20260709 13:20:06.204272 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 173360us
I20260709 13:20:06.177170 23194 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.206977 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.194571 22974 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.209833 17313 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:06.215348 17998 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:20:06.215742 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.216353 17998 pending_rounds.cc:85] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 12
I20260709 13:20:06.219017 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.206220 23165 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:20:06.220557 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:06.223901 17998 pending_rounds.cc:107] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:20:06.211841 22974 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:06.227104 17998 raft_consensus.cc:2889] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:06.234910 17470 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.237252 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:06.238968 17992 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:06.219827 23102 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:20:06.245903 23019 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.254438 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:06.255259 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.251689 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:06.257190 17469 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:06.257467 17395 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:06.252431 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:06.258114 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:06.258507 17392 raft_consensus.cc:2368] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16.
I20260709 13:20:06.258816 17469 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 13: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:06.259016 17397 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:06.259646 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.255679 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:06.236114 17319 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
I20260709 13:20:06.244551 23016 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:06.253597 17393 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:06.256371 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:06.251296 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:06.265360 17471 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:06.263171 23057 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.271049 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:06.271193 23057 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.273370 23057 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.274073 17390 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:06.274363 23102 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:06.274801 23102 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:06.275143 17394 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:06.277478 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:06.281086 17434 connection.cc:256] RPC call timeout handler was delayed by -1.4229117729998961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 13:20:06.282178 17434 connection.cc:256] RPC call timeout handler was delayed by -1.395011772999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
I20260709 13:20:06.281589 23188 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.283478 23188 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.286185 17318 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:06.286605 23188 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.287153 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.287649 23175 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:06.287837 23095 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:06.289274 23175 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:06.289680 23098 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:06.306644 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.342062 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.291328 23168 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:06.342672 23168 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:06.305338 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:06.290503 23175 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:06.313385 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.314244 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.289695 22983 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:20:06.292474 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:06.368093 17996 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:06.315831 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:06.314447 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:06.316901 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.318354 23089 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:06.318634 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.321666 23102 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.299468 17316 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:20:06.323333 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:06.323786 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:06.323948 23189 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:06.369416 17315 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:06.327482 17318 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:06.381705 17314 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:06.329457 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:06.331161 17993 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:06.332479 23164 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:06.260110 23019 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.282599 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.308557 23098 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:06.345016 17463 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:20:06.345510 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 77603.5us
I20260709 13:20:06.327279 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.290830 22740 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:20:06.388116 17991 raft_consensus.cc:2368] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15.
I20260709 13:20:06.388957 17320 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:06.394346 17997 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:06.400938 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.403254 17470 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:06.408167 17992 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:06.388156 23188 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.388325 23057 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:06.412518 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.417961 17997 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
W20260709 13:20:06.422279 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 134814us
I20260709 13:20:06.395809 23165 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:20:06.435215 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.329694 17213 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 9 to 14, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 14 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.420624 23058 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:06.434712 23102 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:06.455466 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:06.461076 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 191792us
I20260709 13:20:06.462044 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:06.463510 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:06.448254 23165 consensus_queue.cc:1243] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:06.465142 23019 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:06.465198 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:06.465621 23019 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.466006 23019 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.469098 17213 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.470219 23165 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:06.470681 23165 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:06.471663 23165 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.473011 23165 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:06.478561 23016 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:06.479462 23016 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.482272 23149 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.482893 23149 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.484952 23009 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:20:06.486346 23098 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.486747 23149 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:06.487522 23098 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:06.471454 17213 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 9 to 17, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 17 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.447259 23194 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.493005 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:06.487251 23165 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:06.407670 23168 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.434988 23188 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.454483 23058 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:06.434890 23195 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:06.513470 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 223521us
W20260709 13:20:06.519253 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 101709us
W20260709 13:20:06.515184 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45174.8us
I20260709 13:20:06.501704 23175 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:06.512156 23149 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:06.509308 23201 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.526764 17317 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 12.
W20260709 13:20:06.529419 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 74002us
I20260709 13:20:06.529763 17467 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
W20260709 13:20:06.532267 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 77144.6us
I20260709 13:20:06.535640 23188 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.537169 23225 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:06.542215 23195 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.525033 23175 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:06.514096 23165 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:20:06.529105 23149 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:06.552433 23229 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:06.552904 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88082.3us
I20260709 13:20:06.552723 23058 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.553752 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:06.555514 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:06.556368 23016 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.557489 23228 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:20:06.563237 23194 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:06.563771 23194 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.564157 23194 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:06.565092 23164 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:06.565505 23164 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:06.566174 23019 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.566454 23164 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.567837 23164 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.568343 23019 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:06.577025 17213 catalog_manager.cc:5697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 11 to 15, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 15 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.578402 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:06.569626 23217 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:20:06.570705 23218 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:20:06.586973 23175 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.550531 23168 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:06.590411 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45921us
I20260709 13:20:06.579042 22899 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:20:06.593005 23225 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:06.593226 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:06.594033 17213 catalog_manager.cc:5697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.594916 23225 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:06.595191 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:06.595355 23225 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:06.583738 23220 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:20:06.558126 23149 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.596766 17389 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:06.594029 17391 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:06.595940 17388 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:06.600114 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:06.595995 17213 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.610613 17390 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:20:06.612442 23168 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:06.612546 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:06.613166 23168 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:06.613978 23168 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.600185 23095 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:06.614779 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:06.615724 23057 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:06.617103 23195 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:06.617748 23195 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.618966 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:06.619530 17390 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:06.620092 23195 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:06.585162 23186 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:20:06.621834 17389 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:06.623802 17391 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
W20260709 13:20:06.624926 23222 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:20:06.550711 23201 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:20:06.614253 23175 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:06.623920 22974 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.634575 23227 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:06.636224 22974 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:06.647435 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:06.653213 23226 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:06.653136 23168 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.613170 17213 catalog_manager.cc:5697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 8 to 12, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 12 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.646298 23201 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.662551 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:06.625877 23223 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:06.666121 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 117883us
I20260709 13:20:06.627252 23225 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.660014 23186 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:06.672861 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:06.660737 23168 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.687536 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:06.688283 23232 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:06.688400 23019 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:06.689493 23019 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.689570 23232 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:06.689924 23019 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:06.690828 23232 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.693274 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:06.693930 17317 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.695978 23228 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.696537 23228 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.696872 23019 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.698704 23228 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:06.707273 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.721419 17317 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
W20260709 13:20:06.723559 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.729835 17390 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:06.730090 17388 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
W20260709 13:20:06.734881 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 179444us
I20260709 13:20:06.735250 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:06.736251 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 68129.1us
I20260709 13:20:06.671790 23226 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:06.734437 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:06.740286 17995 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.733351 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:06.743381 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:06.739678 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:06.746568 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:06.747213 17999 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.748986 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:06.749185 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:06.749840 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:06.748973 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:06.751461 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60201.2us
I20260709 13:20:06.751684 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:06.753379 17963 leader_election.cc:400] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16.
I20260709 13:20:06.669552 23201 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.753741 17963 leader_election.cc:403] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:06.751989 17321 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:20:06.739631 23226 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.738816 23019 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:06.759253 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 111870us
I20260709 13:20:06.731302 22740 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:20:06.729168 23089 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:20:06.729607 23149 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.761502 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:06.766094 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:06.766409 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:06.762151 23226 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:06.771418 22924 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:06.772296 22924 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:06.772645 22924 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:06.773561 22924 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.774705 22924 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.777797 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:06.780210 23186 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:06.781066 23186 raft_consensus.cc:2764] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:20:06.782198 23230 log.cc:927] Time spent T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:20:06.782533 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.756098 23165 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:06.787793 17467 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:06.790055 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.791417 17467 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 18: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:06.791457 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:06.795464 23201 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.796525 17467 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 16. Current term is 17. Ops: [15.12-16.13]
I20260709 13:20:06.758163 23095 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:06.794798 17999 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:06.807344 17995 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:06.761947 22899 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:06.814219 17470 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:06.766042 23195 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.820786 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 54782.4us
I20260709 13:20:06.821612 17285 leader_election.cc:400] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15.
I20260709 13:20:06.821897 17285 leader_election.cc:403] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:20:06.822956 23234 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:06.824712 23058 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:06.825264 23058 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:06.826164 23058 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.831024 23225 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.832909 22983 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.833364 17470 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:06.833413 23195 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.817310 23095 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:06.835711 23195 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.837100 23109 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:06.837576 23109 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:06.837474 23194 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.838102 23109 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:06.839751 23194 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:06.844257 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.835402 23095 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.811022 23182 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16.
I20260709 13:20:06.849239 17393 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 13:20:06.849826 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88402.5us
I20260709 13:20:06.811435 23165 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:06.871013 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:06.844027 23226 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:06.878154 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 56655.3us
I20260709 13:20:06.872438 22899 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15.
I20260709 13:20:06.881981 23089 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:06.882387 23089 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:06.882761 23089 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:06.885468 17287 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:06.886250 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.886860 17463 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:06.888232 17391 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:20:06.880681 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:06.900300 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:06.901990 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:06.905755 17463 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:06.909687 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.910518 17467 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:06.902658 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 111958us
I20260709 13:20:06.817453 23240 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:20:06.918375 17320 raft_consensus.cc:2410] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:20:06.926745 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.930713 23242 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.905635 23019 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:06.937256 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:06.956489 17996 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:06.939764 23165 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:06.946915 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 61527.1us
I20260709 13:20:06.947889 23149 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:06.811115 17213 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:06.952826 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.957068 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:06.966545 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 230551us
I20260709 13:20:06.967290 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:06.968302 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:06.967970 23242 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.968675 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:06.968899 17992 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:06.969434 17470 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:20:06.960878 23195 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:06.970625 23195 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:06.970862 23089 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:06.977078 17992 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:06.911715 22899 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:20:06.985914 17360 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:06.952265 23226 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:06.988142 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:06.988197 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:06.991437 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 239823us
I20260709 13:20:06.924149 23225 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:07.017249 23225 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:06.957867 22740 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:07.021111 23239 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:07.021723 23239 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:07.022744 23239 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.027328 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:07.027204 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:07.028203 17992 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
W20260709 13:20:07.030296 23238 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 13:20:06.970350 23242 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:07.034983 23195 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:07.039094 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:07.039371 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.039844 17318 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:07.040099 17470 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:20:06.980104 23019 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:07.019081 23225 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:07.018579 23016 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.026118 22740 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.046213 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:07.046710 22740 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:07.047701 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:07.048592 17316 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:20:07.049360 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 82146.5us
I20260709 13:20:07.050235 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:07.049944 23019 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.052234 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:07.049383 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:07.046602 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:07.053772 17394 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:07.053889 17321 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:07.046294 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:07.054510 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:07.055315 17317 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.063796 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.034472 23089 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:07.059482 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:07.043656 23242 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:07.070822 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:07.030359 23175 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:20:07.044169 23058 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:07.057781 22924 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:20:07.077898 17317 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:07.057794 23195 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:07.111722 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.079226 23232 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:07.136893 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 112682us
I20260709 13:20:07.097888 23058 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.139616 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:07.142022 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 71289.7us
I20260709 13:20:07.095980 23098 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:07.103891 23149 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:07.099551 23102 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:07.133423 23217 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:07.099488 23242 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:07.151758 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.153062 17467 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:07.077786 23109 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:07.104601 23195 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:07.154165 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:07.150030 23149 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.157788 23149 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:07.163653 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.166849 23149 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.169425 23149 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:07.178025 17317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:07.178936 17317 raft_consensus.cc:606] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:07.179292 17317 raft_consensus.cc:614] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:07.181316 17321 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:07.182767 17317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "622554a5186d4910b8476a653411c85d"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:07.193495 23242 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:07.194545 17317 raft_consensus.cc:606] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:07.195072 17317 raft_consensus.cc:614] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:07.182441 17213 catalog_manager.cc:5697] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 6 to 9, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 9 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:07.198468 17213 catalog_manager.cc:5697] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 2 to 16, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 16 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.201200 23098 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:07.201644 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45630.8us
I20260709 13:20:07.201965 23168 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:07.202539 23098 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.204182 23168 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:07.204521 23168 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:07.141162 23194 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:07.201292 23102 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:07.157789 23245 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:07.143834 23058 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:07.205796 17317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:07.189224 23223 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:07.190152 23149 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:07.209144 23102 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:07.219635 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.212625 17317 raft_consensus.cc:606] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:07.215850 17320 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 13:20:07.216025 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 227883us
W20260709 13:20:07.232981 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.237188 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88574.9us
I20260709 13:20:07.211535 23245 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:07.242713 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.243696 17470 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:20:07.214872 23223 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:07.211249 23226 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:07.259469 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:07.261940 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 202556us
I20260709 13:20:07.210704 23225 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.263592 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:07.248612 23245 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:07.233527 23149 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:07.252977 23261 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:07.274281 17320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:07.276645 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.275139 17320 raft_consensus.cc:606] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:07.301218 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.301955 17467 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
W20260709 13:20:07.304416 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 316357us
I20260709 13:20:07.305456 17962 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:07.273849 23261 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:07.246759 17213 catalog_manager.cc:5697] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:07.316962 17962 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:07.263713 23168 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:07.315208 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.311802 23089 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.331218 17467 raft_consensus.cc:2376] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17. Re-sending same reply.
I20260709 13:20:07.335142 17470 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:07.332267 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:07.337402 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.341218 17463 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:07.344048 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.344139 23258 raft_consensus.cc:2764] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:07.344702 17462 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.320612 22924 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.312944 23261 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:07.369053 23149 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:07.370868 23109 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:07.372478 23225 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:07.341269 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:07.355944 23168 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:07.337441 23243 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:20:07.374351 17213 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 13 to 15, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 15 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.273237 23195 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:07.376626 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:07.377009 23243 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:07.377633 23243 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:07.377301 17990 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:07.310096 23223 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:07.378597 23243 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.377341 23258 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:07.381203 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.381724 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.382359 17463 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:07.382869 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.394184 23223 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:07.406890 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.413579 23189 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:07.414352 23189 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.418764 17463 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:20:07.422494 17462 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:07.443604 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:07.444715 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 206170us
I20260709 13:20:07.445490 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:07.444772 23194 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:07.447675 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 184163us
I20260709 13:20:07.447789 17321 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:07.447860 23194 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:07.448520 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:07.448693 23194 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:07.449815 17317 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:07.450052 23194 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.452298 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.452961 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:07.453410 17466 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:07.453634 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.454514 17471 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:20:07.454671 23241 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:07.454783 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.455374 23241 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:07.455492 17467 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:20:07.456203 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.454186 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:07.461356 23149 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:07.461966 23149 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:07.462881 23149 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:07.457630 17394 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:07.464809 23258 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:07.457676 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.461467 17998 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:07.456590 23241 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.466864 22924 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:07.474874 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:07.476086 17393 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:07.476490 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:07.477435 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:07.477675 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:07.478178 17390 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:07.481247 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:07.496706 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.502274 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.503173 17463 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:20:07.507468 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.515105 17391 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:20:07.376259 17213 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.416770 23189 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:07.523186 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.534025 17469 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:20:07.523705 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.524595 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.535135 17471 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:07.523217 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.518237 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:07.535976 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.535650 17466 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:07.540395 17467 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:07.543332 17390 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:07.547880 17465 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:07.556119 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:07.556967 17390 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:07.565878 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.584513 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:07.586035 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:07.586784 17390 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:07.552762 23189 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:07.556175 23182 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.590173 17392 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:20:07.590839 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.558522 23016 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.561874 23019 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:07.587608 22740 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.007s
I20260709 13:20:07.561648 22983 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.581945 23201 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:07.605505 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:07.606470 17390 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:07.579231 23263 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:07.578537 23149 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:20:07.603273 23019 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.631829 17990 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:07.633705 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:07.607777 23189 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:07.643369 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.653160 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:07.683080 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.630637 23019 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.691347 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:07.603186 23016 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.610167 22740 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:07.599968 23182 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.611919 22983 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:07.652967 23245 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:07.692164 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 106595us
I20260709 13:20:07.694722 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:07.701604 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:07.713689 17396 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:07.750149 17995 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:20:07.714776 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:07.710846 17391 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:07.713340 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:07.733606 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:07.732620 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:07.633976 23263 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:07.715152 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:07.751479 17388 raft_consensus.cc:2368] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:07.754594 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:07.753804 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:07.706763 17469 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:07.762434 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.763391 17469 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:07.764464 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.765152 17469 raft_consensus.cc:2376] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15. Re-sending same reply.
I20260709 13:20:07.767374 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.769842 17992 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:20:07.635552 17213 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.850538 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:07.879783 17995 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:07.861413 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.890661 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:07.859397 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:07.893496 17395 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:07.781224 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:07.892655 17469 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:07.841007 17992 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:20:07.826562 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:07.827153 17464 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:07.898139 17392 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:07.777742 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:07.785633 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:07.916858 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 361311us
I20260709 13:20:07.784758 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:07.862852 23269 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:20:07.828877 17393 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:07.929164 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 151584us
I20260709 13:20:07.930222 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.930996 17464 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:07.783326 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:07.785246 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:07.864149 23260 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:07.936149 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:07.938156 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:07.851946 23164 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.863220 23249 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.760440 23232 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:08.052426 23279 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:20:08.053790 23281 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
W20260709 13:20:08.055269 23272 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.351s	user 0.000s	sys 0.000s
I20260709 13:20:08.055542 23201 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:08.056053 23201 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:08.057366 23273 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 13:20:08.059361 23201 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:08.059518 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:08.060316 17471 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:08.062505 23223 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.000s
I20260709 13:20:07.864606 23243 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.857191 23278 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:07.828454 23239 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.851532 23245 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:07.848906 22740 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:07.946270 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:07.715308 23256 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.333s
W20260709 13:20:07.996415 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45262.5us
I20260709 13:20:07.998018 22983 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:07.998919 23294 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:07.999583 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 72608us
I20260709 13:20:08.029428 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:08.000458 17391 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:08.030440 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 81360.8us
I20260709 13:20:08.031433 17320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:07.936074 23241 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:08.108399 17320 raft_consensus.cc:606] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:08.108824 23286 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:20:08.032871 17316 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:08.035354 17464 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:08.045763 23263 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.046329 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:08.046908 23261 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.000s
I20260709 13:20:08.049428 17318 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:20:07.939353 23182 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:08.113497 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:08.074537 17395 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:07.944380 23260 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:07.890450 23189 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.082002 23102 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.084962 23278 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:08.088112 23288 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:20:08.089964 23058 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.856s	user 0.009s	sys 0.001s
W20260709 13:20:08.091176 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:08.094435 23168 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
I20260709 13:20:08.094950 17213 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:08.097643 23285 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.067s	user 0.002s	sys 0.001s
I20260709 13:20:08.101025 17471 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:08.112426 17469 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:08.073429 17321 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:08.000810 23164 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.126677 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:08.119382 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:08.130008 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.182018 17315 raft_consensus.cc:2410] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:20:08.184479 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 55908us
I20260709 13:20:08.170687 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:08.184218 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 57676.7us
I20260709 13:20:08.192305 17391 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:08.193364 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.203553 17397 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:08.186615 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:08.129601 23182 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:08.085832 23243 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.207840 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:08.185671 23089 consensus_meta.cc:287] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.807s	user 0.007s	sys 0.003s
W20260709 13:20:08.222388 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 101716us
I20260709 13:20:08.076297 23249 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.219290 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:08.229367 23278 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:08.230078 23278 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:08.235244 23164 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.204130 23168 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:08.237385 23168 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:08.238406 23168 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.221312 23182 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:08.181712 23058 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.241207 23182 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.236955 23089 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:08.243881 17997 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:20:08.244750 17390 raft_consensus.cc:2368] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13.
I20260709 13:20:08.245769 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:08.247406 23283 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:20:08.248577 23296 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:08.249864 23262 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:08.249619 17213 catalog_manager.cc:5697] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:08.250368 23262 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:08.251406 23262 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.251588 17213 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:08.254361 22899 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.254689 23225 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.254863 22899 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.255278 23225 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.256554 23252 raft_consensus.cc:993] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:20:08.240110 23243 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.259363 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:08.260118 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:08.124339 23261 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:08.263557 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44409.4us
I20260709 13:20:08.264879 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:08.266984 23241 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:08.268796 23241 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:08.223766 23227 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:08.142050 23102 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:08.261798 23288 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:08.220335 23229 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:08.291935 23229 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.279258 22983 raft_consensus.cc:1081] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:20:08.283383 23227 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:08.294028 23229 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.294659 23227 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:08.296034 23019 consensus_meta.cc:287] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.001s
I20260709 13:20:08.296473 23019 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.296942 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:08.297596 17462 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:20:08.298564 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:08.298943 17388 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:08.284276 23225 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:08.285802 23089 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:08.120292 23294 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.301868 23089 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.302347 23089 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:08.302726 17470 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:08.303452 23294 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:08.236940 23260 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.305024 23260 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:08.285032 23297 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:08.288321 23249 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.287114 23102 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.290064 23261 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:08.290501 17389 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:08.295037 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:08.307423 17471 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:08.307471 23256 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:08.308012 23256 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:08.308809 23256 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:08.309113 23009 consensus_queue.cc:1175] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c23a664ebf3347a4934dee377c8b5101" responder_term: 19 status { last_received { term: 18 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:08.310321 23256 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:08.289494 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:08.311513 17213 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 11 to 15, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 15 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:08.312479 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:08.313000 23294 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:08.313707 23294 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.314507 17434 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:08.298604 23019 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:08.315625 23290 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:20:08.315688 23297 raft_consensus.cc:2764] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:08.316462 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:08.317469 23292 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:08.318581 23298 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:08.319255 23298 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:08.320293 23058 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.321580 22899 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.321981 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:08.322614 17321 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:08.323069 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:08.323956 17470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:20:08.324401 17434 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:08.324497 17470 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:08.325234 17470 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:08.266247 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:08.328662 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:08.329423 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 63269.2us
I20260709 13:20:08.338286 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.338943 17389 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:08.341565 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:08.342267 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:08.342788 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.326129 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:08.344352 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:08.346524 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 86481.5us
I20260709 13:20:08.347610 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:08.279958 23016 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:08.353067 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 246196us
I20260709 13:20:08.355121 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.351840 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.355798 17394 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:08.358618 17397 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
W20260709 13:20:08.379755 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 52470.9us
W20260709 13:20:08.380342 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 54286us
I20260709 13:20:08.355702 17963 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:08.386441 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.391085 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:08.387672 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:08.352667 23294 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:08.349159 23298 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:08.356832 23296 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:08.381043 23297 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.382918 23278 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.399592 23289 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:08.423632 23297 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.424007 23278 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:08.396821 17470 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.420447 23240 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:08.377923 23282 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:20:08.422446 23296 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.450920 23297 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:08.452296 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 385186us
I20260709 13:20:08.412158 23182 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.402454 23264 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:08.397365 23164 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:08.389544 23201 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:20:08.429993 23289 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.450557 17470 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:08.459080 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:08.465869 17468 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:08.459630 17469 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:08.466393 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:08.398563 22983 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:08.461505 17467 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:08.467475 17467 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:08.490579 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:08.494225 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:08.495219 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:08.495893 17471 raft_consensus.cc:2368] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17.
I20260709 13:20:08.405761 23295 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:20:08.451977 23240 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:08.498356 17463 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:20:08.315117 17213 catalog_manager.cc:5697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.488438 22983 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.499861 17464 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:08.503997 17315 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:08.457036 23264 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:08.488178 23289 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:08.502887 17321 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:08.455940 23296 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:08.491945 23098 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.499033 17467 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.430639 23243 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:08.492364 23297 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:08.518430 17471 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:08.605381 17471 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:08.504740 22983 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:08.494072 23164 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:08.575922 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 182228us
I20260709 13:20:08.641678 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:08.546953 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 191319us
I20260709 13:20:08.455629 23278 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:08.605485 23243 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:08.644083 23243 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:08.644290 23278 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.605299 23297 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:08.645783 23297 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.646786 23286 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:08.646981 23297 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:08.647322 23286 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.649523 23286 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:08.547483 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 167646us
W20260709 13:20:08.546212 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 152965us
I20260709 13:20:08.650519 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:08.575124 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 188364us
I20260709 13:20:08.580351 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:08.654337 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:08.583310 17468 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:08.498664 22899 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.538347 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:08.533916 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:08.513933 23264 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:08.597409 17467 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.649981 23299 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.567317 23240 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.607384 17471 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.616508 22983 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.617648 17213 catalog_manager.cc:5697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 10 to 12, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 12 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:08.637326 23089 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.641575 23164 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:08.658003 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 77719us
I20260709 13:20:08.655139 17997 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:08.651163 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:08.658350 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:08.685436 17321 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:08.685760 17321 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:08.658808 22899 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.660048 23304 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:08.674176 17467 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:08.697330 17317 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:08.680977 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:08.683725 17471 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:08.689666 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:08.686491 17321 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.710306 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:08.710860 17990 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:08.714162 17992 raft_consensus.cc:2410] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:08.715530 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.715879 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:08.716893 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 325907us
I20260709 13:20:08.717391 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:08.718549 17316 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:20:08.718461 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:08.669662 23298 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:08.682096 23009 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:08.682082 22740 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.582343 23098 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.668535 23299 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.687214 23262 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:08.723456 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:08.723453 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:08.745061 17992 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:08.726343 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:08.743568 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62734us
I20260709 13:20:08.745569 17318 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.726563 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.687142 23241 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:08.733589 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.750150 17393 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 19: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:08.750224 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:08.686893 23095 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:20:08.738591 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:08.736178 17999 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:08.738134 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:08.752382 17320 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:08.754441 17395 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:08.727277 23009 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.755786 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:08.734741 23240 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:08.760560 17467 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:08.758544 17471 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:08.708046 23225 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:08.718168 23058 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:20:08.733103 23316 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:08.767627 17464 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:08.773470 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:08.768467 17999 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:08.712481 23292 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:20:08.744081 23262 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.743613 23304 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:08.752595 23314 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:08.778224 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:08.768247 23009 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:08.741210 22740 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.752776 23286 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:20:08.774976 23261 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:20:08.779031 23262 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:08.811157 23314 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.814150 23323 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:08.814386 23325 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:20:08.786247 17213 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 12 to 16, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 16 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:08.815738 17320 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:08.816027 23299 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.820647 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:08.824807 17318 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:20:08.771664 23016 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:20:08.783640 23295 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:08.779814 23241 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:20:08.780489 23239 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:20:08.840689 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:08.786958 23201 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
W20260709 13:20:08.847533 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 264267us
I20260709 13:20:08.849586 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:08.853127 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 102976us
I20260709 13:20:08.788407 23245 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:20:08.839148 23316 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:08.873958 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 95809.2us
I20260709 13:20:08.881821 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:08.818284 23243 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:08.889791 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.885679 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:08.885030 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 111628us
I20260709 13:20:08.834414 23019 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:20:08.845985 23278 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:08.914125 17468 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:08.905682 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:08.906451 17318 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:08.921790 17394 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:08.884689 23058 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:08.915514 17322 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:08.883281 23316 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:08.928755 22740 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:08.929473 23319 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:08.929978 23319 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.930346 23319 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:08.931658 23306 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:20:08.935868 23318 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:08.936851 23326 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:08.937433 23326 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.937867 23326 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:08.939846 23330 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:08.941849 23318 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:08.942061 23321 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:08.781678 23298 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.964468 23336 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:08.889334 22983 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.892591 23089 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.967267 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:08.892838 23102 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.892468 23225 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.974303 17318 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:08.843483 23295 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:08.888602 23263 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:20:08.974226 23336 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.947295 23315 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.974473 23278 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:08.962579 22899 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.814152 23322 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.200s
I20260709 13:20:08.996296 23322 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:08.996767 23322 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:08.997867 23322 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.999472 23322 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:08.844324 23314 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:09.006892 23314 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:08.980794 23102 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:09.013991 23329 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:09.015653 23102 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:08.986438 23245 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:09.016947 23245 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.017194 17213 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 9 to 13, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 13 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:09.019183 23245 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:08.789706 23304 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.021801 23304 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:09.023241 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.026347 23299 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:09.027130 23299 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.982273 23225 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:09.030586 23189 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:09.031183 23225 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:09.033237 17320 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:20:09.040565 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.031222 23189 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:08.966657 23058 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:08.987885 23278 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.990782 23328 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:08.992728 23336 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:09.048400 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:09.072424 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:09.055051 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 173272us
I20260709 13:20:09.042289 23189 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.041286 23299 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.063175 23009 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:08.975001 23098 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:09.068264 17990 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:20:09.138705 17990 pending_rounds.cc:85] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 10
I20260709 13:20:09.139034 17990 pending_rounds.cc:107] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:20:09.139286 17990 raft_consensus.cc:2889] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:09.140671 17390 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:09.087308 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.075917 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:08.989246 23089 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:08.959756 23316 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.164057 23189 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.160758 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:09.168731 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.169905 17390 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:09.172266 23341 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.172865 23341 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.067867 23256 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:09.178993 23256 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.149611 17995 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:09.179849 23316 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.181092 23256 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.150182 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:09.143433 17394 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:09.182574 17392 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:08.972618 23296 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.178381 23009 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.190599 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:09.191392 17388 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:09.194525 17317 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:09.144605 23095 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.188337 23299 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.142823 23225 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:09.204057 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.211382 17463 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:09.135476 17470 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:09.219310 17392 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:09.197542 23304 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:09.223021 23304 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.224931 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:09.225211 23304 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.227028 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:09.211128 23299 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.230798 23299 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.231451 23299 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:09.232031 23299 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:09.233560 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:09.234957 23239 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:09.235525 23239 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:09.235993 23239 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:09.043395 23315 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:09.264261 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.280149 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:09.281023 17392 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:09.239312 23289 consensus_meta.cc:287] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.003s
I20260709 13:20:09.202661 23095 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.295724 23095 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.297869 23305 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.298425 23305 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.300544 23305 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.142153 23328 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.309244 17392 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:09.303170 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:09.338434 17998 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:09.212055 23225 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.209414 23319 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.340559 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:09.436865 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.445014 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:09.361017 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:09.435775 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.447088 17388 raft_consensus.cc:2393] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:09.439738 17471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.018s
W20260709 13:20:09.448217 17471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.008s	sys 0.019s
W20260709 13:20:09.448395 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 107946us
W20260709 13:20:09.443585 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 367741us
I20260709 13:20:09.287638 23089 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:09.284474 23323 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:09.451370 23304 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:09.461604 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:09.462183 23263 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:09.463131 23339 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:20:09.463729 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:09.393743 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.080s	sys 0.192s
W20260709 13:20:09.467177 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.085s	sys 0.194s
I20260709 13:20:09.467430 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:09.468297 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 618768us
I20260709 13:20:09.469063 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:09.451504 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:09.468159 23089 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:09.471096 23089 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:09.471871 23098 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:09.365108 23297 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.718s	user 0.012s	sys 0.000s
I20260709 13:20:09.322113 23295 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:09.385944 23182 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.920s	user 0.008s	sys 0.004s
I20260709 13:20:09.472419 23098 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.475203 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:09.473454 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:09.377844 23243 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:09.369719 23286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.078s	sys 0.117s
I20260709 13:20:09.477136 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:09.493409 23286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.086s	sys 0.134s
I20260709 13:20:09.493696 17322 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
W20260709 13:20:09.498907 23264 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.002s
I20260709 13:20:09.499432 23264 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:09.500682 17389 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:09.487916 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:09.506381 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:09.482524 17320 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:09.451808 23316 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:09.490047 22983 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:09.340833 23058 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:09.314641 23289 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:09.468050 23304 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.476472 23332 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:09.370344 23312 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.480s
W20260709 13:20:09.563369 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50115.1us
I20260709 13:20:09.478343 22899 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:09.444718 23256 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:20:09.501336 23333 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:09.583636 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:09.584089 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 81250.1us
I20260709 13:20:09.477909 23260 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:20:09.476276 23263 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:09.602490 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:09.576592 23095 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:09.606962 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 100698us
I20260709 13:20:09.580935 23304 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:09.621236 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:09.584424 23332 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.602113 23319 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.607091 23296 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.648185 23095 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:09.577508 23345 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:09.597888 22899 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.649000 23332 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:09.650496 17435 leader_election.cc:400] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:09.669858 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:09.670426 17435 leader_election.cc:403] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:09.587162 23312 consensus_queue.cc:1243] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:09.643297 17991 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:09.609172 23260 consensus_queue.cc:1243] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:09.633391 23240 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:09.680269 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:09.645090 23315 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:09.694137 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:09.669773 22899 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:09.700237 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.017s	sys 0.057s
I20260709 13:20:09.698647 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:09.677575 23195 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:09.700740 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.017s	sys 0.057s
I20260709 13:20:09.708703 23240 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:09.709316 23240 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.711619 23240 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:09.700915 23345 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:09.712941 23310 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:20:09.715230 23340 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:09.689180 23342 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:09.717440 23340 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:09.718631 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48900.3us
I20260709 13:20:09.719497 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:09.719669 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:09.701658 23299 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:09.722069 23340 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:09.690905 23261 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:09.723227 23261 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:09.725054 17435 leader_election.cc:400] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13.
I20260709 13:20:09.727442 17314 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:09.689723 17469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.011s	sys 0.008s
W20260709 13:20:09.732259 17469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.012s	sys 0.008s
I20260709 13:20:09.699222 23319 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:09.704737 23298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.013s	sys 0.006s
I20260709 13:20:09.701234 23333 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:09.742583 23340 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:20:09.752080 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:09.749207 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 261371us
I20260709 13:20:09.742218 23240 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:09.645437 23323 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:09.730991 23195 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:09.756132 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 172621us
I20260709 13:20:09.763790 17999 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:09.764997 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.767450 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:09.768112 17320 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:09.769239 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:09.761310 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:09.750557 23298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.013s	sys 0.006s
I20260709 13:20:09.755709 23240 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:09.773932 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:09.774369 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:09.774786 17467 raft_consensus.cc:2410] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:20:09.776775 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.776971 17313 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:09.774101 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.757455 23195 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.779451 17390 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:09.777499 17397 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:09.783043 17471 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:09.756103 23328 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:09.778901 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:09.815495 17467 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:20:09.777081 23312 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.847221 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:09.919162 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.854822 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:09.779244 23240 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:09.921700 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:09.925194 23328 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:09.925619 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2282) took 1430 ms. Trace:
I20260709 13:20:09.925688 23328 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:09.818012 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.818457 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:09.863884 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.926126 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 71489us
I20260709 13:20:09.860599 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:09.832800 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 80826us
I20260709 13:20:09.932868 17467 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:20:09.818902 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:09.933961 17471 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:09.929665 17470 raft_consensus.cc:2410] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:20:09.846194 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 1931) took 1138 ms. Trace:
I20260709 13:20:09.842490 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2108) took 1324 ms. Trace:
I20260709 13:20:09.775280 23225 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.926170 17316 rpcz_store.cc:276] 0709 13:20:08.495544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.502420 (+  6876us) service_pool.cc:224] Handling call
0709 13:20:08.502711 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:08.722334 (+219623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.925283 (+1202949us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400369054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:09.925517 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482694528}
I20260709 13:20:09.941237 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:09.941980 17468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.012s	sys 0.028s
W20260709 13:20:09.947073 17468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.013s	sys 0.028s
I20260709 13:20:09.937364 17317 rpcz_store.cc:276] 0709 13:20:08.707824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.717093 (+  9269us) service_pool.cc:224] Handling call
0709 13:20:09.845899 (+1128806us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540043f8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:09.846085 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066973440}
I20260709 13:20:09.939201 17463 rpcz_store.cc:276] 0709 13:20:08.517870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.518894 (+  1024us) service_pool.cc:224] Handling call
0709 13:20:09.842169 (+1323275us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400162454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:09.842388 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267301760}
I20260709 13:20:09.926267 23328 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:09.941572 17285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.572s (SENT) [suppressed 23 similar messages]
I20260709 13:20:09.962134 17467 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:20:09.965040 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:09.969995 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:09.833948 23322 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.834s	user 0.012s	sys 0.001s
I20260709 13:20:09.970764 17469 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
W20260709 13:20:09.818118 23347 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:20:09.777288 23354 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:09.863179 23313 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:09.944979 23239 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.708s	user 0.002s	sys 0.009s
I20260709 13:20:09.979702 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:09.834029 23331 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:09.830009 23262 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.993s	user 0.007s	sys 0.004s
I20260709 13:20:09.981947 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:09.832736 23342 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.862617 23098 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:09.982487 23326 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.044s	user 0.011s	sys 0.004s
I20260709 13:20:09.757647 23095 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.815685 23261 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:09.825487 23260 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:09.984898 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.859743 23341 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:09.991823 17465 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:09.961297 22983 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:10.007565 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 307836us
I20260709 13:20:10.016745 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:10.018128 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:10.021821 17990 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:09.981137 23344 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:09.841967 23149 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.146s
W20260709 13:20:10.012442 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 243093us
I20260709 13:20:09.984306 23256 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:09.786010 23340 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:10.011751 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:10.026183 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.020766 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.018870 17469 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:10.061334 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:09.860826 23089 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:09.985347 23313 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:09.947566 23312 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.055037 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.055138 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:10.056265 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:09.990839 23331 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:10.063491 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:10.064267 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:10.070276 17469 raft_consensus.cc:2393] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:10.071332 17463 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:10.081053 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:10.070067 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:10.082281 17394 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:10.077840 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:09.989559 23343 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.077s
W20260709 13:20:10.065063 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 123516us
I20260709 13:20:10.063272 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:09.979521 23319 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:20:09.989964 23303 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:10.063490 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:10.064272 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:10.090708 17395 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:09.961946 23304 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:10.064649 23347 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:10.085916 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:10.050036 23322 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.046016 23333 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.087442 17393 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.089813 17990 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:09.993793 23239 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.023931 23326 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.021921 23315 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:20:10.096222 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.005564 23262 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.095109 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.131837 17994 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:10.093281 17389 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:10.015702 23260 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.103741 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:10.059309 23256 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:10.015285 23342 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.051043 23257 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:20:10.057526 23194 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:20:10.123592 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:10.122267 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.128968 23313 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.130585 23240 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.134214 17394 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:10.155225 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.143630 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:10.146467 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.148224 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:10.069929 23362 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:20:10.152390 17991 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:20:10.124580 23355 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:20:10.156760 17471 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:10.077067 23340 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.160478 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.160591 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:10.161417 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.161650 17315 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:10.150830 17392 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:10.165057 17470 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:10.151330 23256 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.060529 23344 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.166531 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:10.170885 17395 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.095433 23303 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.167273 17394 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:10.168259 17997 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:10.101806 23322 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.155465 23149 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:10.175185 17394 pending_rounds.cc:85] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 10
I20260709 13:20:10.181335 17394 pending_rounds.cc:107] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:20:10.181675 17394 raft_consensus.cc:2889] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:10.134536 23261 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:20:10.189800 23360 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:10.191495 23303 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:10.192023 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3526) took 1283 ms. Trace:
I20260709 13:20:10.193676 23322 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:10.192487 17468 rpcz_store.cc:276] 0709 13:20:08.908516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.989856 (+ 81340us) service_pool.cc:224] Handling call
0709 13:20:09.073243 (+ 83387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.073810 (+   567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.073854 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.154402 (+ 80548us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.947691 (+793289us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:10.133525 (+185834us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.134058 (+   533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.134150 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.191735 (+ 57585us) raft_consensus.cc:1685] finished
0709 13:20:10.191763 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.191934 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14785,"raft.queue_time_us":216,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":92608,"thread_start_us":882626,"threads_started":2,"wal-append.queue_time_us":867691}
I20260709 13:20:10.194823 23240 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:10.176790 23313 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.147692 23358 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:20:10.198278 17467 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:10.105957 23333 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.200137 17389 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:20:10.196961 17995 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
W20260709 13:20:10.202714 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 141610us
I20260709 13:20:10.175558 23227 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:10.208940 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1062) took 1157 ms. Trace:
W20260709 13:20:10.208876 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 152732us
W20260709 13:20:10.217521 23363 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:10.217900 22899 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.220031 22899 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:10.222673 17463 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:10.158066 22983 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.226006 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2104) took 1760 ms. Trace:
I20260709 13:20:10.226519 17462 rpcz_store.cc:276] 0709 13:20:08.466048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.466157 (+   109us) service_pool.cc:224] Handling call
0709 13:20:10.225770 (+1759613us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400280854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:10.225932 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3019481984}
I20260709 13:20:10.227995 17462 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:10.231056 17998 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:10.209326 17992 rpcz_store.cc:276] 0709 13:20:09.047296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.048405 (+  1109us) service_pool.cc:224] Handling call
0709 13:20:09.048738 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:09.063999 (+ 15261us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:09.064379 (+   380us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.442863 (+378484us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:09.466195 (+ 23332us) log.cc:844] Serialized 52 byte log entry
0709 13:20:09.466383 (+   188us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:09.466839 (+   456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.466904 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:09.623220 (+156316us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4800041ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:20:10.198105 (+574885us) raft_consensus.cc:1685] finished
0709 13:20:10.204435 (+  6330us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.204628 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63351,"prepare.queue_time_us":706,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":5878,"raft.queue_time_us":80840,"raft.run_cpu_time_us":3246,"raft.run_wall_time_us":248466,"spinlock_wait_cycles":29063552,"thread_start_us":317581,"threads_started":1,"wal-append.queue_time_us":533474}
I20260709 13:20:10.237521 17467 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:10.237648 17393 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:10.166136 23359 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:20:10.240418 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:10.253873 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1071) took 1015 ms. Trace:
I20260709 13:20:10.257423 17395 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:10.216187 23331 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.269312 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:10.280261 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:10.282306 17992 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:10.254446 17993 rpcz_store.cc:276] 0709 13:20:09.238177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.238326 (+   149us) service_pool.cc:224] Handling call
0709 13:20:09.288588 (+ 50262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.289307 (+   719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.289340 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.370215 (+ 80875us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.671099 (+300884us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:09.671148 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.671214 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.253596 (+582382us) raft_consensus.cc:1685] finished
0709 13:20:10.253624 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.253798 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":330,"raft.queue_time_us":50559,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":220631,"threads_started":1,"wal-append.queue_time_us":342172}
I20260709 13:20:10.282084 17395 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:10.284818 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 141294us
I20260709 13:20:10.282491 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.287865 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:10.294559 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.306582 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:10.312566 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 102064us
I20260709 13:20:10.318450 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.251848 23261 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:20:10.320937 17395 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:10.319340 17391 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:10.317688 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:10.329295 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.330183 17993 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 9.
I20260709 13:20:10.336928 22899 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:10.337343 22899 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.337674 22899 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.341835 23089 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:10.347407 23263 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:10.348014 23239 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:10.348649 23312 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:10.349591 23384 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:10.350133 23384 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.352190 23384 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:10.352909 23260 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:10.354331 23289 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:10.310959 23331 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:10.286593 23227 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 13:20:10.361963 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 151325us
I20260709 13:20:10.359056 17465 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:10.362422 17990 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:10.361600 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:10.313742 23380 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:10.324252 23304 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:10.336627 23296 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:20:10.332777 23195 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
W20260709 13:20:10.369380 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.369693 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:10.370867 23296 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:10.377686 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:10.378343 17463 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:10.379426 23381 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.119s	user 0.000s	sys 0.005s
I20260709 13:20:10.377835 23296 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:10.376224 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 58671.7us
I20260709 13:20:10.397806 17993 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:10.399307 17463 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:10.401615 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:10.369009 23380 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:10.406914 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 129651us
I20260709 13:20:10.373579 23326 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:10.409520 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:10.388773 23332 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.701s	user 0.005s	sys 0.006s
I20260709 13:20:10.365329 23164 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:20:10.411271 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:10.402014 23373 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:20:10.396111 23239 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:10.412210 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:10.399471 23252 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:10.400835 23342 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:10.441951 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:10.454353 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:10.454836 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.456000 17990 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:10.407930 23296 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.376130 23195 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:10.462314 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48830.8us
I20260709 13:20:10.460405 17318 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:20:10.413224 23019 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:10.410136 23380 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.463441 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:10.437379 23252 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.464769 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:10.472579 17463 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.421149 23340 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:10.463380 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:10.413149 23377 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:10.468997 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:10.435977 23333 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:10.434684 23239 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:10.473910 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:10.459021 23263 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:10.434855 23384 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:20:10.481370 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.488270 17319 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:20:10.490854 17396 raft_consensus.cc:2393] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:10.490491 17993 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:10.414393 23332 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:10.486249 23382 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:20:10.481693 23387 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:10.476627 23252 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.467350 23342 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:10.497192 17463 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
W20260709 13:20:10.485823 23378 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:20:10.511822 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:10.492134 23019 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:10.513607 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.529981 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:10.530855 17393 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 18: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:10.513705 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.489761 23377 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:10.484452 23239 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.516927 17963 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:10.487408 23344 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:10.487304 23263 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:10.512748 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:10.480264 23393 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:10.528582 17317 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: [11.9-15.11]
I20260709 13:20:10.532334 17389 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:10.545205 17393 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:10.545403 17471 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:10.557914 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.546362 17467 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:10.526969 23319 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:10.565224 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 111011us
I20260709 13:20:10.568332 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:10.553884 23263 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.543206 23333 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:10.528378 23342 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.559635 23393 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:10.571950 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:10.584100 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1066) took 1507 ms. Trace:
I20260709 13:20:10.571465 23019 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:10.575968 23340 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.587852 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:10.585280 17996 rpcz_store.cc:276] 0709 13:20:09.077087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.077672 (+   585us) service_pool.cc:224] Handling call
0709 13:20:09.155688 (+ 78016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.156068 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.156098 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:10.100266 (+944168us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b2c00100b48. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:20:10.140369 (+ 40103us) log.cc:844] Serialized 26 byte log entry
0709 13:20:10.303845 (+163476us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:10.303883 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.303945 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.579148 (+275203us) raft_consensus.cc:1685] finished
0709 13:20:10.579170 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.584027 (+  4857us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":20531,"spinlock_wait_cycles":11791104,"thread_start_us":146015,"threads_started":1,"wal-append.queue_time_us":216511}
I20260709 13:20:10.581959 23393 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.608250 23340 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.586702 23396 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:10.580681 23345 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:10.616451 23342 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:10.591081 23377 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.618328 22899 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.625963 17321 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.628017 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:10.630640 23278 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:10.568154 23319 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.634318 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:10.636344 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:10.637156 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:10.637885 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:10.637938 23019 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:10.663151 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 75367.4us
I20260709 13:20:10.811291 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:10.661394 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 146859us
I20260709 13:20:10.746891 23304 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:10.798208 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.642139 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:10.816931 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:10.914011 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 271940us
I20260709 13:20:10.914625 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:10.915241 17314 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
W20260709 13:20:10.915437 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.916409 17314 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: [13.13-15.14]
I20260709 13:20:10.815368 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:10.880481 23319 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:10.817458 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:10.861479 23328 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.000s
W20260709 13:20:10.917156 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 101839us
I20260709 13:20:10.919085 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3542) took 1154 ms. Trace:
I20260709 13:20:10.817518 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:10.837064 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:10.840185 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:10.822014 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:10.921175 17389 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:10.921332 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 84328.6us
I20260709 13:20:10.764451 23326 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:10.832213 23175 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.923621 17390 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:10.844668 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:10.853591 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:10.840483 23195 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:10.841189 23396 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.814437 23345 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.856141 23332 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:10.871511 23331 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.003s
I20260709 13:20:10.866350 23252 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:10.868615 23256 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.001s
I20260709 13:20:10.896857 22899 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:10.891636 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.898377 23340 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:10.874466 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.931604 17397 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:10.932090 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:10.933256 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:10.916620 23009 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:10.865886 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:10.901772 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.866832 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.938692 17388 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:10.904930 23380 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:10.860468 23394 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:20:10.917048 23296 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:10.928761 23333 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:10.957089 23333 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.957420 23333 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.957571 17389 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:10.919808 17396 rpcz_store.cc:276] 0709 13:20:09.764270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.764706 (+   436us) service_pool.cc:224] Handling call
0709 13:20:10.918839 (+1154133us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b540013abd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:10.918999 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643016064}
I20260709 13:20:10.849536 17321 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:10.898926 23239 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.865482 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3539) took 1104 ms. Trace:
I20260709 13:20:10.926726 23278 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.936421 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:10.939158 17316 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 16. Ops: []
I20260709 13:20:10.907770 23393 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:10.943162 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 77352.6us
I20260709 13:20:10.961580 17392 rpcz_store.cc:276] 0709 13:20:09.761044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.761157 (+   113us) service_pool.cc:224] Handling call
0709 13:20:09.774067 (+ 12910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.164947 (+390880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.865215 (+700268us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54004128d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:10.865392 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866034432}
I20260709 13:20:10.937369 23009 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:10.947016 22899 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:10.949447 23340 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:10.977322 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.888032 23263 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.929070 23175 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.929219 23326 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.956616 23296 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:10.977747 22899 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.926726 23328 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.922384 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:10.927058 23342 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:10.966816 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:10.946543 23332 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:10.968325 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:10.974221 17321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 2283) took 2302 ms (client timeout 1626 ms). Trace:
I20260709 13:20:10.934561 23256 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.961020 23098 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.988427 17999 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:10.997689 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:10.992643 17321 rpcz_store.cc:269] 0709 13:20:08.657971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.658098 (+   127us) service_pool.cc:224] Handling call
0709 13:20:09.180247 (+522149us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b18000daa00. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d6282f646 00007f7d6276958e 00007f7d627eaf9e 00007f7d627ec7de 00007f7d627f827c 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c
0709 13:20:09.845214 (+664967us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b58009416d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627500aa 00007f7d627d2447 00007f7d627eafe7 00007f7d627ec7de 00007f7d627f827c 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c
0709 13:20:10.625345 (+780131us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b58009419d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627500aa 00007f7d627d2447 00007f7d627eafe7 00007f7d627ec7de 00007f7d627f827c 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c
0709 13:20:10.960059 (+334714us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707352448}
I20260709 13:20:10.980647 17389 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:10.992945 17395 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:10.991734 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 69448.4us
I20260709 13:20:11.003734 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.006150 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.001338 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:11.008059 17388 raft_consensus.cc:2368] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20.
I20260709 13:20:11.008606 23098 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:10.976106 23278 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:10.990291 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.985780 23296 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.023382 23252 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:11.061077 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 63457.2us
I20260709 13:20:11.017271 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:10.986227 22899 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.025760 23342 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:11.027065 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:10.990002 23264 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:10.991181 22983 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:20:10.997345 23361 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:11.040660 17393 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:11.041963 23263 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:11.078871 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1515) took 1062 ms. Trace:
W20260709 13:20:11.079268 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.079396 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:11.048180 23332 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:11.051293 17392 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:11.063489 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:10.992650 23331 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:10.988225 23328 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:11.050274 23347 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:10.988229 23326 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:11.013339 23319 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:10.982358 23340 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.105890 23340 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:11.080730 17394 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.036s	sys 0.038s
I20260709 13:20:11.047690 23256 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.079288 17999 rpcz_store.cc:276] 0709 13:20:10.017087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.017424 (+   337us) service_pool.cc:224] Handling call
0709 13:20:10.017885 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.009331 (+991446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.076461 (+ 67130us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b5400472a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:11.078812 (+  2351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231550848}
I20260709 13:20:11.071112 23314 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:11.107118 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1933) took 2382 ms. Trace:
I20260709 13:20:11.022269 23358 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:20:11.107722 17315 rpcz_store.cc:276] 0709 13:20:08.724774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.724931 (+   157us) service_pool.cc:224] Handling call
0709 13:20:08.725218 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.164899 (+1439681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.106809 (+941910us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001423d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:11.107002 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3303070464}
I20260709 13:20:11.060696 23168 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 13:20:11.112298 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.113032 23334 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:11.113472 23334 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.113655 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 961) took 1346 ms. Trace:
I20260709 13:20:11.113847 23334 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.114110 17390 rpcz_store.cc:276] 0709 13:20:09.767700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.928224 (+160524us) service_pool.cc:224] Handling call
0709 13:20:10.923371 (+995147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.925483 (+  2112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.113469 (+187986us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b540013abd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:11.113600 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167937408}
I20260709 13:20:11.085672 17994 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:11.118323 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 91358.3us
I20260709 13:20:11.119099 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.079962 23361 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:11.108317 23328 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:10.985584 23009 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.125449 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:11.126255 17394 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.036s	sys 0.038s
I20260709 13:20:11.123134 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:11.121045 23331 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.128221 23326 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:11.129966 23358 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:11.130898 23278 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.195890 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:11.124943 23342 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:11.163112 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 123634us
W20260709 13:20:11.193142 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 70109.6us
I20260709 13:20:11.121677 23341 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:11.126116 23361 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:11.186203 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3544) took 1056 ms. Trace:
W20260709 13:20:11.197131 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 71784.3us
I20260709 13:20:11.175338 23393 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:11.204414 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.206959 17963 leader_election.cc:400] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20.
I20260709 13:20:11.147092 23009 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.159741 23239 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:11.219281 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 136284us
I20260709 13:20:11.219637 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.226480 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:11.227329 17390 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:11.229455 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:11.231271 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.124671 23314 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:11.135305 22740 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:20:11.161625 23380 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.221887 17963 leader_election.cc:403] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:20:11.142459 23260 consensus_queue.cc:1175] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7108577e5754060b7e468a43dfdcdeb" responder_term: 18 status { last_received { term: 17 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:11.203302 23289 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:11.195272 23358 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:11.175215 23262 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.221460 23340 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:11.208007 23319 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.203042 23175 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.134935 23328 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.142748 23194 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:20:11.243991 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.218142 17394 rpcz_store.cc:276] 0709 13:20:10.130519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.174515 (+ 43996us) service_pool.cc:224] Handling call
0709 13:20:10.174941 (+   426us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:10.198297 (+ 23356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.198341 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:10.201604 (+  3263us) log.cc:844] Serialized 52 byte log entry
0709 13:20:10.366752 (+165148us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:10.461339 (+ 94587us) log.cc:844] Serialized 14 byte log entry
0709 13:20:11.185939 (+724600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.185999 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.186035 (+    36us) raft_consensus.cc:1685] finished
0709 13:20:11.186042 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.186156 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13071,"prepare.queue_time_us":94674,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":49889,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":6887,"thread_start_us":887811,"threads_started":3,"wal-append.queue_time_us":176968}
I20260709 13:20:11.234418 23331 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:11.266242 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.218851 23278 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:20:11.245699 23332 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.221000 23341 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.252723 23420 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:11.484508 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 240633us
I20260709 13:20:11.525763 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.476300 23340 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.540737 23278 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:11.253537 23289 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:11.475780 23417 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:11.552263 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 324536us
I20260709 13:20:11.484091 23239 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:11.554450 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 422199us
I20260709 13:20:11.249992 23342 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.260s
I20260709 13:20:11.483680 22899 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:11.587922 23296 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.003s
W20260709 13:20:11.636220 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 390319us
I20260709 13:20:11.509827 23420 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:11.631707 23175 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:11.665246 23295 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:20:11.669567 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 116479us
I20260709 13:20:11.671268 22899 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.681890 23341 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:11.682548 23341 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.683033 23341 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.685850 23340 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:11.587157 23314 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.686480 23340 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:11.687314 23340 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.687772 23340 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.672267 23420 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.671964 23296 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.693226 23418 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.693454 23296 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:11.695369 23296 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:11.632367 23331 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:11.695931 23334 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.002s
W20260709 13:20:11.697976 23333 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.739s	user 0.007s	sys 0.004s
I20260709 13:20:11.692950 23175 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.628329 23249 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:11.676056 23295 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:11.709239 23296 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.748411 23296 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:11.725795 23365 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:11.749128 23365 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.750077 23319 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:11.751295 23365 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:11.666790 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:11.649638 23379 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.637207 23239 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.734201 23333 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.760686 23239 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.676594 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:11.761140 23421 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.653034 23328 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.761842 23421 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:11.762243 23421 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.762692 23421 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.736750 23341 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:11.714079 23304 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:11.738323 23249 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.765622 23304 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.767439 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:11.768292 23379 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.770488 23379 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.632684 23358 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.771435 23249 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:11.725368 23194 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:11.772269 23194 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.773554 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2291) took 1338 ms. Trace:
I20260709 13:20:11.774034 17318 rpcz_store.cc:276] 0709 13:20:10.435495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.435865 (+   370us) service_pool.cc:224] Handling call
0709 13:20:10.436209 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.463885 (+ 27676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.773231 (+1309346us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5400369054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:11.773471 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54885760}
I20260709 13:20:11.729234 23334 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:11.776484 23396 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.850s	user 0.006s	sys 0.003s
I20260709 13:20:11.776722 23334 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.696676 23289 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.775000 23194 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:11.780927 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:11.758275 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 91736.3us
I20260709 13:20:11.768067 17996 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:11.737373 23326 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:11.789459 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:11.789948 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:11.792543 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:11.793381 17322 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.799170 17321 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:11.799455 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:11.801041 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:11.803399 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.725383 23331 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.800240 17992 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:11.805214 17392 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:11.754966 23433 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.806752 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:11.806923 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 130425us
I20260709 13:20:11.812525 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.768038 23304 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:11.795315 23419 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 13:20:11.816545 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:11.819505 17998 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:11.789693 23396 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.818876 17321 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:11.795852 23326 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:11.787858 23365 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:11.816022 23058 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.011s	sys 0.029s
I20260709 13:20:11.826172 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.832298 17396 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:11.832796 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:11.815418 23341 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:11.835680 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 310035us
I20260709 13:20:11.844406 17964 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.796257 23194 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:20:11.840480 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:11.841362 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:11.842717 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:11.842720 17321 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:11.845520 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:11.845671 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.847407 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:11.854362 17388 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:11.828830 23342 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:11.833498 23058 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.011s	sys 0.029s
I20260709 13:20:11.858777 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:11.860514 17397 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: [11.9-15.11]
I20260709 13:20:11.832645 23296 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:11.862493 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:11.862983 17464 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.872143 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:11.848912 23319 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.873929 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1523) took 1805 ms. Trace:
I20260709 13:20:11.873999 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2289) took 1465 ms. Trace:
I20260709 13:20:11.874912 17317 rpcz_store.cc:276] 0709 13:20:10.408229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.408368 (+   139us) service_pool.cc:224] Handling call
0709 13:20:10.408719 (+   351us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:10.557032 (+148313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.873759 (+1316727us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540035c0d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:11.873941 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255710080}
I20260709 13:20:11.876535 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:11.874660 17314 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:11.817664 23433 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.880021 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:11.874387 17997 rpcz_store.cc:276] 0709 13:20:10.068998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.077584 (+  8586us) service_pool.cc:224] Handling call
0709 13:20:10.077860 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.175886 (+ 98026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.873699 (+1697813us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b5400661054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:11.873869 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207452416}
I20260709 13:20:11.854645 23422 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:11.815446 23295 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.857554 23341 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:11.889657 23341 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.844907 23365 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:11.893473 23175 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.894908 23365 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.896250 23098 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:11.909772 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3552) took 1453 ms. Trace:
I20260709 13:20:11.910353 17391 rpcz_store.cc:276] 0709 13:20:10.455940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.456082 (+   142us) service_pool.cc:224] Handling call
0709 13:20:10.456429 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:10.500906 (+ 44477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.500949 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:10.501624 (+   675us) log.cc:844] Serialized 52 byte log entry
0709 13:20:10.583191 (+ 81567us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:10.583240 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.909166 (+1325926us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5400254754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:11.909231 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.909297 (+    66us) raft_consensus.cc:1685] finished
0709 13:20:11.909317 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.909668 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13181,"raft.queue_time_us":93381,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8730,"spinlock_wait_cycles":37905792,"thread_start_us":57572,"threads_started":2,"wal-append.queue_time_us":369539}
W20260709 13:20:11.913089 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3542) took 1939 ms (client timeout 1972 ms). Trace:
W20260709 13:20:11.913609 17465 rpcz_store.cc:269] 0709 13:20:09.974091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.012377 (+ 38286us) service_pool.cc:224] Handling call
0709 13:20:11.912896 (+1900519us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54003840d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:11.913028 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617229696}
I20260709 13:20:11.917266 23422 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:11.919394 23422 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:11.920130 23422 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:11.921383 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:11.922061 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:11.922158 17434 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:11.861191 23434 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.885849 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:11.931113 17466 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.883841 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:11.886210 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:11.885207 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:11.869259 23194 consensus_queue.cc:1243] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:11.941613 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:11.945212 17317 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.946069 17322 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:11.947530 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:11.948310 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:11.942204 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:11.949150 17313 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:11.949244 17321 raft_consensus.cc:2376] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17. Re-sending same reply.
I20260709 13:20:11.949505 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:11.950294 17320 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:11.951560 23365 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:11.951689 23386 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:11.952257 23365 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:11.954224 17466 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:11.954406 23433 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:11.953830 17317 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:11.932320 23342 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:11.933264 23430 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:20:11.963574 23430 consensus_queue.cc:1243] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:11.967113 23278 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:11.967864 23278 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:11.880437 23340 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:11.879238 23344 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:11.888129 23009 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.003s
I20260709 13:20:11.974640 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:11.976622 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:11.875298 23432 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.945760 23328 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:11.884497 23436 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.884654 23333 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:11.981014 23342 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:20:11.994464 23304 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:12.002837 23342 consensus_queue.cc:1243] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:12.003486 23342 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:12.003858 23342 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:12.004709 23149 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:12.004817 23342 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:12.006024 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 967) took 1494 ms. Trace:
I20260709 13:20:12.006721 23342 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.006556 17395 rpcz_store.cc:276] 0709 13:20:10.512044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.512202 (+   158us) service_pool.cc:224] Handling call
0709 13:20:10.512518 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.002355 (+489837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.005671 (+1003316us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b540009b5d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:12.005933 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104417664}
I20260709 13:20:12.018396 17389 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:12.016881 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:12.019932 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:12.017848 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:12.023598 17390 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:11.991310 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:11.981395 23361 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.004s
W20260709 13:20:12.047892 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.029443 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:12.031275 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:12.031721 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:11.983708 23194 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:12.037529 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:12.038854 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:12.005336 23149 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:12.041299 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:12.041522 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:12.066246 17393 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:12.041311 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:12.041949 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:12.064904 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:12.042649 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:12.067883 17322 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:12.043159 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:12.025130 23428 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:20:11.970477 23434 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.062989 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:12.063220 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:12.070993 17317 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:20:12.065505 17314 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:12.065994 17466 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.989459 23344 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.041661 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:12.084476 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:12.013679 23437 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:12.102923 17466 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:11.922281 23326 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.064299 23304 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:12.050377 23333 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:12.114530 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:12.116185 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:12.071285 23430 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:12.118296 17463 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.102713 17391 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:12.118772 17466 raft_consensus.cc:2410] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:12.019851 23175 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:20:12.097668 23359 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:12.054833 23340 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:20:12.116351 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 87014.7us
I20260709 13:20:12.122159 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:12.136238 17471 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.046636 23380 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:20:12.000959 23436 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:12.138302 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.109301 23384 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:12.115362 23345 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:12.155758 17463 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:12.142158 17393 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:12.102391 23164 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:20:12.096230 23431 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:20:12.111161 23242 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:12.116611 23332 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.613s	user 0.005s	sys 0.005s
I20260709 13:20:12.122923 23292 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:12.114802 23402 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:12.063645 23361 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.112361 23433 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:12.123200 23331 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:12.036216 17464 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:12.232120 23278 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:12.235635 23344 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:12.210707 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.259814 23434 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:12.135349 23359 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:12.232802 23332 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:12.231689 23242 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:12.267589 17471 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:12.135541 23304 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:12.158269 23326 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:12.058893 23422 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.116148 23437 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:12.310300 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 438216us
I20260709 13:20:12.130156 23333 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.314268 17318 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
W20260709 13:20:12.354631 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 474510us
I20260709 13:20:12.194708 23384 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:12.332355 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:12.311848 23278 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.357492 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:12.361872 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.020s	sys 0.065s
W20260709 13:20:12.367785 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.020s	sys 0.065s
I20260709 13:20:12.308378 23292 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:12.350143 17962 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:12.361385 17434 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:12.369134 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:12.369894 17464 raft_consensus.cc:2376] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18. Re-sending same reply.
I20260709 13:20:12.372408 17466 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 13:20:12.374872 17992 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:12.372386 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:12.375913 17999 raft_consensus.cc:2368] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:12.157292 23430 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.376365 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:12.377103 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:12.379197 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:12.385205 23396 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:12.385782 23396 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:12.164633 23149 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.305572 23402 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:12.307648 23433 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.424467 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:12.399062 17315 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.014s	sys 0.014s
W20260709 13:20:12.401697 17996 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.014s	sys 0.007s
W20260709 13:20:12.401671 17468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.011s	sys 0.018s
W20260709 13:20:12.442289 17315 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.015s	sys 0.014s
W20260709 13:20:12.442507 17468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.012s	sys 0.018s
W20260709 13:20:12.442323 17996 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.014s	sys 0.007s
I20260709 13:20:12.400604 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:12.510311 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:12.511124 17998 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:20:12.518297 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 120844us
W20260709 13:20:12.522099 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 172074us
I20260709 13:20:12.523816 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:12.539552 17362 leader_election.cc:336] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.652s (SENT)
I20260709 13:20:12.540235 17362 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:12.376377 23345 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:12.423408 23058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.012s	sys 0.020s
I20260709 13:20:12.376294 23434 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:12.399616 23396 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:12.522401 23340 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:12.614683 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:12.614948 23292 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.375800 23278 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:12.616645 23440 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.309s	user 0.000s	sys 0.000s
I20260709 13:20:12.618943 23435 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:12.619246 23437 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:12.629485 23421 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.866s	user 0.013s	sys 0.000s
W20260709 13:20:12.681607 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.042s
I20260709 13:20:12.683094 17464 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
W20260709 13:20:12.760504 17362 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.767s (SENT)
I20260709 13:20:12.769851 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:12.508898 23341 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.581156 23420 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.891s	user 0.005s	sys 0.008s
W20260709 13:20:12.769418 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.011s	sys 0.042s
I20260709 13:20:12.630419 23263 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.651887 23434 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.682601 23331 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.679359 23194 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.653591 23345 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:12.800272 17997 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.029s	sys 0.030s
W20260709 13:20:12.802436 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 656975us
W20260709 13:20:12.808545 17997 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.029s	sys 0.030s
I20260709 13:20:12.769228 23309 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:12.400724 23359 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:12.821570 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.833487 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:12.839326 17464 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.767984 23435 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:12.795428 23434 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.814009 23396 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.767616 23340 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:12.832628 23440 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:20:12.817129 23365 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:12.816397 23058 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:12.878523 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 69687us
I20260709 13:20:12.825937 23309 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:12.885074 17464 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:20:12.881268 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:12.798586 23341 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:12.843317 23245 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:12.631768 23304 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:12.848903 23467 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.869711 23359 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.781199 23421 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.807677 23263 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:12.893949 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:12.882351 23342 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.875s	user 0.011s	sys 0.000s
I20260709 13:20:12.807848 23331 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:12.818362 23194 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.812507 23420 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:12.868052 23436 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:12.904938 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.074810 17962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.013s
W20260709 13:20:13.154181 17962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.000s	sys 0.016s
W20260709 13:20:13.062912 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.050076 17998 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:20:13.190411 17998 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
W20260709 13:20:12.960587 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.400501 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.922024 23245 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.929126 23435 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.208216 23333 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:13.264142 23470 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.269s	user 0.000s	sys 0.000s
W20260709 13:20:13.273147 23455 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:20:13.237005 23402 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:13.264667 23462 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:20:13.232257 23384 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.211753 23309 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:13.291946 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.354979 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 831186us
I20260709 13:20:13.355362 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1092) took 1566 ms. Trace:
I20260709 13:20:12.897509 23380 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.899605 23446 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.364923 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:13.381146 23478 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:13.470034 17462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.004s	sys 0.016s
W20260709 13:20:13.041100 23418 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.347s	user 0.011s	sys 0.002s
I20260709 13:20:12.887220 23437 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:13.382108 17464 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.441370 23465 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.395272 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.451145 23333 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.883388 23058 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:13.496366 17964 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:13.052637 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 171459us
I20260709 13:20:13.498212 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:13.401355 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.502828 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:13.503371 23264 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.503844 23264 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:13.504220 23264 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.357861 23436 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:13.380937 23451 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.530s	user 0.011s	sys 0.011s
W20260709 13:20:13.384938 23441 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.599s	user 0.000s	sys 0.022s
W20260709 13:20:13.389051 23473 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.468s	user 0.000s	sys 0.008s
W20260709 13:20:13.415879 23444 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.380s	user 0.000s	sys 0.008s
I20260709 13:20:13.457584 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:13.452618 17996 rpcz_store.cc:276] 0709 13:20:11.788823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.797106 (+  8283us) service_pool.cc:224] Handling call
0709 13:20:11.812424 (+ 15318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.812637 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:12.443595 (+630958us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.052979 (+609384us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:13.355063 (+302084us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:13.355109 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.355175 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.355308 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":994,"prepare.queue_time_us":709468,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":21791,"spinlock_wait_cycles":195414272,"thread_start_us":1238528,"threads_started":3,"wal-append.queue_time_us":454487}
I20260709 13:20:13.381219 23422 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:12.881892 23361 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.374650 17992 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:13.495905 23465 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.505059 23437 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:13.479089 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 114267us
I20260709 13:20:13.550774 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:13.551347 17991 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:13.551401 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:13.551834 23485 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:13.483883 17463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.009s	sys 0.011s
W20260709 13:20:13.552433 17463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.010s	sys 0.011s
W20260709 13:20:13.552992 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 95524us
W20260709 13:20:13.484087 17462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.004s	sys 0.016s
I20260709 13:20:13.368357 23467 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.448469 23342 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.492210 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 123111us
I20260709 13:20:13.505008 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:13.466574 23402 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:13.430899 23245 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.515738 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:13.515993 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:13.519094 17464 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:13.521477 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1959) took 1707 ms. Trace:
I20260709 13:20:13.477931 23486 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.478838 23418 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:13.529996 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:13.540587 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:13.535733 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1970) took 1496 ms. Trace:
I20260709 13:20:13.544787 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:13.547394 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:13.548977 17995 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:13.036005 23242 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.550196 17999 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:13.553162 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3573) took 1362 ms. Trace:
I20260709 13:20:13.554471 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:13.453635 23435 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.467379 23380 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.529099 23309 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:13.619849 23417 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.996s	user 0.000s	sys 0.019s
I20260709 13:20:13.620311 23417 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20.
I20260709 13:20:13.509413 23345 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.620944 23483 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:13.621208 23345 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:13.621462 23434 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.005s
I20260709 13:20:13.621886 23345 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:13.621984 23434 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.622475 23345 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.624322 23434 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:13.586365 23342 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:13.625345 23326 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.272s	user 0.012s	sys 0.008s
W20260709 13:20:13.626313 23396 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.753s	user 0.006s	sys 0.006s
I20260709 13:20:13.626753 23342 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.627465 23342 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.627940 23342 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.628861 23194 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.573803 23402 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:13.629462 23421 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.568851 23430 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.614820 23242 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:13.630980 23245 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.529843 23278 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.551419 23331 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:13.631978 23331 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.604169 23486 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.632468 23331 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.633975 23486 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.629562 23263 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.634615 23331 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:13.635241 23433 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.635419 17466 raft_consensus.cc:2368] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15.
I20260709 13:20:13.593878 17996 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:13.473343 23446 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.557158 23422 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.638123 23432 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:13.638572 23432 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:13.598830 17395 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:13.568055 23492 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.644758 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:13.608989 17995 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:13.690260 17395 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.690598 23278 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.691159 23278 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.530194 23436 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.669883 23418 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:20:13.629542 23402 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:13.694185 23436 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:13.695271 23328 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:13.695667 23328 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:13.696432 23328 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.697443 23422 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.698241 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3576) took 1117 ms. Trace:
I20260709 13:20:13.630862 23242 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.631340 23467 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.588476 17319 rpcz_store.cc:276] 0709 13:20:11.813868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.814095 (+   227us) service_pool.cc:224] Handling call
0709 13:20:11.814420 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.814791 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.814819 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.911291 (+ 96472us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b18003f7b40. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a
0709 13:20:11.911924 (+   633us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b2c00014ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:20:11.912802 (+   878us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.401348 (+488546us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:12.401391 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.401457 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.521210 (+1119753us) raft_consensus.cc:1685] finished
0709 13:20:13.521239 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.521402 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7035,"raft.queue_time_us":1079,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":35436,"spinlock_wait_cycles":10849792,"thread_start_us":407273,"threads_started":1,"wal-append.queue_time_us":852271}
I20260709 13:20:13.570618 17397 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:13.588277 17390 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:13.644580 23488 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.727679 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 976) took 1942 ms. Trace:
I20260709 13:20:13.728240 17394 rpcz_store.cc:276] 0709 13:20:11.785546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.786329 (+   783us) service_pool.cc:224] Handling call
0709 13:20:11.786656 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:11.789277 (+  2621us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:11.823598 (+ 34321us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.306547 (+482949us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:12.347885 (+ 41338us) log.cc:844] Serialized 52 byte log entry
0709 13:20:12.348042 (+   157us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:12.348079 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.348147 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.727379 (+1379232us) raft_consensus.cc:1685] finished
0709 13:20:13.727408 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.727605 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4004,"prepare.queue_time_us":303804,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":14131,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":13794,"thread_start_us":447673,"threads_started":1,"wal-append.queue_time_us":1888412}
I20260709 13:20:13.600226 17313 rpcz_store.cc:276] 0709 13:20:12.039494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.067924 (+ 28430us) service_pool.cc:224] Handling call
0709 13:20:12.103068 (+ 35144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.103541 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.103587 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.112234 (+  8647us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.514325 (+402091us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:12.514384 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.514478 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.535417 (+1020939us) raft_consensus.cc:1685] finished
0709 13:20:13.535447 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.535654 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":5086,"thread_start_us":323673,"threads_started":1,"wal-append.queue_time_us":743448}
W20260709 13:20:13.647080 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 92686.9us
I20260709 13:20:13.732231 17962 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:13.733835 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:13.557706 23341 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:13.608856 23384 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.638041 17466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2122) took 1262 ms (client timeout 1558 ms). Trace:
I20260709 13:20:13.510524 23058 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.647639 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3569) took 1595 ms. Trace:
I20260709 13:20:13.639287 23446 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:13.644047 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:13.649472 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:13.651127 17996 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:13.742103 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.646443 23430 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:13.621496 23483 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:13.656379 23471 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 13:20:13.750702 23424 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.952s	user 0.013s	sys 0.013s
W20260709 13:20:13.753656 23480 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.602s	user 0.005s	sys 0.003s
W20260709 13:20:13.657688 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.755530 17285 connection.cc:256] RPC call timeout handler was delayed by -1.7779054799998448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 13:20:13.755901 17285 connection.cc:256] RPC call timeout handler was delayed by -1.418163247999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 13:20:13.756182 17285 connection.cc:256] RPC call timeout handler was delayed by -1.1539083220000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 13:20:13.744803 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:13.759641 17962 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:13.624600 23345 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:13.760571 23421 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:13.604899 23379 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:13.659685 23463 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:20:13.766198 23342 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.767202 23359 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.767695 23359 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.768137 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1547) took 1355 ms. Trace:
I20260709 13:20:13.743289 23488 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.769429 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1951) took 1982 ms. Trace:
I20260709 13:20:13.769923 23359 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.769891 17318 rpcz_store.cc:276] 0709 13:20:11.787492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.791483 (+  3991us) service_pool.cc:224] Handling call
0709 13:20:11.791885 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.354519 (+562634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.769220 (+1414701us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400366854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:13.769375 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1200911232}
I20260709 13:20:13.770959 23488 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.742359 23384 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.771282 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.662721 23417 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:13.673949 23489 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.741302 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 189943us
W20260709 13:20:13.675815 23445 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:20:13.664384 23434 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.786638 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.787457 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.657336 23492 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.674000 23420 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.678704 17315 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:13.664057 23245 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:20:13.668769 23486 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:13.680063 17320 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:13.679937 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2124) took 1279 ms. Trace:
I20260709 13:20:13.676119 23499 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:13.681520 17314 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 13:20:13.681864 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.682078 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.804904 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.683034 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.684032 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3574) took 1328 ms. Trace:
I20260709 13:20:13.684259 23380 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.687037 23264 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.643072 17991 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:20:13.606063 17463 rpcz_store.cc:276] 0709 13:20:12.191078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.191224 (+   146us) service_pool.cc:224] Handling call
0709 13:20:12.191553 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.192311 (+   758us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:12.231352 (+ 39041us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.552787 (+1321435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:13.552861 (+    74us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:13.552913 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.552985 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.553106 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122615,"prepare.queue_time_us":39044,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":555225,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":9055,"thread_start_us":1198334,"threads_started":2,"wal-append.queue_time_us":898123}
I20260709 13:20:13.614274 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:13.698730 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 153640us
I20260709 13:20:13.812482 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.813900 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.815147 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.738137 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:13.738045 17466 rpcz_store.cc:269] 0709 13:20:12.375531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.376736 (+  1205us) service_pool.cc:224] Handling call
0709 13:20:13.637844 (+1261108us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001f2054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:13.637980 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2891867392}
I20260709 13:20:13.742365 17994 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:13.655215 23432 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.744777 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.745600 23483 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:13.746217 23242 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:13.820150 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3565) took 1942 ms. Trace:
I20260709 13:20:13.822610 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:13.823346 17463 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
W20260709 13:20:13.824265 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 1009) took 1375 ms (client timeout 1831 ms). Trace:
I20260709 13:20:13.762774 17962 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:13.765388 23058 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.768725 23502 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:20:13.831722 23487 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:13.832100 23487 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:13.832494 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3575) took 1451 ms. Trace:
I20260709 13:20:13.833179 23492 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.834223 23432 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.835389 23328 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.837694 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.785451 23334 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:13.653851 23377 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:13.838786 23377 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:13.839098 23334 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:13.839461 23334 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:13.839635 23377 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:13.840579 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.840698 23377 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.791764 23434 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.768545 17993 rpcz_store.cc:276] 0709 13:20:12.412646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.415460 (+  2814us) service_pool.cc:224] Handling call
0709 13:20:12.581585 (+166125us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:12.947101 (+365516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.947159 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:13.004432 (+ 57273us) log.cc:844] Serialized 52 byte log entry
0709 13:20:13.446951 (+442519us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:13.478144 (+ 31193us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.478391 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.760810 (+282419us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b180038c260. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f707522 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:13.767826 (+  7016us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400246154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:13.767879 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.767925 (+    46us) raft_consensus.cc:1685] finished
0709 13:20:13.767939 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.768082 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31551,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":10924,"raft.queue_time_us":893738,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3406,"spinlock_wait_cycles":529581824,"thread_start_us":241506,"threads_started":2,"wal-append.queue_time_us":600041}
I20260709 13:20:13.842499 23149 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.843648 23245 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.844146 23245 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.844659 23504 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.845178 23504 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.790575 23488 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:20:13.846282 23488 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.846720 23386 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:13.847124 23386 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:13.847810 23264 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.847906 23487 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.720448 17395 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:13.776782 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:13.783259 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.740399 23467 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:13.851692 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1543) took 1472 ms. Trace:
I20260709 13:20:13.795682 23461 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:20:13.852603 23492 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:13.853053 23242 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:13.853399 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:13.853739 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 91051.1us
I20260709 13:20:13.788882 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3557) took 2655 ms. Trace:
W20260709 13:20:13.854808 23477 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.813s	user 0.003s	sys 0.000s
I20260709 13:20:13.857115 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:13.857815 23358 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.858770 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:13.860067 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.860000 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:13.861223 23467 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:13.861783 23467 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:13.862322 23499 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:13.862622 23467 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.862882 23499 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.854617 17470 rpcz_store.cc:276] 0709 13:20:11.123050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.123166 (+   116us) service_pool.cc:224] Handling call
0709 13:20:11.130688 (+  7522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.555421 (+424733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.555469 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.555528 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:11.555574 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.778161 (+2222587us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400200654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:13.778211 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.778326 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976084224}
I20260709 13:20:13.865226 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:13.865963 17470 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 15: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:13.866322 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3578) took 1060 ms. Trace:
I20260709 13:20:13.866622 17470 rpcz_store.cc:276] 0709 13:20:12.806050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.864972 (+1058922us) service_pool.cc:224] Handling call
0709 13:20:13.866272 (+  1300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:13.867547 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:13.868682 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:13.869469 17392 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:13.789577 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2264) took 2938 ms. Trace:
I20260709 13:20:13.773831 23421 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:13.871376 17389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3567) took 1852 ms (client timeout 1662 ms). Trace:
I20260709 13:20:13.766100 23340 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:13.871946 17389 rpcz_store.cc:269] 0709 13:20:12.018893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.019610 (+   717us) service_pool.cc:224] Handling call
0709 13:20:13.871143 (+1851533us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540023c3d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:13.871300 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3965252352}
I20260709 13:20:13.794008 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.799355 17462 rpcz_store.cc:276] 0709 13:20:12.400904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.402524 (+  1620us) service_pool.cc:224] Handling call
0709 13:20:12.402857 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.403228 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.403262 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.446776 (+ 43514us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.624113 (+177337us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b180047de80. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:20:13.553772 (+929659us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:13.553820 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.553896 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.679650 (+125754us) raft_consensus.cc:1685] finished
0709 13:20:13.679671 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.679882 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1093,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":32108,"spinlock_wait_cycles":150684928,"thread_start_us":929460,"threads_started":1,"wal-append.queue_time_us":1222486}
I20260709 13:20:13.873174 17315 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:13.874117 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:13.874624 17315 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:20:13.875145 17462 raft_consensus.cc:2410] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:13.875713 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3579) took 1031 ms. Trace:
I20260709 13:20:13.773705 23417 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:13.809360 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.809505 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:13.806509 17471 rpcz_store.cc:276] 0709 13:20:12.355663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.355794 (+   131us) service_pool.cc:224] Handling call
0709 13:20:12.356138 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.356387 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:12.375863 (+ 19476us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.683526 (+1307663us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b18004c8940. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a
0709 13:20:13.683727 (+   201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:13.683774 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:13.683815 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.683876 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.683978 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25940,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":89,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":18973568,"thread_start_us":144162,"threads_started":1,"wal-append.queue_time_us":1232964}
I20260709 13:20:13.877238 17322 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.766042 23379 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:13.787968 23333 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:13.818928 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.820063 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.821429 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:13.852006 17360 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:13.895328 17388 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:13.895649 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 43727.2us
I20260709 13:20:13.822741 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.897610 17313 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:13.823014 17468 rpcz_store.cc:276] 0709 13:20:11.877686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.877850 (+   164us) service_pool.cc:224] Handling call
0709 13:20:11.878313 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.878632 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.878673 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.884524 (+  5851us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.442847 (+558323us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:12.442885 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.442953 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.819903 (+1376950us) raft_consensus.cc:1685] finished
0709 13:20:13.819931 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.820087 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":549642,"threads_started":1,"wal-append.queue_time_us":1589857}
I20260709 13:20:13.825716 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:13.898825 17466 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.749150 23450 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:13.765189 23168 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:13.849529 23487 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:13.903998 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:13.794714 23489 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.921066 17360 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:13.827924 23384 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.739830 17465 rpcz_store.cc:276] 0709 13:20:12.052138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.052311 (+   173us) service_pool.cc:224] Handling call
0709 13:20:12.096068 (+ 43757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:13.360739 (+1264671us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:13.446837 (+ 86098us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.500176 (+ 53339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:13.500245 (+    69us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:13.500301 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.647377 (+147076us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54004213d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:13.647434 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.647573 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":149645,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":128353,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":2665555328,"thread_start_us":98869,"threads_started":3,"wal-append.queue_time_us":293126}
I20260709 13:20:13.772403 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:13.798277 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:13.923043 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 124830us
I20260709 13:20:13.923835 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:13.698619 17464 rpcz_store.cc:276] 0709 13:20:12.581020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.893602 (+312582us) service_pool.cc:224] Handling call
0709 13:20:13.698086 (+804484us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b54003840d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:13.698184 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45074304}
W20260709 13:20:13.788763 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.928727 17390 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:13.876056 17462 rpcz_store.cc:276] 0709 13:20:12.844375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.873816 (+1029441us) service_pool.cc:224] Handling call
0709 13:20:13.875654 (+  1838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:13.870847 17396 rpcz_store.cc:276] 0709 13:20:10.841028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.985947 (+144919us) service_pool.cc:224] Handling call
0709 13:20:10.986230 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.833274 (+847044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.774092 (+1940818us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540036fbd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:13.779171 (+  5079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937993088}
I20260709 13:20:13.916483 17322 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
W20260709 13:20:13.824784 17463 rpcz_store.cc:269] 0709 13:20:12.449337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.822388 (+1373051us) service_pool.cc:224] Handling call
0709 13:20:13.824189 (+  1801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:13.852221 17992 rpcz_store.cc:276] 0709 13:20:12.379166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.379311 (+   145us) service_pool.cc:224] Handling call
0709 13:20:12.379632 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:13.550313 (+1170681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.851345 (+301032us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b54006cedd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:13.851610 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2287848320}
I20260709 13:20:13.784493 17285 leader_election.cc:400] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:13.892469 17996 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:13.892333 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 115613us
I20260709 13:20:13.876438 23417 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.832928 17467 rpcz_store.cc:276] 0709 13:20:12.381288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.382817 (+  1529us) service_pool.cc:224] Handling call
0709 13:20:12.383135 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.859070 (+475935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.859109 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:12.859157 (+    48us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:12.859187 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.832260 (+973073us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400281c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:13.832307 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.832437 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093829504}
I20260709 13:20:13.902276 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:13.840200 23334 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.956236 23334 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.960043 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:13.901918 23492 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.960896 17463 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:13.961179 23492 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.962060 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2138) took 1030 ms. Trace:
I20260709 13:20:13.962517 17463 rpcz_store.cc:276] 0709 13:20:12.931678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.959761 (+1028083us) service_pool.cc:224] Handling call
0709 13:20:13.961688 (+  1927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:13.962853 23245 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.853478 23242 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:13.963428 23492 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:13.963711 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:13.964497 17463 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:13.910974 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:13.969595 17468 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:13.912854 17314 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:13.933449 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:13.937887 17285 leader_election.cc:403] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:13.941547 17321 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:13.910887 23261 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.939854 22983 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:13.932487 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:13.986931 17471 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:20:13.911092 23421 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:13.941406 23264 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:13.939483 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:13.949566 23437 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.014222 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:14.015009 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 240012us
I20260709 13:20:13.950088 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:14.016592 17995 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.847852 23386 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.953790 23402 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:13.940506 23426 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 2.314s	user 0.008s	sys 0.000s
W20260709 13:20:13.907173 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.964136 23242 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:13.932267 23507 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.894883 23295 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:13.965626 23465 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:13.933365 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.911438 23483 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.872450 17470 raft_consensus.cc:2368] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15.
I20260709 13:20:14.052461 17394 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:13.987756 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 1013) took 1537 ms. Trace:
W20260709 13:20:13.998878 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 55903.1us
I20260709 13:20:14.000527 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.053825 17471 rpcz_store.cc:276] 0709 13:20:12.450496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.877487 (+1426991us) service_pool.cc:224] Handling call
0709 13:20:13.987550 (+110063us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.003355 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:14.004634 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.007802 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1094) took 2078 ms. Trace:
I20260709 13:20:14.007414 17388 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:14.054893 17464 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:14.055660 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:13.994539 17466 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
W20260709 13:20:14.013477 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 74024.6us
W20260709 13:20:14.024339 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.057499 17466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2133) took 1355 ms (client timeout 1748 ms). Trace:
W20260709 13:20:14.057847 17466 rpcz_store.cc:269] 0709 13:20:12.702468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.825390 (+1122922us) service_pool.cc:224] Handling call
0709 13:20:14.057428 (+232038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.058593 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.058982 17466 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:20:14.026343 17389 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:13.846760 23488 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.059993 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.030704 17393 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:20:14.060771 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.022051 23435 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.031957 23492 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:14.033126 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.937706 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.036120 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.063737 17992 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:14.064448 17434 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:14.040184 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 1953) took 2252 ms. Trace:
I20260709 13:20:13.995231 23261 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.995378 23374 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.040153 17285 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.043399 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.043399 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.066959 17991 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:14.005432 23264 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.021570 22983 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:13.970971 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 399229us
I20260709 13:20:14.056974 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.013739 23421 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.052979 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2135) took 1224 ms. Trace:
I20260709 13:20:14.068427 17995 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:14.043823 23507 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.069569 23261 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.060611 17314 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:14.071858 17396 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:14.054796 17997 rpcz_store.cc:276] 0709 13:20:11.929541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.929670 (+   129us) service_pool.cc:224] Handling call
0709 13:20:11.930049 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.930351 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:13.772141 (+1841790us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b1800399a60. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf
0709 13:20:13.772272 (+   131us) log.cc:844] Serialized 14 byte log entry
0709 13:20:14.007351 (+235079us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:14.007424 (+    73us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:14.007485 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.007570 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.007727 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":835665,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":5756,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":13126,"spinlock_wait_cycles":50902912,"thread_start_us":1058625,"threads_started":2,"wal-append.queue_time_us":239243}
I20260709 13:20:14.072667 23264 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:14.135663 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.069876 23492 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.065279 17316 rpcz_store.cc:276] 0709 13:20:11.788191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.802487 (+ 14296us) service_pool.cc:224] Handling call
0709 13:20:11.813255 (+ 10768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.814479 (+  1224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.814527 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.830930 (+2016403us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b2c00014ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:20:13.831348 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:20:14.006848 (+175500us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:14.006890 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.006952 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.006993 (+    41us) raft_consensus.cc:1685] finished
0709 13:20:14.007003 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.040096 (+ 33093us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2306,"raft.queue_time_us":918,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":14116,"spinlock_wait_cycles":7179136,"thread_start_us":175143,"threads_started":1,"wal-append.queue_time_us":170978}
I20260709 13:20:14.038879 23361 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:14.137015 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:14.138082 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 66749.7us
I20260709 13:20:14.066886 17465 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:20:14.140093 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:14.140404 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 100365us
W20260709 13:20:14.141973 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.143633 17470 rpcz_store.cc:276] 0709 13:20:12.828971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.867325 (+1038354us) service_pool.cc:224] Handling call
0709 13:20:14.052917 (+185592us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:14.145612 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 88766.5us
I20260709 13:20:14.053541 23386 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:14.061124 23485 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.170527 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.188210 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 1014) took 1034 ms. Trace:
I20260709 13:20:14.188467 17995 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:14.189637 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.189939 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.190366 17995 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:20:14.054052 23362 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.924s	user 0.007s	sys 0.036s
I20260709 13:20:14.175551 17389 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:14.179809 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.194583 17471 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:14.173136 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:14.191102 17465 rpcz_store.cc:276] 0709 13:20:13.153905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.014255 (+860350us) service_pool.cc:224] Handling call
0709 13:20:14.188152 (+173897us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.184734 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.191145 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.201416 17464 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:14.201606 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.202268 17465 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:14.202436 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.203056 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.203094 17464 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.203544 17465 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:14.204111 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.204452 17465 raft_consensus.cc:2376] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17. Re-sending same reply.
I20260709 13:20:14.189381 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:14.140422 23396 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.185231 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3555) took 3066 ms. Trace:
I20260709 13:20:14.205348 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.207216 17465 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.212031 23497 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:14.178359 23164 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:20:14.205261 23396 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:14.213253 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.213183 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.214457 23465 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:14.214562 23396 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:14.215060 23465 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.217784 23402 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:14.218266 23417 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.219452 17999 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:14.220481 23511 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.221151 23511 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.184697 23512 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:14.224750 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 51604.3us
I20260709 13:20:14.224984 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.133510 23374 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.134028 23435 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.070398 23483 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.212697 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.205264 17469 rpcz_store.cc:276] 0709 13:20:11.119026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.119183 (+   157us) service_pool.cc:224] Handling call
0709 13:20:11.119604 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.119879 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.119916 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.120459 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:20:11.236268 (+115809us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:11.236347 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.236492 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.877189 (+2640697us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:14.173496 (+296307us) raft_consensus.cc:1685] finished
0709 13:20:14.173516 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.185143 (+ 11627us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25236224,"thread_start_us":115368,"threads_started":1,"wal-append.queue_time_us":383952}
W20260709 13:20:14.235630 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.239925 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.246793 23505 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:14.249074 23340 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.249910 23342 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:14.146369 23344 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:20:14.253352 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.254513 23421 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.171931 23467 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:14.281351 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 90670.8us
I20260709 13:20:14.336088 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:14.179370 23504 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:14.184276 23507 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.282171 17991 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
W20260709 13:20:14.212731 23453 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.004s	sys 0.024s
I20260709 13:20:14.277259 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.368695 17471 raft_consensus.cc:2376] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13. Re-sending same reply.
I20260709 13:20:14.272222 23486 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:14.212875 23447 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:20:14.330205 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:14.329093 17992 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
W20260709 13:20:14.374063 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 44000.7us
W20260709 13:20:14.194260 23362 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.064s	user 0.008s	sys 0.037s
W20260709 13:20:14.336337 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 111422us
I20260709 13:20:14.337433 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.294911 17465 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:20:14.264418 23296 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.255991 23488 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:14.257321 23513 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:20:14.344727 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.384908 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.345539 17464 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:14.342267 23467 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:14.342713 23502 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:14.332670 23342 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.349829 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.350092 23435 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:14.350211 23358 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:14.351259 23309 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.278026 23264 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.351514 23380 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:14.353063 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 120450us
I20260709 13:20:14.332532 23340 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.267695 23511 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:14.223919 23485 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.183866 23175 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.159s
I20260709 13:20:14.264817 23434 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:14.193780 23492 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.273378 23489 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:14.376235 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:14.382499 23296 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.381207 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.386459 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.421474 17465 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:14.421967 17464 raft_consensus.cc:2410] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:14.344470 23512 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:14.377460 23453 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.371s	user 0.005s	sys 0.024s
I20260709 13:20:14.391273 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:14.379374 23295 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.391825 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.370275 23486 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.393615 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.261036 22983 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.430581 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.430811 23486 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:14.431255 17469 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:14.401655 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:14.401918 17322 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:14.404903 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:14.382496 23465 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:14.393174 23334 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:14.408339 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.387490 23467 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.387749 23502 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:14.391930 23342 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.415982 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:14.368781 23432 consensus_meta.cc:287] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
W20260709 13:20:14.420640 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.417845 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:14.414522 23261 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.428399 17992 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:14.428511 17471 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
W20260709 13:20:14.469511 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51766.9us
I20260709 13:20:14.466643 17316 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:14.470252 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:14.443323 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.473245 17990 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:14.428500 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.404935 23358 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:14.450894 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.477741 17464 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:14.454998 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:14.462695 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 57892.1us
W20260709 13:20:14.463809 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 293643us
I20260709 13:20:14.479128 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.479614 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.426119 23434 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.479956 17469 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:14.404667 23309 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.400826 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:14.475499 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 337690us
I20260709 13:20:14.481370 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:14.475847 17995 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:20:14.425855 23487 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:14.480901 17318 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:14.482684 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:14.487835 17287 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.488065 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:14.489619 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.489748 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:14.457352 23529 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:14.465461 23502 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.494951 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:14.495730 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:14.469048 23465 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:14.480775 23328 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:14.536967 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.537665 17471 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:14.508570 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.508030 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:14.523743 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.507521 23361 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:14.480314 23434 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.499378 23334 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:14.530105 23296 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:14.540947 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.554004 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.526638 23465 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:14.554626 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.554756 17391 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:14.555711 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.555424 23465 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.527434 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.556758 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.528055 23365 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:14.559412 23361 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:14.554759 23434 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:14.559902 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.560755 17395 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:20:14.560467 23361 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.561800 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:14.563045 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.563941 23223 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:14.564285 23512 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.565973 23334 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:14.567057 23261 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:14.567202 23334 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.568370 23264 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.529263 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.570744 17392 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:14.571776 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.530017 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.532250 23483 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:14.533764 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.506106 23428 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:14.574735 23428 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:14.575133 17396 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:14.576465 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.577287 17392 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:20:14.558794 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 50214.7us
I20260709 13:20:14.549005 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.582955 17990 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:20:14.552587 17992 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:14.583906 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 207442us
I20260709 13:20:14.555842 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.559453 23365 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:14.584757 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.523481 23511 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.505944 23488 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:14.548975 23194 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.499426 23504 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:14.548138 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.578034 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.578493 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.602275 17471 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:14.486413 23487 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.549181 23328 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.605284 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.481014 23489 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:14.499712 23396 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:14.499372 23380 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:14.499486 23304 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:14.539915 23529 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:14.557303 23374 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.563915 17395 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:20:14.564733 23223 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:14.599469 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.603086 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.575659 23428 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.599792 23432 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:14.599550 23460 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:14.625746 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.625653 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.639622 17471 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:14.629384 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.640359 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.604275 23504 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.633121 17992 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:14.605166 23488 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:14.607115 23487 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.608547 23328 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.646816 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.599443 23511 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.610558 23396 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.640766 17993 raft_consensus.cc:2410] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:14.641887 17995 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:20:14.642396 23223 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.587237 23507 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.660774 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.661423 17471 raft_consensus.cc:2376] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18. Re-sending same reply.
I20260709 13:20:14.601284 23194 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.646648 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.611114 23489 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.651180 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.656522 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.662879 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.663378 17318 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:14.663726 17992 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:14.664316 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.647289 23504 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:14.670529 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.658984 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.640971 23508 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:14.659611 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:14.659960 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:14.658280 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.676496 17322 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:14.665704 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.657465 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.665966 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.666956 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.668530 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.659634 23396 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:14.608397 23358 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.666244 23489 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.692785 23328 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.693958 23379 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.695077 23328 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.670439 17318 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:14.671262 17990 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:14.645231 23432 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:14.680639 17994 raft_consensus.cc:2368] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:14.682471 17317 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:14.679747 23421 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:14.684507 23194 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.710165 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.711457 17471 raft_consensus.cc:2410] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:14.715432 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.717216 17471 raft_consensus.cc:2410] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:14.636665 23365 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.673792 23508 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:14.705224 23421 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:14.732389 23538 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.092s	user 0.003s	sys 0.001s
I20260709 13:20:14.738721 23511 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:14.728622 23508 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.729791 23365 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.751663 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.754842 17471 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:14.759675 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.734735 23421 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:14.771996 23507 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.774649 23489 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.680953 23529 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.724829 23488 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.792105 23508 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.794459 23508 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.782686 23505 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:14.811627 23505 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:14.768563 23432 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.831972 17990 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:14.836790 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.843439 17997 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:14.845703 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.846381 17470 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.853657 23460 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.854218 23460 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.861821 17470 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:14.812224 23492 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.864070 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.865028 17470 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.868862 17990 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:14.877064 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1549) took 1330 ms. Trace:
I20260709 13:20:14.878237 23504 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.877506 17998 rpcz_store.cc:276] 0709 13:20:13.546579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.546738 (+   159us) service_pool.cc:224] Handling call
0709 13:20:13.547109 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:13.673296 (+126187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.673343 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:13.673972 (+   629us) log.cc:844] Serialized 52 byte log entry
0709 13:20:14.004507 (+330535us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:14.034715 (+ 30208us) log.cc:844] Serialized 14 byte log entry
0709 13:20:14.034952 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.876642 (+841690us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b5400600ed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:14.876691 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.876744 (+    53us) raft_consensus.cc:1685] finished
0709 13:20:14.876863 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.877005 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62579,"prepare.queue_time_us":33767,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":69318,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":155612288,"thread_start_us":315070,"threads_started":1,"wal-append.queue_time_us":314222}
I20260709 13:20:14.880412 23504 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.880789 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.881153 17394 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:14.881469 17465 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:14.881544 23342 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.882457 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.883155 17465 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
W20260709 13:20:14.870317 23540 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:20:14.886132 17471 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:14.886512 17465 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:20:14.887856 17463 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:14.890251 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2125) took 2478 ms. Trace:
I20260709 13:20:14.890579 17465 rpcz_store.cc:276] 0709 13:20:12.412182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.885938 (+2473756us) service_pool.cc:224] Handling call
0709 13:20:14.886267 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.890003 (+  3736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.890209 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.886780 23489 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.900573 17470 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
W20260709 13:20:14.903991 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 72028.2us
I20260709 13:20:14.904031 17470 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:20:14.882618 23486 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.905057 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2127) took 2460 ms. Trace:
I20260709 13:20:14.894810 23295 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:14.906476 17470 rpcz_store.cc:276] 0709 13:20:12.444333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.903597 (+2459264us) service_pool.cc:224] Handling call
0709 13:20:14.903874 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.904780 (+   906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.905004 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.908318 23492 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:14.908504 17470 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: [13.13-15.14]
I20260709 13:20:14.909374 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1010) took 2459 ms. Trace:
I20260709 13:20:14.910125 17389 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:14.909698 17470 rpcz_store.cc:276] 0709 13:20:12.449601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.907883 (+2458282us) service_pool.cc:224] Handling call
0709 13:20:14.908268 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:14.909122 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.909329 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.911051 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:14.883738 23487 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.916457 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:14.926335 17462 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:20:14.926755 17462 pending_rounds.cc:85] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 7
I20260709 13:20:14.926981 17462 pending_rounds.cc:107] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:20:14.927214 17462 raft_consensus.cc:2889] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.927462 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1103) took 1238 ms. Trace:
I20260709 13:20:14.927887 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2128) took 2410 ms. Trace:
W20260709 13:20:14.930179 17463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2140) took 1573 ms (client timeout 1949 ms). Trace:
I20260709 13:20:14.930339 23227 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:14.930639 17463 rpcz_store.cc:269] 0709 13:20:13.357207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.997399 (+640192us) service_pool.cc:224] Handling call
0709 13:20:14.929986 (+932587us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54002e2f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:14.930114 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894561664}
I20260709 13:20:14.932029 23227 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:14.932453 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2129) took 2351 ms. Trace:
I20260709 13:20:14.932868 23257 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:14.933260 23257 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:14.934051 23257 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.936514 23460 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:14.937762 23543 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:20:14.939409 17962 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:14.940701 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:14.941290 17466 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.928387 17462 rpcz_store.cc:276] 0709 13:20:12.517278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.925687 (+2408409us) service_pool.cc:224] Handling call
0709 13:20:14.925987 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.927651 (+  1664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.927827 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.941505 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:14.942319 17463 rpcz_store.cc:276] 0709 13:20:12.581515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.931631 (+2350116us) service_pool.cc:224] Handling call
0709 13:20:14.931955 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.932131 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.932173 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:14.932216 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:14.932251 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.932305 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.932403 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.945225 17434 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:14.946828 17321 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:14.948577 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.949913 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:14.951329 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:14.951936 17319 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:14.953584 23486 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.927855 17999 rpcz_store.cc:276] 0709 13:20:13.689120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.705012 (+ 15892us) service_pool.cc:224] Handling call
0709 13:20:13.705409 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.219815 (+514406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.927256 (+707441us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400640354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:14.927409 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181717248}
I20260709 13:20:14.927256 22983 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:14.953830 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:14.964874 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:14.940506 23467 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:14.970878 23278 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.971705 23497 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:14.972220 23497 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:14.974576 23499 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:14.974246 23497 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:14.977929 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.982689 23435 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:14.983301 23435 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:14.983812 23435 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:14.985941 17466 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:14.987736 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:14.977833 17962 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:14.993456 23549 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:20:14.998659 17393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 2276) took 1483 ms (client timeout 1569 ms). Trace:
I20260709 13:20:14.999466 23102 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:15.001945 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:15.002694 17468 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.912679 23502 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:14.999280 17393 rpcz_store.cc:269] 0709 13:20:13.515361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.515480 (+   119us) service_pool.cc:224] Handling call
0709 13:20:14.998431 (+1482951us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400014354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:14.998582 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017693440}
I20260709 13:20:15.006996 17999 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:15.008009 17462 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:15.011113 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:14.966008 23486 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:14.975808 23497 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:15.032797 17997 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:15.031275 17468 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:15.034679 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:15.035454 17468 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
W20260709 13:20:15.039139 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.981424 23295 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:15.030154 17962 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:15.014048 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:15.046536 17466 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:20:15.047313 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2134) took 2270 ms. Trace:
I20260709 13:20:15.047712 17466 rpcz_store.cc:276] 0709 13:20:12.776908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.045860 (+2268952us) service_pool.cc:224] Handling call
0709 13:20:15.046252 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.047021 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.047252 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:15.036475 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:15.050293 17468 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.055980 17466 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:15.060050 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2136) took 2186 ms. Trace:
I20260709 13:20:14.960515 23396 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:14.981346 23460 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:15.018055 23168 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:15.018559 23499 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:15.032274 23450 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:15.044423 23295 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.016323 23421 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.076292 23278 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:15.089515 23278 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.089959 23278 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.093295 23505 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:15.068949 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2126) took 2649 ms. Trace:
I20260709 13:20:15.096782 23421 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:15.072772 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:15.095811 17465 rpcz_store.cc:276] 0709 13:20:12.419493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.891336 (+2471843us) service_pool.cc:224] Handling call
0709 13:20:14.891617 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.891759 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:14.967694 (+ 75935us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.068566 (+100872us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:15.068625 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:15.068676 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.068743 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.068888 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72985,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":98,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":173388,"threads_started":2,"wal-append.queue_time_us":123457}
I20260709 13:20:15.097579 17992 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:15.102027 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:15.060958 17468 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 11.
W20260709 13:20:15.080644 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.062136 23342 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.069978 23168 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:15.084035 23502 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:15.084890 23487 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:15.085222 23295 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.042168 23489 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:20:15.103946 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2137) took 2201 ms. Trace:
I20260709 13:20:15.106714 17396 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:15.107829 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.107167 17394 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:15.068480 23479 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:15.110162 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.110803 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.111419 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.101670 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.104101 17393 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:15.104569 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.101923 17465 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:20:15.105224 17392 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:20:15.075809 23249 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:20:15.107321 23450 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:15.117513 23249 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:15.117910 23249 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:15.106427 23428 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:15.118666 23428 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:15.118901 23249 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.119426 23428 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.113507 17468 rpcz_store.cc:276] 0709 13:20:12.902629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.103205 (+2200576us) service_pool.cc:224] Handling call
0709 13:20:15.103455 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.103629 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.103653 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:15.103694 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:15.103733 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.103798 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.103897 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:15.117944 23450 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:15.120132 23249 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.121752 17468 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:15.136307 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3581) took 2220 ms. Trace:
I20260709 13:20:15.060503 17466 rpcz_store.cc:276] 0709 13:20:12.873592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.048632 (+2175040us) service_pool.cc:224] Handling call
0709 13:20:15.055734 (+  7102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.056626 (+   892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.059962 (+  3336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:15.116703 17465 pending_rounds.cc:85] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 11
I20260709 13:20:15.115831 17990 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:15.137533 17465 pending_rounds.cc:107] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:20:15.137977 17465 raft_consensus.cc:2889] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:15.121141 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.120585 23428 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:15.093324 23553 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:20:15.138700 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3580) took 2252 ms. Trace:
I20260709 13:20:15.136785 17468 rpcz_store.cc:276] 0709 13:20:12.916424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.121272 (+2204848us) service_pool.cc:224] Handling call
0709 13:20:15.121563 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.135963 (+ 14400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.136231 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:15.135123 23450 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:15.162249 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.140074 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3582) took 2179 ms. Trace:
I20260709 13:20:15.141664 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.105180 23168 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.138559 23164 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:20:15.137512 23506 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:15.197700 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.209389 23559 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:15.210999 23467 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:15.211215 23396 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:15.198413 17998 raft_consensus.cc:2393] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:15.143158 17465 rpcz_store.cc:276] 0709 13:20:12.886595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.101307 (+2214712us) service_pool.cc:224] Handling call
0709 13:20:15.101586 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.138436 (+ 36850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.138634 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:15.163753 17466 rpcz_store.cc:276] 0709 13:20:12.960377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.139295 (+2178918us) service_pool.cc:224] Handling call
0709 13:20:15.139599 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.139786 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.139817 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:15.139859 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:15.139886 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.139931 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.140025 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:15.206079 23164 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:15.211220 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.212822 17465 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:15.216295 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1021) took 1319 ms. Trace:
I20260709 13:20:15.138761 23528 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:20:15.140549 23529 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:20:15.216634 17465 rpcz_store.cc:276] 0709 13:20:13.896521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.212352 (+1315831us) service_pool.cc:224] Handling call
0709 13:20:15.212661 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.216063 (+  3402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.216244 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:15.219448 17465 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:15.220831 17465 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:15.116803 23421 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
W20260709 13:20:15.217720 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 76182.8us
I20260709 13:20:15.229710 23168 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.223548 23529 consensus_queue.cc:1243] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 18.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:15.235173 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1012) took 2785 ms. Trace:
I20260709 13:20:15.272149 17470 rpcz_store.cc:276] 0709 13:20:12.450220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.910689 (+2460469us) service_pool.cc:224] Handling call
0709 13:20:14.911927 (+  1238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.912282 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.912313 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:14.914116 (+  1803us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.068174 (+154058us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:15.068237 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.068646 (+   409us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.234956 (+166310us) raft_consensus.cc:1685] finished
0709 13:20:15.234976 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.235113 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5017,"thread_start_us":153546,"threads_started":1,"wal-append.queue_time_us":225880}
W20260709 13:20:15.273372 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.273895 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.274267 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.236075 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2132) took 2552 ms. Trace:
I20260709 13:20:15.237068 23223 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:15.241763 23304 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:15.283800 23304 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.265789 23278 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.286659 23278 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:15.288225 23558 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:20:15.213794 23435 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.293187 23435 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.295511 23450 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.296936 17465 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:15.282615 23223 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:15.300498 17991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 1121) took 1407 ms (client timeout 1857 ms). Trace:
W20260709 13:20:15.300928 17991 rpcz_store.cc:269] 0709 13:20:13.893222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.067566 (+174344us) service_pool.cc:224] Handling call
0709 13:20:15.300296 (+1232730us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b54001de2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:15.300411 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215816960}
I20260709 13:20:15.301374 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.301259 23223 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:15.302174 17996 raft_consensus.cc:2368] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:15.302649 23223 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.303283 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.304131 17999 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:15.243474 23309 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:15.247028 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.249603 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.251686 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:15.308729 17467 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:15.309260 23505 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:15.309350 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:15.311530 23239 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:15.256235 17287 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.315634 23239 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:15.315919 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59783.4us
I20260709 13:20:15.257184 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3582) took 1259 ms. Trace:
I20260709 13:20:15.263953 22983 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:15.316700 23239 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.222934 23492 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:15.315934 23227 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:15.318636 17388 rpcz_store.cc:276] 0709 13:20:13.997352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.056477 (+ 59125us) service_pool.cc:224] Handling call
0709 13:20:14.056782 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:14.057172 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:14.475344 (+418172us) log.cc:844] Serialized 14 byte log entry
0709 13:20:14.688577 (+213233us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:15.242426 (+553849us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:15.243040 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 13:20:15.243212 (+   172us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:15.243246 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.243321 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.256876 (+ 13555us) raft_consensus.cc:1685] finished
0709 13:20:15.256989 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.257127 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":625357,"prepare.queue_time_us":188283,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":615528,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":11118,"spinlock_wait_cycles":33780096,"thread_start_us":397995,"threads_started":2,"wal-append.queue_time_us":128206}
I20260709 13:20:15.316733 17287 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:15.322115 17994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 1119) took 1465 ms (client timeout 1905 ms). Trace:
W20260709 13:20:15.322494 17994 rpcz_store.cc:269] 0709 13:20:13.856495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.902008 (+ 45513us) service_pool.cc:224] Handling call
0709 13:20:15.321941 (+1419933us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54007611d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:15.322061 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696647040}
I20260709 13:20:15.322962 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.324072 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.325063 23227 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:15.325734 23227 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:15.326031 22983 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:15.326508 22983 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:15.326862 22983 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:15.326939 23227 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:15.274219 17470 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:20:15.329082 17470 pending_rounds.cc:85] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 9
I20260709 13:20:15.329396 17470 pending_rounds.cc:107] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:20:15.329772 17470 raft_consensus.cc:2889] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:15.330153 17470 pending_rounds.cc:107] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:20:15.330422 17470 raft_consensus.cc:2889] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:15.274731 17463 rpcz_store.cc:276] 0709 13:20:12.684086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.943325 (+2259239us) service_pool.cc:224] Handling call
0709 13:20:14.961506 (+ 18181us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:14.961946 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.961985 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:14.962669 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 13:20:15.144329 (+181660us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:15.198971 (+ 54642us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.199344 (+   373us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.199514 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.199585 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.235873 (+ 36288us) raft_consensus.cc:1685] finished
0709 13:20:15.235894 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.236022 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9025,"prepare.queue_time_us":54270,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":3831,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":10277,"spinlock_wait_cycles":27864192,"thread_start_us":125435,"threads_started":1,"wal-append.queue_time_us":232201}
I20260709 13:20:15.215119 23164 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:15.279285 17393 pending_rounds.cc:85] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 7
I20260709 13:20:15.335266 17393 pending_rounds.cc:107] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 18.8
W20260709 13:20:15.335493 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.335602 17393 raft_consensus.cc:2889] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:15.337001 17463 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:15.340250 17463 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:15.312368 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:15.255069 23242 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:15.314536 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:15.341432 17466 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:15.341774 17396 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:15.316057 23257 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:15.341110 17389 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:15.311721 17467 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:15.342875 17470 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:15.334522 23164 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:15.270925 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:15.240170 23295 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.343374 23168 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:15.352064 23098 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:15.353255 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:15.353305 23358 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:15.353838 23529 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:15.359390 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 88582.1us
W20260709 13:20:15.405314 17362 leader_election.cc:336] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.558s (SENT)
I20260709 13:20:15.405993 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:15.407428 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:15.369227 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.407076 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:15.414022 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:15.415035 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:15.412536 23365 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:15.363340 23492 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:15.421182 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53437.9us
I20260709 13:20:15.420490 23365 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.412696 23164 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:15.412544 23505 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:15.427630 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:15.421968 23362 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:15.422606 23538 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:15.416152 23342 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:15.434728 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:15.425323 23365 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.425635 23435 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:15.441972 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:15.472414 17314 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:20:15.446715 17362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.963s (SENT) [suppressed 25 similar messages]
I20260709 13:20:15.446736 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.448609 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:15.453192 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:15.456074 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.458699 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.461362 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.428207 23386 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:15.471119 17999 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:15.420615 23168 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:20:15.463971 17991 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:15.477159 17996 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:15.433729 23505 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.480787 23505 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:15.426411 17434 leader_election.cc:400] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:15.484454 17434 leader_election.cc:403] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:15.435401 23402 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:15.486655 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.489624 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 63395.5us
I20260709 13:20:15.490593 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.493140 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.494303 23359 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.494742 23295 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.494823 23359 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:15.496027 23562 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:15.498404 23359 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:15.493970 17996 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
W20260709 13:20:15.493947 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.426879 23249 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:20:15.471700 23489 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.505419 23309 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:15.505054 23489 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.505856 23309 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:15.506752 23309 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:15.507756 23489 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:15.501196 23506 raft_consensus.cc:2764] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:20:15.510674 17992 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:15.516058 23365 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.518437 23365 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.519923 23359 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.522156 23461 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:15.526575 23461 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.523808 23374 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:15.529374 23374 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:15.529289 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.529959 23374 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:15.530267 17991 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:15.530918 23374 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:15.532192 23374 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.528642 23461 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.533665 23359 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.535910 23359 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.473694 23460 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:15.439821 23362 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:15.486327 23168 consensus_queue.cc:1243] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:15.540077 17996 pending_rounds.cc:85] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 12
I20260709 13:20:15.557544 17996 pending_rounds.cc:107] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:20:15.557693 17390 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 10.
I20260709 13:20:15.557924 17996 raft_consensus.cc:2889] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:15.487336 17396 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:15.489071 23402 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.560236 17992 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:15.474002 23504 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:20:15.561858 17996 pending_rounds.cc:107] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:20:15.550997 23342 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:15.508056 23309 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:15.565773 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.551551 23460 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.550964 23479 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:15.566987 17996 raft_consensus.cc:2889] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:15.594934 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:15.571209 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.596046 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.571872 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.582451 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:15.597666 17320 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:15.552704 23450 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:15.440423 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:15.607642 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.608430 17320 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.569438 23402 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:15.606225 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:15.606197 23479 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.616231 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.594940 23460 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.594498 23342 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:15.620949 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:15.626441 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.608106 17964 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:15.630398 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:15.631345 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.632023 17314 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.634013 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.634404 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:15.631399 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:15.635705 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:15.634523 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.636232 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:15.633548 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:15.637549 17991 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:15.639645 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:15.641584 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:15.606956 23359 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:15.655109 17314 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:15.658246 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:15.659042 17992 raft_consensus.cc:2393] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:15.659363 23485 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.565407 22983 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:15.661623 22983 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:15.610855 23506 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:15.663077 23563 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.228s	user 0.003s	sys 0.000s
I20260709 13:20:15.664400 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3577) took 2973 ms. Trace:
I20260709 13:20:15.664975 17469 rpcz_store.cc:276] 0709 13:20:12.691360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.994273 (+2302913us) service_pool.cc:224] Handling call
0709 13:20:14.994716 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.007690 (+ 12974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.007737 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.008358 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.199857 (+191499us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:15.421707 (+221850us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.425009 (+  3302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.425119 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.662449 (+237330us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:15.663988 (+  1539us) raft_consensus.cc:1685] finished
0709 13:20:15.664098 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.664341 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15433,"prepare.queue_time_us":330190,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":48,"raft.queue_time_us":17365,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":8641,"spinlock_wait_cycles":3050752,"thread_start_us":335018,"threads_started":2,"wal-append.queue_time_us":346868}
I20260709 13:20:15.666970 23421 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:15.667621 23421 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:15.668589 23421 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.669112 23342 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:15.669884 23342 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:15.612501 23278 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:15.681063 23194 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:20:15.632148 23435 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:15.689038 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 265500us
I20260709 13:20:15.687554 17317 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:15.681607 23467 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.631942 23295 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:15.691800 23295 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.654753 23531 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:20:15.645468 23489 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:15.705965 23340 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.644239 23492 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:15.692281 23295 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:15.654757 23450 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:15.656327 23359 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:15.694794 23467 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.699446 23292 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:15.707505 17318 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:15.717304 17397 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:15.724125 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:15.694211 23479 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.731122 17463 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:20:15.733784 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 287109us
I20260709 13:20:15.739066 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:15.740243 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:15.754696 17397 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:15.723251 23292 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:15.686244 23362 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.763180 23249 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:15.765293 23528 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:15.765698 23528 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:15.766042 17313 raft_consensus.cc:2410] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:15.725019 23223 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:20:15.766578 23528 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.768112 23528 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:15.767081 23223 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:15.773233 23223 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:15.773667 17466 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:15.774926 23227 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:15.775528 23227 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:15.779492 17321 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:15.722939 23168 consensus_queue.cc:1059] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:20:15.781749 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:15.790407 23567 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:15.790592 23428 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:15.791453 23315 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:15.793061 23467 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:15.793295 23223 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.776469 23227 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:15.799844 17320 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:15.762578 23497 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.801707 23497 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.804534 23497 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.761953 23359 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:15.814384 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.815116 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.815876 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.813454 23361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.170s	user 0.013s	sys 0.016s
I20260709 13:20:15.822429 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3592) took 1186 ms. Trace:
I20260709 13:20:15.840759 17471 rpcz_store.cc:276] 0709 13:20:14.635974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.755687 (+119713us) service_pool.cc:224] Handling call
0709 13:20:15.822140 (+1066453us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400061154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:15.822350 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284721536}
I20260709 13:20:15.824298 17468 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:15.829404 23359 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.836422 23292 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.861758 23417 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:15.842800 23361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.013s	sys 0.016s
I20260709 13:20:15.838430 23428 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:20:15.880025 23292 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.892895 23505 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.903522 23505 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.878808 23402 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.919427 23402 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.923108 23460 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.926993 23460 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:15.866132 23497 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:15.944270 23497 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:15.945434 23497 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:15.947165 23497 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:15.940725 23295 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:15.943658 23489 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:15.953780 23489 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:15.955776 23295 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:16.016861 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 365711us
I20260709 13:20:16.020525 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:16.029863 17317 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:16.032394 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.032452 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:16.045919 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1020) took 2149 ms. Trace:
I20260709 13:20:16.046388 17468 rpcz_store.cc:276] 0709 13:20:13.896278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.161060 (+1264782us) service_pool.cc:224] Handling call
0709 13:20:15.824045 (+662985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.841837 (+ 17792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.045423 (+203586us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b5400061150. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:16.045722 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523774208}
W20260709 13:20:16.033981 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.049297 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:16.050726 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2130) took 3424 ms. Trace:
I20260709 13:20:16.051280 17462 rpcz_store.cc:276] 0709 13:20:12.626291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.941998 (+2315707us) service_pool.cc:224] Handling call
0709 13:20:15.007755 (+ 65757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.018420 (+ 10665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.050219 (+1031799us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b5400161f50. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:16.050480 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150531840}
I20260709 13:20:16.052093 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:16.061043 22740 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:16.062150 22740 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.069394 17999 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:16.070887 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:16.071877 17990 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.035109 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:16.072393 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:16.036185 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 400411us
I20260709 13:20:16.073432 17392 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:16.073364 17996 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:16.074242 17434 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.037158 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:16.074934 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:16.075862 17388 raft_consensus.cc:2410] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:20:16.075935 17993 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:16.038430 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 404356us
I20260709 13:20:16.078624 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.039258 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:16.040088 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:16.082412 17397 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
W20260709 13:20:16.038431 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3578) took 2105 ms (client timeout 2042 ms). Trace:
W20260709 13:20:16.083552 17390 rpcz_store.cc:269] 0709 13:20:13.932860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.933191 (+   331us) service_pool.cc:224] Handling call
0709 13:20:16.037867 (+2104676us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400015754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:16.038164 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3530124160}
I20260709 13:20:16.042213 17464 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 13:20:16.085132 17434 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:16.087802 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.033856 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:16.043895 17466 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:16.089344 17391 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:16.034835 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:16.041365 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3598) took 1103 ms. Trace:
I20260709 13:20:16.092069 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:16.090898 17465 rpcz_store.cc:276] 0709 13:20:14.937454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.298698 (+361244us) service_pool.cc:224] Handling call
0709 13:20:15.299022 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.299265 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:15.728599 (+429334us) log.cc:844] Serialized 14 byte log entry
0709 13:20:16.040405 (+311806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:16.040528 (+   123us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:16.040643 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.040767 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.041063 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":230805,"prepare.queue_time_us":231155,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"thread_start_us":509147,"threads_started":2,"wal-append.queue_time_us":213462}
I20260709 13:20:16.101856 17321 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:16.097981 22740 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.105774 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:16.107560 23242 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:16.109308 23278 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:16.056416 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:16.163584 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 62854.3us
I20260709 13:20:16.171944 17321 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.153507 23242 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:16.187390 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 403895us
W20260709 13:20:16.190132 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 133946us
W20260709 13:20:16.191500 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.191910 23492 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:16.193568 23488 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.203554 23488 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.204136 23488 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.195214 23582 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.196581 23584 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:16.197403 23585 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.182300 23242 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.198824 23506 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:16.198906 23342 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:16.198510 23278 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:16.199882 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.199047 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:16.181702 23304 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:16.198261 23374 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:16.211261 17990 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:16.174656 23292 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.214692 17993 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:16.225939 17317 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:20:16.227093 23598 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:20:16.231246 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:16.236958 23359 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:16.239563 23292 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.242502 23292 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.242777 23340 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.243291 23340 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.243651 23340 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.252199 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:16.253664 23585 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.254992 17996 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:16.255653 23223 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.258435 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:16.260442 23365 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.219007 23304 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:16.209954 23582 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.205252 23435 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:16.256608 23585 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:16.223119 23374 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:16.212045 23584 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:16.270682 23304 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.284619 23374 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.274684 23582 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.269076 23365 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:16.289036 17321 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
W20260709 13:20:16.286875 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 199351us
I20260709 13:20:16.284879 23584 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.291329 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:16.274763 23435 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:16.296554 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.293685 23365 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.306665 17993 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.301421 23435 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.308264 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:16.308987 23295 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:16.310904 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.313063 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:16.314164 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:16.315207 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:16.315857 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.317019 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.317076 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:16.318051 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.317999 23467 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:16.319290 23168 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:16.328766 17471 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:16.335404 17320 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:16.335594 17314 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:16.337323 23168 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:16.338347 23450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.010s	sys 0.011s
W20260709 13:20:16.338869 23450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.010s	sys 0.011s
I20260709 13:20:16.339223 23450 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:16.340386 23168 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.350190 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.367763 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:16.372388 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:16.376024 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:16.377184 17397 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:16.378553 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:16.379199 23574 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:16.380311 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:16.340646 23450 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.382763 23596 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:16.382893 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:16.379498 17396 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:20:16.368080 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:16.389932 17321 raft_consensus.cc:2393] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 19: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:16.395345 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:16.397379 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 91387.5us
I20260709 13:20:16.350499 23295 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:16.396585 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:16.394632 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 492934us
I20260709 13:20:16.349040 23362 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:20:16.355561 17216 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.415376 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:16.415844 23599 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:20:16.424814 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:16.429138 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 99657us
I20260709 13:20:16.430881 23600 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:16.431982 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.436625 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.437434 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:16.444682 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:16.449707 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.434275 23168 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.449709 17396 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 10.
I20260709 13:20:16.450240 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.432138 23342 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:16.457983 17393 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:16.444782 23295 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:16.460378 17397 raft_consensus.cc:2393] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 19: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:16.461469 23508 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.462141 23508 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.464540 23508 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.465440 17471 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.465982 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:16.453624 23358 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:16.472223 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.439440 23365 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.452495 23168 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.475618 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:16.445756 23242 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.479492 17391 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:16.487910 23504 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:16.488801 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:16.490289 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:16.495187 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:16.497205 23362 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:16.497715 23362 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:16.498764 23362 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.482000 23168 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:16.501236 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 111338us
I20260709 13:20:16.501888 17464 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:16.501968 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.503728 17462 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:16.505689 17393 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:16.506078 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:16.507863 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 157835us
I20260709 13:20:16.456404 23428 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:16.457408 23600 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:16.510725 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:16.516458 17990 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:16.517489 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:16.518935 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.521518 17470 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:16.522630 23242 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.524946 23358 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.525506 23358 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.527671 23358 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:16.512428 23428 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:16.531337 23428 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.488848 23504 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.537037 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:16.524619 23479 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:16.538074 23396 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:16.446686 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "132676f9343f4733b4f07f4587384a56"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:16.538184 23479 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.538743 23396 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:16.539167 17321 raft_consensus.cc:606] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:16.539872 23396 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.540361 23374 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.541832 17360 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:16.542371 23257 raft_consensus.cc:3055] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:16.537098 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:16.542676 23374 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:16.542889 23257 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:16.543597 17313 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:16.538765 23365 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:16.550731 17388 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:16.545583 23257 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.553818 17393 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:16.553818 17471 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:16.511023 17993 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:16.544723 23098 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:16.559720 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 53973.1us
I20260709 13:20:16.545568 23428 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:16.568704 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:16.572956 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:16.573191 17362 leader_election.cc:336] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.949s (SENT)
I20260709 13:20:16.573745 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:16.574592 23365 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:16.575770 23365 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:16.548111 23295 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:16.540825 23479 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.586036 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:16.561164 23504 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:16.588271 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:16.576309 23365 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:16.590783 17994 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:16.591226 23365 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.592293 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:16.592437 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:16.593953 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:16.594298 23340 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.595492 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:16.596450 23340 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:16.596961 23359 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:16.597997 23264 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:16.598372 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46294.1us
I20260709 13:20:16.598539 23264 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:16.599484 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.599778 23264 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.602926 23613 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:16.605005 23245 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:20:16.606345 17993 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:16.606390 23435 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.551874 23467 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:20:16.600210 23582 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.608961 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.626176 17318 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:16.628443 17320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:16.629072 17320 raft_consensus.cc:606] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:16.623441 23245 consensus_queue.cc:1243] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:16.587615 23374 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:16.634951 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.647315 17999 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.647356 17392 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:16.648559 17360 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:16.648698 23264 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.650444 17470 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:16.651430 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.652088 17470 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:16.652639 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.652937 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.653298 17466 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.653357 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.654058 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.654691 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.655359 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.656050 17468 raft_consensus.cc:2368] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18.
I20260709 13:20:16.656936 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.657761 17465 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:16.645215 23479 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:16.657912 23168 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.658424 23479 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:16.658820 23479 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:16.660102 23168 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.587857 23358 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:20:16.665040 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:16.619539 23488 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:16.669523 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60388.5us
I20260709 13:20:16.670409 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:16.670598 17465 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:16.671629 23467 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:16.673275 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.646481 23374 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:16.683377 23529 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:20:16.687409 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:16.684536 23242 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:16.686327 23619 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:16.667814 23613 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:16.679667 23358 consensus_queue.cc:1243] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:16.696235 17392 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:16.696722 23304 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:16.701843 23608 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 13:20:16.702414 23606 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:20:16.703156 23488 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:16.704468 23435 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:16.673277 23600 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.684361 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:16.640062 23584 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.725275 17390 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
W20260709 13:20:16.726065 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 46197us
I20260709 13:20:16.708855 23242 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.727221 23242 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.727313 23584 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.729028 23292 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:16.729605 23292 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:16.730590 23292 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.732990 17463 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.708539 23374 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.733165 23583 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:16.734395 23583 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:16.719568 23342 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:16.735939 23583 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:16.737560 17396 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:16.737730 23583 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:16.740079 17962 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:16.741153 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:16.741552 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.741958 23508 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:16.742640 23585 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.743041 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.742937 23295 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.743726 23361 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:16.744124 23361 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:16.742792 23432 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.744946 23361 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.745093 23249 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:16.746238 22983 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:16.746554 23361 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.686892 23611 raft_consensus.cc:2764] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:16.742193 17468 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:16.743491 23227 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:16.748808 23613 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.749670 17963 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:16.750808 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 148618us
I20260709 13:20:16.751601 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:16.751737 23613 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:16.751904 23585 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:16.752584 23585 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.753317 23249 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:16.753747 23249 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:16.754632 23249 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.755879 23249 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.744783 23432 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.757091 23467 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:16.757215 23432 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.745126 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:16.764266 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.764153 17463 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:16.764611 23304 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.765244 17391 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:16.766129 23264 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.766758 23264 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.767517 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.768206 17465 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:16.768441 23358 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:16.768405 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.770537 17470 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.680738 23257 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:16.743497 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.775888 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.738837 23583 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.781188 17466 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:16.664489 23362 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:20:16.784281 17286 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:16.787117 17466 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:20:16.788796 23175 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:20:16.794100 23242 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.795506 23264 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:16.796132 22740 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:16.796597 22740 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.796964 22740 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:16.799688 23585 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.800966 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:16.801587 17993 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:20:16.802240 17388 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:16.802672 17388 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:16.803572 17388 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.813208 17470 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:16.814881 17471 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:20:16.811293 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 176407us
I20260709 13:20:16.796324 23242 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.812194 23358 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:16.784984 23508 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:16.830893 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 47510us
I20260709 13:20:16.810290 23613 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:16.785056 23359 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:20:16.838209 22983 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:20:16.847002 23450 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:16.858763 22983 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:16.858829 23450 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.859233 22983 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:16.859396 23450 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.861137 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.861806 17464 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:16.862768 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:16.863482 23614 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:20:16.860247 22983 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.866304 22983 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.877041 23613 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.879329 23613 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:16.863539 17464 raft_consensus.cc:2368] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18.
I20260709 13:20:16.883108 22740 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.889869 23585 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:16.859053 23508 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:16.892129 23508 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:16.852560 23358 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.856146 23396 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:16.912154 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 57440.8us
W20260709 13:20:16.901530 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.914539 22740 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:16.901144 17999 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:16.915743 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:16.915867 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.920342 17464 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:16.922959 23582 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:16.918571 23583 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.916813 23396 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.925132 23613 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:16.917663 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:16.897707 23358 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:16.915861 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 164429us
I20260709 13:20:16.927768 23600 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:16.930363 23600 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.934386 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:16.927613 23396 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.936126 23374 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:16.938028 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.935050 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:16.943346 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.935057 23582 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:16.932816 23600 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:16.938239 23374 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:16.948194 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.946269 23506 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:16.946960 23628 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:16.950297 23628 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.950336 23450 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.950811 23628 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.928282 23432 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.948937 23374 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.949712 23585 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:16.954420 23631 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:16.955241 23450 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:16.955623 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:16.957140 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:16.965708 17464 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:16.947034 23396 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.970336 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:16.970578 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.972930 17316 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:20:16.973313 17316 pending_rounds.cc:85] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 12
I20260709 13:20:16.973558 17316 pending_rounds.cc:107] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:20:16.973838 17316 raft_consensus.cc:2889] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:16.975179 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:16.975775 17315 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.978611 23585 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:16.981379 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:16.985750 23479 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.988530 17996 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:16.990219 17315 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:16.997309 23278 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:16.998032 23278 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.998981 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.001721 23278 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:17.001276 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.003649 17467 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.008622 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:17.002722 17962 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:17.020726 23601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.002s	sys 0.014s
W20260709 13:20:17.021296 23601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.003s	sys 0.014s
W20260709 13:20:17.022142 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 87187.9us
I20260709 13:20:17.022832 22740 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.034709 23488 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:17.035187 23488 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:17.026008 23611 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.035794 23611 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:16.966941 23450 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:17.029793 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:17.026015 23492 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:17.040337 23611 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:17.041159 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:17.041529 23479 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:17.033102 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:17.034014 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.034829 22740 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.031860 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.023033 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:17.039587 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:17.063658 17389 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:17.036090 23488 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.041889 17393 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:16.976388 23257 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.960244 23582 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.046003 17285 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:16.948173 23613 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:17.047866 23623 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 13:20:17.047811 23432 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:17.050300 17317 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:20:17.050989 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:17.085508 17316 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 18: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:17.051532 23278 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:17.052243 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 104125us
I20260709 13:20:16.977401 23396 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.089313 17395 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:20:17.053328 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 267584us
I20260709 13:20:17.091034 23585 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.091560 23585 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.093737 23585 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:17.092494 23257 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.058542 17467 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:17.086359 23628 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.097621 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:17.097924 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:17.098762 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:17.099180 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.099505 17994 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:17.061072 23358 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.062487 17468 raft_consensus.cc:2376] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18. Re-sending same reply.
I20260709 13:20:17.062482 17469 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:17.067819 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.065344 23467 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:20:17.069644 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:17.077957 23488 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.079198 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.133131 17463 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:17.079905 23582 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:17.080735 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 57801.6us
I20260709 13:20:17.099924 17467 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:17.100073 17462 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
W20260709 13:20:17.101619 23638 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:20:17.101926 23396 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:17.100884 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:17.104019 23374 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:17.105247 23489 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:20:17.105860 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.147481 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.107820 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:17.075855 17216 catalog_manager.cc:5697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 8 to 11, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 11 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:17.100366 23628 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:17.119657 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:17.100898 23292 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:17.121670 22740 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:17.121781 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:17.122058 23223 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:17.122859 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:17.175066 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:17.123330 23257 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:17.123771 23278 raft_consensus.cc:697] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:17.130172 17318 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:17.131237 23358 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:17.121519 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 75623.5us
I20260709 13:20:17.132407 17999 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:17.133962 17389 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
W20260709 13:20:17.057238 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 48001us
W20260709 13:20:17.153893 23634 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.229s	user 0.003s	sys 0.000s
I20260709 13:20:17.154783 23102 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:17.155483 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:17.149364 23098 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:20:17.191493 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:17.161612 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.192310 17470 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:17.163357 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.166913 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.166993 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:17.167717 23497 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:17.168284 17993 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:17.147001 23489 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:17.168721 23374 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:17.169158 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:17.170039 17395 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:17.170256 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:17.205453 23489 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.206408 17998 raft_consensus.cc:2368] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15.
I20260709 13:20:17.206637 23489 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:17.170797 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:17.171958 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:17.180819 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:17.208312 17990 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:17.159994 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:17.193676 17997 raft_consensus.cc:2368] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16.
I20260709 13:20:17.209249 23601 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:17.210009 23340 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:17.210546 23497 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:17.210932 23340 consensus_queue.cc:1243] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:17.211454 23479 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:17.211902 23479 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:17.211557 23497 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:17.212785 23479 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:17.214165 23479 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.213939 23278 consensus_queue.cc:237] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.220944 17464 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
W20260709 13:20:17.221262 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 99586.2us
I20260709 13:20:17.222043 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:17.222319 23628 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:17.222679 17464 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:17.223261 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:17.223610 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:17.223922 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.224357 17464 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:17.224592 17469 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:17.225113 23450 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:17.225663 23450 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:17.226637 23450 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.229924 17434 leader_election.cc:400] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15.
I20260709 13:20:17.230274 17434 leader_election.cc:403] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:17.229272 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.222862 17388 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:17.231200 17464 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.195477 23102 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:17.233081 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:17.233443 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:17.234118 17314 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:17.234061 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:17.234359 23102 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:17.234799 17313 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.191360 23264 consensus_queue.cc:1059] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:20:17.235337 23223 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:17.198311 23582 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.237224 23582 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.194877 17992 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:17.239413 23582 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:17.231077 23508 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.239972 23508 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:17.241750 23260 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:17.242053 23508 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:17.242350 23260 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:17.243830 17315 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:20:17.240259 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 80343.8us
I20260709 13:20:17.246104 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:17.247218 23098 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:17.243366 23260 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.251303 23528 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:17.251731 23528 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.252045 23528 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:17.254204 17434 leader_election.cc:400] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16.
I20260709 13:20:17.254528 17434 leader_election.cc:403] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:20:17.254418 17466 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
W20260709 13:20:17.256137 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 69472.7us
I20260709 13:20:17.232432 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:17.256318 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:17.257365 17465 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 18: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:17.261747 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:17.262421 17997 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:17.262578 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:17.263453 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:17.264074 17994 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:17.264518 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:17.236389 23223 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.265133 17990 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:17.270869 17285 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:17.231007 23625 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.305s	user 0.000s	sys 0.003s
I20260709 13:20:17.279255 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:17.280354 22740 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.285137 17470 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:17.275684 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:17.274416 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:17.287101 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 120209us
I20260709 13:20:17.279024 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:17.287906 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:17.291109 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:17.288524 17318 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:17.268038 23497 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.297631 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:17.297813 17313 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:17.293951 23432 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:17.278017 23362 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:17.267941 23582 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16.
I20260709 13:20:17.277908 23635 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:17.296999 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:17.300812 17469 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:17.295679 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:17.306092 17388 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:17.223923 23628 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:20:17.306730 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:17.306985 17463 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:20:17.301033 23637 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:20:17.293286 17464 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:17.310343 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:17.296829 23358 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:17.294843 23508 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:17.326617 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:17.327739 17362 leader_election.cc:400] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18.
I20260709 13:20:17.328073 17362 leader_election.cc:403] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:17.328891 17999 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:17.301170 23421 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:17.279381 23529 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:20:17.307781 23601 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15.
I20260709 13:20:17.315653 23636 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:17.335825 17990 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:17.319958 23635 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:17.322469 23504 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:20:17.324926 23358 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.355094 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:17.352039 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 76561.4us
I20260709 13:20:17.363651 22740 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:17.364372 17470 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:20:17.372680 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.373745 17470 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:17.368791 23358 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.366293 23508 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:17.368491 23359 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.370222 23631 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:20:17.366748 23636 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:17.419368 23613 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:17.420327 23636 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.425508 17462 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:20:17.430039 23359 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18.
I20260709 13:20:17.426970 17462 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:20:17.441540 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.443220 23479 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.443881 23479 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.448160 23479 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:17.453482 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:17.456019 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 143771us
I20260709 13:20:17.463416 17991 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:20:17.454725 23643 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:20:17.471683 22740 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:17.474611 17990 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:17.454828 23261 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:17.375900 23362 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:20:17.464764 23594 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:17.506989 23594 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:17.508172 23594 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:17.510188 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45574.6us
I20260709 13:20:17.511219 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:17.515343 23642 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:20:17.520509 17216 catalog_manager.cc:5697] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 6 to 12, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 12 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:17.522140 17216 catalog_manager.cc:5697] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 9 to 10, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 10 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:17.523109 23257 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:17.523524 23257 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:17.523660 17216 catalog_manager.cc:5697] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 5 to 12, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 12 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:17.525787 17216 catalog_manager.cc:5697] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 4 to 15, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 15 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:17.528738 17216 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:17.530324 23242 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:17.530269 17216 catalog_manager.cc:5697] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 8 to 10, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 10 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:17.531311 23583 raft_consensus.cc:3055] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:17.531703 23583 raft_consensus.cc:740] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:17.532528 23583 consensus_queue.cc:260] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.534082 23583 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.537111 23227 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.537778 23227 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:17.538451 17469 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:17.502399 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:17.541553 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1573) took 1806 ms. Trace:
I20260709 13:20:17.541913 17992 rpcz_store.cc:276] 0709 13:20:15.735212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.735367 (+   155us) service_pool.cc:224] Handling call
0709 13:20:15.761264 (+ 25897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.239343 (+1478079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.541261 (+301918us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400680954. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:17.541481 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3253295488}
I20260709 13:20:17.546324 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:17.524565 23257 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.475474 23585 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:20:17.556754 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:17.499327 17314 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:17.558058 23257 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:17.502499 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:17.558768 17320 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:17.559695 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:17.503750 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:17.504943 17322 raft_consensus.cc:1240] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:20:17.561820 17319 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:17.562312 17322 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:20:17.563445 23644 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
W20260709 13:20:17.505414 23645 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:20:17.505455 23611 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:17.564567 23611 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.566879 23611 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:17.492041 23304 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:20:17.570827 17320 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:17.572536 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:17.505059 23508 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:17.453596 23603 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.211s
I20260709 13:20:17.550010 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:17.576864 17466 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:17.552915 23635 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.484473 23261 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:17.583627 17434 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:17.584501 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:17.587544 17319 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:17.585863 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:17.589258 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 212743us
I20260709 13:20:17.539966 23227 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:17.501358 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:17.574831 17317 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:17.512737 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:17.594064 17964 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:17.575852 17996 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:17.595913 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:17.604089 22740 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:17.604457 17320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:17.605221 17320 raft_consensus.cc:606] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:17.605644 17320 raft_consensus.cc:614] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:17.602141 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:17.608337 23601 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.599624 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:17.608776 17319 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:17.608901 23613 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:17.609369 17322 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:17.610359 17319 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:20:17.613461 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 100823us
I20260709 13:20:17.615020 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:17.582999 23261 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:17.618340 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:17.621258 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:17.601840 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:17.622129 17992 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:20:17.603137 23489 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:20:17.620965 23505 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:20:17.625358 17397 raft_consensus.cc:2410] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:17.611009 23492 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:17.626611 23492 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:17.629006 23650 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:17.622485 17992 pending_rounds.cc:85] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 12
I20260709 13:20:17.643514 17992 pending_rounds.cc:107] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:20:17.643954 17992 raft_consensus.cc:2889] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:17.646689 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:17.600318 23479 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:17.649837 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:17.651722 17317 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:17.606815 23582 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:17.616233 23450 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:17.653975 23479 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:17.670640 17390 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:17.601007 23628 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:20:17.631704 23488 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:17.644598 23631 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:17.672102 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48430.4us
I20260709 13:20:17.610405 23340 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:20:17.606477 23304 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:20:17.644738 23613 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:17.648347 23260 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:17.644140 23359 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:17.745512 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 58786.7us
I20260709 13:20:17.647502 23528 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:17.790297 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.839212 17316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.010s	sys 0.015s
W20260709 13:20:17.904040 17316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.011s	sys 0.020s
W20260709 13:20:17.845314 23278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.003s	sys 0.020s
I20260709 13:20:17.753084 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:17.630088 23611 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:20:17.669567 23450 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:17.789149 17317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "622554a5186d4910b8476a653411c85d"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:17.939960 17317 raft_consensus.cc:606] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:17.747368 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 90640.4us
I20260709 13:20:17.748689 23479 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.748117 23374 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:17.933203 17318 raft_consensus.cc:2368] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:20:17.862779 23168 raft_consensus.cc:993] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:20:17.869212 23628 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:17.740409 23505 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.748950 23362 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.187s
W20260709 13:20:17.927397 23278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.005s	sys 0.026s
W20260709 13:20:17.962600 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.970311 17395 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:20:17.837558 23596 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.788628 23358 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:17.928349 23260 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.928810 23613 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:17.901098 23417 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.369s
I20260709 13:20:17.942588 23450 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.951808 23264 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:17.940544 17317 raft_consensus.cc:614] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:18.004904 17313 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:17.943423 23488 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:20:17.981328 23650 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:17.944340 23601 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:20:17.985867 23260 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.999884 23613 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.979295 23596 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:17.984584 23628 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:18.131183 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 378147us
I20260709 13:20:17.985463 23505 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:18.132145 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 387550us
I20260709 13:20:18.145742 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:18.205334 23528 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:18.209815 23102 raft_consensus.cc:1081] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
W20260709 13:20:18.213596 23666 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:20:18.216073 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 70430.4us
I20260709 13:20:18.250420 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:18.251698 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:18.253012 23292 raft_consensus.cc:2764] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:20:18.253187 23264 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.254603 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:18.257443 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:18.238775 23358 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:18.240048 23655 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:20:18.204597 17286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.039s
W20260709 13:20:18.291785 17286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.003s	sys 0.039s
W20260709 13:20:18.292084 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 673044us
I20260709 13:20:18.293274 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:18.248028 23649 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
I20260709 13:20:18.295529 23505 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.296236 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3635) took 1527 ms. Trace:
I20260709 13:20:18.297380 23628 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.296588 17468 rpcz_store.cc:276] 0709 13:20:16.769319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.146345 (+377026us) service_pool.cc:224] Handling call
0709 13:20:17.172535 (+ 26190us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:17.172989 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.173014 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:17.173712 (+   698us) log.cc:844] Serialized 52 byte log entry
0709 13:20:17.456648 (+282936us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:17.463623 (+  6975us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.465063 (+  1440us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.465227 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.465296 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.296036 (+830740us) raft_consensus.cc:1685] finished
0709 13:20:18.296053 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.296179 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45808,"prepare.queue_time_us":97811,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":7705,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":23780,"thread_start_us":282573,"threads_started":1,"wal-append.queue_time_us":430461}
I20260709 13:20:18.163671 23362 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:18.260632 23652 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:20:18.302760 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:18.303607 23223 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:18.304006 23223 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:20:18.233914 23261 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.607s	user 0.002s	sys 0.012s
I20260709 13:20:18.234545 23374 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.304958 23374 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:18.267822 23653 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
W20260709 13:20:18.269501 23659 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:20:18.270989 23492 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:18.273895 23596 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.224884 23650 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:18.223618 23657 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 13:20:18.218063 23656 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
W20260709 13:20:18.183490 23651 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
W20260709 13:20:18.278122 23658 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:20:18.341581 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:18.312904 23264 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:18.314041 23245 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:18.281282 23340 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:18.287428 23497 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.987s	user 0.005s	sys 0.004s
I20260709 13:20:18.288328 22740 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:18.350471 22740 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:18.304292 23631 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.314719 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3649) took 1033 ms. Trace:
I20260709 13:20:18.315505 17462 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:20:18.304373 23223 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.279289 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 2346) took 1046 ms. Trace:
I20260709 13:20:18.346400 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.310794 23582 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:18.289851 23257 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.000s
I20260709 13:20:18.339828 23362 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.310657 23261 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.353320 17321 rpcz_store.cc:276] 0709 13:20:17.232687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.232805 (+   118us) service_pool.cc:224] Handling call
0709 13:20:18.279027 (+1046222us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b540010ca54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:18.279209 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443544960}
I20260709 13:20:18.336490 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:18.354995 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:18.355510 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.368790 17434 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:18.369861 17434 leader_election.cc:400] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:20:18.351303 23245 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:18.350076 23529 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:18.369077 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1035) took 1261 ms. Trace:
I20260709 13:20:18.370163 17434 leader_election.cc:403] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:18.353178 23631 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.380458 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:18.374575 22740 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.386237 22740 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.373507 23497 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.387960 23497 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.388046 23450 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.389158 23674 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.390386 23497 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.381927 17468 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 22: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:18.397308 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3638) took 1618 ms. Trace:
I20260709 13:20:18.397540 23261 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:18.398535 23374 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:18.397715 17465 rpcz_store.cc:276] 0709 13:20:16.778479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.265877 (+487398us) service_pool.cc:224] Handling call
0709 13:20:17.286627 (+ 20750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.331727 (+ 45100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.331776 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.351545 (+ 19769us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.612288 (+260743us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:17.612325 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.612387 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.397086 (+784699us) raft_consensus.cc:1685] finished
0709 13:20:18.397108 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.397250 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7532,"raft.queue_time_us":29014,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":15558,"thread_start_us":159409,"threads_started":1,"wal-append.queue_time_us":481992}
I20260709 13:20:18.399403 17313 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:18.399029 23529 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.407470 23529 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:18.384028 23245 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.358875 23479 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.411530 23479 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:18.400969 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 143593us
I20260709 13:20:18.401310 23450 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.358180 23340 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.414924 23340 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:18.415135 23661 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:20:18.416787 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.417341 17392 raft_consensus.cc:1217] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 16.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:20:18.382331 23492 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:18.417796 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:18.418145 23492 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:18.418262 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.419045 17396 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:18.403530 23628 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.419205 23492 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.419905 23628 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.422485 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:18.422866 23488 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:18.423331 17393 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:18.417858 17392 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:20:18.424270 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.424444 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.424824 17393 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:18.425000 17392 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:18.425854 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.426436 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.426988 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.427695 17393 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:18.427579 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.384302 17316 rpcz_store.cc:276] 0709 13:20:17.096337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.096588 (+   251us) service_pool.cc:224] Handling call
0709 13:20:17.109191 (+ 12603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.109399 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.109422 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.252011 (+142589us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b2c00014ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:20:17.252409 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.904428 (+652019us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:17.904469 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.904534 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.354013 (+449479us) raft_consensus.cc:1685] finished
0709 13:20:18.354030 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.357483 (+  3453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18200320,"thread_start_us":651611,"threads_started":1,"wal-append.queue_time_us":787713}
I20260709 13:20:18.428644 17393 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.429557 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:18.352596 17467 rpcz_store.cc:276] 0709 13:20:17.281191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.435734 (+154543us) service_pool.cc:224] Handling call
0709 13:20:17.436115 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:17.448884 (+ 12769us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:17.449646 (+   762us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.669792 (+220146us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.753043 (+ 83251us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:17.931659 (+178616us) log.cc:844] Serialized 52 byte log entry
0709 13:20:17.931854 (+   195us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:17.932325 (+   471us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.191262 (+258937us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b1800382de0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf 00007f7d6280e038
0709 13:20:18.205024 (+ 13762us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.235128 (+ 30104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.235210 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.314432 (+ 79222us) raft_consensus.cc:1685] finished
0709 13:20:18.314461 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.314649 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":340242,"prepare.queue_time_us":459826,"prepare.run_cpu_time_us":181,"prepare.run_wall_time_us":4746,"raft.queue_time_us":375527,"raft.run_cpu_time_us":650,"raft.run_wall_time_us":89811,"spinlock_wait_cycles":12162944,"thread_start_us":217265,"threads_started":1,"wal-append.queue_time_us":540457}
I20260709 13:20:18.430287 17390 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.370146 23671 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:20:18.423327 23628 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.432457 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:18.361624 23362 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.433123 17465 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:18.425834 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:18.435752 17397 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:18.436178 17392 raft_consensus.cc:2368] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15.
I20260709 13:20:18.416796 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:18.439770 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:18.451293 17388 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:18.438432 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:18.466146 17393 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:18.466471 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.467288 17388 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:18.469991 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:18.472332 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:18.473579 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.474326 17392 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:18.476663 17315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:18.477480 17315 raft_consensus.cc:606] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:18.477941 17315 raft_consensus.cc:614] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:18.479045 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:18.481328 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:18.484655 17396 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:18.485821 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:18.487558 22740 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:18.487987 22740 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.488339 22740 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.475987 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:18.492890 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.023s
W20260709 13:20:18.497152 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.003s	sys 0.023s
I20260709 13:20:18.498004 23432 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:18.503114 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 567892us
I20260709 13:20:18.511430 17316 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:18.468207 23264 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.468309 23261 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.486089 23529 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:18.553984 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:18.475028 23613 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:18.588155 17999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.008s	sys 0.019s
W20260709 13:20:18.688362 17999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.012s	sys 0.021s
W20260709 13:20:18.667958 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 155105us
I20260709 13:20:18.564823 23582 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.669886 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:18.671025 22740 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.671507 17391 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:18.466266 23098 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.679332 17390 raft_consensus.cc:2410] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:20:18.665925 23594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.010s	sys 0.008s
W20260709 13:20:18.691993 17963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.012s	sys 0.008s
W20260709 13:20:18.700058 17963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.013s	sys 0.008s
W20260709 13:20:18.700500 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 1.10133e+06us
I20260709 13:20:18.701269 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:18.507349 23432 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.710934 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:18.711486 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:18.711593 17992 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.725713 17995 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:18.684960 23340 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.725332 22740 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.750200 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:18.730172 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 289172us
W20260709 13:20:18.762416 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.763104 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:18.688356 23529 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:18.685707 23681 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.684337 23292 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:20:18.702543 23374 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.703440 23594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.011s	sys 0.008s
I20260709 13:20:18.771852 17998 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:18.772156 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:18.767069 17993 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:18.774044 17462 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:18.790793 23667 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:18.721978 23489 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:18.773703 17285 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:18.791954 23677 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.708964 23611 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:18.723604 23603 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:18.791409 23667 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.780129 17467 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:18.709892 23479 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.753423 23362 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:18.723431 23428 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.688261 23261 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.728775 23102 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.805114 23102 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.792217 23489 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.754400 23665 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.690372 23264 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.765062 23635 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:18.729586 23679 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.773597 23529 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.826766 23489 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:18.810680 17463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "132676f9343f4733b4f07f4587384a56"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:20:18.829352 17463 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:18.828974 23611 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.829952 17463 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:18.840394 23260 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.744s	user 0.006s	sys 0.002s
I20260709 13:20:18.741123 23304 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:20:18.739087 23098 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.806571 23227 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:20:18.845209 23690 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:18.808193 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 69844.7us
I20260709 13:20:18.852865 17465 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:18.777249 23340 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.854398 23257 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.854107 23679 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.855696 23689 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:18.859172 23245 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.786548 23585 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:18.864419 17992 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:18.861225 23292 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:18.816200 23674 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:20:18.786877 23374 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.902117 17463 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.897819 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:18.905239 17465 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
W20260709 13:20:18.905437 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 118239us
I20260709 13:20:18.778311 23681 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:18.906893 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 205673us
I20260709 13:20:18.911250 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:18.910079 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 139003us
I20260709 13:20:18.914049 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:18.918594 17992 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:18.921922 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:18.847455 23665 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.815315 23603 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.930639 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:18.905119 23292 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.934697 23292 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.935235 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:18.936894 23432 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.938727 23264 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:18.910514 23585 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.913615 23257 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:18.941519 23102 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.941682 23245 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:18.943508 23098 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:18.944914 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1145) took 1365 ms. Trace:
I20260709 13:20:18.945299 17991 rpcz_store.cc:276] 0709 13:20:17.579253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.579459 (+   206us) service_pool.cc:224] Handling call
0709 13:20:17.592192 (+ 12733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.034006 (+441814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.034048 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.087854 (+ 53806us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.668998 (+581144us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:18.669035 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.669101 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.944698 (+275597us) raft_consensus.cc:1685] finished
0709 13:20:18.944720 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.944859 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31161,"raft.queue_time_us":188290,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":789104,"threads_started":2,"wal-append.queue_time_us":700858}
I20260709 13:20:18.947266 23479 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:18.947849 23479 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:18.948341 23479 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.951697 23611 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:18.959591 23611 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:18.913650 23677 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:20:18.967133 23677 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:18.967482 23677 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:18.968317 23677 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.969612 23677 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.970602 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:18.971091 23227 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:18.971231 17468 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.971621 23227 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.974087 23692 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.957252 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:18.974833 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:18.975531 17392 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.976136 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:18.976758 17462 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:18.977212 17463 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:18.953583 23683 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:18.962253 23098 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:18.964638 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:18.965663 23585 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:18.974184 17396 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:18.941810 23257 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.955148 17997 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:18.867502 23260 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:18.985517 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:18.982827 17434 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:18.993815 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:18.998237 17395 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:18.999053 17997 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:18.974794 23692 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:18.910774 23635 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:20:19.058125 17468 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:19.015324 17470 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:19.015396 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:19.030583 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:19.045706 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:19.010317 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 102703us
I20260709 13:20:18.997821 17316 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:19.046765 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 134131us
I20260709 13:20:19.062129 17316 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:18.998466 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:19.062839 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:19.010963 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:18.896899 23689 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.037318 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:19.026873 23681 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.093657 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1052) took 1462 ms. Trace:
I20260709 13:20:19.065984 23613 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.096177 23432 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.096802 23689 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:18.984295 23611 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:19.093307 17316 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.098845 23704 raft_consensus.cc:2764] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:19.100243 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:19.094321 17466 rpcz_store.cc:276] 0709 13:20:17.631530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.668105 (+ 36575us) service_pool.cc:224] Handling call
0709 13:20:17.668544 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.020478 (+351934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.020539 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.029648 (+  9109us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.514086 (+484438us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:18.700114 (+186028us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.703999 (+  3885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.704084 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.093437 (+389353us) raft_consensus.cc:1685] finished
0709 13:20:19.093467 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.093609 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13779,"prepare.queue_time_us":21896,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":123417,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":51710,"thread_start_us":643271,"threads_started":2,"wal-append.queue_time_us":722588}
W20260709 13:20:19.100867 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 102499us
W20260709 13:20:19.101338 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 128905us
I20260709 13:20:19.102214 17316 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:19.121793 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:19.122908 17995 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:18.991611 23672 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.106s
I20260709 13:20:19.099789 17997 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.127287 17997 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:19.130612 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:19.028170 23693 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:20:19.035367 23601 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.892046 23690 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.019562 23585 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.103015 23631 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.712s	user 0.000s	sys 0.016s
I20260709 13:20:19.030035 23701 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.116997 23613 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:18.978281 23479 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.174466 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:19.096742 23432 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.178166 17995 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
W20260709 13:20:19.157876 23636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.015s	sys 0.016s
I20260709 13:20:19.153224 17435 leader_election.cc:400] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15.
I20260709 13:20:19.148599 23674 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:19.101442 23596 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:20:19.188246 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.153854 17316 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:19.001555 23679 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.116452 23611 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:19.182153 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:19.106914 23703 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:19.183261 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:19.189145 17318 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:19.194351 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:19.154330 23528 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:19.184425 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:19.151237 23689 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:19.002120 23098 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.195537 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:19.183521 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:19.200518 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:19.131632 23628 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:20:19.199271 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:19.167205 23304 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:19.205947 23257 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.195639 23227 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.207816 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.208371 23682 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.209682 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.229729 23682 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.230065 17318 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:19.230396 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:19.231601 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.231663 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.232441 17321 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:19.210880 17396 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:19.238739 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:19.180500 23636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.015s	sys 0.017s
W20260709 13:20:19.211166 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 76301.5us
I20260709 13:20:19.213263 17392 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:19.174829 23704 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.233726 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.236644 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:19.239778 17287 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:19.245769 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:19.239502 17321 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:19.247224 23711 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:19.239782 23704 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.247776 23711 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:19.248332 23684 raft_consensus.cc:993] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:20:19.246616 23257 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:19.249155 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1049) took 2019 ms. Trace:
I20260709 13:20:19.249225 23257 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.249814 23257 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:19.250165 17321 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:20:19.251091 23716 raft_consensus.cc:1081] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
I20260709 13:20:19.251412 17316 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:19.253016 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:19.256245 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:19.257136 17462 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:19.166769 23601 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.249616 17471 rpcz_store.cc:276] 0709 13:20:17.229471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.431412 (+201941us) service_pool.cc:224] Handling call
0709 13:20:17.431762 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.432172 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.432200 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.432783 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.633049 (+200266us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:17.633094 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.633171 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.246370 (+1613199us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b240004b968. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f58d9c4 00007f7d5f58bacb 00007f7d5f746dc9 00007f7d5f746a55 00007f7d5f745fb0 00007f7d623bc488 00007f7d623bcbe8 00007f7d62394398 00007f7d6238f76a 00007f7d6238ebb6
0709 13:20:19.248897 (+  2527us) raft_consensus.cc:1685] finished
0709 13:20:19.248916 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.249103 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8511,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"spinlock_wait_cycles":26608896,"thread_start_us":182489,"threads_started":1,"wal-append.queue_time_us":486214}
I20260709 13:20:19.259989 17962 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:19.262802 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:19.263396 17468 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:20:19.267125 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:19.265712 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:19.267938 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:19.268111 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 230924us
I20260709 13:20:19.272444 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.173776 23631 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.277462 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:19.279318 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:19.280323 23676 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:19.186338 23529 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.185461 23585 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.235651 23703 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:19.285719 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 133517us
I20260709 13:20:19.210528 23679 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:20:19.290086 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.290191 17467 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:19.287451 17463 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:19.253172 23667 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:19.217965 23528 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.285904 23613 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:19.313920 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 43812.8us
I20260709 13:20:19.314769 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:19.235971 23304 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.315858 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:19.280629 23669 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:19.264348 23227 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.305560 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.309682 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.323704 17316 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:19.179798 23701 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.292440 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:19.274649 23278 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:19.282233 23689 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:19.287319 23650 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:19.289642 23489 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:19.317801 17318 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:19.289580 23705 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:19.299512 23340 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.306070 23632 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.267552 23264 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:20:19.323750 23669 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.347666 17393 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:19.324402 23613 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:19.340736 23489 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:19.248623 23711 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.342463 23684 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:19.363416 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 94631us
W20260709 13:20:19.348019 23696 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:20:19.332084 23278 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:19.292078 23676 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.351203 23260 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:19.336009 23227 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.344864 23594 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
W20260709 13:20:19.365074 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 66707.1us
I20260709 13:20:19.437832 17394 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:19.373176 17393 raft_consensus.cc:2410] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:19.343688 23713 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:19.356938 23669 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:19.580447 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 264639us
I20260709 13:20:19.361435 23613 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:19.357411 23716 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:19.357054 23340 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.578893 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:19.438764 23719 log.cc:927] Time spent T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:20:19.437456 23697 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:20:19.366675 23245 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:19.364212 23489 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:19.366001 23684 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.437963 23098 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.442426 23528 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.443529 23304 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:19.653486 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 74708.6us
I20260709 13:20:19.676219 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:19.677029 17997 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 11: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:20:19.654994 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 366223us
I20260709 13:20:19.569504 23665 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.592020 23278 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:19.657655 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 365247us
I20260709 13:20:19.593691 23682 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:19.630851 23479 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.632385 23716 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:19.635605 23432 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:19.360939 23632 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.678320 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:19.654289 23245 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:19.648975 23692 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.664472 23684 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:19.663450 23723 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:19.655145 23611 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.650167 23340 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.709681 17462 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:20:19.717576 23705 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:19.718393 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 115747us
I20260709 13:20:19.718751 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:19.719295 23713 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:19.720360 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:19.719801 23705 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.720196 23713 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.721567 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:19.721832 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:19.722198 17466 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:19.720937 17462 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:19.724988 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.724467 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:19.725934 17468 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:19.728132 17468 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:19.723598 17466 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:20:19.732105 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:19.684369 23650 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:19.696763 23672 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.694703 23689 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:19.752460 17462 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:19.745189 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:19.754410 23432 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:19.745921 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:19.749831 17390 raft_consensus.cc:2410] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:20:19.704391 23716 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:19.711269 23682 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:19.752517 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2356) took 2130 ms. Trace:
I20260709 13:20:19.708928 23603 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:19.709415 23723 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.713413 23585 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:19.734087 23665 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:19.770660 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:19.771813 17465 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:19.762173 17322 rpcz_store.cc:276] 0709 13:20:17.612622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.612746 (+   124us) service_pool.cc:224] Handling call
0709 13:20:17.621043 (+  8297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.652050 (+ 31007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.652081 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.787382 (+135301us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.386301 (+598919us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b18003be7e0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:20:18.712267 (+325966us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:18.712320 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.712484 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.709161 (+996677us) raft_consensus.cc:1685] finished
0709 13:20:19.709190 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.742631 (+ 33441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34520,"raft.queue_time_us":34028,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":84655,"spinlock_wait_cycles":6423296,"thread_start_us":313948,"threads_started":1,"wal-append.queue_time_us":1277134}
I20260709 13:20:19.735183 23529 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.779323 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:19.779472 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:19.779942 23632 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.784116 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:19.793524 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:19.791718 17991 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:19.789011 17996 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:19.780936 23304 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.760082 23245 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.768246 23690 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.778040 23723 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:19.800541 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:19.830888 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:19.801339 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:19.797279 23730 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:20:19.804100 23728 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.804769 23632 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:19.805251 23582 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:19.807032 23257 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.005s
W20260709 13:20:19.812002 23677 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.842s	user 0.008s	sys 0.001s
I20260709 13:20:19.812431 23304 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.751775 23650 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.762799 23672 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.798519 23665 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:19.820930 23611 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.628860 23703 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.836525 17463 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:19.849680 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:19.851194 17314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.000s
W20260709 13:20:19.890913 17314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.005s	sys 0.000s
W20260709 13:20:19.852612 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 59234.3us
I20260709 13:20:19.835429 23242 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:19.854775 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:19.861474 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:19.865106 23676 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:19.865190 23740 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:19.870433 23304 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.852916 23728 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.862435 23732 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:19.863979 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.873948 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.841499 23245 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:19.853317 23257 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.877301 23489 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.872416 23601 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:19.877821 23734 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.924124 23734 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:19.878845 23421 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:20:19.841187 23689 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.880131 23665 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:19.881166 23691 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.938s	user 0.008s	sys 0.008s
W20260709 13:20:19.854135 23223 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.485s	user 0.015s	sys 0.003s
I20260709 13:20:19.891884 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:19.890560 17397 raft_consensus.cc:2376] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18. Re-sending same reply.
I20260709 13:20:19.875108 23690 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.897276 23242 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.913324 23340 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:19.913794 23740 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.937963 23242 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:19.884063 23260 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.939746 23740 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:19.939867 23260 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.942360 17997 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:19.943138 23260 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:19.943298 23489 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:19.944056 17322 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:19.919323 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.874382 23632 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:20:19.937147 23690 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.915757 23631 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:19.915055 23732 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:19.945238 17321 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 11.
W20260709 13:20:19.954047 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 121605us
I20260709 13:20:19.966568 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:19.967173 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:19.967814 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:19.954666 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 61151.3us
I20260709 13:20:19.974705 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:19.978454 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:19.937541 23669 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:19.982625 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:19.984309 17995 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:19.931905 23582 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:19.972335 23613 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:19.987136 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:19.985287 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:19.985340 23671 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.007s	sys 0.035s
I20260709 13:20:20.015826 23729 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:20.016220 23751 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.016390 23729 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.016796 23751 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.017483 23632 raft_consensus.cc:2764] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:20.018772 23650 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.019191 23751 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.019649 23690 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.020581 23257 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.020393 23716 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.021838 17316 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:19.944375 23223 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.023696 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:19.972922 23732 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:19.985098 23260 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.967262 23734 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.029265 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.030938 23613 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.016856 23729 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:20.032196 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:20.033469 17397 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:20.022859 23671 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.007s	sys 0.040s
I20260709 13:20:20.013159 23631 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:20.055696 17317 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:20.057081 23710 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.801s	user 0.011s	sys 0.000s
W20260709 13:20:20.060256 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 198882us
I20260709 13:20:20.062584 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:20.030143 23260 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.070374 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1152) took 1148 ms. Trace:
I20260709 13:20:20.059367 23631 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:20.070900 17992 rpcz_store.cc:276] 0709 13:20:18.921886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.944300 (+ 22414us) service_pool.cc:224] Handling call
0709 13:20:18.944735 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.945251 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.945296 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.945890 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.100948 (+155058us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:19.101001 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.101073 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.022078 (+921005us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b2400326738. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f58d9c4 00007f7d5f58bacb 00007f7d5f746dc9 00007f7d5f746a55 00007f7d5f74609d 00007f7d6237810e 00007f7d6238f88c 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221
0709 13:20:20.070018 (+ 47940us) raft_consensus.cc:1685] finished
0709 13:20:20.070051 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.070314 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1250,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"spinlock_wait_cycles":27438976,"thread_start_us":153987,"threads_started":1,"wal-append.queue_time_us":297510}
I20260709 13:20:20.078367 23750 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.079038 23750 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.080513 23261 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.090481 23746 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:20.090955 23749 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:20.091140 23746 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.091521 23749 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.092015 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2360) took 1721 ms. Trace:
I20260709 13:20:20.094055 23746 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.095171 23749 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:20.097543 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.092466 17317 rpcz_store.cc:276] 0709 13:20:18.370574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.377915 (+  7341us) service_pool.cc:224] Handling call
0709 13:20:18.378222 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.056300 (+1678078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.091759 (+ 35459us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54003e30d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:20.091952 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3857222528}
I20260709 13:20:20.098304 17964 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:20.098758 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:20.099493 23421 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:20.099707 17317 raft_consensus.cc:2368] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:20.100031 23421 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:20.100955 23421 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.101744 17434 leader_election.cc:400] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:20.102072 17434 leader_election.cc:403] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:20.102890 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:20.100610 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:20.104327 23716 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.104979 23603 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:20.105098 23672 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.107548 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:20.108290 23603 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:20.098817 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:20.064414 23488 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:20.113061 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:20.115867 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:20.116436 17321 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:20.123257 23631 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.127347 23374 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:20.128398 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45882.7us
I20260709 13:20:20.127554 23669 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.130884 23261 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:20.131656 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2177) took 3336 ms. Trace:
I20260709 13:20:20.132000 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:20.132028 17464 rpcz_store.cc:276] 0709 13:20:16.795195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.312306 (+517111us) service_pool.cc:224] Handling call
0709 13:20:17.312602 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.330777 (+ 18175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.330821 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.347083 (+ 16262us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.592450 (+245367us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:17.622897 (+ 30447us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.927613 (+304716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.927706 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.267135 (+339429us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:20.130471 (+1863336us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b240004b968. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f58d9c4 00007f7d5f58bacb 00007f7d5f746dc9 00007f7d5f746a55 00007f7d5f745fb0 00007f7d623bc488 00007f7d623bcbe8 00007f7d62394398 00007f7d6238f76a 00007f7d6238ebb6
0709 13:20:20.131411 (+   940us) raft_consensus.cc:1685] finished
0709 13:20:20.131429 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.131571 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12587,"prepare.queue_time_us":37090,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66967,"raft.queue_time_us":19451,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":24538,"spinlock_wait_cycles":91354240,"thread_start_us":523737,"threads_started":2,"wal-append.queue_time_us":601889}
I20260709 13:20:20.137214 23260 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.141554 23723 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.145524 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.146353 17992 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:20.146467 23723 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.140746 23223 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.147823 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:20.148429 23750 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.129060 23278 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.149541 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:20.150203 23668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.020s	sys 0.004s
I20260709 13:20:20.171635 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:20.172289 17320 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:20:20.111909 23632 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:20:20.112236 23689 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:20:20.152091 23675 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:20.154068 23242 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.160034 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.180990 17464 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:20.165068 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:20.170588 17397 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:20.182694 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:20.183571 17397 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:20.111975 23729 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.178397 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:20.174553 23668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.020s	sys 0.004s
I20260709 13:20:20.135385 23488 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:20:20.210222 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45269.4us
I20260709 13:20:20.222146 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.223259 17397 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:20.224804 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.302620 23756 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:20.227670 23508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.922s	user 0.009s	sys 0.022s
W20260709 13:20:20.310902 23508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.006s	user 0.009s	sys 0.022s
I20260709 13:20:20.310676 23756 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.211421 23734 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:20.312170 23374 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.312680 23374 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.301035 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.314625 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:20.309583 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.315320 17471 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:20.227963 23750 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:20:20.328313 23729 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.314951 23374 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.158852 23732 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.313499 23756 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.341228 23729 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.343286 23729 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.316468 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:20.327553 23762 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:20:20.345027 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:20.347440 17397 raft_consensus.cc:2410] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:20:20.214426 23245 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.347466 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.216639 23504 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:20.345564 17471 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:20.341333 23671 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.341264 23763 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.345628 23374 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.353127 23650 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.364143 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.403177 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:20.405419 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 89449us
I20260709 13:20:20.414996 17397 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:20.423810 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 217920us
I20260709 13:20:20.425411 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:20.429983 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.430251 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:20.445303 23723 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.445596 23729 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.446143 23723 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.448289 23723 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.448859 23723 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:20.450373 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:20.450444 23278 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:20.403861 23374 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.400909 23671 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.454361 23723 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:20.454936 23374 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.455508 23374 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:20.455827 23671 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.413888 23703 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.457120 23703 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:20.410115 23762 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:20.460237 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:20.454823 23723 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.467566 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:20.400431 23763 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.476578 23362 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.476953 23763 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.477296 23362 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.477742 23732 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.478446 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:20.479235 17395 raft_consensus.cc:2368] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:20.480034 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.421892 23650 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.481456 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.483096 23650 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.483873 23362 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:20.485728 23684 consensus_meta.cc:287] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.770s	user 0.009s	sys 0.003s
I20260709 13:20:20.486568 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:20.487949 17286 leader_election.cc:400] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:20.488408 17286 leader_election.cc:403] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:20.490607 22740 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:20.491312 22740 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:20.494231 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:20.492347 22740 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.495162 17395 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:20.452731 23675 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:20.487738 23723 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.510401 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:20.511155 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 2041) took 1310 ms. Trace:
I20260709 13:20:20.511600 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:20.512327 17315 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:20.511755 17318 rpcz_store.cc:276] 0709 13:20:19.200542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.233360 (+ 32818us) service_pool.cc:224] Handling call
0709 13:20:20.510855 (+1277495us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b540043f3d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:20.511023 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176952576}
W20260709 13:20:20.508219 17285 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.504s (SENT) [suppressed 9 similar messages]
I20260709 13:20:20.460196 23703 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.524295 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.525157 17471 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:20.455864 23374 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.486296 23684 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.356184 23504 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.515383 23102 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:20.533625 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:20.534175 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.541091 17471 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.500757 23635 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.362823 23245 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.513835 23729 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.519218 23732 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.537186 17397 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
W20260709 13:20:20.538442 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 70975.4us
I20260709 13:20:20.522008 23726 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.541435 17996 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:20.543612 17317 raft_consensus.cc:2368] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23.
I20260709 13:20:20.545989 17362 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:20.532060 23374 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:20.548823 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.535909 23613 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:20.550285 17397 raft_consensus.cc:2368] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:20.551450 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.552007 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:20.539085 23242 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.540272 23773 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.556452 23242 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:20.560055 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:20.562570 17996 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:20.566020 17397 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:20.566989 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.567572 17471 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:20.575094 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:20.576879 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.578414 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.580322 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.582580 17389 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:20.547525 23729 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.548828 23732 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.579039 17991 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:20.587702 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.587708 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:20.560889 23242 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.590520 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.589526 17466 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:20.594060 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.550880 23726 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.553061 23635 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.598645 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.588037 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.605530 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.606024 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.606760 17397 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:20.607568 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.560295 23773 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.611037 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.595264 23242 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:20.612543 17397 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:20.616091 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 70199.8us
I20260709 13:20:20.619532 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:20.622359 23768 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:20:20.622597 23729 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.625048 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:20.628371 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.632979 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.635931 17996 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 11.
I20260709 13:20:20.633353 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:20.633221 23421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.010s	sys 0.029s
I20260709 13:20:20.641412 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.642777 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.643831 17397 raft_consensus.cc:2410] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 20 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:20:20.647720 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.650279 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3669) took 1039 ms. Trace:
I20260709 13:20:20.650717 17397 rpcz_store.cc:276] 0709 13:20:19.610756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.649477 (+1038721us) service_pool.cc:224] Handling call
0709 13:20:20.649783 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.649973 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.650002 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.650046 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:20.650081 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.650133 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.650230 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:20.653082 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3670) took 1042 ms. Trace:
I20260709 13:20:20.653990 17397 rpcz_store.cc:276] 0709 13:20:19.610992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.652255 (+1041263us) service_pool.cc:224] Handling call
0709 13:20:20.652610 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.652788 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.652816 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.652875 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:20.652903 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.652950 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.653036 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:20.657307 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:20.642750 23708 log.cc:927] Time spent T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.453s	user 0.000s	sys 0.010s
I20260709 13:20:20.663724 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:20.668336 17991 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:20.669920 23726 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.670894 23684 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.674615 23732 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.675033 23729 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:20.675357 23245 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.675652 23729 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.676932 23635 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.678241 23729 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.684688 23635 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:20.646124 23779 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:20.705013 23684 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:20.705031 23635 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.681672 23774 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:20.641237 23421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.011s	sys 0.029s
I20260709 13:20:20.693660 17395 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
W20260709 13:20:20.714354 23492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.777s	user 0.019s	sys 0.036s
W20260709 13:20:20.716933 23492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.780s	user 0.019s	sys 0.036s
I20260709 13:20:20.708644 23504 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.718339 23635 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.721835 23704 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.724190 23701 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.724376 23102 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:20.710119 23779 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:20.734004 23779 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:20.742636 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47450.4us
I20260709 13:20:20.732510 23723 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.749023 17389 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:20.740166 23701 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:20.750600 17470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3656) took 1986 ms (client timeout 1568 ms). Trace:
W20260709 13:20:20.751219 17470 rpcz_store.cc:269] 0709 13:20:18.763992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.764111 (+   119us) service_pool.cc:224] Handling call
0709 13:20:20.750270 (+1986159us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540041f5d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:20.750431 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289047808}
I20260709 13:20:20.754001 23723 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.750450 23701 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.761023 23492 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.761687 23492 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.744289 23497 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:20.763408 17462 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:20.765636 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2202) took 1034 ms. Trace:
I20260709 13:20:20.766075 17462 rpcz_store.cc:276] 0709 13:20:19.730883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.766150 (+ 35267us) service_pool.cc:224] Handling call
0709 13:20:20.763012 (+996862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.763803 (+   791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.765374 (+  1571us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54001afed0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:20.765564 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2135806720}
I20260709 13:20:20.767161 23374 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.771263 23729 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.771821 23729 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.772790 23680 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:20.762094 17467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3666) took 1829 ms (client timeout 1949 ms). Trace:
W20260709 13:20:20.774366 17467 rpcz_store.cc:269] 0709 13:20:18.933156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.980201 (+ 47045us) service_pool.cc:224] Handling call
0709 13:20:20.761840 (+1781639us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54001afed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:20.762004 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516614016}
I20260709 13:20:20.773351 23680 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.777189 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:20.787400 17462 raft_consensus.cc:2376] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20. Re-sending same reply.
I20260709 13:20:20.775926 23723 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:20.788269 23723 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.789997 23680 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.790578 23723 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:20.783344 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 119698us
I20260709 13:20:20.785836 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:20.777168 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:20.788401 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:20.793740 17470 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:20.796422 23724 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.797072 23724 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.796720 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:20.799234 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.799532 17997 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:20.800897 23724 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.802573 23724 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:20.803154 23724 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.767261 23242 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.794965 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.781733 23729 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:20.808379 17470 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:20.788311 23492 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:20.808549 17997 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:20.806013 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3672) took 1194 ms. Trace:
I20260709 13:20:20.810151 17462 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:20.815917 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.816529 17462 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:20.817348 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.818209 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:20.818718 17462 raft_consensus.cc:2368] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23.
I20260709 13:20:20.819283 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:20.807201 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:20.811339 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:20.815294 17397 rpcz_store.cc:276] 0709 13:20:19.611527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.656211 (+1044684us) service_pool.cc:224] Handling call
0709 13:20:20.656499 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:20.657833 (+  1334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.657860 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:20.658438 (+   578us) log.cc:844] Serialized 52 byte log entry
0709 13:20:20.776564 (+118126us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:20.776634 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.776723 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.805710 (+ 28987us) raft_consensus.cc:1685] finished
0709 13:20:20.805740 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.805941 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":794,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":117703,"threads_started":1,"wal-append.queue_time_us":137292}
I20260709 13:20:20.821377 17467 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:20.816586 17287 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:20.823195 23724 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.879746 23701 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.847663 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.916069 23730 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:20.916602 23730 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:20.917516 23730 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.918584 23730 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.920023 23242 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.924145 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1157) took 1244 ms. Trace:
W20260709 13:20:20.877162 23721 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.346s	user 0.001s	sys 0.002s
I20260709 13:20:20.855468 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:20.926517 23664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.622s	user 0.031s	sys 0.049s
W20260709 13:20:20.926976 23664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.622s	user 0.033s	sys 0.050s
I20260709 13:20:20.926538 17467 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:20.929752 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:20.930130 23770 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.391s	user 0.001s	sys 0.000s
I20260709 13:20:20.824997 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:20.932371 17462 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.932413 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.933439 17468 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:20.934502 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:20.934923 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 118408us
I20260709 13:20:20.930473 17467 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:20.809572 23714 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:20.936822 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.937463 17468 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:20.939131 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:20.940151 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.924600 17998 rpcz_store.cc:276] 0709 13:20:19.679324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.679527 (+   203us) service_pool.cc:224] Handling call
0709 13:20:19.705329 (+ 25802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.898278 (+192949us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:19.914894 (+ 16616us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.915154 (+   260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.915218 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:19.915279 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.923895 (+1008616us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54006de554. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:20.923943 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.924089 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18321,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":464,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":8595,"spinlock_wait_cycles":443076352}
W20260709 13:20:20.828048 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.942484 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:20.936336 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 129224us
I20260709 13:20:20.943439 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:20.876371 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:20.940631 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:20.945298 17397 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.947249 17462 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:20:20.949720 17468 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:20.950145 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:20.847324 23374 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:20.951767 17468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:20:20.953063 17470 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:20.938647 23492 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.938241 23701 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:20.940001 23729 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:20.949033 23724 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:20.959028 17467 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:20.967844 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1009) took 1780 ms. Trace:
I20260709 13:20:20.855043 23358 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:20.952219 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:20.953508 17468 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:20.951102 23669 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:20.981752 17468 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:20.958108 23223 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:20.968194 17397 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:20:20.948446 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:20.953227 23785 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:20.942148 23714 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.989471 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:20.968511 23724 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:20.985572 17286 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:20.992624 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:20.981091 23650 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.954154 23492 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:20.965363 23701 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:21.001125 23701 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.001897 23492 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:20.967682 23729 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:20.981547 23669 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.005393 23669 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:21.008311 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:20.983897 23223 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:21.009764 23223 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:20.999864 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.012449 17397 raft_consensus.cc:2410] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:21.013769 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1039) took 2060 ms. Trace:
I20260709 13:20:21.014361 23714 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:21.014971 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.015352 23227 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:21.015709 17397 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:20.987164 23784 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:21.016778 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:21.017385 23784 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:21.017751 23709 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.696s	user 0.007s	sys 0.004s
I20260709 13:20:21.018203 23227 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.018656 23227 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:21.019184 23227 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.018514 23784 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.004681 23729 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:20.993223 23715 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:20.996055 23724 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:21.000242 23650 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.009588 17285 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:21.014133 17319 rpcz_store.cc:276] 0709 13:20:18.953436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.953609 (+   173us) service_pool.cc:224] Handling call
0709 13:20:18.953930 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.124520 (+170590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.124563 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.124611 (+    48us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:19.124650 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.013564 (+1888914us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540010bb54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:21.013608 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.013719 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391841024}
I20260709 13:20:21.021886 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:20.968181 17388 rpcz_store.cc:276] 0709 13:20:19.183608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.192132 (+  8524us) service_pool.cc:224] Handling call
0709 13:20:19.192577 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.193027 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.193072 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.204292 (+ 11220us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.311947 (+107655us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:19.311998 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.312086 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.876540 (+1564454us) spinlock_profiling.cc:243] Waited 9.86 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:20.952943 (+ 76403us) raft_consensus.cc:1685] finished
0709 13:20:20.952967 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.963561 (+ 10594us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17082,"raft.queue_time_us":779,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":23137,"spinlock_wait_cycles":22672256,"thread_start_us":43801,"threads_started":1,"wal-append.queue_time_us":110122}
I20260709 13:20:21.066936 17397 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:21.068056 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:21.068625 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.068960 17388 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.070405 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.071219 17397 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:21.072268 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.024474 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:21.074544 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50193.1us
W20260709 13:20:21.077368 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 69109.5us
I20260709 13:20:21.078416 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:21.082785 17397 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:21.083453 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:21.083923 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.030328 17468 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.085804 17467 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:21.088634 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.092417 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:21.094928 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.095937 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:20.999233 23358 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:21.094851 23726 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:21.097077 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:21.093097 23714 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:21.098734 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:21.100289 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.102120 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2036) took 2185 ms. Trace:
I20260709 13:20:21.102665 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.132264 17391 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
W20260709 13:20:21.103385 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 1003) took 1923 ms (client timeout 1891 ms). Trace:
W20260709 13:20:21.133062 17390 rpcz_store.cc:269] 0709 13:20:19.180384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.180914 (+   530us) service_pool.cc:224] Handling call
0709 13:20:21.103147 (+1922233us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54004132d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:21.103301 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261025536}
I20260709 13:20:21.103781 23421 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:21.104094 17396 raft_consensus.cc:1275] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:20:21.137912 17396 pending_rounds.cc:85] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 12
I20260709 13:20:21.138243 17396 pending_rounds.cc:107] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:20:21.138403 17468 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:21.105649 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.134261 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:21.132042 17313 rpcz_store.cc:276] 0709 13:20:18.916814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.916969 (+   155us) service_pool.cc:224] Handling call
0709 13:20:18.917264 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.927711 (+ 10447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.927759 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.936477 (+  8718us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.101175 (+164698us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:19.101214 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.626903 (+1525689us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:21.101819 (+474916us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b5400369f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:21.101870 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.101916 (+    46us) raft_consensus.cc:1685] finished
0709 13:20:21.101930 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.102068 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19096,"raft.queue_time_us":1446,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":73778,"spinlock_wait_cycles":42221312,"thread_start_us":163203,"threads_started":1,"wal-append.queue_time_us":215051}
I20260709 13:20:21.133553 17397 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:21.140328 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.141572 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.136143 17462 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:21.135962 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.138521 17396 raft_consensus.cc:2889] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:21.105028 23102 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:21.142462 17995 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:21.115655 17963 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.154317 23358 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:21.155611 23358 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:21.160732 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49932us
W20260709 13:20:21.161242 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.165628 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 50109.5us
I20260709 13:20:21.166059 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.166946 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.167837 17963 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:21.168375 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:21.086833 23682 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:21.087308 23679 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.191484 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:21.200114 17998 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:21.166764 17318 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:21.129405 23726 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.206002 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.205298 17435 leader_election.cc:400] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:21.213722 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.216766 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:21.219853 23728 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:21.220119 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.220916 17320 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:21.224665 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:21.149943 23102 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.170499 23704 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.228411 17391 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:21.228287 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.213376 23799 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:20:21.222837 23678 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:21.200170 23774 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.217114 23726 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:21.200361 23732 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:21.199554 23679 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.201071 23714 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:21.237246 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:21.202996 23682 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.206240 23585 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:21.235868 23102 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:21.171994 23729 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:21.244305 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.232918 17388 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:21.246461 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.249284 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:21.254770 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:21.253459 17314 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:21.236445 23628 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.323530 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.329577 17991 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:21.331211 17391 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:21.258189 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:21.240499 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:21.260941 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.257870 23714 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.241408 23774 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.257236 23679 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.256088 23492 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:21.171269 23421 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.320051 17998 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:21.324555 17993 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:20:21.324724 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.238688 23728 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:21.333035 17468 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
W20260709 13:20:21.335233 23798 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
I20260709 13:20:21.332505 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.363710 23687 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:21.364369 23687 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:21.365123 17391 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:20:21.365494 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:21.366397 17468 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.335937 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.369606 17997 raft_consensus.cc:2410] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:20:21.339349 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 81251.4us
I20260709 13:20:21.370936 17964 leader_election.cc:400] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23.
I20260709 13:20:21.371344 17964 leader_election.cc:403] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
W20260709 13:20:21.341233 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 171300us
I20260709 13:20:21.373816 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:21.345256 23585 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:21.374807 23585 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:21.375422 23585 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:21.328505 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.377566 17388 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:21.379175 17388 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:21.379966 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1020) took 1552 ms. Trace:
I20260709 13:20:21.326472 23682 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:21.336624 23628 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.381980 23628 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.382675 23603 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23.
I20260709 13:20:21.364794 23687 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:21.385466 23699 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 2.428s	user 0.016s	sys 0.008s
I20260709 13:20:21.386782 23631 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:21.365833 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1018) took 1538 ms. Trace:
I20260709 13:20:21.387194 23631 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:21.388130 23631 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.380424 17388 rpcz_store.cc:276] 0709 13:20:19.827685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.378462 (+1550777us) service_pool.cc:224] Handling call
0709 13:20:21.378878 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.379649 (+   771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.379899 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.389183 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1144) took 3810 ms. Trace:
W20260709 13:20:21.406409 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 189862us
W20260709 13:20:21.346107 23791 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:20:21.392620 23492 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:21.393445 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1048) took 2127 ms. Trace:
I20260709 13:20:21.394773 23728 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.399732 23650 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:21.417554 17316 rpcz_store.cc:276] 0709 13:20:19.269256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.352977 (+ 83721us) service_pool.cc:224] Handling call
0709 13:20:19.353398 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.022263 (+668865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.393095 (+1370832us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54000c94d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:21.393369 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536781568}
I20260709 13:20:21.419206 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.419853 17316 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:21.420612 17388 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:20:21.401428 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:21.421286 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1023) took 1378 ms. Trace:
I20260709 13:20:21.402822 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:21.247762 23704 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.407667 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.387356 17391 rpcz_store.cc:276] 0709 13:20:19.827024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.364431 (+1537407us) service_pool.cc:224] Handling call
0709 13:20:21.364823 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.365568 (+   745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.365776 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.340915 23774 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.334848 23714 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.411053 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.412710 17285 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.406849 17990 rpcz_store.cc:276] 0709 13:20:17.578885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.582863 (+  3978us) service_pool.cc:224] Handling call
0709 13:20:17.603419 (+ 20556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.004003 (+400584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.004121 (+   118us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.426941 (+422820us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b2c00100b48. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:20:18.427360 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.796386 (+369026us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:18.796436 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.796525 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.384930 (+2588405us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:21.388914 (+  3984us) raft_consensus.cc:1685] finished
0709 13:20:21.388935 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.389092 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48268,"raft.queue_time_us":184361,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":80764032,"thread_start_us":708358,"threads_started":2,"wal-append.queue_time_us":529510}
I20260709 13:20:21.409924 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.432186 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:21.433075 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.433465 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.434950 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.420897 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:21.401569 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.422262 17388 rpcz_store.cc:276] 0709 13:20:20.043397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.420087 (+1376690us) service_pool.cc:224] Handling call
0709 13:20:21.420399 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.421019 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.421234 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.427477 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:21.436255 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.258044 23732 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.442683 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.448529 17388 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:21.450834 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2332) took 1297 ms. Trace:
I20260709 13:20:21.452382 17462 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:21.452180 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.447711 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:21.329156 23729 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.417847 23756 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.457888 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.451380 17388 rpcz_store.cc:276] 0709 13:20:20.153108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.446065 (+1292957us) service_pool.cc:224] Handling call
0709 13:20:21.446424 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.450501 (+  4077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.450765 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.469412 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.442852 23358 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:21.445459 23736 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:21.440268 23750 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:21.471385 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.473477 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 2371) took 1510 ms. Trace:
I20260709 13:20:21.452184 23242 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.445129 23603 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.469342 17468 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
W20260709 13:20:21.480234 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 67636.8us
I20260709 13:20:21.484588 17321 rpcz_store.cc:276] 0709 13:20:19.963484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.985026 (+ 21542us) service_pool.cc:224] Handling call
0709 13:20:21.473160 (+1488134us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001423d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:21.473407 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239655680}
I20260709 13:20:21.476826 17390 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:21.450769 23631 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:21.485117 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.485733 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.476643 23245 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:21.536549 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.484223 23799 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.441763 23726 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.515707 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:21.478969 23654 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:21.548305 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:21.572340 17321 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:21.525106 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.537200 23794 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:20:21.549535 23603 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:21.550417 23729 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:21.581354 23686 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 2.638s	user 0.007s	sys 0.018s
I20260709 13:20:21.582067 23654 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:21.582527 23654 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:21.583033 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1146) took 3994 ms. Trace:
I20260709 13:20:21.583267 17395 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:21.584971 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:21.585757 17470 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:21.586309 23497 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:21.586695 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:21.477355 23806 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:21.587423 17470 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:20:21.479703 23756 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.494040 23805 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:21.570426 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.537139 23677 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.581270 23729 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:21.586877 23497 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:21.588945 23806 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:21.590216 17322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 1050) took 1726 ms (client timeout 1625 ms). Trace:
I20260709 13:20:21.568945 17468 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 23: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:21.598192 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.625996 17322 rpcz_store.cc:269] 0709 13:20:19.863311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.863432 (+   121us) service_pool.cc:224] Handling call
0709 13:20:21.589995 (+1726563us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b5400211e54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:21.590143 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76311936}
W20260709 13:20:21.594412 23702 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 2.653s	user 0.004s	sys 0.016s
I20260709 13:20:21.551163 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:21.489423 23242 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.592422 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:21.553170 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:21.583099 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 2328) took 1794 ms. Trace:
I20260709 13:20:21.572515 23245 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:21.598464 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:21.595361 23728 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:21.599951 17999 rpcz_store.cc:276] 0709 13:20:17.588295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.588431 (+   136us) service_pool.cc:224] Handling call
0709 13:20:17.603935 (+ 15504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.944658 (+340723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.944702 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.979856 (+ 35154us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.689522 (+709666us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:18.689581 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.689671 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.478695 (+2789024us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:21.582694 (+103999us) raft_consensus.cc:1685] finished
0709 13:20:21.582718 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.582969 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81860,"raft.queue_time_us":56455,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4763,"spinlock_wait_cycles":86097280,"thread_start_us":961933,"threads_started":2,"wal-append.queue_time_us":939240}
I20260709 13:20:21.489670 23650 consensus_queue.cc:1059] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:20:21.556934 23508 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:21.643116 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.622177 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:21.622695 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.552724 23421 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:21.543908 23358 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:21.677723 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 241523us
I20260709 13:20:21.540925 23227 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.593904 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:21.634101 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:21.632396 17389 rpcz_store.cc:276] 0709 13:20:19.793017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.594955 (+801938us) service_pool.cc:224] Handling call
0709 13:20:21.582877 (+987922us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400014354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:21.583042 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327431552}
I20260709 13:20:21.593446 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2312) took 3171 ms. Trace:
I20260709 13:20:21.696669 17468 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.697402 17394 rpcz_store.cc:276] 0709 13:20:18.421782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.422821 (+  1039us) service_pool.cc:224] Handling call
0709 13:20:18.423139 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.601523 (+1178384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.593148 (+1991625us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b540023c3d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:21.593356 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021541120}
I20260709 13:20:21.635107 17470 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:21.700239 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:21.701922 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:21.615926 23674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.301s	user 0.013s	sys 0.029s
I20260709 13:20:21.649458 17321 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:21.705987 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:21.634596 23223 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.623s	user 0.004s	sys 0.006s
W20260709 13:20:21.627637 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 459846us
I20260709 13:20:21.708966 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.684226 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.634246 23750 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.634181 23242 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.593226 23704 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:21.706640 17321 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:21.719616 17321 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:21.709304 17468 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:21.710250 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.712992 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.715363 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:21.724800 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:21.717180 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:21.622293 23677 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.583415 23654 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.674153 23728 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:21.710520 23674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.398s	user 0.013s	sys 0.030s
I20260709 13:20:21.572057 23492 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.748703 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1054) took 3500 ms. Trace:
I20260709 13:20:21.695787 23650 raft_consensus.cc:3055] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:21.737257 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:21.753398 17314 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:21.748445 17319 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:20:21.708232 23669 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.003s
I20260709 13:20:21.741220 17466 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:21.749285 17469 rpcz_store.cc:276] 0709 13:20:18.248583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.248766 (+   183us) service_pool.cc:224] Handling call
0709 13:20:18.249117 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.669358 (+420241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.669386 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.697070 (+ 27684us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.921601 (+224531us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:18.921661 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.921753 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.593668 (+2671915us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:21.737723 (+144055us) raft_consensus.cc:1685] finished
0709 13:20:21.737745 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.748642 (+ 10897us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31709,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":50,"spinlock_wait_cycles":99353344,"thread_start_us":503373,"threads_started":2,"wal-append.queue_time_us":172483}
I20260709 13:20:21.749583 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.734606 23667 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:21.730901 23801 raft_consensus.cc:2764] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:21.729971 23729 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:21.681969 23508 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.741356 23757 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.752897 23650 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:21.718267 23421 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:21.747886 23704 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:21.759184 23724 consensus_meta.cc:287] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.000s
I20260709 13:20:21.762429 17466 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:21.732268 23750 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.771832 17469 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:21.775141 23773 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:21.782241 23227 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:21.720104 23784 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:20:21.767138 23815 raft_consensus.cc:2764] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:21.783954 23757 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:21.803123 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 71083.8us
I20260709 13:20:21.718029 23223 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.756999 23669 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.753021 23728 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.785892 23756 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:21.829352 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 79985.9us
I20260709 13:20:21.800997 17469 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:21.769078 23803 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:20:21.835318 23757 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.764549 23245 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.784548 23628 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:21.847076 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 366395us
I20260709 13:20:21.849138 17320 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:21.831255 23704 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:21.803607 23724 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:21.855355 17318 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:21.855491 23704 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.856411 23724 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:21.857347 17999 pending_rounds.cc:85] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 12
I20260709 13:20:21.857661 17999 pending_rounds.cc:107] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:20:21.857815 17999 raft_consensus.cc:2889] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:21.770576 23358 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.802387 23809 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:20:21.841596 23726 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:21.851081 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:21.839578 23667 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:20:21.846042 23421 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:21.838697 23701 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:20:21.851431 23803 consensus_queue.cc:1243] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:21.870086 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.883260 17991 raft_consensus.cc:2410] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:20:21.883070 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:21.883901 17993 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:21.884663 23825 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:21.885048 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:21.837606 23811 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:20:21.868870 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:21.877473 17393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 1008) took 2694 ms (client timeout 1556 ms). Trace:
I20260709 13:20:21.859543 23774 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.848292 23636 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:21.853324 23817 raft_consensus.cc:2764] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:21.848243 23821 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:21.845126 23802 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:20:21.888422 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:21.852134 23784 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:20:21.896639 17465 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:20:21.890169 17393 rpcz_store.cc:269] 0709 13:20:19.183326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.184118 (+   792us) service_pool.cc:224] Handling call
0709 13:20:21.877217 (+2693099us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400015754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:21.877383 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344031488}
I20260709 13:20:21.910784 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:21.843638 23650 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.894070 23223 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:21.934059 17393 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:21.934942 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2336) took 1778 ms. Trace:
I20260709 13:20:21.935436 17393 rpcz_store.cc:276] 0709 13:20:20.156817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.933578 (+1776761us) service_pool.cc:224] Handling call
0709 13:20:21.933890 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.934635 (+   745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.934875 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.939356 17285 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.943398 23825 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:21.943965 23825 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:21.946069 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.947656 17285 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:21.915100 23674 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:21.881978 23421 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.946162 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1079) took 1027 ms. Trace:
I20260709 13:20:21.949558 17392 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:21.960331 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:21.956267 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2342) took 1334 ms. Trace:
I20260709 13:20:21.956924 17393 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:20:21.963794 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1024) took 1507 ms. Trace:
I20260709 13:20:21.964241 17393 rpcz_store.cc:276] 0709 13:20:20.456019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.936614 (+1480595us) service_pool.cc:224] Handling call
0709 13:20:21.956680 (+ 20066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.963446 (+  6766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.963723 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.966056 17390 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
W20260709 13:20:21.968012 17213 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49270 (request call id 328) took 28712 ms (client timeout 15000 ms). Trace:
I20260709 13:20:21.968251 23315 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:21.945066 23796 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.581s	user 0.000s	sys 0.002s
I20260709 13:20:21.961791 17392 rpcz_store.cc:276] 0709 13:20:20.624631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.949097 (+1324466us) service_pool.cc:224] Handling call
0709 13:20:21.949397 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.955998 (+  6601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.956207 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.976379 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1027) took 1300 ms. Trace:
I20260709 13:20:21.976898 17392 rpcz_store.cc:276] 0709 13:20:20.676015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.975187 (+1299172us) service_pool.cc:224] Handling call
0709 13:20:21.975562 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.975950 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.975991 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.976048 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:21.976092 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.976159 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.976315 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.984918 17465 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:21.949019 23824 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:21.959383 23102 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.004s
I20260709 13:20:21.908897 23636 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.969547 23223 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.915196 23821 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:21.954473 23827 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:21.959983 23650 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.972047 23817 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:21.956264 23677 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:22.019362 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3679) took 1285 ms. Trace:
I20260709 13:20:22.020323 17393 rpcz_store.cc:276] 0709 13:20:20.734072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.993418 (+1259346us) service_pool.cc:224] Handling call
0709 13:20:22.018637 (+ 25219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.018890 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.018931 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.018996 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:22.019045 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.019140 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.019286 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.023202 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:22.023466 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:22.024399 17465 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:22.029708 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:21.997839 23508 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:22.019265 23736 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.004s
I20260709 13:20:22.014341 23479 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.047536 23836 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:22.048195 23682 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.004s
I20260709 13:20:22.088176 23677 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.085392 23728 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:22.077370 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:21.999408 23102 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:22.086818 23820 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:20:22.067334 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.076030 23821 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.087030 23421 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:22.180672 17313 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:22.066277 23736 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:22.043387 23669 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:22.113188 23585 consensus_meta.cc:287] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.737s	user 0.016s	sys 0.001s
W20260709 13:20:22.099715 23679 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.000s
W20260709 13:20:22.113468 23714 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.001s
I20260709 13:20:22.032424 23809 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:20:22.175899 17393 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:22.165107 23774 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:22.152570 23833 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:22.149494 23497 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:20:22.113379 23628 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:22.115270 23819 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
I20260709 13:20:22.190625 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2219) took 1008 ms. Trace:
I20260709 13:20:22.215664 17462 rpcz_store.cc:276] 0709 13:20:21.182382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.402569 (+220187us) service_pool.cc:224] Handling call
0709 13:20:22.190454 (+787885us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b54001f1154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:22.190569 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68451072}
I20260709 13:20:22.217967 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2227) took 1033 ms. Trace:
I20260709 13:20:22.218432 17462 rpcz_store.cc:276] 0709 13:20:21.199142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.216933 (+1017791us) service_pool.cc:224] Handling call
0709 13:20:22.217309 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.217540 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.217578 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.217635 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:22.217678 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.217751 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.217900 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.220288 17462 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:20:22.190819 23636 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:22.176976 23682 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.177729 23677 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.193928 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:22.246716 23677 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.248486 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3683) took 1513 ms. Trace:
I20260709 13:20:22.248974 17392 rpcz_store.cc:276] 0709 13:20:20.735180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.247449 (+1512269us) service_pool.cc:224] Handling call
0709 13:20:22.247843 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.248066 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.248103 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.248160 (+    57us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:22.248216 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.248286 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.248418 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.195680 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3699) took 1390 ms. Trace:
I20260709 13:20:22.201015 23757 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.250332 17470 rpcz_store.cc:276] 0709 13:20:20.805358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.714363 (+909005us) service_pool.cc:224] Handling call
0709 13:20:22.194435 (+480072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.194648 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.194673 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.194715 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:22.194755 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.194810 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.195438 (+   628us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54001f1150. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:22.195605 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102940544}
I20260709 13:20:22.251863 23757 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:22.121903 23687 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.007s
W20260709 13:20:21.968499 17213 rpcz_store.cc:269] 0709 13:19:53.138542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.141022 (+  2480us) service_pool.cc:224] Handling call
0709 13:20:21.846582 (+28705560us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:10.206843 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:10.357231 (+150388us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:10.357284 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:20:10.357316 (+    32us) tablet.cc:662] Decoding operations
0709 13:20:10.529613 (+172297us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:10.529777 (+   164us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:10.529804 (+    27us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:20:10.562608 (+ 32804us) tablet.cc:701] Row locks acquired
0709 13:20:10.573131 (+ 10523us) write_op.cc:260] PREPARE: finished
0709 13:20:10.592400 (+ 19269us) write_op.cc:270] Start()
0709 13:20:10.747439 (+155039us) write_op.cc:276] Timestamp: P: 1783603210586673 usec, L: 0
0709 13:20:10.760496 (+ 13057us) op_driver.cc:348] REPLICATION: starting
0709 13:20:10.898834 (+138338us) log.cc:844] Serialized 8585 byte log entry
0709 13:20:12.859651 (+1960817us) op_driver.cc:464] REPLICATION: finished
0709 13:20:13.860333 (+1000682us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d5f6ea0ac 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6622aef0
0709 13:20:14.272442 (+412109us) write_op.cc:301] APPLY: starting
0709 13:20:14.272568 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:14.362118 (+ 89550us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:14.362182 (+    64us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:14.890513 (+528331us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:14.940079 (+ 49566us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:20:14.940151 (+    72us) write_op.cc:312] APPLY: finished
0709 13:20:14.940671 (+   520us) log.cc:844] Serialized 196 byte log entry
0709 13:20:15.065685 (+125014us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:15.082196 (+ 16511us) write_op.cc:454] Released schema lock
0709 13:20:15.121756 (+ 39560us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:15.199878 (+ 78122us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:15.201957 (+  2079us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62697,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1389918,"apply.run_cpu_time_us":74333,"apply.run_wall_time_us":887940,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96087,"num_ops":22,"prepare.queue_time_us":340765,"prepare.run_cpu_time_us":37227,"prepare.run_wall_time_us":1056849,"raft.queue_time_us":718677,"raft.run_cpu_time_us":31308,"raft.run_wall_time_us":1668977,"replication_time_us":2039879,"spinlock_wait_cycles":53261568,"thread_start_us":2435522,"threads_started":5,"wal-append.queue_time_us":771670,"wal-append.run_cpu_time_us":25044,"wal-append.run_wall_time_us":3032202}]]}
I20260709 13:20:22.198375 17321 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.254930 17321 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.166266 23802 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:22.258170 23818 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.415s	user 0.000s	sys 0.001s
I20260709 13:20:22.258272 23802 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:22.260111 23816 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
I20260709 13:20:22.029014 23825 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:22.208016 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 199333us
I20260709 13:20:22.121382 23756 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.263789 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2334) took 2110 ms. Trace:
I20260709 13:20:22.070210 23479 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.221333 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2228) took 1017 ms. Trace:
W20260709 13:20:22.235018 23799 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.000s
I20260709 13:20:22.222020 23679 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.237466 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:22.239478 23817 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:22.233479 23223 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:22.241199 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:22.277437 17464 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
W20260709 13:20:22.278172 17464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 1068) took 1618 ms (client timeout 1625 ms). Trace:
W20260709 13:20:22.278613 17464 rpcz_store.cc:269] 0709 13:20:20.659522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.764192 (+104670us) service_pool.cc:224] Handling call
0709 13:20:22.240989 (+1476797us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677ba0a0 00007f7d677b9984 00007f7d60d346d4 00007f7d60d34662
0709 13:20:22.278094 (+ 37105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4000640}
I20260709 13:20:22.210816 23714 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.242753 23750 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:22.264600 17392 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:22.282459 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3688) took 1545 ms. Trace:
I20260709 13:20:22.282895 17392 rpcz_store.cc:276] 0709 13:20:20.736651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.264139 (+1527488us) service_pool.cc:224] Handling call
0709 13:20:22.264439 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.282141 (+ 17702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.282390 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.243992 23242 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.266956 17462 rpcz_store.cc:276] 0709 13:20:21.204059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.219573 (+1015514us) service_pool.cc:224] Handling call
0709 13:20:22.219977 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.220744 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.221258 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.268325 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:22.209857 23585 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.215358 23833 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.264271 17388 rpcz_store.cc:276] 0709 13:20:20.153836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.470470 (+1316634us) service_pool.cc:224] Handling call
0709 13:20:21.470963 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.484296 (+ 13333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.484327 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.484828 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.710023 (+225195us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:21.741193 (+ 31170us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.741440 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.741514 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.263582 (+522068us) raft_consensus.cc:1685] finished
0709 13:20:22.263602 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.263736 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6172,"prepare.queue_time_us":25584,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3521,"raft.queue_time_us":22018,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":10356,"thread_start_us":135151,"threads_started":1,"wal-append.queue_time_us":393108}
I20260709 13:20:22.286967 17321 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:22.267393 23756 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.287232 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3690) took 1542 ms. Trace:
W20260709 13:20:22.287482 23227 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:20:22.287698 17388 rpcz_store.cc:276] 0709 13:20:20.744701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.286482 (+1541781us) service_pool.cc:224] Handling call
0709 13:20:22.286752 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.286922 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.286946 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.286987 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:22.287019 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.287073 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.287169 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:22.265185 23808 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.573s	user 0.005s	sys 0.000s
I20260709 13:20:22.214361 23102 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.284339 17992 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:22.252628 23687 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.284778 17393 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:22.296921 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.297461 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3689) took 1560 ms. Trace:
I20260709 13:20:22.277143 23799 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:22.297863 17393 rpcz_store.cc:276] 0709 13:20:20.737944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.274718 (+1536774us) service_pool.cc:224] Handling call
0709 13:20:22.284455 (+  9737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.297192 (+ 12737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.297403 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.298247 17321 raft_consensus.cc:2368] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18.
I20260709 13:20:22.285369 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:22.270054 23802 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:22.291411 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:22.267238 23838 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
W20260709 13:20:22.304100 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 1.20343e+06us
I20260709 13:20:22.265429 23497 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.311448 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.314687 23750 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:22.315338 23750 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.316079 23726 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:22.316495 23726 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:22.317590 23750 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:22.317359 23726 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.314706 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:22.355430 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.321666 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2057) took 1210 ms. Trace:
I20260709 13:20:22.356617 23750 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.356966 23723 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.357151 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:22.357249 23750 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.329221 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.358773 17362 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:22.359023 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.359565 23750 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:22.360074 23750 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:22.360140 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:22.360656 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:22.328173 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2331) took 2192 ms. Trace:
I20260709 13:20:22.361528 17391 rpcz_store.cc:276] 0709 13:20:20.136086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.444210 (+1308124us) service_pool.cc:224] Handling call
0709 13:20:21.444639 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.644355 (+199716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.644409 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.644478 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:21.644532 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.327868 (+683336us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54004123d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:22.327935 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.328099 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30713,"raft.queue_time_us":6750,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":32233,"spinlock_wait_cycles":436893056}
I20260709 13:20:22.362443 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:22.364324 23779 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:22.311673 17397 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:22.355293 17322 raft_consensus.cc:2376] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19. Re-sending same reply.
I20260709 13:20:21.955837 17468 rpcz_store.cc:276] 0709 13:20:20.919055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.740958 (+821903us) service_pool.cc:224] Handling call
0709 13:20:21.745594 (+  4636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.745794 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:21.847976 (+102182us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.945745 (+ 97769us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.945817 (+    72us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:21.945877 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.945963 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.946099 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18498,"prepare.queue_time_us":208051,"raft.queue_time_us":23083,"spinlock_wait_cycles":10449792,"thread_start_us":162416,"threads_started":2}
I20260709 13:20:22.318517 23726 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:22.364471 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:22.364336 23677 raft_consensus.cc:2764] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:22.364718 23779 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:22.371688 23779 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.371868 23774 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:22.372411 23774 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:22.360498 23750 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:22.373221 23750 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:22.373385 23774 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.374557 17388 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:22.375181 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2347) took 1241 ms. Trace:
I20260709 13:20:22.375483 17388 rpcz_store.cc:276] 0709 13:20:21.133618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.373893 (+1240275us) service_pool.cc:224] Handling call
0709 13:20:22.374203 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.374944 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.375131 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.375983 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:22.377264 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:22.365507 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3696) took 1433 ms. Trace:
I20260709 13:20:22.377980 17397 rpcz_store.cc:276] 0709 13:20:20.931751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.311053 (+1379302us) service_pool.cc:224] Handling call
0709 13:20:22.311433 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.365271 (+ 53838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.365457 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.379244 17992 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:22.379942 17464 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:22.320362 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 2051) took 1215 ms. Trace:
I20260709 13:20:22.381732 17319 rpcz_store.cc:276] 0709 13:20:21.105205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.105385 (+   180us) service_pool.cc:224] Handling call
0709 13:20:22.320090 (+1214705us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b540035b6d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:22.320285 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366331648}
W20260709 13:20:22.382330 17317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 1054) took 2403 ms (client timeout 1995 ms). Trace:
I20260709 13:20:22.351718 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:22.366307 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.381078 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.346679 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2061) took 1136 ms. Trace:
W20260709 13:20:22.343254 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.356354 17318 rpcz_store.cc:276] 0709 13:20:21.111115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.201468 (+ 90353us) service_pool.cc:224] Handling call
0709 13:20:21.229322 (+ 27854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.855747 (+626425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.321297 (+465550us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b540010cf54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:22.321599 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439298432}
I20260709 13:20:22.384317 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.364971 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3697) took 1433 ms. Trace:
I20260709 13:20:22.385948 17391 rpcz_store.cc:276] 0709 13:20:20.932016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.362871 (+1430855us) service_pool.cc:224] Handling call
0709 13:20:22.363164 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.363328 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.363353 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.363393 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:22.363423 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.363477 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.364914 (+  1437us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:22.382720 17317 rpcz_store.cc:269] 0709 13:20:19.974850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.102617 (+127767us) service_pool.cc:224] Handling call
0709 13:20:22.378297 (+2275680us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54001428d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:22.378410 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011786624}
I20260709 13:20:22.371213 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1029) took 1274 ms. Trace:
I20260709 13:20:22.388016 17389 rpcz_store.cc:276] 0709 13:20:21.096372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.370413 (+1274041us) service_pool.cc:224] Handling call
0709 13:20:22.370724 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.370891 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.370938 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.370989 (+    51us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:22.371016 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.371065 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.371163 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.388724 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:22.368695 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:22.388979 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:22.390153 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:22.371210 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.393970 17997 raft_consensus.cc:2393] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:22.384084 17320 rpcz_store.cc:276] 0709 13:20:21.210732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.231213 (+ 20481us) service_pool.cc:224] Handling call
0709 13:20:21.231526 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.854553 (+623027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.346342 (+491789us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b5400212354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:22.346596 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419934976}
I20260709 13:20:22.399874 17317 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:22.399936 17468 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:22.400707 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2067) took 1147 ms. Trace:
I20260709 13:20:22.401115 17321 rpcz_store.cc:276] 0709 13:20:21.253500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.399951 (+1146451us) service_pool.cc:224] Handling call
0709 13:20:22.400230 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.400405 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.400429 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.400471 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:22.400510 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.400563 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.400656 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:22.401744 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.400749 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2063) took 1168 ms. Trace:
I20260709 13:20:22.403465 17317 rpcz_store.cc:276] 0709 13:20:21.232316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.399283 (+1166967us) service_pool.cc:224] Handling call
0709 13:20:22.399632 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.400461 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.400684 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.391274 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:22.405185 17389 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:22.406462 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:22.411032 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 59403.5us
I20260709 13:20:22.407359 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 2375) took 1005 ms. Trace:
I20260709 13:20:22.408294 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:22.409710 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:22.417234 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.338095 23674 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.412621 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:22.365617 23757 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:22.414065 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:22.435056 17318 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:22.435679 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2062) took 1206 ms. Trace:
I20260709 13:20:22.365588 23654 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:22.420128 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.445225 17995 raft_consensus.cc:1240] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:22.411711 17391 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.416126 17314 rpcz_store.cc:276] 0709 13:20:21.401657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.370985 (+969328us) service_pool.cc:224] Handling call
0709 13:20:22.407277 (+ 36292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.422971 17962 leader_election.cc:400] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18.
I20260709 13:20:22.446485 17962 leader_election.cc:403] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:22.425719 17994 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:20:22.448191 23839 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:20:22.450214 23242 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:22.451001 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:22.453043 23756 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.458046 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:22.460249 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:22.461401 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:22.461536 17999 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:22.462155 17996 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:22.462546 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:22.462918 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:22.464800 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3712) took 1438 ms. Trace:
I20260709 13:20:22.465173 17469 rpcz_store.cc:276] 0709 13:20:21.026726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.847371 (+820645us) service_pool.cc:224] Handling call
0709 13:20:21.847730 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.949316 (+101586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.949356 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.949884 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.280768 (+330884us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:22.280808 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.280901 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.464602 (+183701us) raft_consensus.cc:1685] finished
0709 13:20:22.464622 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.464746 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35858,"raft.queue_time_us":61679,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":19066,"thread_start_us":356140,"threads_started":2,"wal-append.queue_time_us":473840}
I20260709 13:20:22.467478 17469 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:22.468762 17469 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:22.465306 23757 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:22.477806 23757 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.485031 23687 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.495703 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3704) took 1471 ms. Trace:
I20260709 13:20:22.496378 17466 rpcz_store.cc:276] 0709 13:20:21.024023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.796924 (+772901us) service_pool.cc:224] Handling call
0709 13:20:21.797394 (+   470us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:22.017166 (+219772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.017479 (+   313us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:22.028233 (+ 10754us) log.cc:844] Serialized 78 byte log entry
0709 13:20:22.209381 (+181148us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:22.209418 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.209486 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.495360 (+285874us) raft_consensus.cc:1685] finished
0709 13:20:22.495393 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.495599 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3770,"raft.queue_time_us":78181,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":9284,"thread_start_us":313262,"threads_started":2,"wal-append.queue_time_us":306713}
I20260709 13:20:22.504031 17993 raft_consensus.cc:2410] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:22.419337 23628 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:22.504822 23628 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:22.505476 23628 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.509501 23750 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.409469 23773 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:20:22.357515 23723 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.515455 23750 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.517508 23723 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.520955 23689 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:22.441990 23674 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.525485 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:22.533844 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 111020us
I20260709 13:20:22.538640 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:22.539368 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:22.419916 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.401243 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:22.541325 17468 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:22.430897 17316 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:22.434135 17315 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:22.542738 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2381) took 1123 ms. Trace:
I20260709 13:20:22.541409 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 2376) took 1139 ms. Trace:
I20260709 13:20:22.435963 17318 rpcz_store.cc:276] 0709 13:20:21.229061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.398589 (+1169528us) service_pool.cc:224] Handling call
0709 13:20:22.434883 (+ 36294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.435447 (+   564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.435625 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.543249 17319 rpcz_store.cc:276] 0709 13:20:21.401908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.382525 (+980617us) service_pool.cc:224] Handling call
0709 13:20:22.541346 (+158821us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:22.441895 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.412746 23819 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:20:22.541234 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:22.436995 17320 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:22.520481 17466 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:22.543087 17315 rpcz_store.cc:276] 0709 13:20:21.419498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.409797 (+990299us) service_pool.cc:224] Handling call
0709 13:20:22.433816 (+ 24019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.542495 (+108679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.542689 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.548024 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2073) took 1198 ms. Trace:
I20260709 13:20:22.548403 17320 rpcz_store.cc:276] 0709 13:20:21.349439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.408463 (+1059024us) service_pool.cc:224] Handling call
0709 13:20:22.436752 (+ 28289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.547796 (+111044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.547974 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.550608 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:22.550066 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:22.556226 17468 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:22.557433 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:22.465526 23682 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.537586 23844 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:22.558467 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:22.560633 17466 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:22.549790 23684 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:22.566757 17466 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:22.524737 23674 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:22.568761 17318 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:22.552452 23799 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:22.572618 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2386) took 1082 ms. Trace:
I20260709 13:20:22.572942 17318 rpcz_store.cc:276] 0709 13:20:21.490239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.553683 (+1063444us) service_pool.cc:224] Handling call
0709 13:20:22.568508 (+ 14825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.572443 (+  3935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.572578 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.589632 17391 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:22.570065 23684 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.595088 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:22.563858 23722 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:20:22.580971 23479 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:22.580828 23799 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:22.597585 23684 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.623652 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:22.633569 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2210) took 2169 ms. Trace:
I20260709 13:20:22.654654 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:22.626334 23833 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.659559 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:22.673763 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:22.659147 23585 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.634136 17471 rpcz_store.cc:276] 0709 13:20:20.464747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.605718 (+140971us) service_pool.cc:224] Handling call
0709 13:20:20.616709 (+ 10991us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:20.617139 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:20.629183 (+ 12044us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.595663 (+966480us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18004bf040. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:20:21.785661 (+189998us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.838620 (+ 52959us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:21.844163 (+  5543us) log.cc:844] Serialized 52 byte log entry
0709 13:20:21.844318 (+   155us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:21.844526 (+   208us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.851291 (+  6765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.860010 (+  8719us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.353314 (+493304us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18004bf040. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:22.633268 (+279954us) raft_consensus.cc:1685] finished
0709 13:20:22.633301 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.633481 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85409,"prepare.queue_time_us":748307,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":132,"raft.queue_time_us":235801,"raft.run_cpu_time_us":614,"raft.run_wall_time_us":44258,"spinlock_wait_cycles":12322944,"thread_start_us":239589,"threads_started":3,"wal-append.queue_time_us":1254108}
I20260709 13:20:22.695156 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:22.696241 17466 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:22.663650 23722 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:20:22.734359 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1010) took 3550 ms. Trace:
I20260709 13:20:22.741878 23834 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:22.743157 17396 rpcz_store.cc:276] 0709 13:20:19.183911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.237756 (+ 53845us) service_pool.cc:224] Handling call
0709 13:20:21.103756 (+1866000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.167802 (+ 64046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.730962 (+1563160us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54004132d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:22.734280 (+  3318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4290700672}
I20260709 13:20:22.699327 23833 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:22.751902 23846 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
I20260709 13:20:22.745561 23834 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:22.762920 17434 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:22.767262 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2230) took 1034 ms. Trace:
I20260709 13:20:22.768355 17462 rpcz_store.cc:276] 0709 13:20:21.733045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.299399 (+566354us) service_pool.cc:224] Handling call
0709 13:20:22.299683 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.299906 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:22.670423 (+370517us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.766482 (+ 96059us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.766595 (+   113us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:22.766758 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.766900 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.767137 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47590,"prepare.queue_time_us":92943,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":388625,"threads_started":2}
I20260709 13:20:22.772583 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:22.772604 17471 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:22.676254 23799 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.755362 23358 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:22.777208 23358 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.759441 23833 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:22.788621 23850 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:20:22.789258 23833 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:22.797257 17466 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:22.801487 17434 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:22.801558 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 93233.6us
I20260709 13:20:22.803519 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:22.800318 23833 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:22.816164 17464 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:22.795490 23689 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:22.818482 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.816262 17471 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:20:22.825707 23852 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:20:22.825495 23227 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:22.810218 23730 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:22.800997 23358 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:22.806447 23585 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:22.811319 23811 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.812193 23479 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:22.809650 23833 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.863771 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2379) took 1461 ms. Trace:
I20260709 13:20:22.864253 17317 rpcz_store.cc:276] 0709 13:20:21.402573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.410434 (+1007861us) service_pool.cc:224] Handling call
0709 13:20:22.410798 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.411049 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:22.737234 (+326185us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.863384 (+126150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.863442 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:22.863485 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.863574 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.863708 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5509,"prepare.queue_time_us":350151,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":27396,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":23397,"thread_start_us":385807,"threads_started":3,"wal-append.queue_time_us":129726}
I20260709 13:20:22.869817 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.872462 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:22.872560 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 349640us
I20260709 13:20:22.855052 23669 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:20:22.865314 23529 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:22.832538 23834 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.879889 23834 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:22.881167 23849 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:20:22.882860 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:22.883109 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:22.883625 17992 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:22.883883 17995 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:22.885129 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2229) took 1152 ms. Trace:
I20260709 13:20:22.885762 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:22.888013 23803 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:22.888410 23803 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:22.889422 23803 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.857820 23585 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:22.890895 23803 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:22.894548 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.894905 17992 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
W20260709 13:20:22.895794 17313 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 2056) took 1784 ms (client timeout 2037 ms). Trace:
W20260709 13:20:22.896216 17313 rpcz_store.cc:269] 0709 13:20:21.110871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.166713 (+ 55842us) service_pool.cc:224] Handling call
0709 13:20:22.895437 (+1728724us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003fc0d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:22.895738 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326170368}
I20260709 13:20:22.896957 17389 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:22.897310 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:22.898239 23750 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.898802 23750 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.899672 17391 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:22.901434 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1032) took 1063 ms. Trace:
I20260709 13:20:22.901791 17393 rpcz_store.cc:276] 0709 13:20:21.838178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.375427 (+537249us) service_pool.cc:224] Handling call
0709 13:20:22.397783 (+ 22356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.398006 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:22.632773 (+234767us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.901140 (+268367us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.901188 (+    48us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:22.901229 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.901287 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.901385 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129297,"prepare.queue_time_us":130235,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":538,"thread_start_us":327047,"threads_started":2,"wal-append.queue_time_us":224804}
I20260709 13:20:22.903249 23242 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.903734 23242 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.900604 17397 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:20:22.905167 17397 pending_rounds.cc:85] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 11
I20260709 13:20:22.905381 17397 pending_rounds.cc:107] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:20:22.905589 17397 raft_consensus.cc:2889] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.907513 23242 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.907963 17993 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:22.908241 23242 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.894587 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3695) took 1963 ms. Trace:
I20260709 13:20:22.910341 17313 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.910830 17993 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:22.909447 17392 rpcz_store.cc:276] 0709 13:20:20.931449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.290673 (+1359224us) service_pool.cc:224] Handling call
0709 13:20:22.309447 (+ 18774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.309682 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:22.383104 (+ 73422us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.559249 (+176145us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.887491 (+328242us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b180029d580. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f707522 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:22.893926 (+  6435us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b180029d580. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:20:22.894146 (+   220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.894215 (+    69us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:22.894277 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.894367 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.894518 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4235,"prepare.queue_time_us":83068,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":104,"raft.queue_time_us":340089,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":5524,"spinlock_wait_cycles":24052992,"thread_start_us":160545,"threads_started":1,"wal-append.queue_time_us":224637}
I20260709 13:20:22.898231 17322 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:22.912163 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.885506 17470 rpcz_store.cc:276] 0709 13:20:21.732755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.251765 (+519010us) service_pool.cc:224] Handling call
0709 13:20:22.252180 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.252645 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.252682 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.270770 (+ 18088us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.539800 (+269030us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:22.575935 (+ 36135us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.576671 (+   736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.576788 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.884904 (+308116us) raft_consensus.cc:1685] finished
0709 13:20:22.884924 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.885062 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34136,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":13485,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":12275,"thread_start_us":244689,"threads_started":1,"wal-append.queue_time_us":350344}
I20260709 13:20:22.913172 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:22.913810 17388 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:22.914345 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.915683 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:22.917904 17996 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:20:22.918390 17996 pending_rounds.cc:85] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 12
I20260709 13:20:22.918673 17996 pending_rounds.cc:107] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:20:22.918987 17996 raft_consensus.cc:2889] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:22.920212 23859 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:20:22.921509 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2377) took 1519 ms. Trace:
I20260709 13:20:22.921869 17321 rpcz_store.cc:276] 0709 13:20:21.402151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.409678 (+1007527us) service_pool.cc:224] Handling call
0709 13:20:22.410026 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.410244 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.410277 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.424690 (+ 14413us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.764950 (+340260us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:22.764987 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.770946 (+  5959us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.921289 (+150343us) raft_consensus.cc:1685] finished
0709 13:20:22.921313 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.921454 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":274152,"threads_started":1,"wal-append.queue_time_us":320204}
I20260709 13:20:22.927606 17388 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
W20260709 13:20:22.928931 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 55441.7us
I20260709 13:20:22.937862 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:22.938606 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:22.939152 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:22.943058 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:22.918391 23779 consensus_meta.cc:287] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.546s	user 0.012s	sys 0.001s
I20260709 13:20:22.908707 23242 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:22.951763 17397 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:22.952797 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:22.952203 17313 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:22.956995 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:22.957736 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:22.956480 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:22.962085 17397 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:22.964442 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:22.965446 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.967015 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:22.968670 17393 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:20:22.973434 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.975066 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.977751 17390 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:22.956132 23844 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18.
I20260709 13:20:22.994191 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.995019 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:22.996047 17994 raft_consensus.cc:1240] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:22.996778 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:22.998248 17393 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:22.941218 23756 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:20:22.999905 23833 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:22.993804 23848 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:23.011997 17999 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:22.971238 23682 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.014458 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.017619 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.017690 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:23.018430 17397 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.018682 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:22.954540 23779 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.021622 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:23.022516 23242 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:22.995203 23684 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.012705 23848 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.031738 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:23.039032 17391 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:23.028365 17995 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:20:23.045624 17393 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:23.048592 17321 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:23.033499 23682 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.051553 23682 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:23.053942 23812 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.285s	user 0.004s	sys 0.001s
I20260709 13:20:23.053845 23585 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:23.058888 23750 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:23.065116 17397 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:22.991154 23628 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.071802 17391 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 12.
I20260709 13:20:23.077709 17313 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:23.079553 17313 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:23.082134 17313 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:23.089392 23628 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:23.090417 17991 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:23.125900 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 316222us
I20260709 13:20:23.134868 23684 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:23.135809 23848 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:23.134148 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:23.140305 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.141932 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.144949 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.146181 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.147606 23848 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:23.148944 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.148993 23779 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:23.157485 23421 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:23.158135 23421 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:23.149649 23876 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:23.141855 23811 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.150614 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:23.150933 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:23.151659 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:23.160945 17995 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:23.154524 23714 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:23.155963 17316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35772 (request call id 2378) took 1753 ms (client timeout 1880 ms). Trace:
I20260709 13:20:23.156086 17317 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:23.147532 23628 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:23.162037 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:23.164129 17992 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:20:23.162547 17316 rpcz_store.cc:269] 0709 13:20:21.402360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.552908 (+150548us) service_pool.cc:224] Handling call
0709 13:20:23.155767 (+1602859us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400212854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:23.155909 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723455744}
I20260709 13:20:23.166417 23260 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.167411 23529 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 13:20:23.167354 23834 consensus_queue.cc:1048] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:20:23.170917 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:23.172259 23723 raft_consensus.cc:2764] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:23.172338 23715 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:23.176739 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:23.177947 23628 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:23.178242 23689 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:23.178457 23628 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:23.179445 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:23.182432 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:23.183385 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:23.184377 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 226735us
I20260709 13:20:23.166913 23876 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:23.185333 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:23.185467 23876 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.186460 23689 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.186900 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.185729 23729 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.188271 23836 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:23.188694 23836 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:23.197525 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.203055 23732 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:23.204795 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.205353 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1016) took 3379 ms. Trace:
I20260709 13:20:23.210968 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:23.212090 17313 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.205945 17395 rpcz_store.cc:276] 0709 13:20:19.826262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.715882 (+889620us) service_pool.cc:224] Handling call
0709 13:20:21.583015 (+867133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.583903 (+   888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.205055 (+1621152us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b5400014350. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:23.205273 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1993506560}
I20260709 13:20:23.214846 23674 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:23.215215 23684 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:23.216398 23585 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:23.217414 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.163551 23421 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.185302 23799 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:23.243938 17360 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.231791 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.257688 23677 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:23.246730 23681 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:23.203459 23848 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:23.259208 23681 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:23.259667 17996 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:23.260120 23681 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.261474 23681 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:23.259231 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.263443 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.264238 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2384) took 1792 ms. Trace:
I20260709 13:20:23.264796 17322 rpcz_store.cc:276] 0709 13:20:21.472245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.418545 (+946300us) service_pool.cc:224] Handling call
0709 13:20:22.897990 (+479445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.921889 (+ 23899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.263990 (+342101us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54003fc0d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:23.264163 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035962240}
I20260709 13:20:23.266340 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.271152 17322 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 17: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:23.271570 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:23.271919 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.272787 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:23.273571 17319 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.267639 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1059) took 1655 ms. Trace:
I20260709 13:20:23.276595 17317 rpcz_store.cc:276] 0709 13:20:21.612274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.932884 (+1320610us) service_pool.cc:224] Handling call
0709 13:20:23.155912 (+223028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.162704 (+  6792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.267380 (+104676us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400212850. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:23.267566 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512278912}
I20260709 13:20:23.278007 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.278245 17313 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:23.278555 23679 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:23.280174 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:23.280649 17388 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:23.270081 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:23.281334 17397 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:23.281436 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 1180) took 1670 ms. Trace:
I20260709 13:20:23.281929 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.282406 17990 raft_consensus.cc:1240] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:23.283210 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.283907 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1626) took 1419 ms. Trace:
I20260709 13:20:23.270424 23667 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:23.285085 23667 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:23.285938 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2392) took 1675 ms. Trace:
I20260709 13:20:23.286358 17321 rpcz_store.cc:276] 0709 13:20:21.610789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.932336 (+1321547us) service_pool.cc:224] Handling call
0709 13:20:22.932658 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.049052 (+116394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.285715 (+236663us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54001414d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:23.285883 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266198400}
I20260709 13:20:23.286175 23667 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.287648 23667 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.235683 23497 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:23.246351 23714 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:20:23.291075 17394 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:23.218247 23613 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:20:23.291971 23613 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:23.292286 23613 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:23.293147 23613 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.294238 23613 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.247486 23720 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:20:23.247246 23715 consensus_queue.cc:1059] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:20:23.282051 17997 rpcz_store.cc:276] 0709 13:20:21.611346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.621843 (+ 10497us) service_pool.cc:224] Handling call
0709 13:20:23.281244 (+1659401us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54006d1fd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:23.281359 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1634849664}
I20260709 13:20:23.300052 23715 raft_consensus.cc:3055] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:23.300241 23825 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.300487 23715 raft_consensus.cc:740] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:23.301440 23715 consensus_queue.cc:260] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.302757 23715 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.305184 23799 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:23.306051 23799 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.218246 23729 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:20:23.313434 23729 consensus_queue.cc:1243] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:23.313560 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:23.279448 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:23.314980 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 46962.6us
I20260709 13:20:23.246969 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:23.315737 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:23.313946 23729 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:23.317611 23729 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:23.318567 23264 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.318455 23729 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.319237 23264 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:23.288774 17321 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:23.264467 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.227874 23811 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:20:23.321305 23628 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.322764 23757 consensus_queue.cc:1059] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:23.323487 23421 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.189124 23836 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.323935 23756 raft_consensus.cc:3055] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:23.324361 23756 raft_consensus.cc:740] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:23.325340 23756 consensus_queue.cc:260] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.282096 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.326603 17314 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:23.327481 17360 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.328627 23875 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.221834 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:23.329694 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 107969us
I20260709 13:20:23.330642 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:23.331378 23674 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.284394 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.331380 23756 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.334309 23529 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:23.335668 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 88812.2us
I20260709 13:20:23.284364 17990 rpcz_store.cc:276] 0709 13:20:21.864114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.864253 (+   139us) service_pool.cc:224] Handling call
0709 13:20:23.282229 (+1417976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.282879 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.283698 (+   819us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54006d1fd0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:23.283844 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3223750912}
I20260709 13:20:23.272730 17322 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 12: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:23.347797 17360 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.348096 17285 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:23.348441 17992 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:23.349128 17360 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.221714 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:23.354075 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 142887us
I20260709 13:20:23.355736 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.350620 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:23.360949 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:23.362561 17316 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
W20260709 13:20:23.363960 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 142367us
W20260709 13:20:23.378216 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.388748 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.391619 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.350947 23867 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:23.405167 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.351308 23825 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:23.369988 23714 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:23.416760 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.385793 23730 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.369673 23732 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:23.359855 23806 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:23.369803 23757 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.350947 23264 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:20:23.418936 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:23.418299 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.379602 23809 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.235183 23723 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.168s
I20260709 13:20:23.423226 23779 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:23.360164 23674 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:20:23.423445 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.379483 23358 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:20:23.359582 23875 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:20:23.422142 23848 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.421965 23821 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:23.426905 23833 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.390659 23704 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:20:23.389204 23260 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
W20260709 13:20:23.449440 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.389091 23774 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:20:23.385262 23677 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:20:23.453702 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.456981 17995 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:23.431916 23497 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:23.414690 23242 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:23.418045 23773 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:20:23.435976 23806 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:23.444645 23834 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:23.442380 23732 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:23.434078 23479 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:20:23.502785 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49160.6us
I20260709 13:20:23.557603 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:23.556677 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 206108us
I20260709 13:20:23.499320 23779 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.558951 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.512008 23750 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:23.514205 23729 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.452288 23585 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:23.538741 23720 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:23.549568 17204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b19033ecd72e4ba188910445b70c84d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7241e45fbfca4b46b6df9be8cebcd863 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:20:23.570024 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 143232us
I20260709 13:20:23.489459 23848 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:23.501313 23803 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.003s
I20260709 13:20:23.444012 23836 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:23.563452 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 174786us
I20260709 13:20:23.578250 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.579277 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:23.502403 23682 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:23.579600 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.547889 23806 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.444866 23809 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.564725 17319 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:23.548180 23834 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.581611 17313 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:23.586735 23821 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.593142 23867 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:23.558763 23875 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:23.602694 23875 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:23.594910 23704 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:23.597675 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.493499 23833 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.603971 23682 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.598492 23834 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:23.571476 23879 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
I20260709 13:20:23.603618 23704 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:23.607560 23704 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.573344 23779 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.603615 23875 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.573971 23674 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:23.610296 23875 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.609135 23732 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.610529 23674 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:23.611507 23674 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.596784 23720 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:23.616555 23720 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.617095 23811 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:23.617825 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 241661us
I20260709 13:20:23.567375 23677 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:23.542424 23722 consensus_queue.cc:1059] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 13:20:23.610637 23881 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260709 13:20:23.618297 17204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 258635us
I20260709 13:20:23.566630 23868 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:23.562851 23750 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:23.574097 23889 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:23.675491 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.679384 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.682336 23732 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:23.683143 23732 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:23.684026 23732 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.686271 23715 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:23.722077 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.628131 23870 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:23.612668 23674 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:23.733528 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:23.736092 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48177.9us
I20260709 13:20:23.655982 23714 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:23.666136 23677 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:23.762171 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 182632us
I20260709 13:20:23.618000 23811 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:20:23.784592 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:23.671520 23889 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:23.786407 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.723354 23730 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:23.753875 23890 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:23.628778 23821 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.818041 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:23.824903 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:23.828444 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.834282 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.835466 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.836486 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:23.841120 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 221261us
W20260709 13:20:23.656772 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 59203.5us
I20260709 13:20:23.858745 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:23.827131 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.863648 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.872773 17462 raft_consensus.cc:2410] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:20:23.879729 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:23.885192 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48068.6us
I20260709 13:20:23.888428 23888 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:23.889025 23715 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.889518 23715 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:23.890419 23421 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 13:20:23.891533 23715 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:23.892971 23915 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:23.889067 23888 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.894693 23799 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:23.896301 23900 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:23.897594 23715 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:23.898032 23715 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:23.899184 23779 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:23.898854 23715 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.900247 23910 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:23.900619 23910 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:23.901126 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.901464 23910 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.902953 23910 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.904058 23715 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:23.904399 23613 consensus_meta.cc:287] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.000s
I20260709 13:20:23.907569 23704 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:23.910609 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:23.911312 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:23.912098 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 332879us
I20260709 13:20:23.902302 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.926208 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:23.931335 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44330.4us
I20260709 13:20:23.935074 17462 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:20:23.802270 23750 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.910758 23726 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:23.869680 23730 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:20:23.933238 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:23.940707 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:23.944557 17462 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:23.945200 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:23.835076 23867 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.947506 17394 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:20:23.950340 23888 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:23.950847 23689 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:23.884784 23889 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:23.952607 23667 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.002s
W20260709 13:20:23.953994 23902 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:20:23.954293 17465 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:20:24.014591 17465 pending_rounds.cc:85] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 11
I20260709 13:20:24.014918 17465 pending_rounds.cc:107] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:20:24.015192 17465 raft_consensus.cc:2889] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.016297 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:23.954571 23682 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:23.955565 23903 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:20:23.914464 23677 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:23.957095 23809 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:23.957463 23886 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
I20260709 13:20:23.957787 23848 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:24.031989 23677 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:23.958859 23821 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:23.959609 23757 consensus_meta.cc:287] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.005s
I20260709 13:20:23.962344 23242 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:23.963474 23906 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:20:23.963913 23875 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:23.966177 23681 consensus_meta.cc:287] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.704s	user 0.009s	sys 0.001s
I20260709 13:20:23.966281 23836 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:23.967422 23264 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:24.048316 23264 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:23.967857 23834 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.987468 17388 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:20:23.989177 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:23.992653 23891 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:20:23.918444 23722 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:20:23.993075 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:23.930181 23802 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.993654 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:23.995716 23756 consensus_meta.cc:287] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.000s
I20260709 13:20:23.912609 23714 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:23.998471 23774 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:24.065856 23774 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:24.066823 23774 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.055105 23779 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.067921 23774 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.000222 23833 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:24.069531 23264 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.070029 23689 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:24.068100 23779 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.070737 23689 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.070801 23264 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:24.003986 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.005105 23585 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:24.073674 23585 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.076081 23585 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:24.005162 23679 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:24.005839 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.013804 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 71971.6us
I20260709 13:20:24.079183 23750 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:24.016464 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:24.081041 23905 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.024870 23888 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:24.081585 17313 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:24.081815 23888 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:24.043069 23726 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:24.046177 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:24.046787 23875 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:24.083461 23834 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:24.083726 23669 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:24.047441 23911 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:20:24.085362 23910 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:24.086063 23799 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:24.076723 23679 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:24.086681 23799 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:24.087675 23876 raft_consensus.cc:3055] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:24.087430 23679 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:24.088076 23876 raft_consensus.cc:740] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:24.062935 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 130285us
I20260709 13:20:24.055020 23730 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:24.088914 23876 consensus_queue.cc:260] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.089285 23730 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.090170 23876 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:24.091332 23730 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:24.038885 23821 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.092985 23681 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.092783 23821 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.093503 23681 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:24.043321 23757 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:24.057941 17317 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
W20260709 13:20:24.036697 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.099416 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:24.100776 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:24.082778 23888 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:24.108057 17467 raft_consensus.cc:2410] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
W20260709 13:20:24.064930 23882 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.601s	user 0.005s	sys 0.008s
I20260709 13:20:24.083335 23806 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:24.105623 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:24.121660 17313 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:24.106439 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:24.085892 23910 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.109179 17388 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:24.110519 17996 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:20:24.118263 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 114375us
W20260709 13:20:24.118561 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.126410 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.127236 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.120529 17391 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 10. (term mismatch)
I20260709 13:20:24.128161 17391 pending_rounds.cc:85] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 9
I20260709 13:20:24.128479 17391 pending_rounds.cc:107] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:20:24.128801 17391 raft_consensus.cc:2889] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.130367 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:24.131161 17391 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:24.133366 17388 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:20:24.134827 17388 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:20:24.136433 17388 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:24.084353 23669 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.057152 23704 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:24.143473 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:24.152143 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.143533 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:24.174186 17471 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:20:24.088724 23679 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.173617 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:24.181094 17313 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:24.140781 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:24.183003 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.172777 23529 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:20:24.183972 23756 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:24.187933 23910 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:24.188915 17470 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:24.190258 23223 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:24.179708 23888 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:24.194826 23729 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
I20260709 13:20:24.198302 17390 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:24.200693 23779 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:24.204417 23806 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:24.081609 23905 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:24.206969 23905 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:24.207738 23821 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:24.183655 23674 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.209318 23674 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.209764 23681 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:24.144155 23891 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:24.211349 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.084378 23875 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.213096 17464 raft_consensus.cc:2410] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:20:24.214613 23889 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:24.182921 23890 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:24.216441 23890 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:24.216909 23890 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:24.216991 23479 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.217506 23479 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:24.083279 23726 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:24.227681 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 86990.8us
W20260709 13:20:24.237231 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 393239us
W20260709 13:20:24.238907 17469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.024s	sys 0.075s
W20260709 13:20:24.239326 17469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.024s	sys 0.075s
I20260709 13:20:24.179207 23704 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:24.226354 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 99204.8us
I20260709 13:20:24.183916 23585 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:24.342887 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.337625 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.115478 23834 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.111s
I20260709 13:20:24.246860 23681 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:24.156525 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:24.330691 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:24.144635 17995 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:24.332657 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:24.349373 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:24.333523 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 98228.9us
I20260709 13:20:24.336407 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.351138 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:24.351828 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.348721 17996 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:24.172464 23894 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:20:24.358289 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:24.359221 17321 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
W20260709 13:20:24.322292 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.378648 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.401432 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:24.256626 23821 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.391757 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.369447 17313 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:24.385329 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:24.141633 23799 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:24.385290 17314 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:24.407366 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:24.414283 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.348217 23681 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.421753 17319 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: [18.14-18.14]
W20260709 13:20:24.453780 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.407052 17322 raft_consensus.cc:2376] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18. Re-sending same reply.
I20260709 13:20:24.345615 23833 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:24.340868 23223 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.427289 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.422412 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:24.400676 23891 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:24.404767 23677 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:24.460397 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:24.447919 23684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.017s	sys 0.012s
W20260709 13:20:24.463701 17216 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49282 (request call id 329) took 38033 ms (client timeout 15000 ms). Trace:
I20260709 13:20:24.426703 23674 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:24.449652 23681 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:24.406920 23867 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:20:24.463441 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.353432 23585 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.420862 23821 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:24.465939 23684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.017s	sys 0.013s
W20260709 13:20:24.479596 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.462253 23732 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:24.480312 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.465751 23757 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:24.464628 17216 rpcz_store.cc:269] 0709 13:19:46.426213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.426848 (+   635us) service_pool.cc:224] Handling call
0709 13:19:47.194154 (+767306us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275e090 00007f7d627fcf3a 00007f7d685b31cc 00007f7d686b137e 00007f7d66b722a4 00007f7d66b72232 00007f7d66b72161 00007f7d66b720dc 00007f7d66b71392 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:24.459357 (+37265203us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:18.229300 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:18.271200 (+ 41900us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:18.271258 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:20:18.271299 (+    41us) tablet.cc:662] Decoding operations
0709 13:20:18.272433 (+  1134us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:18.272562 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:18.272596 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:20:18.303244 (+ 30648us) tablet.cc:701] Row locks acquired
0709 13:20:18.303288 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:20:18.303470 (+   182us) write_op.cc:270] Start()
0709 13:20:18.303644 (+   174us) write_op.cc:276] Timestamp: P: 1783603218303404 usec, L: 0
0709 13:20:18.303678 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:20:18.304468 (+   790us) log.cc:844] Serialized 3214 byte log entry
0709 13:20:20.757209 (+2452741us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d5f6ea0ac 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b
0709 13:20:21.004216 (+247007us) op_driver.cc:464] REPLICATION: finished
0709 13:20:21.393152 (+388936us) write_op.cc:301] APPLY: starting
0709 13:20:21.393266 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:21.635209 (+241943us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:21.675458 (+ 40249us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:22.196494 (+521036us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:22.196779 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:20:22.200882 (+  4103us) write_op.cc:312] APPLY: finished
0709 13:20:22.201263 (+   381us) log.cc:844] Serialized 81 byte log entry
0709 13:20:22.443556 (+242293us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:22.487201 (+ 43645us) write_op.cc:454] Released schema lock
0709 13:20:22.487293 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:22.487800 (+   507us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:22.487843 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1077558,"reported_tablets":47,"spinlock_wait_cycles":648038144,"child_traces":[["op",{"apply.queue_time_us":341453,"apply.run_cpu_time_us":38819,"apply.run_wall_time_us":1094614,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37567,"num_ops":8,"prepare.queue_time_us":659176,"prepare.run_cpu_time_us":86356,"prepare.run_wall_time_us":2698299,"raft.queue_time_us":38473,"raft.run_cpu_time_us":24869,"raft.run_wall_time_us":151880,"replication_time_us":2700329,"spinlock_wait_cycles":20100608,"thread_start_us":3303937,"threads_started":5,"wal-append.queue_time_us":3009206,"wal-append.run_cpu_time_us":10286,"wal-append.run_wall_time_us":2251620}]]}
I20260709 13:20:24.519579 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:24.527829 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47606.8us
I20260709 13:20:24.463524 23223 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:24.465646 23799 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:20:24.478042 23773 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:24.480618 23677 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:24.537472 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.468506 23869 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 13:20:24.607858 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 70461.3us
I20260709 13:20:24.520465 23891 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.529877 23756 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:24.621045 17315 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:24.529633 23833 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.545672 23907 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:24.478978 23689 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:24.628427 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.481853 23900 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.133s
I20260709 13:20:24.580703 17218 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 11 to 12, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 12 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:24.606168 23669 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:24.620343 23834 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.622869 23757 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:24.639803 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 233459us
I20260709 13:20:24.672232 17995 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:24.666956 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 241881us
W20260709 13:20:24.679949 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.661880 17218 catalog_manager.cc:5697] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:24.730330 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:24.730942 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:24.731688 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:24.734463 23821 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:24.736500 17218 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:24.737195 23757 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:24.737874 23757 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:24.737905 17218 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 14 to 15, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 15 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:24.739558 17218 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 17, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 17 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:24.731761 17318 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:24.745422 23689 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:24.745285 17218 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 9 to 17, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 17 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:20:24.748044 23774 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.680s	user 0.005s	sys 0.005s
I20260709 13:20:24.747246 17218 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 14 to 17, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 17 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:24.670135 23704 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:24.748862 17393 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:24.749442 17218 catalog_manager.cc:5697] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 7 to 9, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 9 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:24.732699 17995 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:24.628583 23891 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:24.755029 23750 consensus_meta.cc:287] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.675s	user 0.006s	sys 0.006s
I20260709 13:20:24.638998 23833 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.755225 23669 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:24.819603 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.755496 23757 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:24.697685 23834 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:24.780267 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 287518us
W20260709 13:20:24.825407 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.796733 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 168396us
W20260709 13:20:24.792034 23876 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.701s	user 0.004s	sys 0.008s
I20260709 13:20:24.821578 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:24.828651 17995 raft_consensus.cc:2410] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:20:24.794147 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:24.826431 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.834302 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:24.836724 17390 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:24.792544 23732 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:24.842895 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:24.839322 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:24.847640 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:24.850989 17218 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:24.873409 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:24.841955 23890 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.005s
W20260709 13:20:24.844496 23922 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:20:24.850427 23757 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:24.845715 23750 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:24.886279 23585 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:24.829459 23669 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:24.896332 17995 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:24.888674 23908 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:24.897015 17218 catalog_manager.cc:5697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:20:24.890712 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47938.2us
W20260709 13:20:24.914912 17992 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.015s	sys 0.003s
W20260709 13:20:24.894291 23929 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:20:24.916774 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:24.903503 23585 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:24.893854 23757 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.978895 17218 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:20:24.905833 23921 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260709 13:20:24.899389 23926 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:20:24.911398 23891 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:24.902884 23834 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:24.982271 23679 consensus_meta.cc:287] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.001s
I20260709 13:20:24.984437 17391 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:24.998324 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:24.967907 17992 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.017s	sys 0.005s
I20260709 13:20:24.998688 17218 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:24.915845 23750 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.998575 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:24.985222 23628 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.981685 23585 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:24.987026 23757 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:25.003880 23889 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.789s	user 0.008s	sys 0.008s
I20260709 13:20:24.890020 23890 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:25.020308 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.020830 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.021843 23613 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.022208 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2249) took 1020 ms. Trace:
I20260709 13:20:25.022379 23613 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.022786 17462 rpcz_store.cc:276] 0709 13:20:24.001556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.019526 (+ 17970us) service_pool.cc:224] Handling call
0709 13:20:24.019861 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.036900 (+ 17039us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:24.059101 (+ 22201us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.021737 (+962636us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:25.021834 (+    97us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:25.021893 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.021979 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.022139 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":617542,"prepare.queue_time_us":21198,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":47,"spinlock_wait_cycles":17857792,"thread_start_us":362293,"threads_started":1,"wal-append.queue_time_us":685606}
I20260709 13:20:25.024215 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:25.027824 23888 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.029054 23674 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.029791 23674 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.033274 23669 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.007467 23833 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.007829 23628 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.034966 23730 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.007563 23821 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:25.004724 23952 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:25.037315 23952 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.037708 23952 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.037636 23910 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:25.041900 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.042567 17467 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:25.042692 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:25.043934 17470 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:25.044487 23681 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.000s
I20260709 13:20:25.044747 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.046133 17468 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:25.047204 17465 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:25.074936 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.028537 23888 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.005404 23750 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.090883 17464 raft_consensus.cc:2410] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:20:25.008445 23585 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.103390 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.113219 17471 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:25.114141 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.115252 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.106489 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1038) took 1124 ms. Trace:
I20260709 13:20:25.115969 17397 rpcz_store.cc:276] 0709 13:20:23.981975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.983384 (+  1409us) service_pool.cc:224] Handling call
0709 13:20:23.983829 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.984118 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.984255 (+   137us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.998021 (+ 13766us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.477695 (+479674us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:24.477744 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.477827 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.106257 (+628430us) raft_consensus.cc:1685] finished
0709 13:20:25.106278 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.106417 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":479354,"threads_started":1,"wal-append.queue_time_us":661446}
I20260709 13:20:25.117723 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.006712 17218 catalog_manager.cc:5697] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 6 to 14, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 14 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:25.121883 17470 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:25.123059 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.108927 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.032615 23674 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:25.106954 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.129463 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 86845.3us
I20260709 13:20:25.130106 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.133416 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3742) took 1942 ms. Trace:
I20260709 13:20:25.135980 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.141178 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.141834 17397 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:25.144124 17470 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:25.145655 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.146425 17391 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:25.133818 17469 rpcz_store.cc:276] 0709 13:20:23.190728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.191140 (+   412us) service_pool.cc:224] Handling call
0709 13:20:23.334815 (+143675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.335077 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:23.673378 (+338301us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.326904 (+653526us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.006242 (+679338us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b18000ccca0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:20:25.010249 (+  4007us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.133008 (+122759us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:25.133077 (+    69us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:25.133122 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.133189 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.133361 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":213228,"prepare.queue_time_us":169396,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":790237,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":61014,"spinlock_wait_cycles":59790080,"thread_start_us":903835,"threads_started":2,"wal-append.queue_time_us":712519}
I20260709 13:20:25.149818 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.151250 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:25.152714 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.153386 17397 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:25.154346 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:25.155373 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.155961 17397 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:25.156831 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.158763 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.150456 17391 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:25.161607 17218 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 11 to 13, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 13 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:25.165467 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:25.167292 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.138674 23910 consensus_queue.cc:1243] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:25.111934 23681 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.146605 23729 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.168830 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.138253 23919 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.172689 17391 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:25.168809 17218 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:25.164999 23689 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.167693 23674 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:25.187592 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.167485 23889 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.174113 23613 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.174306 23919 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.191375 23613 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.191967 23613 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.179914 23242 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:20:25.194494 23242 consensus_queue.cc:1243] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:25.196372 23613 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.199060 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.200073 17470 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:25.183115 23965 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.183813 17391 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:25.185598 23479 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.188372 17469 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:25.180516 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:25.189836 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:25.197062 23613 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.159564 23920 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:20:25.177038 23908 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.172470 23729 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:25.175552 23910 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.229679 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2250) took 1227 ms. Trace:
I20260709 13:20:25.202457 23889 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.205367 23730 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:25.206148 23750 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.197402 23674 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.180258 23774 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:20:25.180101 23951 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:20:25.190580 23689 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.216883 23888 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:25.217159 23939 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.395s	user 0.000s	sys 0.003s
I20260709 13:20:25.219359 17218 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:25.230199 17463 rpcz_store.cc:276] 0709 13:20:24.001881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.026280 (+ 24399us) service_pool.cc:224] Handling call
0709 13:20:24.029524 (+  3244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.035720 (+  6196us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:24.054620 (+ 18900us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.171723 (+1117103us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.174642 (+  2919us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.174853 (+   211us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:25.174891 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.174956 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.229441 (+ 54485us) raft_consensus.cc:1685] finished
0709 13:20:25.229464 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.229615 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":574207,"prepare.queue_time_us":21547,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":590846,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":5184,"thread_start_us":532589,"threads_started":2,"wal-append.queue_time_us":526171}
W20260709 13:20:25.223757 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.228292 23613 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.219621 23965 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.222625 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:25.224330 23479 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:25.230080 23729 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.224628 23908 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:25.250937 23908 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.252004 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.253360 23869 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:25.253784 23869 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:25.254290 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.254951 17469 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:25.254609 23869 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.256189 23869 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:25.256716 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.257334 23836 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:25.257485 17464 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:25.257824 23836 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:25.258818 23836 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.259614 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3728) took 1162 ms. Trace:
I20260709 13:20:25.260198 23836 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:25.262355 23674 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.263772 23681 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.239558 23750 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.266407 23689 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.266510 23888 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:25.267174 23888 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.267575 23888 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:25.268953 23730 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:25.270198 23889 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.271447 23585 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.264778 23750 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.275225 23750 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.276921 23898 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:25.246207 23479 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:25.278270 23479 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:25.233785 23910 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.260016 17389 rpcz_store.cc:276] 0709 13:20:24.097418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.118823 (+ 21405us) service_pool.cc:224] Handling call
0709 13:20:24.119167 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.119574 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.119611 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.176373 (+ 56762us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.437898 (+261525us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b1800412060. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:20:24.636220 (+198322us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:24.636275 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.636363 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.216539 (+580176us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:25.259398 (+ 42859us) raft_consensus.cc:1685] finished
0709 13:20:25.259420 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.259555 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53805,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7564,"spinlock_wait_cycles":53056640,"thread_start_us":198124,"threads_started":1,"wal-append.queue_time_us":565856}
I20260709 13:20:25.283811 23910 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.284006 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:25.284276 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3727) took 1187 ms. Trace:
I20260709 13:20:25.284731 17393 rpcz_store.cc:276] 0709 13:20:24.097112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.107607 (+ 10495us) service_pool.cc:224] Handling call
0709 13:20:24.139858 (+ 32251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.749378 (+609520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.284039 (+534661us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b540013abd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:25.284215 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399738240}
W20260709 13:20:25.285671 23917 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.815s	user 0.002s	sys 0.000s
I20260709 13:20:25.286005 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.286653 17393 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:25.239180 23968 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.288311 23223 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.288499 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:25.289160 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3750) took 1921 ms. Trace:
I20260709 13:20:25.288792 23968 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.292488 17434 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:25.248373 17218 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 6 to 14, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 14 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:25.231393 23890 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.277536 23898 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.252688 17391 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:25.289577 17466 rpcz_store.cc:276] 0709 13:20:23.367838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.367973 (+   135us) service_pool.cc:224] Handling call
0709 13:20:23.368362 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.440513 (+ 72151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.440559 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.722990 (+282431us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b2c0014aa78. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:20:23.745381 (+ 22391us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.176295 (+430914us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:24.176335 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.176399 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.285095 (+1108696us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:25.288901 (+  3806us) raft_consensus.cc:1685] finished
0709 13:20:25.288926 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.289101 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4389,"raft.queue_time_us":20982,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":14686,"spinlock_wait_cycles":7422592,"thread_start_us":426583,"threads_started":2,"wal-append.queue_time_us":611324}
I20260709 13:20:25.290592 23952 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.256204 17469 pending_rounds.cc:85] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 8
I20260709 13:20:25.314864 17469 pending_rounds.cc:107] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:20:25.315253 17469 raft_consensus.cc:2889] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:25.248342 23959 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:20:25.266448 23613 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.250219 23965 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.296407 23910 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:25.296553 23968 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.298405 23908 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:25.300570 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.305469 17218 catalog_manager.cc:5697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:25.308528 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.312995 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.326947 17466 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:25.328320 17218 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 15 to 17, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 17 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:25.317261 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:25.332680 23479 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.333848 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.334726 23750 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.335208 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.335345 23750 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.336071 17391 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:25.246958 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.335964 23750 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.341531 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.342494 17391 raft_consensus.cc:2393] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:25.338933 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:25.322688 23927 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.580s	user 0.000s	sys 0.003s
I20260709 13:20:25.317435 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:25.325770 23910 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:25.352331 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.335264 23479 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.354470 17391 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:25.370801 23888 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.374111 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1045) took 1031 ms. Trace:
I20260709 13:20:25.360885 23910 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:25.324142 23729 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.376211 23585 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.378147 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39712 (request call id 1) took 1640 ms. Trace:
I20260709 13:20:25.378499 23898 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:25.380359 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 190619us
I20260709 13:20:25.381309 23628 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.382124 23956 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.382916 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.414016 17996 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:25.384776 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.414595 17993 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:25.385579 23952 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.385582 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.421736 17992 raft_consensus.cc:2393] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:25.422009 23919 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.422695 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.423974 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.387451 17998 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:20:25.387735 23928 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.643s	user 0.004s	sys 0.004s
I20260709 13:20:25.389144 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.344072 23726 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.398702 17397 rpcz_store.cc:276] 0709 13:20:24.342540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.172160 (+829620us) service_pool.cc:224] Handling call
0709 13:20:25.175009 (+  2849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:25.175416 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:25.175462 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.176666 (+  1204us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.313494 (+136828us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:25.325264 (+ 11770us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.325521 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.325607 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.373856 (+ 48249us) raft_consensus.cc:1685] finished
0709 13:20:25.373877 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.374048 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6522,"prepare.queue_time_us":19538,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":7622,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":5334,"thread_start_us":129062,"threads_started":1,"wal-append.queue_time_us":191701}
I20260709 13:20:25.380779 23834 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.407325 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.407088 17962 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:25.406631 17316 rpcz_store.cc:276] 0709 13:20:23.737575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.737864 (+   289us) service_pool.cc:224] Handling call
0709 13:20:25.377843 (+1639979us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400211e54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627fa735 00007f7d627f29fa 00007f7d677ba4c9 00007f7d60d36c54 00007f7d60d36be2 00007f7d60d36b11 00007f7d60d36a8c 00007f7d60d35d42 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:25.378046 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708833536}
I20260709 13:20:25.411367 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:25.440630 17995 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:25.439334 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:25.418788 23934 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.676s	user 0.003s	sys 0.000s
I20260709 13:20:25.429057 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 1044) took 1386 ms. Trace:
I20260709 13:20:25.424705 17992 raft_consensus.cc:2368] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:25.442531 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.442829 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:25.424551 17464 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:25.442655 17390 rpcz_store.cc:276] 0709 13:20:24.238342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.401175 (+162833us) service_pool.cc:224] Handling call
0709 13:20:25.428819 (+1027644us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54004128d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:25.428995 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958101888}
I20260709 13:20:25.443655 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:25.437469 17990 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
W20260709 13:20:25.448243 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 130928us
I20260709 13:20:25.449494 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:25.432715 23585 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.458447 23729 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.459630 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:25.455008 23836 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:25.462558 23613 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.444855 23834 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.474771 17316 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 17: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:25.408432 23833 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:20:25.482127 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:25.489869 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:25.434923 23956 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.462131 23920 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.447712 23952 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:25.450399 23628 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:25.482832 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.488065 23834 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.463001 23730 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.493292 17434 leader_election.cc:400] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:25.513665 17434 leader_election.cc:403] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:25.494787 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3722) took 1399 ms. Trace:
I20260709 13:20:25.445634 23757 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.496030 17397 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
W20260709 13:20:25.497633 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 54100.7us
I20260709 13:20:25.442559 23726 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.477450 23968 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.474738 23965 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.515064 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2360) took 1511 ms. Trace:
W20260709 13:20:25.526081 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.488667 23836 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:25.518640 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:25.514446 17392 rpcz_store.cc:276] 0709 13:20:24.095636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.097898 (+  2262us) service_pool.cc:224] Handling call
0709 13:20:24.098246 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.179551 (+ 81305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.179584 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.180086 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.542868 (+362782us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:24.542933 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.543025 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.418120 (+875095us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:25.488763 (+ 70643us) raft_consensus.cc:1685] finished
0709 13:20:25.488789 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.494706 (+  5917us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80906,"raft.queue_time_us":82317,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":17916,"spinlock_wait_cycles":22628224,"thread_start_us":351913,"threads_started":1,"wal-append.queue_time_us":562385}
I20260709 13:20:25.487709 23689 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.526785 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:25.475692 23953 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:25.498588 23952 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.477137 23585 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.495350 23920 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.526321 17396 rpcz_store.cc:276] 0709 13:20:24.003562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.004526 (+   964us) service_pool.cc:224] Handling call
0709 13:20:24.004895 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.005164 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.005205 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.005719 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.477291 (+471572us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:24.477397 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.477491 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.301308 (+823817us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:25.495969 (+194661us) raft_consensus.cc:1685] finished
0709 13:20:25.495990 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.514983 (+ 18993us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37380480,"thread_start_us":471161,"threads_started":1,"wal-append.queue_time_us":736001}
I20260709 13:20:25.534067 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:25.540931 23952 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:25.545970 23875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.005s	sys 0.009s
I20260709 13:20:25.531941 23965 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:25.569125 23875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.354s	user 0.005s	sys 0.009s
I20260709 13:20:25.570093 17394 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:25.542269 23968 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.531668 23919 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.571213 23919 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.572361 23968 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.543085 23628 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:25.573269 23920 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.545455 23729 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.568811 17392 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:25.488474 23613 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.579339 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.574870 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.532222 23689 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.513398 23915 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 13:20:25.581073 23971 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:20:25.584427 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:25.531868 23890 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:25.520795 23730 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.583160 23908 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.581194 23674 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.600695 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:25.602574 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:25.605480 17992 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:25.603818 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 73101.4us
I20260709 13:20:25.587507 23918 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.589865 23689 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.610070 17392 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:25.573324 23919 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.599884 23964 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:25.635382 23613 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.639003 23833 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.639621 23833 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.594278 23888 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.590220 23968 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:25.641417 23968 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.641893 23833 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.642654 23833 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.643119 23833 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.643553 23968 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.583745 23965 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.645210 23833 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.645639 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:25.649263 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:25.649281 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.609200 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:25.631225 17992 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
W20260709 13:20:25.632061 23720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.012s	user 0.012s	sys 0.009s
I20260709 13:20:25.633229 17994 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:25.652069 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:25.634029 23975 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:20:25.607461 23674 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.653728 23910 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.632622 23726 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.648412 23836 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.606678 23890 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.665030 23479 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:25.693277 23479 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:25.693609 23890 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.676415 23965 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:25.694608 23965 consensus_queue.cc:1243] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:25.634498 23964 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.611572 23918 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.696612 23964 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.653272 23833 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.679268 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.679795 23910 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.680322 17468 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:25.680825 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:25.682376 23980 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:20:25.685307 17964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.915s (SENT) [suppressed 15 similar messages]
I20260709 13:20:25.687318 23978 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:25.704587 23978 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.705116 23978 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:25.690477 23970 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:20:25.690689 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3730) took 1480 ms. Trace:
I20260709 13:20:25.709148 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:25.651723 23720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.032s	user 0.012s	sys 0.009s
I20260709 13:20:25.691838 23730 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.692715 23757 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.694191 23479 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.663270 23750 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.617029 23897 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:25.698377 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:25.700627 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:25.709945 17992 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:25.701261 23729 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17.
I20260709 13:20:25.719378 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.672755 23674 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.709295 17388 rpcz_store.cc:276] 0709 13:20:24.210212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.306142 (+ 95930us) service_pool.cc:224] Handling call
0709 13:20:24.306767 (+   625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.337467 (+ 30700us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:25.292470 (+955003us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b18002be940. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf 00007f7d6280e038
0709 13:20:25.391319 (+ 98849us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.493422 (+102103us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.493656 (+   234us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.499721 (+  6065us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.499875 (+   154us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:25.499924 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.500013 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.690447 (+190434us) raft_consensus.cc:1685] finished
0709 13:20:25.690475 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.690631 (+   156us) inbound_call.cc:177] Queueing success response
0709 13:20:25.708660 (+ 18029us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b18002be940. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
Metrics: {"mutex_wait_us":14285,"prepare.queue_time_us":643855,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":17739,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":23129,"spinlock_wait_cycles":84336512,"thread_start_us":199866,"threads_started":2,"wal-append.queue_time_us":211902}
I20260709 13:20:25.720532 17469 raft_consensus.cc:2410] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:20:25.722853 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.730031 17466 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:25.731015 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.731588 17466 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:25.733737 23750 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.734638 17964 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:25.735816 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:25.741044 23953 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:25.741755 23953 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.742110 23953 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.742445 23953 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.745157 17467 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:25.745672 17467 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:25.746785 17467 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.748445 17467 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.717278 23918 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.754784 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:25.760555 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.770960 17466 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:25.709707 23920 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.717475 23730 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.779368 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.709527 23833 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.748464 23952 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.805073 23952 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.805701 23952 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:25.806073 23952 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.806443 23952 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:25.809036 23988 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:25.809631 23988 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.795471 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:25.795635 17467 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:20:25.798292 17287 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:25.801873 23920 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.814215 17467 pending_rounds.cc:85] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 13
I20260709 13:20:25.822378 17467 pending_rounds.cc:107] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:20:25.822695 17467 raft_consensus.cc:2889] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:25.819975 23985 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:25.778097 23585 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.811640 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.820284 17471 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:25.823279 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:25.838099 17287 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:25.838186 17467 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:20:25.720881 23897 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.825161 23898 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.825167 23987 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.839370 23704 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:20:25.845129 23898 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.841988 23223 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:25.851158 23992 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:20:25.852325 23933 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.122s	user 0.004s	sys 0.000s
I20260709 13:20:25.862677 23897 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.841903 23726 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.788136 23730 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.847106 23833 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.873696 23985 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.873237 23987 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:25.872788 23898 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.903167 23978 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.910646 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:25.877650 23726 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.809088 23674 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:25.885634 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 88540.2us
I20260709 13:20:25.891310 23730 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.892021 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3721) took 1796 ms. Trace:
W20260709 13:20:25.916673 17204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b19033ecd72e4ba188910445b70c84d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:20:25.918251 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:25.919282 17395 rpcz_store.cc:276] 0709 13:20:24.095304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.097813 (+  2509us) service_pool.cc:224] Handling call
0709 13:20:24.139342 (+ 41529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.178517 (+ 39175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.178556 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.207203 (+ 28647us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.522515 (+315312us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:24.522573 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.522660 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.851771 (+1329111us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:25.891618 (+ 39847us) raft_consensus.cc:1685] finished
0709 13:20:25.891644 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.891937 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40758,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":22344,"spinlock_wait_cycles":50897152,"thread_start_us":314911,"threads_started":1,"wal-append.queue_time_us":522806}
I20260709 13:20:25.923902 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:25.924898 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:25.926951 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:25.914791 23924 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.163s	user 0.005s	sys 0.004s
I20260709 13:20:25.914125 23726 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:25.936514 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.007405 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.007460 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 82680us
I20260709 13:20:26.008549 17434 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:25.920035 23993 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:20:25.942910 17360 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:25.928810 23833 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:25.933454 23988 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:25.963835 24001 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:25.965742 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1037) took 1985 ms. Trace:
W20260709 13:20:25.966924 23932 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.222s	user 0.003s	sys 0.000s
I20260709 13:20:25.968992 23834 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.065713 17396 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:20:25.969767 23931 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.226s	user 0.002s	sys 0.000s
I20260709 13:20:25.971729 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:25.972651 23868 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:25.973742 23978 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:25.942116 23756 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:20:25.977044 23689 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.977965 23952 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:25.978931 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.979630 23956 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:25.981737 23935 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.251s	user 0.005s	sys 0.000s
I20260709 13:20:25.985060 23674 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:25.985426 23953 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:25.985958 23985 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:25.990167 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 150552us
W20260709 13:20:25.993072 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.994014 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.994891 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:25.995213 23947 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.177s	user 0.000s	sys 0.008s
I20260709 13:20:25.997948 17388 raft_consensus.cc:1240] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 13:20:26.005100 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 78268.2us
I20260709 13:20:26.098690 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:26.015581 17434 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:26.063484 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:26.063696 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.024480 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:25.999557 23897 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.999784 23677 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:26.003227 23870 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.078917 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 1104) took 1015 ms. Trace:
I20260709 13:20:26.023375 23730 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:26.023453 23987 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:26.073552 24001 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.089195 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2405) took 1733 ms. Trace:
I20260709 13:20:26.024672 23704 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:26.023627 23757 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.024240 23715 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:20:26.092175 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 83053.8us
I20260709 13:20:26.102103 23674 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:26.067574 17394 rpcz_store.cc:276] 0709 13:20:23.980325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.981583 (+  1258us) service_pool.cc:224] Handling call
0709 13:20:23.998743 (+ 17160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.570613 (+1571870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.965480 (+394867us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54004105d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:25.965685 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3613251328}
W20260709 13:20:26.101280 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 86256us
I20260709 13:20:26.075616 23868 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:26.023972 23875 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:26.103581 23677 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.104070 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1647) took 2502 ms. Trace:
I20260709 13:20:26.103950 23898 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.107996 17462 rpcz_store.cc:276] 0709 13:20:25.063934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.971443 (+907509us) service_pool.cc:224] Handling call
0709 13:20:26.078825 (+107382us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:26.109860 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 186032us
I20260709 13:20:26.098112 23750 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:26.022670 23585 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:26.113708 17315 rpcz_store.cc:276] 0709 13:20:24.355942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.356105 (+   163us) service_pool.cc:224] Handling call
0709 13:20:24.356397 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.625489 (+269092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.088931 (+1463442us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54001419d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:26.089130 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607539456}
W20260709 13:20:26.148773 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.098878 17389 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:26.153090 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.155577 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:26.113018 23870 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.165325 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.164368 17997 rpcz_store.cc:276] 0709 13:20:23.602094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.602276 (+   182us) service_pool.cc:224] Handling call
0709 13:20:23.602708 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.874091 (+271383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.874124 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.874600 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.067442 (+192842us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b18004b22c0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:20:24.520711 (+453269us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:24.520756 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.283526 (+762770us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54005f0354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:25.283583 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.969149 (+685566us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:26.103869 (+134720us) raft_consensus.cc:1685] finished
0709 13:20:26.103890 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.104017 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20007,"raft.queue_time_us":20795,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":36761,"spinlock_wait_cycles":606217344,"thread_start_us":453074,"threads_started":1,"wal-append.queue_time_us":861616}
W20260709 13:20:26.177644 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.107841 23730 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:26.111143 23756 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:26.179118 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.195618 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:26.112715 23836 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:26.180264 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 237461us
I20260709 13:20:26.181658 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.185379 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.189831 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.192883 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:26.193267 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:26.148310 23704 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:26.150640 23821 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:26.194463 17471 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:26.196660 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:26.196591 17389 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:26.154912 23999 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.103200 23897 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.192065 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:26.210359 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.231060 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:26.231385 17393 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 15: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:26.213073 17462 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:26.213452 17469 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:26.198662 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1654) took 1998 ms. Trace:
I20260709 13:20:26.198944 17991 raft_consensus.cc:1217] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Deduplicated request from leader. Original: 17.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 13:20:26.234735 17991 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:20:26.236249 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:26.237109 17389 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.215230 17397 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:26.210433 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:26.216264 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:26.217597 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:26.224291 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:26.227594 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.243031 17392 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:26.241593 17466 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:26.242583 17997 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:26.245193 17993 raft_consensus.cc:2393] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:26.248315 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.249387 17392 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:26.232501 17999 rpcz_store.cc:276] 0709 13:20:24.199851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.207977 (+  8126us) service_pool.cc:224] Handling call
0709 13:20:24.208370 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:24.208773 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.208806 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:24.209391 (+   585us) log.cc:844] Serialized 52 byte log entry
0709 13:20:24.547748 (+338357us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:25.262881 (+715133us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b180020ffe0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf
0709 13:20:25.263067 (+   186us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.380473 (+117406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.380556 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.956544 (+575988us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:26.198416 (+241872us) raft_consensus.cc:1685] finished
0709 13:20:26.198436 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.198580 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117111,"prepare.queue_time_us":232184,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":2503,"raft.queue_time_us":119427,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":176,"spinlock_wait_cycles":86111744,"thread_start_us":498281,"threads_started":2,"wal-append.queue_time_us":520585}
I20260709 13:20:26.210824 23756 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:26.191807 24005 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:20:26.210652 23730 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.195969 23978 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:26.197618 23988 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:26.194592 23585 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.220094 23750 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.161587 23757 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.246017 24004 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.258853 17964 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:26.179724 23875 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.222018 23704 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.260465 17990 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:26.266345 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:26.279321 17992 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:26.195931 23833 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:20:26.221931 23821 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:26.288424 23585 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.330102 17395 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:26.329310 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:26.223119 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 128044us
I20260709 13:20:26.295756 23834 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.292058 23988 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:26.297040 23952 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.298563 23677 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:26.259532 23870 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.229419 23868 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.240649 23999 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.287110 23978 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.300386 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:26.329280 23821 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.310531 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.330850 23987 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:26.369755 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.370618 17322 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:20:26.371258 23870 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.371531 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.371796 23870 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.372525 23999 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:26.373131 23999 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:26.373579 23999 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.373914 23870 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.375569 23999 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.305626 17964 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:26.377321 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 71777.1us
I20260709 13:20:26.377493 23978 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:26.377977 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:26.379237 23996 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:26.379648 23996 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:26.380019 23996 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:26.380419 24000 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:20:26.382965 23479 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:26.385349 17964 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:26.322234 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.388278 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.389380 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.389938 17313 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:26.390722 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.391361 17313 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:20:26.392151 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:26.322829 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 56579.2us
I20260709 13:20:26.192488 23956 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:20:26.393921 23956 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:26.394387 23956 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:26.325730 17389 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:26.260658 24013 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:26.395629 24013 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.396211 23757 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.397253 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:26.398327 24013 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.398530 23897 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.302615 23750 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.418174 17313 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:26.333727 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:26.419086 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:26.313910 23935 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:20:26.336018 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.421224 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:26.340214 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.316396 23985 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:26.364008 17394 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.307224 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.424901 17434 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:26.425089 17317 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:26.251871 23756 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:26.337635 23914 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:20:26.378082 23978 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:26.386685 24011 consensus_queue.cc:1059] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:26.401158 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:26.462196 17469 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:26.401895 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:26.464339 17462 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:26.403360 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:26.410115 23898 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:26.411468 24002 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:20:26.412045 24001 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.455149 23757 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.320611 23836 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:20:26.401479 23987 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.417059 17389 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:26.458302 24013 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.426580 17466 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:26.342901 24012 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:26.482179 23674 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:26.482092 24012 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.482710 23674 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:26.483227 23674 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.484472 24012 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:26.313566 24004 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.364670 23834 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:26.417433 23953 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.418664 23952 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:26.429625 23479 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:26.367247 24009 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.475630 23998 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.392s	user 0.006s	sys 0.000s
I20260709 13:20:26.459256 23628 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:26.507418 23628 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.507834 23628 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:26.508340 24004 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:26.509131 23479 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:26.476920 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1189) took 1844 ms. Trace:
I20260709 13:20:26.510293 17991 rpcz_store.cc:276] 0709 13:20:24.632048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.633349 (+  1301us) service_pool.cc:224] Handling call
0709 13:20:26.198817 (+1565468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.247027 (+ 48210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.476708 (+229681us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54004583d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:26.476856 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3599241472}
I20260709 13:20:26.456328 23875 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.458514 23978 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:26.394395 24006 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:26.485018 23988 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.485471 23757 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.492735 23750 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.493263 23987 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:26.469357 23756 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:26.504908 24009 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.484771 23821 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.527648 23757 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:26.532024 23996 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.533296 23956 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.534242 23996 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.528574 23821 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.534723 24009 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.500874 23834 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.536506 23999 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:26.495940 24013 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.536952 23999 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:26.537746 23999 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.538496 24013 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:26.538859 23999 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:26.505483 23952 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.540643 23952 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.534782 23956 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.518873 23978 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:26.542923 23994 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:26.543334 23994 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:26.544593 23834 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.544162 23994 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.545799 23994 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:26.550113 23987 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.561604 23987 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:26.550937 23978 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.563966 23978 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.420009 17313 raft_consensus.cc:2410] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:20:26.317380 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.610276 17315 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:26.313714 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.463434 17391 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:26.493978 17469 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:26.372685 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.329535 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.618883 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.620445 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.476261 23720 raft_consensus.cc:3055] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:26.321753 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.611928 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.643690 17322 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:26.624281 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.610278 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:26.643729 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.705307 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.706611 17319 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:26.708038 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:26.709717 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.715116 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.504343 23704 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.719092 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:26.720058 17322 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:26.721451 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 296414us
I20260709 13:20:26.723250 17434 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:26.724560 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.725051 17315 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:26.725771 17316 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:26.726775 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:26.727924 17316 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:26.729427 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:26.737036 17286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.009s	sys 0.000s
W20260709 13:20:26.737497 17286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.009s	sys 0.001s
W20260709 13:20:26.730319 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 470484us
I20260709 13:20:26.733594 17470 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:26.734192 23689 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:26.735882 23704 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:26.742947 17313 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:20:26.745967 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:26.738930 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 456025us
W20260709 13:20:26.753275 23891 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.036s	sys 0.046s
W20260709 13:20:26.755381 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.755964 23720 raft_consensus.cc:740] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:26.757985 23720 consensus_queue.cc:260] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.756166 17316 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:20:26.763967 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 378559us
I20260709 13:20:26.756189 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:26.778761 17313 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:26.740487 17317 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:26.762850 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 359427us
I20260709 13:20:26.786129 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:26.774792 23720 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.820516 17318 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:26.835717 23988 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:26.836104 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 113168us
I20260709 13:20:26.836758 23988 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.837471 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:26.838799 23479 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:26.839639 23988 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:26.837039 23689 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:26.839900 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:26.840961 23875 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:26.841836 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.841982 23875 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.843271 17395 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:26.846189 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:26.847818 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:26.848739 17393 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:26.849051 23689 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:26.851580 17389 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:20:26.853451 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.854342 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:26.854764 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.856878 23732 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:26.857699 23732 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.860486 23732 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:26.868201 23750 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:26.871402 24022 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:26.869776 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 46830.5us
I20260709 13:20:26.873616 17314 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:26.874071 24022 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.877547 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:26.881114 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 468490us
I20260709 13:20:26.870867 23868 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:26.868319 23951 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:26.869563 23985 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:26.891935 17470 pending_rounds.cc:85] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 9
I20260709 13:20:26.893831 17470 pending_rounds.cc:107] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:20:26.894165 17470 raft_consensus.cc:2889] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:26.890727 23985 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.894515 24007 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:26.898447 23732 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.898785 24007 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:26.899272 23732 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:26.900914 23585 consensus_meta.cc:287] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.557s	user 0.014s	sys 0.005s
I20260709 13:20:26.934378 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:26.877225 24022 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.944428 17392 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:26.945495 17395 raft_consensus.cc:2376] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19. Re-sending same reply.
I20260709 13:20:26.946110 17397 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:26.950604 23750 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.945588 24028 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:26.969084 17204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b19033ecd72e4ba188910445b70c84d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:20:26.972896 23726 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.007s
I20260709 13:20:26.973498 23726 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:26.976315 23726 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:26.977075 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:26.977679 17394 consensus_meta.cc:287] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.011s
I20260709 13:20:26.977932 17389 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:26.978193 17394 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:26.990520 17322 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:26.966281 24028 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.996485 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.997637 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.999142 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:26.985091 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:26.981205 24007 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:26.967665 23875 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:26.993034 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 153341us
I20260709 13:20:27.007359 17397 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:27.008142 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:27.008738 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:27.009732 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:27.009773 17397 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:27.010407 17390 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:27.011415 24033 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.012048 23730 consensus_meta.cc:287] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.010s
I20260709 13:20:27.011981 24033 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.000118 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:27.014607 17395 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:26.944047 23585 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.019471 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:27.029955 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:27.031232 17391 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:27.032995 17388 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:27.033066 23732 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:27.044349 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:27.044677 23732 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:26.964143 23951 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:27.046350 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 81939.5us
I20260709 13:20:27.004877 24028 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:27.012603 23730 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.045924 23732 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:27.063805 17995 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:27.082312 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:27.091655 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 87265.7us
I20260709 13:20:27.093561 23726 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:20:27.103216 24007 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:27.091979 24032 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:27.104363 24007 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:27.093308 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:27.096019 23994 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:27.119902 23994 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.108248 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:27.120757 23260 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:20:27.127836 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:27.110530 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:27.094698 23978 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:27.133049 23978 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:27.134160 24020 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.425s	user 0.000s	sys 0.006s
W20260709 13:20:27.113510 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 212149us
I20260709 13:20:27.127581 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:27.111392 17991 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:27.129021 17470 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:20:27.137385 17470 pending_rounds.cc:85] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 9
I20260709 13:20:27.137643 17470 pending_rounds.cc:107] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:20:27.137878 17470 raft_consensus.cc:2889] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.137962 17393 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:27.111382 17990 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:20:27.144574 17394 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:27.145819 17396 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:27.145651 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:27.129251 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:27.148007 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.147140 23732 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:27.151859 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:27.152781 17469 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:27.154844 24007 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:27.147146 17390 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:27.165243 23628 consensus_meta.cc:287] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.007s
I20260709 13:20:27.165968 23628 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:27.203508 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.176074 17390 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:27.114805 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:27.143383 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:27.251269 23951 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:27.252537 17462 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:27.253834 24032 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:27.255105 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:27.257531 23987 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:27.258109 23987 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:27.258667 23987 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:27.272406 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:27.273336 17469 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:27.275383 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:27.276536 17468 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:27.279521 17462 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:27.288137 23956 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:27.289186 23956 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.294220 23956 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:27.312862 23994 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:27.321683 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 263147us
I20260709 13:20:27.329872 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:27.331234 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:27.331414 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:27.334206 23756 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.008s
I20260709 13:20:27.333995 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:27.337772 23722 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.337859 24027 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.340415 24021 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.341048 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 226407us
I20260709 13:20:27.341195 23260 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:27.343621 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.343869 24019 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:27.348059 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:27.348884 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.413702 24027 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.413687 23722 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.416481 24027 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:27.417233 24021 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:27.349726 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.351424 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.352267 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.351728 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.361999 23730 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:27.121696 23750 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:27.363548 23674 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.880s	user 0.007s	sys 0.011s
I20260709 13:20:27.365347 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:27.193928 24039 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:20:27.445992 17992 raft_consensus.cc:2410] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:20:27.173741 23585 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:27.213312 17466 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:27.366863 24016 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:27.455152 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:27.368055 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 238700us
I20260709 13:20:27.374634 24033 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:27.380760 24028 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.460345 17388 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:20:27.457316 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.464651 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.465647 17468 raft_consensus.cc:2368] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:27.460765 17388 pending_rounds.cc:85] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 11
I20260709 13:20:27.466368 17388 pending_rounds.cc:107] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:20:27.466674 17388 raft_consensus.cc:2889] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.386279 17389 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:27.407243 17995 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 12.
I20260709 13:20:27.417682 23722 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:27.419588 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.419706 24021 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:27.168776 23628 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:27.420924 17315 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
W20260709 13:20:27.444921 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.450016 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.450198 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.458016 17470 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:27.452827 23720 consensus_meta.cc:287] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.643s	user 0.013s	sys 0.001s
W20260709 13:20:27.478648 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 216606us
I20260709 13:20:27.480930 17462 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:27.483039 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.485092 17322 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:27.488119 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:27.523337 17316 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:27.523401 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.489025 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.489507 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.490094 17466 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:27.495850 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:27.492729 24016 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.504070 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:27.508937 23260 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:27.509241 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:27.510015 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:27.510588 23722 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:27.511292 24021 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:27.513236 24019 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.512385 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:27.454546 23674 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:27.515524 17314 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
W20260709 13:20:27.496417 23868 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.005s
I20260709 13:20:27.527755 17318 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:27.531980 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:27.501797 23978 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:27.533056 17320 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:27.541563 17992 raft_consensus.cc:2393] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:27.517704 23756 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:27.544463 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 77414.2us
I20260709 13:20:27.527972 24016 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.543340 17994 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
W20260709 13:20:27.547075 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 258903us
I20260709 13:20:27.566941 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.569540 17998 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:27.551666 23875 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:27.571205 17319 raft_consensus.cc:3060] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:27.577629 23875 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:27.578346 23875 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:27.582561 17963 leader_election.cc:336] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.045s (SENT)
I20260709 13:20:27.595662 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:27.588413 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:27.602860 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:27.606153 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 118250us
W20260709 13:20:27.610626 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 131463us
I20260709 13:20:27.590497 24032 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:27.563398 23756 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:27.622591 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:27.642493 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:27.649107 23868 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:27.649574 23868 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.649979 23868 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:27.660138 23715 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.016s	sys 0.010s
W20260709 13:20:27.662040 23715 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.016s	sys 0.011s
W20260709 13:20:27.661303 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 91926.6us
I20260709 13:20:27.653095 23628 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:27.645478 24032 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:27.668910 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:27.682493 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:27.696324 17994 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:27.677232 24032 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:27.702234 17998 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:20:27.702881 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:27.696246 23674 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:27.715149 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:27.700655 24021 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:27.711794 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:27.739214 17997 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:27.698765 24028 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:27.713693 23722 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:20:27.716909 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:27.719812 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 89093.4us
W20260709 13:20:27.720688 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55321.3us
I20260709 13:20:27.732939 23750 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:27.734308 24016 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:27.735453 23987 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:27.742524 17320 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:27.749284 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:27.749174 24027 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:20:27.751199 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:27.756510 17994 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:27.761454 24011 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:27.762001 24011 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:27.763190 23674 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:27.764178 24049 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:20:27.769335 17319 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:27.744201 23750 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.776471 17997 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
W20260709 13:20:27.802153 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.754058 23260 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:27.809159 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 144152us
I20260709 13:20:27.811214 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:27.812280 23951 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:27.817016 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:27.818162 24027 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:27.818377 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58215.6us
I20260709 13:20:27.819214 17286 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:27.821755 17322 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:27.823035 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:27.822973 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.824555 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:27.825196 17322 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:27.759418 23726 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:27.833679 17322 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:27.835083 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:27.840233 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:27.842535 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:27.801460 23750 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:27.848248 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.843209 24027 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:27.850504 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 101355us
I20260709 13:20:27.840621 24019 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:27.855492 24011 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.856194 23674 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:27.861729 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 299992us
I20260709 13:20:27.860522 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:27.862507 17319 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:27.863888 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60822.7us
I20260709 13:20:27.835690 23260 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:27.838150 23726 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:27.873454 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:27.864784 23674 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:27.887269 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 68172.6us
I20260709 13:20:27.891563 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.880113 24019 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:27.880113 23756 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:27.888571 23674 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:27.890367 23720 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:27.906927 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:27.889355 24011 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:27.890797 24027 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:27.914822 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:27.917599 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 64886.4us
I20260709 13:20:27.904457 23951 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.923588 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:27.924268 17320 raft_consensus.cc:2376] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18. Re-sending same reply.
I20260709 13:20:27.929167 23628 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:27.929936 23628 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:27.930122 24021 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:27.930994 23628 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.929039 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:27.929021 23722 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:27.933265 17434 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:27.936066 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 93803.4us
I20260709 13:20:27.909857 23720 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:27.908085 24019 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:27.935554 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:27.942046 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.951190 17319 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:27.951419 23756 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:20:27.941656 23987 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:27.976374 24066 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:27.976960 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:27.953979 23994 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.985648 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:27.990938 17471 raft_consensus.cc:2410] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:27.984866 23994 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.996392 23994 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:27.991917 23689 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:27.998880 23689 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:27.957356 24032 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.005825 24032 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:28.007433 24019 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.010783 23720 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.033174 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:27.919366 23260 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:27.953816 23951 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.046749 17995 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:28.047389 23951 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.048724 24028 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:27.952690 23726 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.057699 23726 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.066624 23260 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:28.069259 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 82238.3us
I20260709 13:20:27.988533 23868 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.075764 23868 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:28.023856 24056 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:20:28.077260 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:28.044000 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 67269.9us
I20260709 13:20:28.079011 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:28.075912 23720 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:28.040436 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 150725us
I20260709 13:20:28.086525 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.089051 23994 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:28.041759 17468 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:28.080070 23750 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.127823 17319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
W20260709 13:20:28.130167 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 51291.2us
I20260709 13:20:28.131106 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:28.131595 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:28.132591 17287 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:28.133033 23987 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:28.134770 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:28.133185 24032 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:28.133522 23720 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:28.136631 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.137154 23720 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.137537 23897 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:28.137687 24032 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:28.139714 24032 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:28.140252 24032 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.135190 23987 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.141089 23987 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.141974 17434 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:28.142896 24064 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:28.143359 17317 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:20:28.145206 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 223515us
I20260709 13:20:28.136648 17287 leader_election.cc:400] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:28.147563 17287 leader_election.cc:403] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:28.143324 24064 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:28.137643 23720 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.120013 24067 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.137850 24027 raft_consensus.cc:2764] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:28.148231 24064 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.161787 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.132772 23260 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:20:28.163544 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 222250us
I20260709 13:20:28.166301 23260 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.166904 23260 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:28.168958 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:28.175179 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:28.176007 24016 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.164712 24065 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.176703 24016 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.177347 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:28.179469 24016 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.180789 23897 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:28.181389 23897 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.181865 23897 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:28.181968 23750 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.180197 24016 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:28.187103 24016 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:28.189144 23628 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:28.192094 17962 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:28.193208 23628 raft_consensus.cc:2804] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:28.193830 23628 raft_consensus.cc:697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:28.156493 23674 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.195422 23628 consensus_queue.cc:237] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.196482 23674 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:28.156391 23994 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.198962 23715 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:20:28.162844 23730 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.208952 24063 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:28.209527 24063 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:28.209964 24063 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.212936 23715 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:28.213408 23715 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:28.214402 23715 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.216100 23715 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:28.217358 23875 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.002s
I20260709 13:20:28.217823 23875 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.220242 23875 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.221014 24072 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:28.223016 23730 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.225459 23730 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:28.226030 23730 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.226523 23730 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:28.229293 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 313373us
I20260709 13:20:28.197647 24067 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.233410 23750 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:28.233873 23750 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:28.234423 24067 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:28.234751 23750 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.238593 23750 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.240284 24065 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:28.231181 23994 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.250144 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.275161 23897 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.228732 23730 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:28.252974 24064 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.253271 24062 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:28.253767 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 53384.1us
I20260709 13:20:28.254256 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.282475 17322 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:28.254592 23756 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:28.257445 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:28.258342 17315 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:28.259089 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.260058 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.265718 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.267059 23875 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.230417 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:28.277451 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 102367us
I20260709 13:20:28.244340 23987 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:28.285444 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 106767us
W20260709 13:20:28.278940 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 99810.7us
W20260709 13:20:28.281306 17204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b19033ecd72e4ba188910445b70c84d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7241e45fbfca4b46b6df9be8cebcd863 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:28.291911 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.279134 23994 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.297808 17962 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:28.299840 24062 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.301368 23951 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:28.301783 23951 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:28.302277 24062 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.303120 24078 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:28.305502 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.306656 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:28.308378 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.309398 17314 raft_consensus.cc:2368] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:28.302693 23951 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.311192 17318 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.312693 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:28.300540 23897 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.315050 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:28.315733 17315 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:28.318917 24066 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:28.319152 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.313148 23730 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:28.320128 23730 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.321130 17313 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
W20260709 13:20:28.321964 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 91695.3us
I20260709 13:20:28.264730 24032 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.322660 23730 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:28.335048 17319 raft_consensus.cc:606] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.335284 17316 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:28.333280 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:28.308375 24064 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:28.339124 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47279us
I20260709 13:20:28.343930 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:28.293848 23875 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.343093 17470 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:28.344782 17469 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:28.345811 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:28.346479 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:28.378909 17462 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:28.340708 23994 raft_consensus.cc:2804] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:28.299252 23260 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.331296 23868 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:28.366001 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.367398 24032 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:28.367769 23978 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:28.370550 23720 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.372893 17962 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:28.375370 17319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:28.381239 17318 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:20:28.387105 17319 raft_consensus.cc:606] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:28.382885 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.387653 17319 raft_consensus.cc:614] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:28.388152 17287 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:28.390412 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:28.391814 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 49899.3us
I20260709 13:20:28.387050 23951 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.382973 23628 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.386812 23868 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:28.401780 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:28.403906 23868 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.404455 17470 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:28.395088 24078 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:28.409070 24062 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:28.399952 24064 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:28.417925 24078 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.425887 24078 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.393918 23978 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.431353 23978 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.431802 23260 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.431969 23978 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:28.438060 17321 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:28.445798 17462 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:28.447567 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:28.441506 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:28.449127 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 66296.9us
I20260709 13:20:28.450373 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:28.453752 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 57579.9us
I20260709 13:20:28.458560 17470 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:28.453367 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:28.459367 17469 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:20:28.461225 17319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:28.464761 17319 raft_consensus.cc:606] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:28.465219 23994 raft_consensus.cc:697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:28.450928 23260 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:28.510335 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:28.510918 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 138121us
I20260709 13:20:28.510421 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:28.465842 24085 raft_consensus.cc:2804] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:28.513412 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:28.432685 23978 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.518627 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:28.461181 24064 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:28.519757 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 52864.9us
I20260709 13:20:28.418162 23628 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.528463 17396 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:20:28.523674 17391 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:28.530692 17395 raft_consensus.cc:2410] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:28.461673 24071 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:28.532183 17319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:28.532384 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:28.533087 24075 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:20:28.527601 23987 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:28.532191 17360 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:28.534857 24074 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.171s	user 0.004s	sys 0.000s
W20260709 13:20:28.562413 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 121025us
I20260709 13:20:28.545259 23897 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:28.512276 23730 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:28.547554 17319 raft_consensus.cc:606] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.563409 17319 raft_consensus.cc:614] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:28.522089 23260 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:28.575394 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 46869.6us
I20260709 13:20:28.570080 23730 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:28.516108 24063 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.581595 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:28.549876 24085 raft_consensus.cc:697] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:28.587258 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:28.588690 17360 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:28.563201 23994 consensus_queue.cc:237] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.590103 24085 consensus_queue.cc:237] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.590786 23260 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.593258 24077 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:28.593791 24077 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.594214 24077 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.596002 23875 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:28.598392 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:28.599752 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:28.600299 17396 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:28.601296 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:28.601552 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:28.601898 17468 raft_consensus.cc:3060] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.602118 17471 raft_consensus.cc:3060] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.602725 24063 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.603704 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:28.604691 17391 raft_consensus.cc:2393] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:28.604878 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:28.605356 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:28.605770 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:28.606125 17467 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:28.606473 17391 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:28.607128 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:28.607355 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:28.607836 17467 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:28.609391 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:28.609547 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.610461 23987 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:28.610837 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:28.611109 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.611564 17464 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:28.612136 23987 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:28.613648 24081 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:20:28.613834 24080 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:20:28.614725 23720 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:28.615296 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.616865 17320 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:28.531538 24064 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.620110 17322 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:28.577911 23730 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.621167 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:28.623581 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.606185 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:28.628111 17462 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:28.628914 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:28.612701 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:28.634354 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:28.635255 17995 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.630234 17464 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:28.640996 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:28.580379 24071 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:28.643669 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.644472 17360 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:28.647145 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:28.648028 17322 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:28.650681 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:28.653712 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:28.657821 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:28.659350 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:28.660125 17397 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 24: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:28.667526 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:28.668682 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:28.669575 17467 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:28.639276 23875 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:28.672513 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:28.678436 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:28.679436 17318 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:28.680050 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.643366 23715 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:28.674811 17464 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:20:28.682431 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:28.687713 17996 raft_consensus.cc:2393] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:28.683203 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:28.685179 17990 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:28.686426 17317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:28.689234 17317 raft_consensus.cc:606] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:28.690943 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 64391.3us
I20260709 13:20:28.661944 24028 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:28.691934 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:28.668754 24032 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:28.693570 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.698649 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.693851 17314 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:28.672423 23897 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:28.706300 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:28.707031 17322 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:28.694975 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:28.695058 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:28.701030 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:28.694408 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:28.697558 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:28.705077 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.708623 17997 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:28.709509 17397 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.710227 17316 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 24: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:28.711263 17462 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:28.683386 23756 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:28.683899 23875 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.713819 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:28.720450 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 53008.9us
I20260709 13:20:28.709452 17991 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:28.668955 23750 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:20:28.726048 17468 raft_consensus.cc:2468] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:28.693974 24066 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:28.694612 24064 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:28.697232 24028 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.728140 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:28.730108 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:28.715423 24062 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:28.717381 23756 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:28.745391 17997 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:28.749845 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.750289 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.762136 17313 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:28.745263 17990 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:28.721886 23875 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.752496 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:28.767086 17388 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.702128 24032 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:28.764390 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:28.751869 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:28.768244 17471 raft_consensus.cc:2468] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:28.751122 24028 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.769335 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:28.771265 24032 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.796594 24028 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.797415 24078 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:28.802066 17396 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:28.803161 24078 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.785331 23978 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.776469 23628 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:28.798534 17397 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:28.744365 23715 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:28.780859 17993 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:28.813587 17995 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:28.816033 17388 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:28.816921 17469 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
I20260709 13:20:28.818608 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:28.819546 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 97776.4us
I20260709 13:20:28.751536 24072 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.761965 23756 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.727856 24067 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 13:20:28.885241 17318 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:28.884756 17319 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:20:28.895536 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:28.818277 23689 raft_consensus.cc:2764] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:20:28.761456 24071 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:28.907445 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 193732us
I20260709 13:20:28.853559 23715 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:20:28.949011 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 128437us
I20260709 13:20:28.895934 24066 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:28.942485 23674 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:28.980621 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 211251us
I20260709 13:20:28.897789 24072 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:28.977926 23951 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:28.982189 23715 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:28.984148 23868 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 13:20:29.013875 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:29.020325 24028 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:28.984380 24066 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.027047 24032 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.012972 24102 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:20:28.988421 23674 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:28.995666 23951 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:29.030624 24032 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:29.048517 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 255206us
I20260709 13:20:29.034303 24028 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.991741 24103 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:20:29.058439 17434 leader_election.cc:400] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:29.061376 23951 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.062773 23951 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:29.065496 24097 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:20:29.066115 24103 consensus_queue.cc:1243] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:29.066605 24021 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.066706 24103 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:29.067200 24103 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:29.068199 24096 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:20:29.067174 24021 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:29.070256 24093 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:20:29.071457 24021 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:29.071738 17286 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:29.072574 24062 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:29.073062 24062 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:29.073973 24062 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.075034 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:29.075350 23726 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:29.075616 17392 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.075836 23726 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:29.068156 24103 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.084654 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:29.008980 23868 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.079816 17394 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:20:29.088526 17394 pending_rounds.cc:85] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 15
I20260709 13:20:29.088796 17394 pending_rounds.cc:107] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 13:20:29.089061 17394 raft_consensus.cc:2889] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:29.060989 17434 leader_election.cc:403] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:20:29.084605 24092 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:20:29.093843 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:29.094451 17389 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.079898 23875 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.096247 23875 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:29.097179 24063 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:29.097476 24107 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:29.097772 24063 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:29.099325 24101 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:20:29.099040 24063 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.100777 24103 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.091248 17392 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:29.120455 17389 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
W20260709 13:20:29.123225 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 109557us
I20260709 13:20:29.121084 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:29.125696 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:29.131191 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.059473 24064 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:20:29.136262 24106 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:29.076818 23726 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.138335 23726 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.141600 23674 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.131261 23628 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:29.146235 23628 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:29.147148 23628 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.149293 24072 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:29.133421 23730 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.512s	user 0.013s	sys 0.000s
I20260709 13:20:29.059809 24028 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.153869 24028 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:29.149536 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.156905 17470 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:29.157378 23868 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:29.159705 24099 raft_consensus.cc:993] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:20:29.160243 24099 raft_consensus.cc:1081] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:20:29.165221 24064 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:29.165637 24064 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:29.166491 24064 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.167702 24064 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.175068 23978 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:29.176860 24066 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:29.056924 23715 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.185652 17395 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:29.186874 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.187578 17395 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:29.194003 17315 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:29.150075 23730 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.201649 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:29.204094 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:29.220151 17466 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.188565 17395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:20:29.220960 17395 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:29.221464 17395 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:29.210280 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.212041 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.212204 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:29.212074 17469 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:29.214234 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.225051 17470 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
W20260709 13:20:29.214735 24077 consensus_meta.cc:287] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.004s
W20260709 13:20:29.218691 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 93081.3us
I20260709 13:20:29.218959 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:29.230480 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:29.232146 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 173890us
I20260709 13:20:29.223111 17465 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:29.240171 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.219457 23978 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:29.241469 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:29.250986 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.244990 17434 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.236177 23987 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:29.277750 17360 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:29.261801 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.287250 17315 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:29.287822 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.249956 24084 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:29.289877 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.303082 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:29.305125 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:29.238749 24077 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.273968 24114 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:29.309376 24072 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:29.306562 17434 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.322057 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:29.298045 24066 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:29.250957 24086 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:20:29.295116 24084 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.328239 17434 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.332088 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.360383 17394 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:29.282914 24028 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:20:29.361727 17391 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:29.315775 24114 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.271862 23978 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.310681 23987 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:29.324923 23674 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:29.367647 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50105.9us
I20260709 13:20:29.315996 24072 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:29.332952 24085 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.010s	sys 0.021s
W20260709 13:20:29.369789 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 66789.9us
W20260709 13:20:29.371172 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 134048us
I20260709 13:20:29.367707 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:29.374059 17204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b19033ecd72e4ba188910445b70c84d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7241e45fbfca4b46b6df9be8cebcd863 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:29.365438 24084 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:29.379410 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.381724 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:29.382288 17317 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.332659 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:29.383548 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 164173us
I20260709 13:20:29.384785 17963 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:29.384989 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.332084 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.378008 24098 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:29.379362 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.380578 17995 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:20:29.369134 24114 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:29.375622 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.390311 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.388901 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:29.373775 24085 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.017s	sys 0.023s
I20260709 13:20:29.391567 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:29.393332 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.372670 24072 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.370988 24066 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:29.399631 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:29.396126 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:29.396694 17465 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:29.391717 17286 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:29.401556 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:29.372247 24032 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:29.402035 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.405050 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:29.405303 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:29.407886 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.395941 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:29.373281 23674 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:29.404386 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:29.410477 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.411104 17471 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:29.412761 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.417727 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.417968 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:29.375792 23987 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:29.418661 17393 raft_consensus.cc:2376] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17. Re-sending same reply.
I20260709 13:20:29.419071 17467 raft_consensus.cc:1275] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:20:29.417280 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 180355us
I20260709 13:20:29.420626 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.401180 17319 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:29.395957 24028 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:29.426235 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.395119 24098 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:29.425555 17993 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:29.397456 24067 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:29.435418 17468 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:29.399081 23750 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:29.435272 17463 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:29.438015 17471 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:29.448318 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:29.462100 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60605.7us
I20260709 13:20:29.463555 24032 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:29.464891 24032 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:29.466418 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 51639.8us
I20260709 13:20:29.437057 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:29.467595 23987 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.470053 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.451972 17395 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.470739 17286 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:29.479394 23260 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:29.433699 23730 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:29.434222 24028 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.437284 24098 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:29.451383 23756 consensus_meta.cc:287] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.002s
I20260709 13:20:29.445258 24067 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.450781 23750 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:29.488813 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.490741 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.493173 17464 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:29.501466 23674 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.502292 24138 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:29.503336 24116 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:29.504714 17322 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:29.505959 17396 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:29.506065 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.482472 24062 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:29.481549 24102 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.525069 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:29.526182 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 135197us
I20260709 13:20:29.527638 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.489300 24028 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:29.489391 24067 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:29.533587 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 148872us
I20260709 13:20:29.505182 23750 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:29.536165 17396 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:29.536661 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:29.491338 23628 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:20:29.542186 17396 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:29.529781 24138 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:29.525425 23951 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:29.551841 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.536193 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:29.546075 17964 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.530844 24104 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:29.548468 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 111738us
I20260709 13:20:29.550511 17396 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:20:29.532650 24087 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:29.566560 24087 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:29.567241 24087 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:29.492182 23756 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.546938 24105 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.160s
I20260709 13:20:29.554692 24113 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.158s
I20260709 13:20:29.555174 23978 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:29.555406 24121 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:20:29.569828 17388 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
W20260709 13:20:29.556022 24119 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:20:29.556304 24127 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:29.557582 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:29.561239 24114 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.562222 24136 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:29.576038 24127 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:29.576030 24136 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:29.576920 24136 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.577342 24114 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:29.581542 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:29.582423 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:29.586650 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:29.587260 17319 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:29.587543 17319 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:29.556689 24109 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:29.589249 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 167599us
I20260709 13:20:29.551172 24085 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:29.623375 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.533180 24102 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.553604 23951 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:29.622402 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 151725us
I20260709 13:20:29.630970 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:29.588215 17319 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.633085 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:29.635403 17316 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:29.547914 23897 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:20:29.632709 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:29.637214 17464 raft_consensus.cc:2368] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 21. Current term is 22.
I20260709 13:20:29.646665 17466 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:29.657245 17320 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:29.597844 24063 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:29.662775 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:29.663232 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 81773.3us
I20260709 13:20:29.664610 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:29.665529 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 87544.3us
I20260709 13:20:29.665952 17462 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:29.630012 24127 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:29.666414 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:29.666810 24127 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.667261 24127 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.629562 24113 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:29.534111 24066 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.626413 24062 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:29.583861 23260 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:29.639890 23951 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.638657 24105 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:29.681645 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:29.685400 24120 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:20:29.684862 24062 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.686384 24140 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:29.686827 24132 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:29.669943 24063 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.689522 24063 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.688513 23260 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.691282 24127 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.693660 24127 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:29.698122 23994 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:29.698690 23994 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:29.699856 23994 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.675237 23978 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:29.701314 23978 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:29.701815 23978 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:29.702520 24115 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:20:29.704774 23756 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:29.705890 24102 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:29.707782 24103 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.010s
W20260709 13:20:29.708207 23726 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.001s
I20260709 13:20:29.673863 24113 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:29.710386 24113 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.711575 24113 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.715245 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3775) took 1124 ms. Trace:
I20260709 13:20:29.715797 17397 rpcz_store.cc:276] 0709 13:20:28.591229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.807305 (+216076us) service_pool.cc:224] Handling call
0709 13:20:28.807603 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.037420 (+229817us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:29.038085 (+   665us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.293445 (+255360us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:29.307296 (+ 13851us) log.cc:844] Serialized 26 byte log entry
0709 13:20:29.315461 (+  8165us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:29.316381 (+   920us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.362142 (+ 45761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.362247 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:29.714975 (+352728us) raft_consensus.cc:1685] finished
0709 13:20:29.715002 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.715176 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73859,"prepare.queue_time_us":7066,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":232147,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":33802,"thread_start_us":463530,"threads_started":2,"wal-append.queue_time_us":272734}
I20260709 13:20:29.719575 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:29.721308 24127 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:29.641182 24109 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:29.728386 24109 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:29.732739 24128 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:29.682122 24105 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:29.740211 24105 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.741832 24105 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.745816 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:29.753768 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.754339 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.771596 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.791714 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.791543 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 126989us
I20260709 13:20:29.795594 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:29.797330 17317 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
W20260709 13:20:29.801779 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 331771us
I20260709 13:20:29.827378 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:29.830683 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:29.831581 17464 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 24: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:29.821386 24102 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.821069 24124 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.824208 23987 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:29.829655 23994 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.836150 24127 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:29.850178 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:29.853816 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51281.7us
I20260709 13:20:29.837340 24133 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.858011 24145 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:29.857664 24133 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.858505 24145 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:29.858664 24104 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:29.858997 24145 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.859243 24104 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.859823 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.860723 17464 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:29.863116 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3779) took 1270 ms. Trace:
I20260709 13:20:29.863494 17391 rpcz_store.cc:276] 0709 13:20:28.592500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.607109 (+ 14609us) service_pool.cc:224] Handling call
0709 13:20:29.862899 (+1255790us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b540038de54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:29.863030 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729208576}
I20260709 13:20:29.840780 24087 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:20:29.866132 24063 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.856825 24124 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.869181 24124 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:29.869529 24134 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.870165 24134 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.846462 24102 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.854414 23987 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.873431 24141 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:29.870441 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 204115us
I20260709 13:20:29.874958 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:29.874039 24141 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.878873 24147 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:20:29.889218 24063 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:29.905596 24141 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:29.905763 24123 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.528s	user 0.003s	sys 0.000s
W20260709 13:20:29.905993 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.889700 24064 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.003s
I20260709 13:20:29.876395 24132 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.891001 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:29.914389 17464 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.914325 24132 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.892184 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.915160 23750 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.916335 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:29.917547 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.918608 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.919181 23978 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:29.920418 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45556.3us
I20260709 13:20:29.875072 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.921141 23628 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:29.921322 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46330us
I20260709 13:20:29.921891 23628 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:29.922297 23628 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.922650 23628 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:29.922771 24133 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:29.923743 17395 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:29.930800 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:29.895968 24028 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.899580 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:29.901254 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:29.940094 17466 raft_consensus.cc:2368] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20.
I20260709 13:20:29.901850 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:29.902123 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.940972 17462 raft_consensus.cc:2376] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19. Re-sending same reply.
I20260709 13:20:29.941305 24067 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:29.941653 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:29.942378 17470 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:29.902954 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.846385 24032 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:29.943167 23978 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:29.943414 24032 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.939846 17465 raft_consensus.cc:2376] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20. Re-sending same reply.
I20260709 13:20:29.945539 24102 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:29.945796 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:29.946039 24134 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:29.946537 17997 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:29.947037 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:29.947562 17990 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.947917 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:29.949996 24085 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:29.946089 24102 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.950866 24102 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.916555 24132 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:29.946379 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:29.953152 17395 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.947412 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:29.953732 17466 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:29.950248 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.955782 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.938324 17469 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:29.970978 17391 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:29.970858 23951 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.972090 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:29.973169 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.974325 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:29.975368 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:29.977015 24147 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.976965 24102 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:29.978397 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.978561 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:29.978600 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:29.979324 17396 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:29.990558 17395 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:29.978088 24087 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:20:29.992130 17990 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:29.990278 24086 consensus_queue.cc:1048] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:29.997263 24087 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:29.997747 24087 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:29.998558 24087 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:29.998942 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:29.999791 24087 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.000653 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:30.001035 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:30.001718 17996 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:30.001653 24153 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:30.003270 23987 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:29.990438 17997 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:30.004328 17321 raft_consensus.cc:2368] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:29.965731 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:29.988809 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:30.006227 17395 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:30.006880 17391 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:30.007251 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:30.007994 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.006222 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:30.010389 17389 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:30.009450 17991 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:29.945508 24032 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.004876 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:30.014250 17395 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:20:30.021597 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.015053 23750 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:30.011646 23756 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:30.016127 17466 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:20:30.011832 24021 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:30.034898 24021 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.011785 24132 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:30.035321 24021 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.021109 23987 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:30.036207 23987 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.035130 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:30.038579 23987 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.041129 23756 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:30.041957 17998 raft_consensus.cc:2410] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:30.042128 23756 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.042960 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:30.044541 24028 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:29.977626 24147 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.018775 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:30.035153 24153 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:20:30.046554 24147 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.047641 24136 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.048720 17995 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:30.050125 24027 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:30.050493 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:30.051088 17466 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.053107 23994 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:30.022673 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:30.059700 17395 raft_consensus.cc:2368] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 15. Current term is 16.
I20260709 13:20:30.060730 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:30.025172 23951 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.028131 24127 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:30.028508 23978 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:30.029163 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:30.082041 17990 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.030808 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.025739 17360 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:30.083053 17391 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
W20260709 13:20:30.083184 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 57527.8us
I20260709 13:20:30.034451 17991 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:30.054028 17464 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:30.022306 17389 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:30.034107 17397 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:20:29.947453 24104 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.022670 24086 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:30.088470 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:30.091827 17469 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:30.088600 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.095476 17395 raft_consensus.cc:2410] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:20:30.079159 24084 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.681s	user 0.005s	sys 0.009s
I20260709 13:20:30.096758 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:30.097136 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:30.102876 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:30.103505 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.102809 17391 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.104454 17389 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:30.058981 23994 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:30.103434 17992 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:30.114635 24147 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:30.116576 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:30.117331 24011 raft_consensus.cc:993] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:20:30.117877 24147 raft_consensus.cc:1081] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:20:30.109407 24084 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.080113 24027 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:20:30.089682 24019 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:30.140136 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.094017 24113 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:30.168272 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:30.178048 17467 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:30.172657 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.169476 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:30.091514 24086 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.124405 17469 raft_consensus.cc:1275] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:30.170120 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:30.184592 17465 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.163146 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:30.184930 17389 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:30.185631 17397 raft_consensus.cc:2368] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
W20260709 13:20:30.186193 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.169437 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:30.187302 17992 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:30.141737 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:30.188153 17466 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:30.188452 17464 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:20:30.191185 17391 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:30.195169 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3785) took 1098 ms. Trace:
W20260709 13:20:30.128657 24098 consensus_meta.cc:287] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.608s	user 0.005s	sys 0.006s
I20260709 13:20:30.195547 17388 rpcz_store.cc:276] 0709 13:20:29.096512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.125854 (+ 29342us) service_pool.cc:224] Handling call
0709 13:20:30.194992 (+1069138us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540038d454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:30.195108 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006718720}
W20260709 13:20:30.199267 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 170482us
W20260709 13:20:30.200070 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.203627 17990 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:30.205739 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:30.200035 17396 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:20:30.208468 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:30.209230 17318 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:30.196738 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:30.197420 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:30.203107 17360 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:30.213749 17396 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:30.184159 24113 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.215775 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:30.213326 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:30.217226 17322 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:30.215801 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:30.216365 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:30.191299 24086 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.218382 17990 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.218062 17992 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:30.220141 17468 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:30.240891 17468 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:30.206413 24063 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.190966 24019 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.222637 17313 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:30.223495 17314 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:30.223939 24011 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:20:30.246487 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 49148.3us
I20260709 13:20:30.247012 17467 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:30.224167 24136 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:30.225055 24084 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:30.224713 23994 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.226723 24021 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.239158 24113 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.242321 23951 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:30.232519 17465 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:30.243181 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:30.243765 17964 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:30.207423 24098 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.270231 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:30.245059 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:30.248301 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:30.271521 17389 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:30.199350 24147 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:30.207792 24066 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:30.255733 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:30.238077 24109 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:30.288291 24109 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.288528 24098 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.289287 17394 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:30.290184 17316 raft_consensus.cc:2368] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:30.266263 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:30.254012 23720 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:30.244388 17318 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:30.245800 24105 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:20:30.238870 24127 consensus_queue.cc:1048] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
W20260709 13:20:30.272830 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.273379 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:30.273408 24084 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:30.273967 24066 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.275413 24145 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.269846 23994 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.311820 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:30.279196 24077 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:30.281018 24147 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:30.312570 17389 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.282298 24078 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.280826 24065 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:30.290926 17396 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:30.288887 24109 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.270532 23951 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:30.292797 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49129us
I20260709 13:20:30.293272 24104 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.295686 24021 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.333854 23951 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:30.334764 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:30.330924 17964 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:30.338327 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:30.338816 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:30.339551 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:30.339881 24084 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:30.340325 17996 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:30.340464 24084 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:30.341518 24084 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.342039 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:30.342676 17321 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.345155 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:30.346370 17998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:20:30.346863 17998 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.298872 17990 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:30.347191 17998 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:30.348241 17990 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:30.349189 17319 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:30.349381 17990 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:30.263326 24136 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:30.351257 17990 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:30.352339 24136 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:30.300685 17313 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:30.352934 24136 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:30.298481 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:30.299808 17314 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:30.353801 24136 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:30.354254 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56043us
I20260709 13:20:30.355005 17321 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:30.355607 17362 leader_election.cc:400] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 21. Current term is 22.
I20260709 13:20:30.272543 17320 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:30.246098 23750 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
W20260709 13:20:30.309340 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.250620 24063 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:30.281713 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.358547 17393 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:30.330894 17993 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:30.349306 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:30.332253 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:30.360263 17317 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:30.360342 17465 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.362834 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:30.311385 24105 consensus_queue.cc:1243] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:30.369921 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:30.376403 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.357263 24104 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:30.380934 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:30.403242 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:30.422250 17393 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.378408 24133 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:20:30.423470 24161 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.151s	user 0.003s	sys 0.000s
I20260709 13:20:30.381772 24064 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.407946 24145 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:30.409031 24063 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:30.465368 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 102628us
I20260709 13:20:30.466437 17362 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:30.409658 17998 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.410782 24114 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:30.464233 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.328910 24078 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:30.417049 17319 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:30.419248 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:30.421044 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.482044 17466 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.381830 17318 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:20:30.376176 24072 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.956s	user 0.012s	sys 0.003s
I20260709 13:20:30.432245 17465 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:30.435446 17389 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
W20260709 13:20:30.435918 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.436506 17320 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:30.452423 17393 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:30.330628 24065 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.470269 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:30.491178 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:30.492175 24104 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:30.492727 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:30.476665 17316 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:30.494709 17314 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:30.379662 23987 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.103s
I20260709 13:20:30.412206 24113 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.322207 23628 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.492884 17396 raft_consensus.cc:1275] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:30.472275 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:30.473608 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:30.496815 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:30.501191 17466 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:20:30.502621 24019 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.510421 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2286) took 1005 ms. Trace:
I20260709 13:20:30.539426 17471 rpcz_store.cc:276] 0709 13:20:29.505647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.505805 (+   158us) service_pool.cc:224] Handling call
0709 13:20:30.510186 (+1004381us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b5400061654. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:30.510349 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162365312}
I20260709 13:20:30.518369 24138 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.524171 17397 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:30.527276 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 1080) took 1210 ms. Trace:
I20260709 13:20:30.533109 17287 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:30.535910 17462 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.487870 24106 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:30.537428 17465 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:30.541826 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.547708 17396 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:30.543090 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:30.549367 17466 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:30.542397 17394 rpcz_store.cc:276] 0709 13:20:29.328357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.387944 (+ 59587us) service_pool.cc:224] Handling call
0709 13:20:30.527100 (+1139156us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b54001397d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:30.527219 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2038663424}
I20260709 13:20:30.464725 24064 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.551196 17389 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:30.537348 24104 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:30.545085 24138 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.563778 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:30.564121 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.495620 24072 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.540589 23726 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.546607 24131 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:30.583139 17396 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:30.549880 24066 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.592657 17394 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:30.592675 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:30.557126 24147 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:30.554816 23868 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:30.590745 17462 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:30.597503 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:30.604557 17317 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:30.605687 24064 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.559948 23715 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:30.602195 17471 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:20:30.602880 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 355471us
I20260709 13:20:30.614540 17317 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:30.620662 17390 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:30.623289 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:30.589334 24131 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.556504 24086 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.554450 24109 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:30.595858 23260 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:30.601481 24107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.224s	user 0.005s	sys 0.033s
I20260709 13:20:30.597289 24066 raft_consensus.cc:2764] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:30.660059 23715 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:30.661329 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50651.4us
I20260709 13:20:30.661178 23715 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:30.662907 17285 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:30.604068 23868 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:30.670320 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 203988us
I20260709 13:20:30.594345 23726 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:30.651093 24087 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 13:20:30.675846 17991 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:20:30.676221 17991 pending_rounds.cc:85] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 13
I20260709 13:20:30.676424 17991 pending_rounds.cc:107] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:20:30.676709 17991 raft_consensus.cc:2889] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:30.676898 24137 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:30.675601 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:30.677400 24137 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:30.677563 17997 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.581852 24141 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:20:30.647710 24133 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.650758 24131 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.657193 23260 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:30.661048 24107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.283s	user 0.006s	sys 0.033s
I20260709 13:20:30.676457 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:30.688303 17435 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.674s (SENT) [suppressed 28 similar messages]
I20260709 13:20:30.701485 17999 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:30.702744 24175 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.704035 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.678328 24137 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.714557 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.717126 17393 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:30.696866 23260 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.724666 17997 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:30.693713 24133 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.729291 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:30.755225 17998 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:30.767414 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:30.726568 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 253039us
W20260709 13:20:30.780952 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 310758us
I20260709 13:20:30.783952 17360 leader_election.cc:400] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:30.791901 17360 leader_election.cc:403] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:20:30.739715 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:30.764751 24168 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.230s	user 0.001s	sys 0.001s
I20260709 13:20:30.802390 17360 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:30.806193 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:30.799048 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59485.2us
W20260709 13:20:30.800103 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 70932.7us
W20260709 13:20:30.798882 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.764382 23720 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:20:30.797816 24113 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.723395 23868 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:30.832617 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:30.808354 24141 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:30.801017 24165 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:30.716257 24175 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:30.801301 24188 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.843524 17462 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 22: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:30.801182 24170 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:20:30.800853 24071 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:30.829524 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 141258us
I20260709 13:20:30.833120 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:30.827410 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:30.786712 24078 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:30.807668 24064 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.810019 23951 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:30.807050 23987 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:20:30.809638 24066 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:20:30.833212 24019 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.850617 17466 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:30.857913 17434 leader_election.cc:400] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:30.828557 23726 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:30.858843 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 52706.2us
I20260709 13:20:30.845283 24166 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.865429 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:30.870757 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:30.847816 24165 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:30.848253 24072 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.869522 17434 leader_election.cc:403] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:30.882999 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:30.849434 24180 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.861758 24171 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:20:30.853262 24067 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:30.857983 23951 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.895468 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:30.859495 24064 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.898278 24064 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.898808 24064 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:30.899371 17998 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:30.900072 24064 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:30.866367 24106 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:30.869518 24113 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:30.906164 17996 raft_consensus.cc:2368] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:30.907979 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:30.904150 17285 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:30.890003 24071 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:30.960750 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 52841.7us
I20260709 13:20:30.902297 24147 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.895162 23951 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.900581 24064 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:30.892416 24098 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:30.969684 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 65915.1us
I20260709 13:20:30.893114 24086 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:30.974620 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 117019us
W20260709 13:20:30.958664 24179 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 13:20:30.959085 24183 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:30.875334 24019 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.984259 17434 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:30.965327 24071 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.965507 24106 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:30.965181 24109 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:30.971258 24067 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:30.890282 24166 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.894562 24187 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
W20260709 13:20:30.988485 24178 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:20:30.979487 24141 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:31.003878 24181 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:20:30.988989 24071 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:31.005407 24196 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:20:31.003948 24141 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:31.006839 24186 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:20:31.007421 24134 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:31.008038 24193 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:30.997627 24133 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:30.998330 24106 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.010648 24138 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:31.013964 24176 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:20:31.015607 24138 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:31.018039 24064 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:31.025177 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:31.028591 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:31.029258 17317 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:31.030359 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:31.031023 17318 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.036379 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:31.037146 17321 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:20:30.999316 24185 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:20:30.894096 24180 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:30.984652 24027 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:30.981739 24147 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:30.995062 24165 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:30.997881 24197 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:20:31.051364 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.053432 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:31.031169 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:31.083853 17314 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:31.050868 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:31.061173 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:31.062265 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:31.071331 24114 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:31.008406 23756 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:31.101820 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 236467us
I20260709 13:20:31.075551 17393 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:31.076047 17394 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:31.076146 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:31.103914 17396 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:31.076745 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:31.076900 17397 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:31.062145 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:31.079461 17318 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:31.076258 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:30.983134 24098 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:31.031359 23994 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.001s
I20260709 13:20:31.085502 17993 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:31.085588 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:31.094735 17317 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
W20260709 13:20:31.100375 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 49609.2us
I20260709 13:20:31.063825 24188 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:31.072961 24086 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:31.119184 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.123564 17992 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:31.049369 24109 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:20:31.130082 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:31.096552 24114 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:31.133309 17991 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:31.131968 17389 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:31.064488 23987 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:20:31.123245 24102 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.109472 24136 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:31.139730 24136 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:31.140962 24136 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:31.148797 24198 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:20:31.101871 23756 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:31.102097 24193 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:31.137696 24102 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.138381 24114 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.152947 17362 leader_election.cc:400] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20.
I20260709 13:20:31.154495 17362 leader_election.cc:403] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:20:31.164516 24102 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:31.164196 24193 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.136680 24086 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:31.156469 24188 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:31.181571 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.183192 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:31.185635 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:31.176921 17468 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.167739 24114 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:31.194150 24113 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:31.196599 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:31.197486 17317 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:31.197893 17317 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:31.198701 17317 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.201151 17317 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.202791 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:31.212306 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 246920us
I20260709 13:20:31.225800 24072 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:31.227515 17463 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:31.227818 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2418) took 1006 ms. Trace:
I20260709 13:20:31.178630 23750 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20.
I20260709 13:20:31.234414 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:31.228077 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.239626 17388 rpcz_store.cc:276] 0709 13:20:30.221030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.412597 (+191567us) service_pool.cc:224] Handling call
0709 13:20:30.413000 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:30.445081 (+ 32081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.445127 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:30.485287 (+ 40160us) log.cc:844] Serialized 52 byte log entry
0709 13:20:30.823022 (+337735us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:31.202517 (+379495us) log.cc:844] Serialized 14 byte log entry
0709 13:20:31.202743 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.202821 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.202865 (+    44us) raft_consensus.cc:1685] finished
0709 13:20:31.202875 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.227766 (+ 24891us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38352,"prepare.queue_time_us":46807,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":65906,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8203,"thread_start_us":647058,"threads_started":2,"wal-append.queue_time_us":478732}
I20260709 13:20:31.245903 24210 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:31.257992 24210 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.258545 24210 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.259884 24065 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:31.261462 23628 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:31.261548 24216 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:31.262805 24216 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:31.263145 24216 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:31.263928 24216 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.266129 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.269021 24106 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.269320 23897 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:31.269717 24098 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:31.270262 17360 leader_election.cc:400] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:31.270588 17360 leader_election.cc:403] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:20:31.271672 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:31.272918 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:31.273034 24187 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.273583 17388 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 13: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:31.274441 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:31.277673 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.278223 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.278476 17463 raft_consensus.cc:2410] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:20:31.250648 23994 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:31.280726 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:31.280850 23994 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.281430 17469 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:31.282071 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.282661 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.283226 17463 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:31.283988 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:31.284741 24077 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:31.285146 24077 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:31.285912 24077 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.287042 17991 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:31.287137 24077 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.289641 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:31.291208 24021 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:31.291608 24021 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:31.254496 24072 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:31.292394 24021 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.293514 24021 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.295120 23720 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:31.295540 24067 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:31.295907 24067 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:31.296654 24067 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.297794 24067 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.293352 24072 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.283491 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.300876 24180 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:31.301206 17466 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:31.304729 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.305017 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.305449 17462 raft_consensus.cc:2368] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:31.305804 17471 raft_consensus.cc:2368] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:31.293363 23715 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:31.307855 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.309175 17466 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:31.314574 17462 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:31.289685 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:31.283149 23994 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:31.315205 17317 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:20:31.340476 17469 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:31.228291 24215 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:31.345595 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:31.345321 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.345562 17996 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:20:31.339627 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.348760 17394 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:31.350078 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:31.347937 17393 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:31.351948 17962 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:31.352922 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:31.354167 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:31.355975 17397 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:31.360745 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:31.293298 24216 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.269734 24106 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:31.368330 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:31.372928 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.377636 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.379534 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:31.381369 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:31.382061 17469 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:31.383749 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:31.385142 17469 raft_consensus.cc:2368] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20.
I20260709 13:20:31.387791 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:31.388403 17388 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:31.197382 23756 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.346501 24019 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:31.347916 24147 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:31.396092 24221 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:31.418058 24221 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:31.418946 24221 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.420239 24221 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:31.404139 24200 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:20:31.404536 24206 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:20:31.340751 23951 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.361354 24166 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:31.423605 23951 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:31.405290 24222 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:20:31.319284 24134 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:20:31.359802 24086 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.426939 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 1225) took 1185 ms. Trace:
I20260709 13:20:31.427330 17992 rpcz_store.cc:276] 0709 13:20:30.241515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.258953 (+ 17438us) service_pool.cc:224] Handling call
0709 13:20:31.426761 (+1167808us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54002afdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:31.426861 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960801664}
I20260709 13:20:31.319783 23987 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:20:31.430158 23987 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:31.430493 23987 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:31.431286 23987 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.432461 23987 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.318953 24066 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:20:31.434324 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2135) took 1171 ms. Trace:
I20260709 13:20:31.434724 17313 rpcz_store.cc:276] 0709 13:20:30.263036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.353258 (+ 90222us) service_pool.cc:224] Handling call
0709 13:20:30.353552 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.542827 (+189275us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:30.787535 (+244708us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.965839 (+178304us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.982036 (+ 16197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.982098 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:30.982143 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.434056 (+451913us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400369a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:31.434105 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.434245 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78626,"prepare.queue_time_us":222802,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":73593,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":12111,"spinlock_wait_cycles":447503744,"thread_start_us":336559,"threads_started":2,"wal-append.queue_time_us":223123}
I20260709 13:20:31.438961 24071 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:31.441114 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.442060 23756 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.442651 17468 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:31.372265 24109 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.451085 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:31.454567 24192 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:31.455147 24192 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.457086 24071 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:31.416667 23260 consensus_meta.cc:287] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.002s
I20260709 13:20:31.457981 23260 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.459275 17316 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:20:31.460140 23260 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:31.462248 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.436760 24131 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.737s	user 0.004s	sys 0.004s
I20260709 13:20:31.465243 24131 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.466361 17321 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:31.467360 24131 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:31.467717 24028 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:31.465276 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:31.468608 17396 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:31.469636 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:31.470379 17396 raft_consensus.cc:2368] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:20:31.471161 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:31.389633 24133 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:20:31.477062 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.371970 24193 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:31.370695 23628 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:31.474349 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:31.501709 17466 raft_consensus.cc:2368] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:31.474591 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:31.475831 17471 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:31.389294 24138 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:31.452756 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:31.487905 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.492441 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:31.505261 17318 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.494781 17388 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:31.505880 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:31.506523 17313 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.506639 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:31.507681 17469 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:31.498231 17320 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:31.497552 17468 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:20:31.511742 17992 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:31.520323 17318 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:31.523841 17395 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:20:31.525663 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 72977.4us
I20260709 13:20:31.529906 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:31.530260 17320 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:20:31.538292 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1156) took 1333 ms. Trace:
I20260709 13:20:31.540640 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:31.541792 17396 raft_consensus.cc:2368] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:20:31.490370 24066 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:31.544463 17286 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:31.545784 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:31.539016 17468 rpcz_store.cc:276] 0709 13:20:30.176865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.216256 (+ 39391us) service_pool.cc:224] Handling call
0709 13:20:30.220029 (+  3773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.173885 (+953856us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002e0ca0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d6277206f 00007f7d627eaf60 00007f7d627ec7de 00007f7d627f6b49 00007f7d627f7416 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62
0709 13:20:31.442229 (+268344us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5800634ad0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627500aa 00007f7d627d2447 00007f7d627eafe7 00007f7d627ec7de 00007f7d627f6b49 00007f7d627f7416 00007f7d627f3d8f 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4
0709 13:20:31.510040 (+ 67811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.510228 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571806848}
W20260709 13:20:31.538923 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 1085) took 2141 ms (client timeout 1731 ms). Trace:
I20260709 13:20:31.536481 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:31.548429 17388 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:31.317641 24113 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.511579 24071 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:31.549876 17390 rpcz_store.cc:269] 0709 13:20:29.371397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.396140 (+ 24743us) service_pool.cc:224] Handling call
0709 13:20:31.512403 (+2116263us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540023c8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:31.512515 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2758153472}
I20260709 13:20:31.553395 17999 raft_consensus.cc:1217] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Deduplicated request from leader. Original: 15.13->[17.14-18.15]   Dedup: 18.15->[]
I20260709 13:20:31.564319 17999 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: [17.14-18.15]
I20260709 13:20:31.554289 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.551371 24066 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.490697 24087 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:20:31.522921 23628 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:31.584983 24213 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:31.585584 24213 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:31.585986 24213 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.589191 24207 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.594307 24087 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:31.594856 24087 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:31.595800 24087 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.571332 24066 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.602552 24109 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:31.603010 24109 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:31.603852 24109 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.605739 24192 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:31.608546 24175 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:31.609139 24087 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.610055 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:31.610898 17467 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:31.613091 24109 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.615587 24210 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.618106 17314 raft_consensus.cc:2368] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
W20260709 13:20:31.618602 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.619050 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.546501 24138 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:31.562276 24133 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.571480 24147 raft_consensus.cc:2764] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:20:31.545960 24140 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:20:31.641400 24138 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.643972 17360 leader_election.cc:400] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:31.644385 17360 leader_election.cc:403] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:31.638669 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:31.646132 17468 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:31.639634 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 68997.4us
I20260709 13:20:31.547473 23951 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:20:31.572827 24071 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.558547 24072 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:31.649837 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.649665 17313 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
W20260709 13:20:31.650949 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.551608 24078 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:20:31.552104 24189 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 13:20:31.656709 17470 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:20:31.658314 17470 pending_rounds.cc:85] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 11
I20260709 13:20:31.658578 17470 pending_rounds.cc:107] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:20:31.655220 17360 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:31.658812 17470 raft_consensus.cc:2889] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:31.664980 24072 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:31.666471 24071 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:31.666128 24072 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.655875 24106 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.692540 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:31.693639 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45764.2us
I20260709 13:20:31.696962 17463 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:20:31.700564 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 170788us
I20260709 13:20:31.705291 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:31.707787 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:31.694365 24113 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:31.698104 24071 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:31.707882 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.712916 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:31.715382 17995 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:31.717199 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:31.719834 17313 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:20:31.725955 24235 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:20:31.731961 24066 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.733179 24221 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:31.733656 24221 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:31.734045 24221 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.716728 24032 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:31.737232 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:31.737898 17314 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.745002 24113 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:31.747581 17362 leader_election.cc:400] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:31.749271 17362 leader_election.cc:400] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:31.750468 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.701977 24078 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:20:31.758539 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:31.759323 17995 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.755263 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:31.712123 24192 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:31.764530 17394 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
I20260709 13:20:31.766453 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.700366 24019 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:20:31.713021 24071 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:31.747160 24187 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:31.763746 23756 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.776988 24032 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:31.780501 24085 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.783849 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:31.785063 24239 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:31.786235 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2460) took 1582 ms. Trace:
I20260709 13:20:31.788581 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.746035 24113 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.774813 24077 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.784057 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:31.792529 17316 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:31.794330 17388 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:31.795787 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:31.749876 24021 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.754096 24066 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:31.808920 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:31.704223 23628 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.812127 24239 consensus_queue.cc:1243] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:31.817487 24212 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.821355 24142 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:31.758244 24107 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:20:31.825919 17314 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:31.809666 17315 rpcz_store.cc:276] 0709 13:20:30.204288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.204416 (+   128us) service_pool.cc:224] Handling call
0709 13:20:30.206300 (+  1884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.357158 (+150858us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:30.601334 (+244176us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.871520 (+270186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.871593 (+    73us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:30.871657 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.785993 (+914336us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001419d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:31.786041 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.786178 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7615,"prepare.queue_time_us":344617,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":12033,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4583,"spinlock_wait_cycles":346419456,"thread_start_us":478159,"threads_started":2,"wal-append.queue_time_us":419812}
W20260709 13:20:31.833271 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44761.8us
I20260709 13:20:31.838502 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:31.763753 24175 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:20:31.850517 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.809474 17995 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:31.799603 24192 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:31.856663 17362 leader_election.cc:400] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20.
I20260709 13:20:31.857955 17362 leader_election.cc:403] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:20:31.860651 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:31.862090 24032 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:31.841118 23987 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.866495 23994 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.846179 24064 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:20:31.841445 24067 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:20:31.868609 24066 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.867061 23994 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.850229 24077 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.870460 24077 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.871523 23994 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:31.837000 24210 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:31.801191 24084 consensus_queue.cc:1048] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:20:31.873656 17435 leader_election.cc:400] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:20:31.836530 24134 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.877410 17362 leader_election.cc:400] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:31.851173 24142 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:31.808420 24085 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:31.874428 17435 leader_election.cc:403] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:20:31.873759 24240 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:20:31.886277 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:31.858675 24189 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.890992 17465 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.878970 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.897341 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:31.900023 17435 leader_election.cc:400] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:20:31.897317 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:31.900604 17435 leader_election.cc:403] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:31.900899 17468 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.904781 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:31.879691 24107 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.906419 17469 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:31.889211 24142 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.891644 24109 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:31.916491 17465 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:31.903833 24212 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:31.953725 17469 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:31.905917 23987 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.989607 17468 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:31.909574 24134 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:32.008396 24176 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:32.013554 24138 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:20:32.061697 24241 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:20:32.021888 24141 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.029500 24077 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:32.088747 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:32.091722 17995 raft_consensus.cc:2410] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:31.977048 24192 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.088980 24086 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:32.146503 24086 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.091449 24207 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:32.089314 23994 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:32.089821 24141 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.149230 23994 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.151262 23994 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:32.151262 24141 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:32.102111 24243 log.cc:927] Time spent T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:32.098037 24065 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:20:32.110319 24087 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.003s
W20260709 13:20:32.129087 24213 consensus_meta.cc:287] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.006s
I20260709 13:20:32.135068 24212 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.141739 24085 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:32.166327 24212 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.173501 24212 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:32.174010 24212 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.174542 24212 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.168681 24085 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:32.177554 24085 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.180051 24085 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:32.165395 24213 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.160506 24065 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.189446 24065 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:32.197147 24086 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:32.203836 24221 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.206857 24221 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:32.210979 24107 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20.
I20260709 13:20:32.307796 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3812) took 1233 ms. Trace:
I20260709 13:20:32.308228 17389 rpcz_store.cc:276] 0709 13:20:31.074466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.076523 (+  2057us) service_pool.cc:224] Handling call
0709 13:20:32.307602 (+1231079us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b5400254254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:32.307735 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60713216}
I20260709 13:20:32.309433 23868 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.314347 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2475) took 1280 ms. Trace:
I20260709 13:20:32.314829 17319 rpcz_store.cc:276] 0709 13:20:31.033830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.033961 (+   131us) service_pool.cc:224] Handling call
0709 13:20:31.034305 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.110496 (+ 76191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.110528 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.137030 (+ 26502us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.363666 (+226636us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:31.363861 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.313854 (+949993us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54003e17d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:32.313919 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.313982 (+    63us) raft_consensus.cc:1685] finished
0709 13:20:32.314002 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.314271 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3449,"raft.queue_time_us":17400,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":29815,"spinlock_wait_cycles":166392192,"thread_start_us":189617,"threads_started":1,"wal-append.queue_time_us":288914}
W20260709 13:20:32.302438 24106 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.604s	user 0.012s	sys 0.000s
I20260709 13:20:32.290395 24212 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:32.220482 24086 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.240463 17996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1236) took 1176 ms. Trace:
I20260709 13:20:32.366767 17996 rpcz_store.cc:276] 0709 13:20:31.063619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.075214 (+ 11595us) service_pool.cc:224] Handling call
0709 13:20:31.075498 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.347216 (+271718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.240137 (+892921us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400084154. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:32.240368 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617333120}
W20260709 13:20:32.370760 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 470876us
I20260709 13:20:32.372228 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:32.372991 17467 raft_consensus.cc:2393] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:32.374466 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:32.375671 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:32.377115 17468 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
W20260709 13:20:32.379035 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:32.379729 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.399958 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:32.219784 24138 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:20:32.405148 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:32.416289 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:32.416917 17393 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.361747 24106 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
W20260709 13:20:32.401198 24032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.056s	sys 0.080s
I20260709 13:20:32.356287 24109 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:32.438052 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.413555 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:32.441118 17316 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:32.413746 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:32.402411 24212 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.437237 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:32.406718 23987 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:20:32.448098 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:32.408416 24087 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:32.533609 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 78318.7us
I20260709 13:20:32.537427 24087 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.538993 17997 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:32.542016 17393 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
W20260709 13:20:32.421746 24032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.056s	sys 0.080s
I20260709 13:20:32.410775 24077 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:32.545176 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:32.412663 24085 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:32.417969 24137 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.558900 24137 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.560379 17320 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:32.417969 24134 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.561225 24134 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.563325 24134 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:32.565153 24137 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:32.565913 17218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 221) took 25964 ms (client timeout 15000 ms). Trace:
I20260709 13:20:32.383354 24086 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.585990 24086 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:32.586902 24109 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.590112 24124 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.583033 24085 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.590728 24124 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.592039 24085 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:32.582401 17462 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:32.407935 24180 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.139s
W20260709 13:20:32.597011 17396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.060s	sys 0.144s
W20260709 13:20:32.600054 17396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.060s	sys 0.144s
I20260709 13:20:32.415318 24107 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.140s
I20260709 13:20:32.418435 24175 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.152s
I20260709 13:20:32.369369 24071 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.592787 24124 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:32.638029 17467 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:32.615993 24207 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:32.656621 17388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.006s	sys 0.019s
I20260709 13:20:32.610927 24187 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:32.630199 24142 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.694s	user 0.012s	sys 0.000s
W20260709 13:20:32.566363 17218 rpcz_store.cc:269] 0709 13:20:06.415864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.416216 (+   352us) service_pool.cc:224] Handling call
0709 13:20:32.367271 (+25951055us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:25.710557 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:25.780696 (+ 70139us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:25.780737 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:20:25.780757 (+    20us) tablet.cc:662] Decoding operations
0709 13:20:25.915746 (+134989us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:25.919304 (+  3558us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:25.925885 (+  6581us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:20:25.983515 (+ 57630us) tablet.cc:701] Row locks acquired
0709 13:20:25.983539 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:20:25.983743 (+   204us) write_op.cc:270] Start()
0709 13:20:25.983902 (+   159us) write_op.cc:276] Timestamp: P: 1783603225983678 usec, L: 0
0709 13:20:25.983928 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:20:25.995303 (+ 11375us) log.cc:844] Serialized 7436 byte log entry
0709 13:20:26.531041 (+535738us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627efe28 00007f7d6622a581 00007f7d66229d58 00007f7d6622e9f1 00007f7d6622e9a9 00007f7d6622e939 00007f7d6622e901 00007f7d6622db2d 000000000038f354 000000000038f199
0709 13:20:27.000461 (+469420us) op_driver.cc:464] REPLICATION: finished
0709 13:20:27.198042 (+197581us) write_op.cc:301] APPLY: starting
0709 13:20:27.198210 (+   168us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:27.625493 (+427283us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:27.631406 (+  5913us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:28.237069 (+605663us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:28.237467 (+   398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:20:28.237540 (+    73us) write_op.cc:312] APPLY: finished
0709 13:20:28.238051 (+   511us) log.cc:844] Serialized 172 byte log entry
0709 13:20:28.342064 (+104013us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:28.397641 (+ 55577us) write_op.cc:454] Released schema lock
0709 13:20:28.450161 (+ 52520us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:28.530395 (+ 80234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:28.540887 (+ 10492us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":779311,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":165635,"apply.run_cpu_time_us":54237,"apply.run_wall_time_us":1319920,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83547,"num_ops":19,"prepare.queue_time_us":203390,"prepare.run_cpu_time_us":49274,"prepare.run_wall_time_us":845959,"raft.queue_time_us":424117,"raft.run_cpu_time_us":9050,"raft.run_wall_time_us":72433,"replication_time_us":1016263,"spinlock_wait_cycles":9345792,"thread_start_us":503596,"threads_started":5,"wal-append.queue_time_us":452685,"wal-append.run_cpu_time_us":14362,"wal-append.run_wall_time_us":2595483}]]}
I20260709 13:20:32.554350 24212 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.597720 24077 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.628917 24188 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:32.658535 23628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.045s	sys 0.056s
I20260709 13:20:32.657771 24032 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:32.681061 17998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.001s	sys 0.036s
W20260709 13:20:32.681528 17998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.002s	sys 0.036s
W20260709 13:20:32.676477 17388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.007s	sys 0.019s
W20260709 13:20:32.678858 17391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.009s	sys 0.026s
W20260709 13:20:32.684711 17391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.009s	sys 0.026s
W20260709 13:20:32.675761 23628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.046s	sys 0.056s
I20260709 13:20:32.658433 24207 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.720198 24138 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:32.754369 24250 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:20:32.754526 24138 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.757134 24212 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:32.675200 24142 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.760334 24142 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:32.691320 24032 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.762671 24032 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:32.765441 24261 log.cc:927] Time spent T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:20:32.690286 23978 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:32.767230 23978 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.774243 24077 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:32.679787 24188 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.776906 24188 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:32.756755 24138 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:32.821254 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:32.795401 24064 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:32.795662 24188 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:32.817662 24114 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:32.827473 23994 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:32.827148 24086 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
W20260709 13:20:32.843562 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 431386us
W20260709 13:20:32.849629 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 311209us
W20260709 13:20:32.850394 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 472819us
W20260709 13:20:32.850970 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 438636us
I20260709 13:20:32.828676 24188 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.898192 24188 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:32.829483 24064 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.833827 24114 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.877595 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39712 (request call id 8) took 1408 ms. Trace:
I20260709 13:20:32.905506 17321 rpcz_store.cc:276] 0709 13:20:31.469041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.469179 (+   138us) service_pool.cc:224] Handling call
0709 13:20:32.724464 (+1255285us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b54003910a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d62771520 00007f7d627fab42 00007f7d627f9800 00007f7d627f29fa 00007f7d677ba4c9 00007f7d60d36c54 00007f7d60d36be2 00007f7d60d36b11 00007f7d60d36a8c 00007f7d60d35d42
0709 13:20:32.877335 (+152871us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400211e54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627fa735 00007f7d627f29fa 00007f7d677ba4c9 00007f7d60d36c54 00007f7d60d36be2 00007f7d60d36b11 00007f7d60d36a8c 00007f7d60d35d42 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:32.877510 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351583232}
I20260709 13:20:32.862138 24138 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.896250 23756 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.902341 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:32.864883 24142 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.866014 24253 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:32.963652 24253 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.965977 24253 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:32.966907 24260 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:20:32.968436 24252 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:20:32.970404 24262 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:20:32.970482 17286 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:32.971804 24180 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:32.972548 24180 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.975162 24180 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:32.975771 24180 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:32.977931 24124 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:32.978267 24114 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:32.978673 24124 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:32.979872 24124 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:32.949484 17395 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.049s	sys 0.090s
W20260709 13:20:32.994212 17395 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.050s	sys 0.090s
I20260709 13:20:32.954041 24138 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:32.961588 24258 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:20:32.962689 24142 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:32.981560 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:32.950874 24175 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.982656 23756 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:32.947835 24085 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.948010 23260 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:32.984912 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:32.986138 24032 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.986931 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3823) took 1224 ms. Trace:
W20260709 13:20:32.987684 17204 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b19033ecd72e4ba188910445b70c84d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:20:32.976327 24180 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.026800 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3829) took 1237 ms. Trace:
I20260709 13:20:32.993335 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:32.995728 17313 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:32.998339 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:33.048558 17393 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:33.025039 24267 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:32.989575 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3822) took 1227 ms. Trace:
I20260709 13:20:33.063223 17391 rpcz_store.cc:276] 0709 13:20:31.762319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.764424 (+  2105us) service_pool.cc:224] Handling call
0709 13:20:31.795141 (+ 30717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.828754 (+ 33613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.828787 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.841022 (+ 12235us) log.cc:844] Serialized 26 byte log entry
0709 13:20:32.685261 (+844239us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:32.950814 (+265553us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.989186 (+ 38372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.989288 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.989340 (+    52us) raft_consensus.cc:1685] finished
0709 13:20:32.989360 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.989510 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71124,"raft.queue_time_us":99607,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":15155,"thread_start_us":1025343,"threads_started":2,"wal-append.queue_time_us":1015129}
I20260709 13:20:33.064968 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:32.990705 24109 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.987684 24087 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.026412 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.049368 17388 rpcz_store.cc:276] 0709 13:20:31.789723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.936981 (+147258us) service_pool.cc:224] Handling call
0709 13:20:32.006551 (+ 69570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:32.006895 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.006926 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:32.015539 (+  8613us) log.cc:844] Serialized 26 byte log entry
0709 13:20:32.684740 (+669201us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:32.684800 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.684921 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.026585 (+341664us) raft_consensus.cc:1685] finished
0709 13:20:33.026603 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.026747 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3044,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5364,"thread_start_us":629227,"threads_started":1,"wal-append.queue_time_us":812118}
W20260709 13:20:33.077271 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 250575us
I20260709 13:20:33.053442 17468 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:20:33.016721 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 114422us
I20260709 13:20:33.037499 23260 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.055478 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.055744 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.056710 17471 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:20:33.093330 17465 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:33.093794 17471 pending_rounds.cc:85] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 15
I20260709 13:20:33.094195 17471 pending_rounds.cc:107] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:20:33.094471 17471 raft_consensus.cc:2889] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.057878 17466 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:33.060926 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:33.061465 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 298952us
W20260709 13:20:32.945639 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46526us
I20260709 13:20:33.098543 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.093473 17469 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:33.019328 24212 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.026160 17396 rpcz_store.cc:276] 0709 13:20:31.762687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.762813 (+   126us) service_pool.cc:224] Handling call
0709 13:20:31.793214 (+ 30401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.829393 (+ 36179us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:31.852242 (+ 22849us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.600618 (+748376us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:32.609133 (+  8515us) log.cc:844] Serialized 26 byte log entry
0709 13:20:32.609354 (+   221us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:32.609402 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.609571 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.986639 (+377068us) raft_consensus.cc:1685] finished
0709 13:20:32.986665 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.986835 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4811,"prepare.queue_time_us":22785,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":72,"raft.queue_time_us":15907,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":29526,"thread_start_us":711682,"threads_started":1,"wal-append.queue_time_us":947282}
I20260709 13:20:33.052013 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.055154 17464 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:33.123534 17467 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:33.076860 17392 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:33.083917 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:33.086161 17393 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:33.094872 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.126423 17390 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:33.126478 17465 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:33.101521 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.122437 17998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1232) took 2095 ms. Trace:
I20260709 13:20:33.123293 17394 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:33.048882 24251 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:33.158288 24251 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.027367 24085 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.156170 24138 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.128499 17998 rpcz_store.cc:276] 0709 13:20:31.026677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.027435 (+   758us) service_pool.cc:224] Handling call
0709 13:20:31.027876 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.028329 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.028372 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.059377 (+ 31005us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.787524 (+728147us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b18004bdde0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:20:32.682160 (+894636us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:32.682220 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.682324 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.081013 (+398689us) raft_consensus.cc:1685] finished
0709 13:20:33.081033 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.122368 (+ 41335us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":25323,"spinlock_wait_cycles":11743616,"thread_start_us":894387,"threads_started":1,"wal-append.queue_time_us":1770024}
I20260709 13:20:33.023866 24175 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.164819 24175 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.147555 17470 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:33.148655 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.166244 17391 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:33.167430 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.168388 17391 raft_consensus.cc:2410] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:33.170784 24251 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:33.162086 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:33.174463 24137 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:33.175302 24137 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:33.176551 24137 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.174952 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:33.080682 24270 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:33.043483 24032 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:33.227826 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45551.1us
I20260709 13:20:33.233453 23994 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:33.233904 24166 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:33.234095 23994 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.239300 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.088204 24067 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.147s
I20260709 13:20:33.088905 24114 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.141s
I20260709 13:20:33.145788 24264 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:33.174321 24085 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.152390 24087 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.266882 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.088449 24109 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.239568 24166 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.236234 23994 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.235893 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:33.238782 24028 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:33.180886 24019 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:20:33.147270 24212 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.239806 24268 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:33.277304 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.253041 17390 raft_consensus.cc:2410] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:20:33.248343 24105 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:33.249912 24175 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.264880 24078 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.309087 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:33.313462 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 76190.4us
I20260709 13:20:33.320609 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.321868 17394 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:33.316926 17390 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:33.324951 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:33.325747 17994 raft_consensus.cc:2410] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:33.328295 17998 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:20:33.328708 17998 pending_rounds.cc:85] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 11
I20260709 13:20:33.328946 17998 pending_rounds.cc:107] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:20:33.329188 17998 raft_consensus.cc:2889] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.330798 17994 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:33.304639 24085 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:33.332473 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.337173 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.330703 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.334358 17394 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:33.334837 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.339272 17996 raft_consensus.cc:2393] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:33.308831 24265 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.335731 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.241756 24270 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.346443 17999 raft_consensus.cc:2410] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:20:33.318728 24269 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.277482 24087 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.323400 24155 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.358140 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.278229 24166 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.331331 24064 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.331650 23720 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:33.270746 24264 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.317792 23994 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:20:33.336527 24085 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:33.375620 24290 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:33.381001 24277 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:20:33.382236 17319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2149) took 1006 ms. Trace:
I20260709 13:20:33.323767 24105 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.345124 24279 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:33.383704 17999 raft_consensus.cc:1275] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:33.386035 17319 rpcz_store.cc:276] 0709 13:20:32.375656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.376724 (+  1068us) service_pool.cc:224] Handling call
0709 13:20:32.377060 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:32.389323 (+ 12263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.389372 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:33.272678 (+883306us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b2c00014ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:20:33.278467 (+  5789us) log.cc:844] Serialized 26 byte log entry
0709 13:20:33.356002 (+ 77535us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:33.356045 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.356119 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.381939 (+ 25820us) raft_consensus.cc:1685] finished
0709 13:20:33.381962 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.382180 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11828,"raft.queue_time_us":34347,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":6390,"spinlock_wait_cycles":32132480,"thread_start_us":24138,"threads_started":1,"wal-append.queue_time_us":97383}
I20260709 13:20:33.383173 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.353482 24180 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.325955 24175 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.351553 23756 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.398633 24175 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.433766 24180 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:33.434492 24180 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.437330 24180 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.328437 24078 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.323449 24268 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.441612 24138 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.498052 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.504629 17993 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:33.363313 24269 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.389544 24085 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:33.507071 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.510349 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:33.511446 17319 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:33.519140 17390 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:33.520033 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.511512 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.391983 24279 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:33.467902 23756 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.493993 24192 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:33.533911 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.524545 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.525503 17999 raft_consensus.cc:2410] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:20:33.526165 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:33.527392 17319 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:33.386140 23720 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.353803 24265 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.375231 24155 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.543126 24265 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:33.523298 24274 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 13:20:33.521133 24189 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:33.531849 24279 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:33.539899 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:33.524775 24273 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:20:33.546361 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.548667 17992 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:33.536502 17316 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 13.
I20260709 13:20:33.444914 24290 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.590070 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.583276 17993 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:33.532505 23628 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:33.584606 17322 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:33.588799 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.576930 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.530947 23260 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:33.593580 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 65336.9us
I20260709 13:20:33.518457 24138 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.545799 24155 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.546110 24302 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:33.546729 23720 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.597644 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.584129 24032 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:33.633195 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.634435 17991 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:33.546976 23994 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:33.588943 24028 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:33.641438 24028 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.595376 23628 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:33.644366 23628 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.541275 23756 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.647518 23756 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.648021 23756 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.649212 24166 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:33.635842 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.544543 24192 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.594480 24109 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:33.654402 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.657285 17471 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
W20260709 13:20:33.661346 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 62597.6us
I20260709 13:20:33.663626 17992 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:33.664758 24268 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:33.669072 24285 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:20:33.535946 24280 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.102s
I20260709 13:20:33.648469 23756 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.695559 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.696426 17471 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:33.595091 24189 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.700953 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:33.653870 24212 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:33.670727 24283 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 13:20:33.702561 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:33.706290 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.706797 17285 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:33.699923 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 173866us
I20260709 13:20:33.708828 17360 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:33.702040 24309 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:20:33.711890 24310 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:20:33.713440 24289 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:20:33.721589 24269 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.696257 24087 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.725278 24105 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.726452 24307 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:33.639788 24302 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.708415 23260 consensus_queue.cc:1048] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:20:33.729259 24192 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.702530 24124 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:20:33.733896 24189 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.700930 24304 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:20:33.708266 23868 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:33.735189 24264 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:33.706036 24281 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
W20260709 13:20:33.738112 24300 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:20:33.739705 24207 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.739843 24138 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.746464 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.823939 17390 raft_consensus.cc:2468] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:33.824467 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.824880 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.747651 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.741889 24137 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:33.755249 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 46495.8us
I20260709 13:20:33.730674 24213 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.752919 24270 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.757361 24307 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.842272 24307 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:33.831619 24137 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.845299 24137 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:33.805687 24286 log.cc:927] Time spent T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 13:20:33.806102 24278 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 13:20:33.847354 24301 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:33.847483 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3831) took 1443 ms. Trace:
I20260709 13:20:33.807806 24302 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.848701 24302 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:33.849298 24302 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.849596 24308 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:33.808316 17466 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 23.
I20260709 13:20:33.756363 24086 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:20:33.754580 23628 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.810144 24290 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:33.810617 24267 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:33.812671 24113 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:33.815223 24142 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.819032 24071 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:33.820047 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.834020 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.852756 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3832) took 1448 ms. Trace:
I20260709 13:20:33.857826 17389 rpcz_store.cc:276] 0709 13:20:32.404379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.404487 (+   108us) service_pool.cc:224] Handling call
0709 13:20:32.421798 (+ 17311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:32.810476 (+388678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.810551 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:32.818479 (+  7928us) log.cc:844] Serialized 26 byte log entry
0709 13:20:33.238038 (+419559us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:33.238080 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.238523 (+   443us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.852532 (+614009us) raft_consensus.cc:1685] finished
0709 13:20:33.852556 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.852698 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141821,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"thread_start_us":773837,"threads_started":2,"wal-append.queue_time_us":528094}
I20260709 13:20:33.859689 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.860307 17389 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
W20260709 13:20:33.861647 24306 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:20:33.861881 24267 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.862424 24267 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:33.835095 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.800292 24087 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:20:33.864140 24113 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:33.865785 17464 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:33.801710 23868 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.866466 23628 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.867880 23868 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:33.853289 24314 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.869434 24314 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.870648 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.868708 17394 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:33.871253 17396 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
W20260709 13:20:33.871578 24316 log.cc:927] Time spent T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:20:33.871780 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.872069 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.827152 24309 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:33.872766 24309 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:33.873659 24113 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.874264 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:33.874768 24113 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:33.875365 17464 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:33.876042 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.876674 17392 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:33.877537 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.847972 17395 rpcz_store.cc:276] 0709 13:20:32.404084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.405996 (+  1912us) service_pool.cc:224] Handling call
0709 13:20:32.406295 (+   299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:32.994564 (+588269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.994594 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:33.021424 (+ 26830us) log.cc:844] Serialized 52 byte log entry
0709 13:20:33.278769 (+257345us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:33.278806 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.278878 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.847196 (+568318us) raft_consensus.cc:1685] finished
0709 13:20:33.847227 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.847425 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6977,"raft.queue_time_us":157234,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":805414,"threads_started":2,"wal-append.queue_time_us":459801}
I20260709 13:20:33.839061 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.884881 17997 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:33.872882 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:33.887197 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.887820 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47499.6us
I20260709 13:20:33.889724 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:33.889854 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.892544 17316 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:33.872612 17396 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:33.895175 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:33.895810 17397 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:33.900502 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.832132 24084 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.908118 17322 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:33.909376 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.832384 24315 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.931655 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.937462 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.958881 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.961087 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.959833 17320 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:33.966444 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:33.936620 24309 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:33.973310 24309 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:33.977093 23628 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:33.977530 24085 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.978634 24314 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.987006 17962 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:33.989368 23628 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:33.989854 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.990688 17962 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:33.991523 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:33.991906 24137 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.994132 17319 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:33.994405 23628 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:33.995368 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:33.995126 17216 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 12 to 13, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 13 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:33.939682 24066 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:20:33.996873 24245 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.914s	user 0.003s	sys 0.012s
I20260709 13:20:33.997184 24066 consensus_queue.cc:1243] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:33.997738 24066 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:33.933960 24062 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:33.957719 24084 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:33.999935 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:34.001031 24084 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:34.001394 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:34.002008 17463 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:34.003506 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.004511 17319 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:33.998122 24066 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:34.005916 24066 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:34.006464 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.007118 24066 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:34.007380 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.896309 24087 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:20:33.927693 24064 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:34.011500 24064 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.013681 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.970435 24280 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:20:34.025497 17317 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:34.015136 17320 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:34.015918 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:34.016582 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:34.018363 24302 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:34.026158 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:34.032223 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:34.034055 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:34.035478 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:34.035960 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:34.026670 24106 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:34.037140 24106 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.037354 24166 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:34.037434 24267 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.039592 24267 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:34.028792 24062 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.040320 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:34.041730 24062 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:34.042488 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:34.018930 24064 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:34.035399 24087 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:34.020668 23978 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:33.937188 24315 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.021759 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.027617 24085 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:34.022266 23628 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:34.039206 24166 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:33.957079 23756 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:34.039315 23868 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:34.003420 17462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2324) took 1628 ms (client timeout 1791 ms). Trace:
I20260709 13:20:34.023180 24279 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:34.061599 17462 rpcz_store.cc:269] 0709 13:20:32.375311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.375441 (+   130us) service_pool.cc:224] Handling call
0709 13:20:34.003224 (+1627783us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54001f0c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:34.003322 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445936000}
I20260709 13:20:34.036412 17469 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:34.047335 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:33.997911 17216 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 15 to 19, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 19 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.047753 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:34.078763 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:33.998047 24137 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:34.050746 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.053761 17322 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:34.055081 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:34.080478 17320 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:34.056686 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.055912 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:34.081456 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.082065 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.080518 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:34.084352 17462 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:34.085528 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:34.082172 17394 raft_consensus.cc:2368] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:34.086886 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:34.082504 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:34.035861 24142 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:34.039697 24084 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:34.089622 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:34.039225 24106 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:34.092521 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.092756 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:34.093195 17389 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:34.092545 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.094892 17317 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:34.052348 24166 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.101542 17321 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 21: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:34.096077 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:34.097074 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.051043 23628 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:34.088541 23978 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:34.113195 23978 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.113613 23978 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.097577 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:34.100768 17216 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 23. New cstate: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:34.118119 17465 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:34.117749 17216 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 6 to 16, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 16 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:34.119537 17216 catalog_manager.cc:5697] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 12 to 18, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 18 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.098928 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.104949 17990 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:34.105939 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:34.122347 24279 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:34.123229 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.123885 17391 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:34.124768 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.125432 17391 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:34.125650 17998 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:34.106961 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.048884 23994 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:20:34.146781 23756 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:34.126261 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.672776 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:34.673636 17391 raft_consensus.cc:2368] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18.
I20260709 13:20:34.674474 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.675228 23756 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:34.133028 17463 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:34.677512 23756 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:34.188648 17397 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:20:34.678308 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:34.678845 17397 pending_rounds.cc:85] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 12
I20260709 13:20:34.679198 17397 pending_rounds.cc:107] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:20:34.192947 24322 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:34.679673 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:34.679818 17397 raft_consensus.cc:2889] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:34.680549 24266 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.129731 17362 connection.cc:256] RPC call timeout handler was delayed by -1.3112288249999438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 13:20:34.681644 17362 connection.cc:256] RPC call timeout handler was delayed by -1.133028824999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 13:20:34.681218 24266 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:34.154752 24106 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.685554 24106 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.189813 24321 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.688112 24106 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:34.688279 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:34.712927 17993 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:34.061306 24085 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:34.691525 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:34.337033 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:34.719532 17395 raft_consensus.cc:2368] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15.
I20260709 13:20:34.266250 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:34.101728 24290 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:34.154466 17471 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:34.721076 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:34.380288 24270 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.693818 17316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.008s	sys 0.008s
W20260709 13:20:34.722503 17316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.008s	sys 0.008s
I20260709 13:20:34.147109 24087 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:34.694027 24113 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:34.093451 24142 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.150061 17216 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:20:34.551561 17392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.006s
W20260709 13:20:34.724771 17462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.010s	sys 0.002s
W20260709 13:20:34.725102 17392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.009s	sys 0.007s
I20260709 13:20:34.128199 24166 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:34.093590 24084 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:34.487963 24324 log.cc:927] Time spent T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:20:34.125428 24307 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.701154 24086 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:34.680802 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:34.450021 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.688131 24315 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:34.708518 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:34.158027 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:34.721318 24290 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.258498 17394 raft_consensus.cc:2410] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:34.742679 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.744314 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.680121 24322 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:34.708184 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.724454 24087 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:34.725129 17462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.010s	sys 0.002s
I20260709 13:20:34.696400 17389 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:34.726652 17216 catalog_manager.cc:5697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 17 to 19, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 19 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:34.728796 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:34.686826 24321 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:34.746621 17395 raft_consensus.cc:2376] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18. Re-sending same reply.
I20260709 13:20:34.747771 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.748464 17395 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:34.728649 24142 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:34.751850 17390 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:34.750991 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.732016 24138 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.729249 23628 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.010s	sys 0.002s
I20260709 13:20:34.736460 24302 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:34.761916 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:34.732780 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:34.708145 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.753427 17395 raft_consensus.cc:2410] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:34.764077 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:34.732199 24085 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.753446 17318 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:34.766405 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1140) took 1452 ms. Trace:
I20260709 13:20:34.730489 24084 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:34.696687 17962 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:34.752035 17216 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.755192 17391 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:20:34.766784 17313 rpcz_store.cc:276] 0709 13:20:33.313675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.314211 (+   536us) service_pool.cc:224] Handling call
0709 13:20:33.334467 (+ 20256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.446013 (+111546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:33.446060 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:33.446116 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:33.446162 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.766192 (+1320030us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003facd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:34.766240 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.766355 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255985024}
I20260709 13:20:34.757797 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:34.769025 17469 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
W20260709 13:20:34.730907 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 464728us
I20260709 13:20:34.772058 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:34.745929 24290 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:34.774326 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 77728.2us
I20260709 13:20:34.774741 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.775645 17395 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:20:34.776738 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.730401 24270 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.777633 17216 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:34.779109 17463 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.763234 24138 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:34.782770 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.783558 17389 raft_consensus.cc:2410] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:20:34.784281 24138 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:34.756569 23628 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.010s	sys 0.002s
I20260709 13:20:34.752743 24087 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:34.789971 23978 consensus_meta.cc:287] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.676s	user 0.005s	sys 0.004s
I20260709 13:20:34.790436 23978 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.781629 17216 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:34.802135 17216 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 18 to 20, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 20 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:34.799706 17392 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:34.804237 17392 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:34.805585 17392 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 17. Current term is 18. Ops: [15.11-17.12]
I20260709 13:20:34.806686 17392 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:34.801167 17395 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:34.795909 24307 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:34.781351 24315 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:34.809515 24315 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.809908 24315 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:34.810027 17216 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 17 to 20, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 20 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:34.814224 17216 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:34.800745 17463 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:34.792593 23978 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:34.812960 24270 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:34.817562 17216 catalog_manager.cc:5697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:20:34.766774 24268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.012s	sys 0.030s
I20260709 13:20:34.778458 24085 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.828274 17392 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:20:34.832895 24279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.003s	sys 0.041s
W20260709 13:20:34.823640 24268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.012s	sys 0.031s
W20260709 13:20:34.833824 24279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.003s	sys 0.042s
I20260709 13:20:34.866583 24085 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:34.869426 24282 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.518s	user 0.009s	sys 0.007s
I20260709 13:20:34.869912 24315 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.871523 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 1182) took 1165 ms. Trace:
I20260709 13:20:34.872124 17466 rpcz_store.cc:276] 0709 13:20:33.705888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.706029 (+   141us) service_pool.cc:224] Handling call
0709 13:20:34.871297 (+1165268us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400281c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:34.871447 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232852224}
I20260709 13:20:34.872762 24315 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:34.873590 17999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44540 (request call id 1728) took 1372 ms. Trace:
I20260709 13:20:34.873956 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:34.874831 17466 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:34.873971 17999 rpcz_store.cc:276] 0709 13:20:33.501001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.501164 (+   163us) service_pool.cc:224] Handling call
0709 13:20:34.873340 (+1372176us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b540049a2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:34.873525 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7769856}
I20260709 13:20:34.877694 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:34.878989 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:34.883894 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 163811us
W20260709 13:20:34.884539 17314 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.015s
W20260709 13:20:34.884944 17314 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.004s	sys 0.015s
W20260709 13:20:34.885910 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.873980 24312 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.122s	user 0.000s	sys 0.012s
I20260709 13:20:34.892666 24165 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:34.862985 24337 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.893422 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1723) took 1567 ms. Trace:
W20260709 13:20:34.896422 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.894802 17990 rpcz_store.cc:276] 0709 13:20:33.326264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.326379 (+   115us) service_pool.cc:224] Handling call
0709 13:20:33.339426 (+ 13047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.122087 (+782661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.893128 (+771041us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b5400604854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:34.893366 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759933824}
I20260709 13:20:34.861123 24087 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.895541 24165 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.901391 24338 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:34.913244 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1176) took 1312 ms. Trace:
I20260709 13:20:34.914409 17467 rpcz_store.cc:276] 0709 13:20:33.601160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.630344 (+ 29184us) service_pool.cc:224] Handling call
0709 13:20:33.630739 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:33.636788 (+  6049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:33.636819 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:33.637290 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:20:33.742583 (+105293us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:33.759512 (+ 16929us) log.cc:844] Serialized 14 byte log entry
0709 13:20:33.760054 (+   542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.761178 (+  1124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.873322 (+1112144us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:34.907996 (+ 34674us) raft_consensus.cc:1685] finished
0709 13:20:34.913037 (+  5041us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.913179 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20770,"prepare.queue_time_us":55984,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":9961,"raft.queue_time_us":7688,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":202,"spinlock_wait_cycles":3612928,"thread_start_us":90893,"threads_started":1,"wal-append.queue_time_us":114245}
I20260709 13:20:34.900002 24337 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:34.935258 17467 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:34.932942 24279 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:34.943885 24334 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:20:34.953768 17321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 1151) took 1042 ms. Trace:
I20260709 13:20:34.954191 17321 rpcz_store.cc:276] 0709 13:20:33.930640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.937111 (+  6471us) service_pool.cc:224] Handling call
0709 13:20:34.953578 (+1016467us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400274f54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:34.953708 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362928000}
I20260709 13:20:34.958588 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:34.955672 24279 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.963411 24078 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:34.965355 24326 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.286s	user 0.002s	sys 0.000s
I20260709 13:20:34.965554 24279 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:34.966693 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2162) took 1038 ms. Trace:
I20260709 13:20:34.967044 17314 rpcz_store.cc:276] 0709 13:20:33.928736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.928891 (+   155us) service_pool.cc:224] Handling call
0709 13:20:33.929283 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:33.936873 (+  7590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:33.936908 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:33.956288 (+ 19380us) log.cc:844] Serialized 52 byte log entry
0709 13:20:34.130112 (+173824us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:34.885473 (+755361us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.894872 (+  9399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.894947 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.964763 (+ 69816us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:34.966404 (+  1641us) raft_consensus.cc:1685] finished
0709 13:20:34.966499 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.966639 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9146,"prepare.queue_time_us":250703,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":26318,"raft.queue_time_us":25262,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":10872,"spinlock_wait_cycles":13827968,"thread_start_us":666430,"threads_started":2,"wal-append.queue_time_us":709431}
W20260709 13:20:34.969035 24325 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
I20260709 13:20:34.969686 24142 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:34.971406 24329 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.569s	user 0.002s	sys 0.003s
W20260709 13:20:34.972681 24330 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.289s	user 0.000s	sys 0.002s
I20260709 13:20:34.973876 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.978955 24337 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:34.992730 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:34.994367 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:34.994949 17313 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:34.995071 24166 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:34.996090 24142 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:34.996870 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:34.997232 24166 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:34.997638 17317 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:35.000204 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:34.983095 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:34.985229 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:35.002347 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:35.002960 17392 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.003765 17287 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:35.006690 17318 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 21: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:35.009424 17313 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:35.016713 17392 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
W20260709 13:20:35.017900 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 140282us
I20260709 13:20:35.020449 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.022146 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:35.023139 17990 raft_consensus.cc:2368] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22.
I20260709 13:20:35.026196 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.027693 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:35.027819 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:35.028353 17318 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:35.029366 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:35.030717 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:35.031355 17314 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:35.034123 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:35.035452 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.037115 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.038251 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:35.038280 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:35.044143 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.045001 17994 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:35.046464 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:35.011673 24142 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:35.051059 24084 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.051460 24263 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:35.051982 24263 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.052366 24263 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.052426 17994 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:35.052309 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:35.053272 24084 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:35.053541 17996 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.054014 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:35.054540 17992 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.064374 17992 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:35.066032 17996 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:35.068964 24337 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:35.041675 24078 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:35.071602 24078 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:35.072054 24078 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.080610 17321 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:35.084551 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:35.086149 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 46431.1us
I20260709 13:20:35.085779 17287 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:35.090584 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2496) took 1083 ms. Trace:
I20260709 13:20:35.039170 24087 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:35.091117 17316 rpcz_store.cc:276] 0709 13:20:34.006723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.011506 (+  4783us) service_pool.cc:224] Handling call
0709 13:20:34.011822 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.012143 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.012171 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:34.012608 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.723023 (+710415us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:34.723087 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.723187 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.972112 (+248925us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:35.049949 (+ 77837us) raft_consensus.cc:1685] finished
0709 13:20:35.049980 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.090482 (+ 40502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1326,"raft.queue_time_us":799,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5082,"spinlock_wait_cycles":44930944,"thread_start_us":710038,"threads_started":1,"wal-append.queue_time_us":670673}
I20260709 13:20:35.089612 17285 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:35.113127 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:35.146837 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.147282 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.148185 17395 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:35.148550 17394 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:20:35.148968 17394 pending_rounds.cc:85] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 10
I20260709 13:20:35.149168 17394 pending_rounds.cc:107] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:20:35.149364 17394 raft_consensus.cc:2889] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:35.150352 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.151177 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2325) took 2775 ms. Trace:
I20260709 13:20:35.151404 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.151984 17394 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:35.151717 17470 rpcz_store.cc:276] 0709 13:20:32.375596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.375837 (+   241us) service_pool.cc:224] Handling call
0709 13:20:32.376092 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.165942 (+789850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.150859 (+1984917us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b540041fad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:35.151077 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1736830848}
I20260709 13:20:35.153108 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.149616 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.153872 17395 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:35.154194 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.147549 17392 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 16.
W20260709 13:20:35.155228 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 3851) took 1336 ms (client timeout 1508 ms). Trace:
I20260709 13:20:35.155267 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:35.146071 17435 connection.cc:256] RPC call timeout handler was delayed by -1.79423715300004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:20:35.155673 17390 rpcz_store.cc:269] 0709 13:20:33.818455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.824606 (+  6151us) service_pool.cc:224] Handling call
0709 13:20:35.155026 (+1330420us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400015754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:35.155173 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129780096}
W20260709 13:20:35.156435 17435 leader_election.cc:336] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.880s (SENT)
I20260709 13:20:35.146880 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.157023 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:35.157603 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.158180 17394 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:35.158758 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3857) took 1156 ms. Trace:
I20260709 13:20:35.080376 24165 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:35.159338 17397 rpcz_store.cc:276] 0709 13:20:34.002467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.002635 (+   168us) service_pool.cc:224] Handling call
0709 13:20:34.002926 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.680431 (+677505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.158537 (+478106us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400124b54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:35.158699 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426275072}
W20260709 13:20:35.161310 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 75626.1us
I20260709 13:20:35.163620 23868 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:35.163839 24124 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:35.164340 24124 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.164703 24124 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.165777 24322 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:35.169024 24341 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.273s	user 0.000s	sys 0.002s
W20260709 13:20:35.171298 24328 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.641s	user 0.000s	sys 0.006s
I20260709 13:20:35.161337 24072 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:35.172120 24072 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.172466 24072 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.174185 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2497) took 1167 ms. Trace:
W20260709 13:20:35.176131 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 86632.8us
I20260709 13:20:35.174721 17315 rpcz_store.cc:276] 0709 13:20:34.007010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.008602 (+  1592us) service_pool.cc:224] Handling call
0709 13:20:34.008981 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.009329 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.009364 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:34.009863 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.080603 (+ 70740us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:34.080643 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.092607 (+ 11964us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.170613 (+1078006us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:35.173774 (+  3161us) raft_consensus.cc:1685] finished
0709 13:20:35.173806 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.174104 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1174,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":44317056,"thread_start_us":70338,"threads_started":1,"wal-append.queue_time_us":392235}
I20260709 13:20:35.177623 24019 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:35.185406 17285 leader_election.cc:400] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22.
I20260709 13:20:35.186024 17285 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:35.186735 24344 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:35.188170 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:35.187753 17285 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:35.198098 24066 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:35.141134 24106 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:20:35.198786 24066 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:35.160784 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 47753.9us
I20260709 13:20:35.049077 24290 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.111723 24166 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:35.202167 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47420.1us
I20260709 13:20:35.085095 24189 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.111s
I20260709 13:20:35.207602 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:35.140583 24340 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:20:35.209026 24344 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.209510 24344 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:35.210150 24344 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.210332 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:35.211536 24340 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:20:35.203299 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46895.3us
I20260709 13:20:35.110504 24337 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:35.214689 24337 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.109787 24345 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.219718 17471 raft_consensus.cc:2393] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 23: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:35.205470 24064 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.205389 24302 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.198166 24072 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.206701 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35772 (request call id 2502) took 1153 ms. Trace:
I20260709 13:20:35.218372 24147 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:35.218205 24270 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:35.212204 24340 consensus_queue.cc:1243] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:35.219185 24345 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.209558 24066 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.221167 24142 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:35.229425 24142 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:35.230376 24142 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.231709 24142 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.221712 23868 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:35.224877 17322 rpcz_store.cc:276] 0709 13:20:34.053095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.081172 (+ 28077us) service_pool.cc:224] Handling call
0709 13:20:34.081486 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.081682 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:34.101458 (+ 19776us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.990348 (+888890us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b18003d58e0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:20:35.206351 (+216003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:35.206418 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:35.206464 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.206530 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.206647 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192708,"prepare.queue_time_us":23751,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":31320,"raft.queue_time_us":2441,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":30153600,"thread_start_us":215754,"threads_started":1}
I20260709 13:20:35.213089 24166 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.228540 24345 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.202080 17990 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:35.226717 24147 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:35.245625 24147 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:35.269203 24340 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:35.269735 24340 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:35.270573 24340 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.271834 24340 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.255136 24078 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.275146 24078 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:35.233356 24270 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.238691 23868 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:35.225683 24302 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:35.282691 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 510690us
I20260709 13:20:35.284171 17964 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:35.281827 23868 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:35.319605 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 156176us
I20260709 13:20:35.201758 17360 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:35.325291 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:35.327313 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.327518 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:35.330394 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.340711 17998 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
W20260709 13:20:35.340996 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 139327us
I20260709 13:20:35.332011 17996 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:35.295454 24315 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:35.343827 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:35.347579 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:35.350129 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:35.350956 17390 raft_consensus.cc:2393] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:35.357488 23994 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:35.358242 23994 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:35.358809 23994 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:35.358974 24302 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:35.368480 17391 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:20:35.370450 17465 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:35.372292 17468 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:35.373059 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 158992us
W20260709 13:20:35.374249 17435 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.898s (SENT)
W20260709 13:20:35.375367 17435 leader_election.cc:336] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.903s (SENT)
W20260709 13:20:35.376308 17435 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.905s (SENT)
I20260709 13:20:35.378742 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:35.379580 17467 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.383203 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:35.384357 17468 raft_consensus.cc:2410] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:20:35.345387 24106 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:35.389163 17470 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:35.354187 24087 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:35.401185 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:35.403963 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.404755 17392 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
W20260709 13:20:35.406821 17435 leader_election.cc:336] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.912s (SENT)
W20260709 13:20:35.407791 17435 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.964s (SENT)
I20260709 13:20:35.408233 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:35.410068 17435 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.973s (SENT)
I20260709 13:20:35.411363 17467 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:35.432063 17990 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 19. Ops: []
W20260709 13:20:35.432228 17435 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 2.068s (SENT)
I20260709 13:20:35.412760 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.432670 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:35.415094 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:35.433624 17390 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.416523 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:35.417680 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:35.435250 17393 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
W20260709 13:20:35.423172 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 210957us
I20260709 13:20:35.354357 24322 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:20:35.391536 24106 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.427888 17397 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:35.437222 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:35.429258 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 221890us
I20260709 13:20:35.438788 17285 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:35.440781 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:35.442809 17435 connection.cc:256] RPC call timeout handler was delayed by -1.0047231870000815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 13:20:35.443759 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:35.444928 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:35.449885 17992 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:35.453634 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:35.454618 17998 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.455068 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:35.458681 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:35.465515 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:35.466292 17314 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.481169 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:35.482214 17315 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.409227 24113 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:35.489931 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.491146 17996 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:20:35.485131 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:35.492556 17314 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:35.421381 24087 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:35.422955 24066 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:35.502053 17313 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:35.428568 24290 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:35.442575 24302 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:35.450333 24106 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.521602 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:35.529734 24062 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.530400 24062 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.530757 24359 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:35.485651 24133 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:35.531073 17390 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:35.498775 24138 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:35.532737 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3892) took 1561 ms. Trace:
I20260709 13:20:35.516017 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:35.521973 23987 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:35.543696 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.514099 24072 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:35.541342 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:35.540208 17998 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:35.540467 17462 rpcz_store.cc:276] 0709 13:20:33.971203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.104030 (+132827us) service_pool.cc:224] Handling call
0709 13:20:34.104379 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.104625 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:34.123175 (+ 18550us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.755429 (+632254us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.186537 (+431108us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b180017b1e0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287 00007f7d6280f208
0709 13:20:35.530406 (+343869us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:35.530485 (+    79us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:35.530551 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.532483 (+  1932us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.532659 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":419252,"prepare.queue_time_us":160110,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":443892,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":17394,"spinlock_wait_cycles":43746176,"thread_start_us":972436,"threads_started":2,"wal-append.queue_time_us":727403}
I20260709 13:20:35.551774 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:35.506011 24356 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 13:20:35.548851 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.502967 24113 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:35.567421 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 128724us
I20260709 13:20:35.534299 24133 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:35.576602 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:35.596282 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:35.577867 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:35.575816 24270 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:35.589334 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 175682us
I20260709 13:20:35.539770 24138 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:35.590961 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 164220us
I20260709 13:20:35.544560 24189 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.594710 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:35.605147 17465 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.543573 23987 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:35.597231 17470 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:35.552621 24166 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:35.598407 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:35.609992 17468 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.599092 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:35.545661 24302 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:35.549497 24066 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.596312 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:35.603713 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 161641us
I20260709 13:20:35.573869 24072 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:35.540993 24124 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.602763 24279 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:35.616550 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:35.625545 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.599583 24133 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:35.612751 24354 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:20:35.553926 24263 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.623287 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.603358 24141 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:35.606910 24138 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.627072 17465 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
W20260709 13:20:35.613715 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 92256.3us
I20260709 13:20:35.605576 24361 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:20:35.600243 24290 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
W20260709 13:20:35.668751 24350 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:20:35.644234 24264 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:35.669204 24322 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:20:35.632676 24351 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:20:35.632895 24349 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:20:35.610091 24270 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:20:35.670825 24322 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:35.608363 24147 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.672539 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1191) took 1541 ms. Trace:
I20260709 13:20:35.613317 23987 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.673578 24064 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:35.634156 17315 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:35.674293 24290 consensus_queue.cc:1243] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:35.615943 24066 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:35.674901 24290 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:35.675137 24302 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:35.675546 24290 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:35.622545 24166 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:20:35.675037 24066 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.642560 17998 raft_consensus.cc:2368] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21.
I20260709 13:20:35.676789 24166 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:35.677290 24166 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:35.678118 24166 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.679306 24166 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.644289 24279 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:35.672986 17464 rpcz_store.cc:276] 0709 13:20:34.130820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.895802 (+764982us) service_pool.cc:224] Handling call
0709 13:20:34.896115 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.198943 (+302828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.198974 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.199419 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:20:35.575568 (+376149us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:35.575610 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.575682 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.672306 (+ 96624us) raft_consensus.cc:1685] finished
0709 13:20:35.672328 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.672474 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":302440,"raft.queue_time_us":306515,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3606,"thread_start_us":373267,"threads_started":1,"wal-append.queue_time_us":464675}
I20260709 13:20:35.681928 24279 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.682096 23994 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.684216 24344 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.686344 24147 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:35.686645 24344 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:35.676549 24290 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:35.649076 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 56831.9us
W20260709 13:20:35.653456 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 50774.2us
I20260709 13:20:35.690304 24263 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:35.691085 17287 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:35.674872 17321 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:20:35.653544 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48541.3us
I20260709 13:20:35.693463 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:35.693809 24147 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:35.694469 24147 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:35.695427 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:35.696373 24321 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:35.660049 23868 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:35.665282 24366 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:20:35.666167 24355 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:35.666420 24124 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:35.613647 24189 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.601742 24358 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:20:35.668246 24113 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:35.669488 24264 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:35.631875 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3899) took 1552 ms. Trace:
I20260709 13:20:35.604400 24087 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.671964 24322 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:35.668258 17360 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:35.688710 24290 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.694604 17962 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:35.684741 23994 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:35.695040 24084 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.698446 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:35.699926 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:35.638023 17468 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:35.728962 17469 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.729151 17315 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:35.702718 24270 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:35.703939 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:35.735148 23868 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:35.736405 24381 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:35.737186 24381 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:35.738368 24381 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.739992 17469 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
W20260709 13:20:35.743166 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.722470 24321 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:35.747771 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 132554us
I20260709 13:20:35.732338 24113 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:35.660053 24106 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:35.652726 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 57408.7us
I20260709 13:20:35.709151 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:35.654671 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49231.9us
W20260709 13:20:35.727026 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 58823.6us
W20260709 13:20:35.759119 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50071.9us
I20260709 13:20:35.688203 24066 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.729727 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:35.701254 17435 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:35.719635 17466 rpcz_store.cc:276] 0709 13:20:34.079707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.886682 (+806975us) service_pool.cc:224] Handling call
0709 13:20:34.886985 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:35.198390 (+311405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.198424 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:35.199105 (+   681us) log.cc:844] Serialized 52 byte log entry
0709 13:20:35.506262 (+307157us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:35.506330 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.506437 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.631660 (+125223us) raft_consensus.cc:1685] finished
0709 13:20:35.631681 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.631818 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":312273,"raft.queue_time_us":312237,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2071,"thread_start_us":306650,"threads_started":1,"wal-append.queue_time_us":430572}
I20260709 13:20:35.703344 24141 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:35.728762 24084 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:35.725941 24322 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:35.772929 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.754154 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:35.751192 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2437) took 1696 ms. Trace:
I20260709 13:20:35.760454 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:35.730414 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:35.779479 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 49156.7us
I20260709 13:20:35.761907 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:35.696381 24147 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.764870 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:35.780900 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.784799 17463 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:35.788302 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 87125.8us
I20260709 13:20:35.789256 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:35.779250 17396 rpcz_store.cc:276] 0709 13:20:34.054760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.054878 (+   118us) service_pool.cc:224] Handling call
0709 13:20:34.055132 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.055314 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:34.055560 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.618777 (+1563217us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b180025f420. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:20:35.750742 (+131965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:35.750815 (+    73us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:35.750883 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.750973 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.751126 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215466,"prepare.queue_time_us":173,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":7046,"raft.queue_time_us":709,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3794,"spinlock_wait_cycles":12638080,"thread_start_us":131008,"threads_started":1}
I20260709 13:20:35.796657 24249 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:35.786609 24107 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.797534 24249 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:35.797605 24107 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.798584 24249 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.800063 24107 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:35.766072 24340 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:35.814307 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 52483.6us
W20260709 13:20:35.814482 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60449us
I20260709 13:20:35.788352 17434 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:35.815260 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:35.813702 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 53339.7us
I20260709 13:20:35.819286 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:35.820920 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:35.822988 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58235.4us
I20260709 13:20:35.824976 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:35.829675 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:35.777493 24084 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.767180 24113 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:35.750228 24321 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:35.831632 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.835001 17285 leader_election.cc:400] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21.
I20260709 13:20:35.831065 24107 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:35.839150 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49970.2us
I20260709 13:20:35.839489 17285 leader_election.cc:403] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:35.835894 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:35.785032 24062 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:35.898782 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 61444.8us
I20260709 13:20:35.832360 24279 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:35.905287 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 70385.6us
I20260709 13:20:35.833933 24263 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:35.834939 24356 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:35.937265 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 148951us
I20260709 13:20:35.835091 24358 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:35.834379 24072 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:35.832916 24385 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:35.948657 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 3905) took 1258 ms. Trace:
I20260709 13:20:35.988613 17471 rpcz_store.cc:276] 0709 13:20:34.689804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.722187 (+ 32383us) service_pool.cc:224] Handling call
0709 13:20:35.948439 (+1226252us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b540041f5d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:35.948594 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050565376}
I20260709 13:20:35.766294 24264 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:35.954530 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 129662us
I20260709 13:20:35.954303 17470 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:20:35.911247 24337 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:35.911578 24107 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.908812 24377 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:35.941040 24279 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.911756 23868 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21.
W20260709 13:20:36.017719 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 181866us
I20260709 13:20:35.942792 24379 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:35.833595 24378 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.138s
W20260709 13:20:35.981801 24339 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:20:35.984901 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 67124.9us
I20260709 13:20:35.985431 24072 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.035108 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:35.915324 24372 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 13:20:35.839176 24322 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:35.948031 24263 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:35.980890 24141 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.060000 24399 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:35.992853 24113 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.034107 24358 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:36.025817 24396 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:36.034884 24189 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:36.036706 24337 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:20:36.103452 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 159816us
I20260709 13:20:36.117367 24066 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:36.119544 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:36.121897 24263 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:36.123287 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 88270.9us
W20260709 13:20:36.130043 24388 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:20:36.152592 24396 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:36.093111 24377 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.135026 24166 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:36.151678 24133 consensus_meta.cc:287] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.507s	user 0.002s	sys 0.008s
I20260709 13:20:36.128233 24106 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:36.105499 24379 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:36.052362 24279 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:36.130704 24386 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 13:20:36.177403 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 74917.8us
I20260709 13:20:36.201336 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:36.155908 24345 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.898s	user 0.006s	sys 0.005s
I20260709 13:20:36.152186 24358 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.186517 24396 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:36.174789 24337 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:36.180886 24352 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:36.118391 24072 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:36.112565 23987 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:36.155432 24403 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:36.197234 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:36.184545 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 65101.1us
W20260709 13:20:36.216526 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.186005 24321 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:36.187436 24376 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:36.207544 24166 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:36.195116 24379 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.177968 24189 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:20:36.212626 24345 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:36.273439 24106 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:36.274116 24106 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:36.276441 24106 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:36.236474 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 330263us
I20260709 13:20:36.214181 24358 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:36.238349 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:36.191072 24133 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.214625 24400 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:20:36.278431 23987 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:36.282598 24166 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:36.290275 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 111180us
I20260709 13:20:36.234273 17286 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:36.296128 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:36.294144 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.247727 24403 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:36.306696 17462 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:36.241448 24408 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.325050 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:36.327380 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 93172.7us
I20260709 13:20:36.327713 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:36.329999 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:36.333516 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:36.334470 17397 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:36.335181 17471 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:36.338799 17287 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.882s (SENT) [suppressed 23 similar messages]
I20260709 13:20:36.340148 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:36.342243 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:36.345579 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:36.346928 17392 raft_consensus.cc:2376] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18. Re-sending same reply.
I20260709 13:20:36.353286 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:36.359485 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.368101 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:36.307006 24384 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:20:36.371008 17393 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:36.303839 24352 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:20:36.456053 17397 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:36.523993 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:36.525429 17397 raft_consensus.cc:2410] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:36.456019 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:36.434257 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:36.435228 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:36.320003 24394 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:36.364099 23868 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.323788 24107 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:36.458205 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:36.482440 24404 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:20:36.479511 24416 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:20:36.629132 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.369990 24106 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:36.464751 24263 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:36.646569 17362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.064s	sys 0.152s
W20260709 13:20:36.675688 17362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.064s	sys 0.152s
I20260709 13:20:36.384101 24372 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.239s
I20260709 13:20:36.476776 24415 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:36.543205 24382 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:36.478945 24381 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:36.384339 24408 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:36.616534 24138 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.945s	user 0.005s	sys 0.006s
I20260709 13:20:36.649788 24270 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:36.738184 24107 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:36.739883 24381 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:36.765035 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.012s	sys 0.033s
W20260709 13:20:36.778688 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.012s	sys 0.033s
W20260709 13:20:36.779016 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 561191us
W20260709 13:20:36.765106 17997 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.014s	sys 0.030s
W20260709 13:20:36.781504 17997 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.015s	sys 0.030s
I20260709 13:20:36.766520 17392 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:36.767887 24414 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
W20260709 13:20:36.771281 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 533412us
I20260709 13:20:36.804344 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:36.804773 17998 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 13:20:36.766839 24084 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.002s
I20260709 13:20:36.752192 24270 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:36.792140 24413 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:20:36.754204 24417 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:36.764909 24406 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.019s	sys 0.025s
W20260709 13:20:36.768333 24409 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.448s	user 0.001s	sys 0.000s
I20260709 13:20:36.560303 24394 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.826273 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:36.814211 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:36.713560 24263 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:36.708199 24106 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:36.764777 24189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.010s	sys 0.034s
I20260709 13:20:36.820161 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:36.821816 17996 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:36.770180 24381 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:36.777633 24380 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.037s
I20260709 13:20:36.766139 24377 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:36.822956 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 107775us
I20260709 13:20:36.843525 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:36.768515 24408 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:36.752349 24138 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:36.811144 24133 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:36.810472 23987 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.845494 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:36.846148 17316 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
W20260709 13:20:36.846410 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.848132 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:36.854206 24390 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.830s	user 0.004s	sys 0.004s
I20260709 13:20:36.855446 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3920) took 1157 ms. Trace:
I20260709 13:20:36.857295 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:36.857923 17391 raft_consensus.cc:2376] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16. Re-sending same reply.
I20260709 13:20:36.855814 17465 rpcz_store.cc:276] 0709 13:20:35.697722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.697840 (+   118us) service_pool.cc:224] Handling call
0709 13:20:35.698155 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.701140 (+  2985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.701167 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.701627 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:20:35.782876 (+ 81249us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:35.782915 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.782982 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.804420 (+ 21438us) spinlock_profiling.cc:243] Waited 944 us on lock 0x7b4800210258. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:20:36.853679 (+1049259us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:36.855240 (+  1561us) raft_consensus.cc:1685] finished
0709 13:20:36.855261 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.855389 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31473,"raft.queue_time_us":49497,"raft.run_cpu_time_us":984,"raft.run_wall_time_us":54624,"spinlock_wait_cycles":11527296,"thread_start_us":77269,"threads_started":1,"wal-append.queue_time_us":213313}
W20260709 13:20:36.860410 24348 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 1.498s	user 0.008s	sys 0.005s
I20260709 13:20:36.861392 17321 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:36.747511 24382 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:36.823586 24406 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.019s	sys 0.025s
I20260709 13:20:36.861675 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1162) took 1885 ms. Trace:
I20260709 13:20:36.818977 24270 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:36.865111 17320 rpcz_store.cc:276] 0709 13:20:34.976682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.981903 (+  5221us) service_pool.cc:224] Handling call
0709 13:20:34.982217 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.982561 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.982590 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:34.983020 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:20:35.214041 (+231021us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:35.214081 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.214146 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.852551 (+1638405us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:36.861409 (+  8858us) raft_consensus.cc:1685] finished
0709 13:20:36.861430 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.861620 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336,"raft.queue_time_us":3353,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3007,"spinlock_wait_cycles":9951488,"thread_start_us":230629,"threads_started":1,"wal-append.queue_time_us":378482}
I20260709 13:20:36.769842 24107 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:36.847376 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:36.829516 24072 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:36.862361 17998 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
W20260709 13:20:36.842154 24380 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.008s	sys 0.037s
W20260709 13:20:36.844270 17287 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.003s	sys 0.019s
W20260709 13:20:36.844166 24189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.011s	sys 0.034s
I20260709 13:20:36.828925 24417 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.884176 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1193) took 1310 ms. Trace:
I20260709 13:20:36.869396 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:36.769152 24403 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:36.874579 17469 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:36.885141 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:36.873231 24133 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:36.886001 17321 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:36.884689 17462 rpcz_store.cc:276] 0709 13:20:35.574323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.577543 (+  3220us) service_pool.cc:224] Handling call
0709 13:20:35.577918 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:36.326385 (+748467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.883944 (+557559us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b540020fdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:36.884114 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675486976}
I20260709 13:20:36.867585 23987 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:36.889822 24322 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:36.891045 23987 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:36.891701 23987 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:36.893721 24392 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.943s	user 0.005s	sys 0.005s
I20260709 13:20:36.895133 24345 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:36.898223 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.900302 24106 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:36.904441 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.842751 24423 consensus_queue.cc:1059] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:20:36.869220 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:36.910667 17362 leader_election.cc:336] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Timed out: RequestConsensusVote RPC to 127.15.208.3:33147 timed out after 1.791s (SENT)
I20260709 13:20:36.892198 23987 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.880100 24263 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:36.880946 24107 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:36.881179 24382 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:36.884291 24417 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:36.822211 24084 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.862917 24424 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:36.868889 17392 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:36.925958 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:36.925959 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:36.930392 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:36.923940 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:36.933773 17321 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:36.939209 17317 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:20:36.929050 24279 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.000s
I20260709 13:20:36.940263 24138 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:36.940364 24279 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.942622 24279 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:36.926628 24396 consensus_meta.cc:287] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.694s	user 0.007s	sys 0.003s
I20260709 13:20:36.946599 24396 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:36.947582 24383 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.911s	user 0.000s	sys 0.009s
I20260709 13:20:36.917512 24137 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:36.949126 24137 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.951323 24137 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:36.948745 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1129) took 1599 ms. Trace:
I20260709 13:20:36.945045 17995 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:36.930433 24337 consensus_meta.cc:287] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.001s
I20260709 13:20:36.952195 17388 rpcz_store.cc:276] 0709 13:20:35.349319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.349486 (+   167us) service_pool.cc:224] Handling call
0709 13:20:35.367670 (+ 18184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.369173 (+  1503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.369203 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.389656 (+ 20453us) log.cc:844] Serialized 26 byte log entry
0709 13:20:35.691487 (+301831us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4800002958. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:20:35.775717 (+ 84230us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:35.775762 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.775835 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.909700 (+1133865us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:36.948546 (+ 38846us) raft_consensus.cc:1685] finished
0709 13:20:36.948568 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.948691 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1129,"raft.queue_time_us":1264,"raft.run_cpu_time_us":4913,"raft.run_wall_time_us":302101,"spinlock_wait_cycles":37068928,"thread_start_us":289384,"threads_started":1,"wal-append.queue_time_us":521076}
I20260709 13:20:36.953414 24337 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:36.955583 24337 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:36.917454 24065 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.977581 24065 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:36.986326 23987 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:36.948709 24396 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:36.987282 24065 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:36.992174 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 164289us
I20260709 13:20:36.998742 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:36.982206 24358 consensus_meta.cc:287] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.004s
I20260709 13:20:36.952443 23868 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:36.967758 24084 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:36.980419 24279 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:36.944581 24107 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:20:37.010121 17435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.000s	sys 0.016s
W20260709 13:20:37.010492 17435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.000s	sys 0.016s
W20260709 13:20:37.011273 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 683597us
I20260709 13:20:37.011525 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:37.013477 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:36.966715 24270 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.011978 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:37.032235 17395 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.009s
W20260709 13:20:37.038627 17395 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.005s	sys 0.010s
W20260709 13:20:37.005841 24378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.000s	sys 0.026s
I20260709 13:20:37.015013 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:37.004106 24359 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:37.014883 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:37.005282 23756 raft_consensus.cc:3055] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:37.045369 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:37.045761 17467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 3918) took 1349 ms. Trace:
I20260709 13:20:37.046222 17467 rpcz_store.cc:276] 0709 13:20:35.696117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.696238 (+   121us) service_pool.cc:224] Handling call
0709 13:20:35.696517 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.696708 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:35.779720 (+ 83012us) log.cc:844] Serialized 14 byte log entry
0709 13:20:37.045333 (+1265613us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b1800355360. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287
0709 13:20:37.045430 (+    97us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:37.045478 (+    48us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:37.045519 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.045600 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.045711 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31429,"prepare.queue_time_us":257047,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":56000,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":61508,"spinlock_wait_cycles":14911872,"thread_start_us":281318,"threads_started":2}
I20260709 13:20:37.047199 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:37.008334 24107 consensus_queue.cc:1243] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:20:37.044795 24378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.005s	sys 0.028s
I20260709 13:20:37.005916 24358 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.041113 24382 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:37.045042 24359 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.007151 23987 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:20:37.014971 24279 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:37.050172 24066 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:37.059223 24266 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:37.145845 24266 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.059937 24359 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.146924 24266 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.061064 24382 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.151312 24403 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.121097 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:36.875978 17287 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.003s	sys 0.019s
I20260709 13:20:37.152310 17317 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:37.123109 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:37.153216 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 814244us
I20260709 13:20:37.066668 24358 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:36.937379 17360 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:37.152204 24403 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:37.156358 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 218969us
I20260709 13:20:37.124578 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:37.138597 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.066730 24379 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.808s	user 0.009s	sys 0.000s
I20260709 13:20:37.143391 24427 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:37.158624 24427 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.159017 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:37.060572 24394 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:37.062688 24270 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:37.126497 17315 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: [18.14-20.15]
I20260709 13:20:37.168099 17313 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:37.152153 24382 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:37.142427 24065 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:37.130511 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:37.158751 24379 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.178017 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:37.177718 24065 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.178524 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:37.179557 17316 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:37.179770 24379 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:37.159771 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:37.050423 24424 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:37.180970 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:37.161098 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:37.161918 24403 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:37.163255 24427 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:37.141485 23868 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.164958 24423 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:37.183938 17319 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:37.184598 17320 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 21: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:37.183825 23868 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.187139 23868 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:37.165441 24266 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:37.132616 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:37.190011 17319 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:37.183881 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:37.161487 24322 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:37.191010 17321 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:37.190708 23868 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:37.191638 24322 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.073962 24381 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.194821 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:37.194962 17287 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:37.196969 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:37.198433 17319 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 19: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:37.200151 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:37.182014 24065 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:37.169971 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:37.201375 24338 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:37.201793 24381 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:37.170351 23987 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:37.202517 23987 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:37.202736 24322 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:37.203208 24113 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:37.203639 24338 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:37.203855 24113 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:37.171770 17322 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:37.204384 23987 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:37.172963 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 125632us
I20260709 13:20:37.207799 23987 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:37.192984 23868 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:37.193615 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1204) took 1598 ms. Trace:
I20260709 13:20:37.205478 24338 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.208717 17470 rpcz_store.cc:276] 0709 13:20:35.594745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.615616 (+ 20871us) service_pool.cc:224] Handling call
0709 13:20:35.949454 (+333838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.027592 (+ 78138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.193147 (+1165555us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540041f5d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:37.193375 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766819712}
I20260709 13:20:37.207778 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:37.174198 24434 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:37.049263 23756 raft_consensus.cc:740] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:37.209944 24396 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:37.168648 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:37.210546 24434 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:37.206286 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 74049.2us
I20260709 13:20:37.212275 24434 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.214260 24113 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.215605 24113 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:37.218773 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:37.220993 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 62287.4us
I20260709 13:20:37.225275 24368 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:37.228664 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:37.229803 17320 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:37.237828 24279 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.241989 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:37.244691 17998 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:37.218282 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:37.279556 24368 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:37.279965 24064 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:37.280347 24379 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:37.281706 24270 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:37.306463 23756 consensus_queue.cc:260] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.310313 24066 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:37.317119 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 71178.8us
I20260709 13:20:37.339915 24270 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.342571 24270 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:37.343895 23756 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:37.331600 24368 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:37.346118 24368 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:37.347312 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.347483 24368 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:37.342244 24359 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.349110 24379 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.351025 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:37.351897 17389 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.352396 24379 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:37.352540 24359 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:37.353484 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.361744 17317 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:37.366598 17434 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:37.361581 24066 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:37.371563 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 164053us
I20260709 13:20:37.375214 17318 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:20:37.375802 17998 pending_rounds.cc:85] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 9
I20260709 13:20:37.376271 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:37.376459 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:37.375849 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 157724us
I20260709 13:20:37.377465 17392 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:37.376175 24346 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:37.383028 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:37.383311 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:37.384491 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:37.385133 24395 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:37.385406 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:37.386271 17322 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:37.386423 17391 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:37.386936 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:37.387400 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:37.387205 17320 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.387845 17315 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:37.388150 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:37.388900 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:37.389098 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:37.376201 17998 pending_rounds.cc:107] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:20:37.395530 17999 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
W20260709 13:20:37.396358 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 56557.1us
W20260709 13:20:37.399847 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 52453.8us
I20260709 13:20:37.400991 17998 raft_consensus.cc:2889] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:37.411746 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45400.5us
I20260709 13:20:37.413844 24087 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.414227 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:37.415298 24087 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.416549 24346 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:37.424451 24107 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.425613 24107 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:37.432865 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.439370 17389 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:37.433660 24087 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:37.455833 17390 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:37.438547 24113 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:37.464442 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.471496 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 229728us
I20260709 13:20:37.473806 24107 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:37.476049 17964 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:37.485072 24302 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:37.485766 24302 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.486233 24302 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:37.465512 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:37.461974 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:37.494056 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 43731.3us
I20260709 13:20:37.496955 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:37.493366 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:37.513098 24395 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:20:37.462553 24264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.007s	sys 0.011s
W20260709 13:20:37.516935 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.506011 24307 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.015s	sys 0.021s
W20260709 13:20:37.529807 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.516407 24264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.008s	sys 0.012s
I20260709 13:20:37.520849 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:37.538672 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.529350 24307 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.016s	sys 0.021s
I20260709 13:20:37.518821 24395 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:37.543303 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:37.547994 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46235.3us
I20260709 13:20:37.502450 24113 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.551904 17392 raft_consensus.cc:2468] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:37.461577 23868 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.554085 17314 raft_consensus.cc:1240] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:20:37.557507 17397 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:37.561803 17991 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:37.564980 24400 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 13:20:37.565783 24448 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:20:37.585036 24379 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:37.586216 24395 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.599345 24379 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.602722 24379 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:37.597668 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56658.3us
I20260709 13:20:37.549104 24382 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.576063 24302 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.613005 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:37.617069 17388 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:37.617774 24249 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:37.619168 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.620034 17391 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:37.626914 17396 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:37.629235 24382 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.632036 24382 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:37.632804 24165 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:37.634305 24113 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:37.625026 17962 leader_election.cc:336] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 1.656s (SENT)
I20260709 13:20:37.635316 24249 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:20:37.645846 24064 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:37.646363 24064 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:37.647107 17216 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 222) took 10457 ms. Trace:
I20260709 13:20:37.668831 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:37.667897 24382 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:20:37.690806 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 175924us
I20260709 13:20:37.692929 24417 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:37.697973 17995 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:37.647541 17216 rpcz_store.cc:276] 0709 13:20:27.189704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.190130 (+   426us) service_pool.cc:224] Handling call
0709 13:20:37.646847 (+10456717us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:35.142846 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:35.143555 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:35.143613 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:20:35.143634 (+    21us) tablet.cc:662] Decoding operations
0709 13:20:35.145018 (+  1384us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:35.145150 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:35.145191 (+    41us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:20:35.485716 (+340525us) tablet.cc:701] Row locks acquired
0709 13:20:35.517468 (+ 31752us) write_op.cc:260] PREPARE: finished
0709 13:20:35.539291 (+ 21823us) write_op.cc:270] Start()
0709 13:20:35.576956 (+ 37665us) write_op.cc:276] Timestamp: P: 1783603235534993 usec, L: 0
0709 13:20:35.591644 (+ 14688us) op_driver.cc:348] REPLICATION: starting
0709 13:20:35.660992 (+ 69348us) log.cc:844] Serialized 5474 byte log entry
0709 13:20:36.245267 (+584275us) op_driver.cc:464] REPLICATION: finished
0709 13:20:36.850885 (+605618us) write_op.cc:301] APPLY: starting
0709 13:20:36.850970 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:36.954518 (+103548us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:36.954643 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:37.073220 (+118577us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:37.073468 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:20:37.073518 (+    50us) write_op.cc:312] APPLY: finished
0709 13:20:37.073926 (+   408us) log.cc:844] Serialized 129 byte log entry
0709 13:20:37.075823 (+  1897us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:37.076014 (+   191us) write_op.cc:454] Released schema lock
0709 13:20:37.076087 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:37.076522 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:37.076553 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":605310,"apply.run_cpu_time_us":19542,"apply.run_wall_time_us":225608,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62647,"num_ops":14,"prepare.queue_time_us":85312,"prepare.run_cpu_time_us":19902,"prepare.run_wall_time_us":671355,"raft.queue_time_us":153569,"raft.run_cpu_time_us":45425,"raft.run_wall_time_us":656874,"replication_time_us":637108,"thread_start_us":940820,"threads_started":4,"wal-append.queue_time_us":394501}]]}
I20260709 13:20:37.699049 24249 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:37.699532 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 270405us
I20260709 13:20:37.699800 24249 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.700681 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:37.701745 23987 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:37.702551 24249 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:37.693109 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:37.694010 24264 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:37.681787 24434 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.711805 17392 raft_consensus.cc:2410] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:20:37.712863 17360 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:37.696190 24382 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:37.740665 24382 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.742688 24382 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:37.749141 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:37.750511 24415 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:37.753646 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.754599 17470 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:20:37.755914 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62946.1us
I20260709 13:20:37.762436 24434 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:37.765232 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 212023us
I20260709 13:20:37.769737 24279 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:37.770725 24279 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.773022 24087 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:37.773331 17286 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:37.714291 24065 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:37.773741 24087 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:37.723626 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 83577.6us
I20260709 13:20:37.724263 23756 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:37.725189 24410 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:37.724778 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:37.726821 17215 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 12 to 15, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 15 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.704226 24417 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:37.733898 23987 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:37.735626 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:37.737068 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.776319 17389 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:37.784988 24279 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:37.711441 24400 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:37.672495 24064 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:37.795362 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.779439 24264 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:37.777117 23756 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:37.801362 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.789167 24400 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:37.803937 24322 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.009s
I20260709 13:20:37.804035 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:37.804582 24322 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.807525 17469 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:37.808470 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.809201 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.799834 23756 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.815820 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:37.820888 17465 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:37.822409 24322 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:37.823249 24322 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:37.823567 17463 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:37.824046 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.824677 17462 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:37.825151 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.825665 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.826134 17467 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:37.826689 17464 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:37.828339 17470 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:37.829993 24410 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:37.830649 24410 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.832151 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.833078 17471 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:37.833106 17469 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:20:37.834975 17470 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 19. Ops: []
I20260709 13:20:37.837296 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.838165 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:37.838469 17467 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:37.839046 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.841018 17397 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:37.823597 24322 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.844691 24322 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.846966 24399 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:37.847465 24399 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:37.847646 24410 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:37.848565 24410 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:37.849329 24410 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.844139 24165 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:37.851126 24087 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:37.851161 24165 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:37.852988 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.854046 17464 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:37.856709 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:37.838754 17462 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.864425 24307 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:37.865113 24307 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:37.866335 24379 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.866173 24307 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.868018 24307 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:37.868481 24379 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:37.869257 24417 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.810974 24400 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.870759 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.855302 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.873481 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.874895 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:37.920610 17471 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:37.875710 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.876253 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:37.876902 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 63142.2us
I20260709 13:20:37.877120 24385 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:37.878067 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:37.879000 24346 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:37.879415 24124 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:37.876611 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:37.819888 24264 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:37.883584 24141 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:37.886982 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.887677 24410 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:37.890465 23987 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:37.891901 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:37.893494 17993 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:37.897642 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:37.901692 24356 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:20:37.868525 17462 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:37.902524 24165 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:37.899124 17992 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:37.939733 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:37.912890 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 177386us
I20260709 13:20:37.817977 24302 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:37.923677 17391 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:37.921603 17394 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:37.929160 17470 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:37.896492 24322 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:37.927131 24066 consensus_meta.cc:287] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.513s	user 0.003s	sys 0.008s
I20260709 13:20:37.909569 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:37.940541 17469 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:20:37.934281 17467 raft_consensus.cc:2376] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20. Re-sending same reply.
W20260709 13:20:37.941538 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 173927us
I20260709 13:20:37.935642 17464 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:37.944751 17471 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:37.948369 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.949558 17287 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:37.945472 17463 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
I20260709 13:20:37.954262 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.963464 17465 raft_consensus.cc:2393] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:37.965730 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.848757 24399 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.971203 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.969197 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.974601 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.981763 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.975102 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.985734 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:37.974654 17468 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
I20260709 13:20:37.982563 17463 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:37.987689 17467 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:37.988734 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.989768 17467 raft_consensus.cc:2410] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:20:37.988977 17215 catalog_manager.cc:5697] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 6 to 13, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 13 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:37.993420 17396 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:37.965864 24165 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.997140 24264 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:37.999939 24373 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:20:37.979326 24417 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:37.997187 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:37.954821 23987 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:38.010067 17462 raft_consensus.cc:2393] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 15: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:37.986502 17470 raft_consensus.cc:2376] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18. Re-sending same reply.
I20260709 13:20:37.990674 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:38.025998 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 51194us
W20260709 13:20:38.011440 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.975185 24368 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.627s	user 0.006s	sys 0.008s
I20260709 13:20:38.014113 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:38.034008 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:38.044826 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:38.046455 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.047272 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:38.048200 17463 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:38.053664 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.045959 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.052899 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.060035 17464 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:20:38.035388 24460 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:38.057547 17467 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:37.953217 24066 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.076426 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.074041 17468 raft_consensus.cc:2393] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 14: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:38.081269 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 356524us
W20260709 13:20:38.089643 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 155285us
I20260709 13:20:38.091070 24346 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:38.126629 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.134152 17466 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:38.146813 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.149724 17468 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:38.149942 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.150882 17464 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:38.151124 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:38.151669 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.152447 17464 raft_consensus.cc:2410] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:20:38.152323 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.148207 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.189735 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:38.210490 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.160945 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.208068 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:38.226570 17466 raft_consensus.cc:2393] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:38.229696 17471 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:38.176071 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.231235 17463 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:38.228343 17470 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:38.190261 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:38.074259 24379 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:38.073218 24307 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:38.231338 17467 raft_consensus.cc:2376] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18. Re-sending same reply.
W20260709 13:20:38.253878 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.157119 17469 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
W20260709 13:20:38.179580 24461 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.147s	user 0.001s	sys 0.001s
I20260709 13:20:38.269335 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:38.152936 24399 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:38.191327 24367 raft_consensus.cc:3055] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:38.165727 24373 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:38.162925 24066 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.164038 24064 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:38.189788 24322 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.282464 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.278384 17394 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:38.283347 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:38.284158 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.280963 17468 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:38.281867 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.296473 17467 raft_consensus.cc:2410] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:20:38.300637 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.190433 24478 consensus_queue.cc:1059] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.095s
I20260709 13:20:38.321031 24356 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:38.304643 17469 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:38.307611 24066 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.321724 24356 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.322360 24066 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.285184 24373 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:38.325146 24066 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.314129 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.325729 24373 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:38.327260 24373 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:38.189831 24124 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:20:38.281983 24367 raft_consensus.cc:740] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:38.314587 24307 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.332059 24307 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.306522 24434 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.333053 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:38.333382 24434 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:38.334586 24367 consensus_queue.cc:260] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.335045 24400 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.335559 24434 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:38.335964 24367 raft_consensus.cc:3060] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.337131 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:38.337450 23868 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:38.337817 23868 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:38.339293 17388 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:38.187148 23756 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.307430 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:38.300102 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 356917us
I20260709 13:20:38.340309 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:38.340255 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.160211 24476 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:38.345599 17470 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:38.344624 17471 raft_consensus.cc:2376] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22. Re-sending same reply.
I20260709 13:20:38.348181 17395 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:38.286712 24368 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:38.350205 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 73742.3us
W20260709 13:20:38.379317 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.381707 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:38.350529 17464 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:38.351455 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51566.3us
I20260709 13:20:38.345628 24356 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.361172 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:38.386596 17993 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:38.157378 23987 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.369108 24395 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:38.369410 24400 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.371726 17392 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:38.372455 17465 raft_consensus.cc:2410] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:20:38.372262 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:38.372797 24476 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:38.398936 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.297708 24379 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:38.402093 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:38.389472 24395 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:38.404331 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:38.402530 17321 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:38.403491 17316 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:38.406985 17467 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:38.403281 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:38.410454 24395 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.415117 17993 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:38.413098 24382 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 13:20:38.417816 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:38.418373 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:38.418954 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:38.423353 17462 raft_consensus.cc:2410] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:20:38.428341 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.430708 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.427279 17320 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
W20260709 13:20:38.433393 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 498591us
I20260709 13:20:38.338781 23868 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.434917 17395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 1153) took 1058 ms. Trace:
I20260709 13:20:38.437630 17322 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:38.435786 17395 rpcz_store.cc:276] 0709 13:20:37.372366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.374188 (+  1822us) service_pool.cc:224] Handling call
0709 13:20:38.430298 (+1056110us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540009c9d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:38.430406 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518864768}
I20260709 13:20:38.438740 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:38.455703 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:38.457095 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:38.410852 24368 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.431797 24307 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:38.443542 24064 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:38.458207 24382 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:38.485105 17394 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 14.
I20260709 13:20:38.481745 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.480334 24322 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:38.494460 17963 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.495482 24465 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:20:38.495837 24356 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:38.495978 24385 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:38.467916 24107 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:20:38.497433 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.483551 24307 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:38.490123 24476 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.501472 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:38.501796 23756 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.503141 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:38.515432 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.520620 17993 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:38.505023 24382 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:20:38.525517 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 45855.3us
W20260709 13:20:38.537827 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.508085 24064 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:38.529640 24356 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:38.531276 24165 raft_consensus.cc:2804] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:38.546868 24476 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:38.574368 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:38.600294 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.576824 17390 raft_consensus.cc:1240] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:38.552390 23756 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.606881 24472 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.607378 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:38.607249 24356 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:38.575908 24379 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:38.612777 17388 pending_rounds.cc:85] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 14
I20260709 13:20:38.617790 17388 pending_rounds.cc:107] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:20:38.617770 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.618256 17388 raft_consensus.cc:2889] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:38.608945 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 151907us
I20260709 13:20:38.614663 17465 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 12.
I20260709 13:20:38.616391 17462 raft_consensus.cc:2393] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 22: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:38.557166 24482 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
W20260709 13:20:38.623893 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.621034 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:38.620930 17392 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:38.609241 24165 raft_consensus.cc:697] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:38.611452 24476 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:38.637902 24476 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:38.630249 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:38.628291 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.634158 24379 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.575663 24249 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:20:38.626246 24064 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:38.653724 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:38.632748 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 89277us
W20260709 13:20:38.673985 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.678212 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:38.642445 24368 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.682346 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:38.686013 17993 raft_consensus.cc:2410] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:20:38.628795 24307 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.674538 24322 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:38.689708 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 186690us
I20260709 13:20:38.643360 24107 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:38.625474 24472 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:38.699555 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.648890 24113 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
W20260709 13:20:38.701910 24475 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.230s	user 0.002s	sys 0.007s
I20260709 13:20:38.701984 17467 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:20:38.709787 24486 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:20:38.710511 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.712158 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:38.713212 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:38.715526 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.715834 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:38.722842 17396 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:38.723127 24492 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:38.725464 24165 consensus_queue.cc:237] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.726665 17469 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:38.729067 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.730470 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:38.731400 17320 raft_consensus.cc:2410] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:20:38.731815 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.684880 24379 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.733266 17463 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:38.734455 24465 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:38.734589 17463 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:38.735025 24465 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:38.735482 24465 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:38.713285 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.738876 17466 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:38.709560 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:38.739727 17465 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.741150 17464 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:38.731304 24472 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:38.722842 17397 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:38.742408 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.753516 17462 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
W20260709 13:20:38.744297 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 44887.1us
I20260709 13:20:38.630838 24382 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.755852 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.754673 17462 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:38.698150 24322 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:38.760464 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 72731.3us
I20260709 13:20:38.697093 24488 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:38.763674 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:38.765192 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:38.765559 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 66072.6us
I20260709 13:20:38.774184 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.754590 24064 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.778117 17462 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:38.781280 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.782191 17434 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:38.764657 24482 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.764377 24141 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:38.794684 17467 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:38.766511 24322 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.790395 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:38.777738 24472 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:38.777415 24368 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:38.795433 17462 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:38.796582 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.810173 24379 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.811165 24087 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:38.802317 24472 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:38.784958 24064 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.816236 24417 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:38.816635 17466 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:20:38.816866 24417 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.817175 17466 pending_rounds.cc:85] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 13
I20260709 13:20:38.817552 17466 pending_rounds.cc:107] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:20:38.817909 17466 raft_consensus.cc:2889] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:38.818228 17466 pending_rounds.cc:107] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:20:38.779333 24249 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:20:38.818457 17466 raft_consensus.cc:2889] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:38.821409 24456 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.184s	user 0.000s	sys 0.003s
W20260709 13:20:38.823544 24479 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:20:38.788977 24488 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:38.826282 24483 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
I20260709 13:20:38.827564 24488 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.813112 24493 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:38.813928 24472 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.840399 17471 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:38.829656 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:38.838274 17463 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:38.842486 17462 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:38.783717 24395 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.817480 24417 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:38.794806 24141 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:38.856405 24113 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:38.845794 24476 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:20:38.885725 17995 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:38.796185 24482 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:38.883769 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:38.885377 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:38.888790 24495 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:20:38.889252 17315 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:38.910449 24482 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.888859 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:38.910595 23987 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:38.894202 24395 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:38.878931 23756 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:38.914251 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:38.916348 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 151507us
W20260709 13:20:38.919204 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.919113 17465 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:38.920823 24485 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:38.921722 24373 consensus_meta.cc:287] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.005s
I20260709 13:20:38.901993 24141 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:38.905138 24064 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:38.866928 24400 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:38.906984 24113 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:38.908242 24492 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:38.948043 24493 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:38.948782 24493 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:38.865641 17471 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:38.925570 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46156.7us
I20260709 13:20:38.927441 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:38.953094 17321 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:38.953390 24124 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:38.953969 24124 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:38.955152 24124 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:38.956614 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:38.957464 17395 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:38.921730 24485 consensus_queue.cc:1059] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:20:38.968183 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:38.969182 24307 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:38.937980 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 104032us
I20260709 13:20:38.938174 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:38.940141 24113 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:38.993182 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:38.997329 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:38.997978 17319 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:38.998261 17317 raft_consensus.cc:2410] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
W20260709 13:20:38.970120 24494 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 13:20:38.994051 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 52629.6us
I20260709 13:20:38.996518 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:38.997292 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 133593us
I20260709 13:20:38.998950 17286 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:38.924739 24469 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:20:39.018221 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:39.019114 17389 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:38.998581 24367 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:39.002075 24399 raft_consensus.cc:3055] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:39.000594 24141 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:39.021699 17390 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:39.064572 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.010573 24469 consensus_queue.cc:1243] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:39.070125 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:39.049094 24399 raft_consensus.cc:740] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:39.074079 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 161340us
I20260709 13:20:39.075573 17390 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:39.007917 24400 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.073342 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:39.082849 24345 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:39.083784 24506 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:39.083490 24345 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.084254 24506 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:39.084671 24506 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:39.085930 24345 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:39.099680 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.063099 24087 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:39.074296 24368 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:39.021826 24165 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:20:39.114542 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:39.059355 24367 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:39.122049 24417 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:39.124037 24491 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.259s	user 0.000s	sys 0.002s
I20260709 13:20:39.124271 24417 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:39.125386 17993 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:39.129130 23868 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:39.133054 24510 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:20:39.134083 24470 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:39.134625 24470 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.135054 24470 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:39.137156 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 114802us
I20260709 13:20:39.138193 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:39.139827 17362 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:39.140645 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:39.142067 24504 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:20:39.143913 24503 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:20:39.149544 24264 raft_consensus.cc:2955] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 3 to 13, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:39.153143 24507 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:20:39.159371 24485 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.159863 24492 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:39.160354 24492 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:39.160197 24485 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:39.159616 24379 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:39.162323 24379 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:39.163352 24379 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:39.164005 24485 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:39.160897 24492 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:39.164692 24379 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:39.169313 24465 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:39.172516 24400 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:39.173111 24492 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:39.178246 24124 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:39.114848 24307 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:39.181989 24307 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.183362 24399 consensus_queue.cc:260] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.218057 17321 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
W20260709 13:20:39.219651 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:39.219743 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 91433.3us
W20260709 13:20:39.237512 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 160930us
I20260709 13:20:39.253279 17394 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:39.251936 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:39.259707 17397 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:39.234385 23756 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:39.262118 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:39.233554 24345 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.271284 24249 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:39.254751 24399 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:39.274272 24322 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.275508 17393 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:20:39.283849 24322 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:39.285328 24417 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:39.238221 24382 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
W20260709 13:20:39.287122 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.288137 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:39.289064 24514 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:39.289505 24514 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.120718 24087 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.289872 24514 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:39.295004 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:39.303630 17390 raft_consensus.cc:1240] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:39.305299 23987 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:39.305547 17396 pending_rounds.cc:85] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 10
I20260709 13:20:39.305930 17396 pending_rounds.cc:107] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:20:39.306174 17396 raft_consensus.cc:2889] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:39.308115 23987 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:39.308972 24485 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.309521 24485 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:39.311862 24485 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:39.312579 17394 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:39.288148 24382 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:39.296769 24510 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:39.336504 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 226100us
W20260709 13:20:39.347364 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:39.354523 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 214819us
W20260709 13:20:39.355208 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 98187.2us
I20260709 13:20:39.357156 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:39.297458 24345 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.372500 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:39.373231 17319 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
I20260709 13:20:39.319936 24367 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:39.320309 24382 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:39.312458 24514 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.372264 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:39.382089 17315 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:20:39.324318 24510 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:39.378927 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:39.361418 17392 raft_consensus.cc:2955] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 3 to 13, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:39.395674 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:39.406121 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.351414 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "622554a5186d4910b8476a653411c85d"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:39.399475 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:39.374235 23987 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.387940 24165 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:39.417841 24165 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:39.418339 24113 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.419143 24522 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.419698 24522 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.383122 24520 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:20:39.360910 24264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39712 (request call id 9) took 1974 ms. Trace:
I20260709 13:20:39.421939 17389 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:39.418782 24165 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.410386 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:39.450996 17320 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:39.417550 17390 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:39.425047 17321 raft_consensus.cc:606] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:39.451922 17321 raft_consensus.cc:614] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:39.414842 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:39.459247 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:39.382302 24249 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:20:39.460593 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:39.469651 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:39.397421 24307 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:39.474077 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 97079.1us
I20260709 13:20:39.459360 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:39.475467 17468 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:39.413360 24345 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:39.476212 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:39.481577 17470 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:39.477083 17469 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:39.479064 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.449116 24113 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:39.483788 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:39.430787 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.488940 17390 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:39.455799 24465 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:39.507550 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:39.475486 24472 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.620s	user 0.013s	sys 0.000s
I20260709 13:20:39.517822 17463 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:39.530143 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:39.475814 23756 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.519731 17464 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:39.529465 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:39.541914 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 158559us
I20260709 13:20:39.530755 17465 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
W20260709 13:20:39.469705 17347 heartbeater.cc:646] Failed to heartbeat to 127.15.208.62:46299 (4 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.208.62:46299 timed out after 15.000s (SENT)
W20260709 13:20:39.534670 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 144851us
I20260709 13:20:39.542357 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:39.531855 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:39.543975 17394 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:39.456949 24379 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:20:39.547653 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:39.549642 17321 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:39.411449 24382 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.417107 24506 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.563717 17319 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:39.564296 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:39.546730 23868 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:39.550486 24456 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:20:39.485757 24499 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:39.571028 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 87423.9us
I20260709 13:20:39.512609 24507 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:20:39.637333 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:39.637527 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.639034 24382 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:39.643543 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.644459 24517 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:39.644945 24517 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:39.645332 24517 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:39.646219 24528 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
I20260709 13:20:39.647684 24528 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.648150 24528 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.653189 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.656795 17320 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:39.556851 24087 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:39.657850 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:39.665215 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:39.415735 24510 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.671093 24510 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:39.665880 24322 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:39.673215 24322 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:39.673676 24322 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:39.674626 24514 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:39.676622 24506 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:39.677311 24517 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:39.680006 24124 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.002s
W20260709 13:20:39.668275 24523 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 13:20:39.668785 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:39.669160 24465 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:39.680471 17394 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:39.552520 23756 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:39.681878 24368 consensus_meta.cc:287] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
W20260709 13:20:39.698026 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 154826us
I20260709 13:20:39.683959 24517 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:39.705130 24541 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:39.685674 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 127939us
I20260709 13:20:39.708524 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.547207 24472 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.689311 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:39.713111 17319 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:39.690218 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:39.693444 17313 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 24.
I20260709 13:20:39.660873 17397 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:39.682070 24087 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.449734 24264 rpcz_store.cc:276] 0709 13:20:37.377472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.381731 (+  4259us) service_pool.cc:224] Handling call
0709 13:20:37.438226 (+ 56495us) log.cc:844] Serialized 494 byte log entry
0709 13:20:39.347730 (+1909504us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23825,"raft.queue_time_us":29628,"raft.run_cpu_time_us":1443,"raft.run_wall_time_us":1440}
I20260709 13:20:39.714879 17320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6758d139882843e5bddc827c260b81a9"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:39.722868 17320 raft_consensus.cc:606] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:39.728024 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:39.565336 24534 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.151s
I20260709 13:20:39.733376 17462 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:39.712314 24368 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:39.721653 24516 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:39.747748 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:39.727412 24510 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.730933 24522 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:39.716910 24473 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:20:39.724663 24124 consensus_queue.cc:1059] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 13:20:39.775522 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 146899us
I20260709 13:20:39.776760 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.776793 17468 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:20:39.763489 24524 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.023s
W20260709 13:20:39.787235 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.773993 24307 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:39.762343 24510 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.783154 24473 consensus_queue.cc:1243] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 22.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:20:39.785938 24534 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:39.805303 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 96928us
I20260709 13:20:39.785326 24528 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:39.789824 23987 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:39.803081 24532 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:20:39.824211 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.783365 24542 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:39.808151 24373 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:39.828766 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.830690 24345 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:39.831383 24264 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:39.826028 23987 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:39.841215 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:39.848934 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 67586.4us
W20260709 13:20:39.852450 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:39.840169 24493 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.891s	user 0.008s	sys 0.009s
I20260709 13:20:39.863837 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.820407 24518 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:20:39.825809 24534 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.866087 24506 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:39.867336 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:39.861846 24527 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:20:39.869648 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.868470 17995 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:39.876796 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:39.873910 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 146107us
I20260709 13:20:39.842989 24465 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:39.880452 24534 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:39.880935 24465 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.881910 24499 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:39.883121 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:39.820225 24529 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.134s
I20260709 13:20:39.884764 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:39.885856 24539 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:39.886896 17996 raft_consensus.cc:1240] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:39.878181 24473 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:20:39.888429 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:39.890005 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:39.878538 24373 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:20:39.891239 24373 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:39.891673 24373 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:39.876199 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:39.854303 24345 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:39.869772 17991 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:39.879855 24476 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:39.884946 17390 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:39.844667 24528 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.868714 17997 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:39.862780 23756 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:39.864984 24087 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:39.896571 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:39.850812 23868 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:20:39.872399 24472 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:39.912576 17388 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:39.913043 24522 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:39.913584 24522 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:39.914465 24522 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.893987 24549 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:39.918170 23987 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:39.918987 24528 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.921597 17995 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:39.864328 24546 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:20:39.922684 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:39.923624 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59897.9us
I20260709 13:20:39.924368 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.921626 17319 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:39.925525 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.926745 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.927561 24541 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:39.927876 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:39.891307 24165 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:39.929046 24492 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:39.929642 24492 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:39.929811 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.930253 24492 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:39.872877 24493 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.932065 17285 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:39.932862 24493 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:39.933800 17999 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:39.902182 24554 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:20:39.934635 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.900957 24345 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.935514 24345 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:39.899998 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:39.930922 24492 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:39.941527 23756 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:39.927953 24541 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:39.915699 24522 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:39.950420 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:39.954345 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:39.947530 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:39.955672 17394 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:20:39.960213 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 82218.1us
I20260709 13:20:39.959674 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:39.964603 17993 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 24: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:39.969051 17991 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:20:39.970670 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 144365us
I20260709 13:20:39.970978 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:39.971668 17389 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:39.968114 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:39.973779 17995 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:39.974288 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:39.974423 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:39.975135 17997 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:39.976051 24417 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:39.976644 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.977725 24510 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:39.980698 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:39.876822 24506 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:39.982362 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 82479us
I20260709 13:20:39.984018 24529 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:39.997104 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:39.985066 24356 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:40.003729 24356 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.003489 24477 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:40.004213 24356 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:40.005016 17435 leader_election.cc:336] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Timed out: RequestConsensusVote RPC to 127.15.208.2:33079 timed out after 1.779s (SENT)
I20260709 13:20:40.005532 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.004941 24477 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:40.006351 24477 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:39.968118 24476 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:40.007411 24477 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.008085 24476 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.985698 17991 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:20:40.008988 17991 pending_rounds.cc:85] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 15
I20260709 13:20:40.009272 17991 pending_rounds.cc:107] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:20:40.009585 17991 raft_consensus.cc:2889] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:39.985721 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:40.011391 24470 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.876s	user 0.013s	sys 0.001s
I20260709 13:20:39.986313 17287 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.011945 17465 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:40.011830 24470 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:39.987686 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:39.989158 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:40.013515 17997 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 24: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:40.013571 24124 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:40.014122 24124 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:40.014304 24470 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:40.014556 24124 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.016086 17316 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:40.017446 17287 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.018543 24473 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:40.019032 24473 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:40.019467 24473 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:40.022156 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.022629 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.022921 17397 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 15: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:40.023119 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:39.996964 24524 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:20:40.024767 24524 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:39.989037 24264 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:39.989806 24367 consensus_queue.cc:1059] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:39.992810 24417 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:39.995906 24322 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:39.995975 24510 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:40.049149 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:39.985033 23868 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:40.001360 17467 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:40.025115 24524 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:40.036489 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:40.038014 24516 raft_consensus.cc:3055] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:20:40.046947 24540 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
I20260709 13:20:40.010139 24346 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:20:40.010715 24476 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:39.973018 24087 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:20:40.014194 24471 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:20:40.032321 23987 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:40.029798 24477 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.062628 24516 raft_consensus.cc:740] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:40.049813 17992 raft_consensus.cc:2955] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 3 to 13, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:40.070580 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:40.079035 24249 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:40.079603 24249 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:40.080659 24249 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.084329 24249 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:40.034576 24470 consensus_queue.cc:1059] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:20:40.069954 24518 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:20:40.109403 24492 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:40.108958 24516 consensus_queue.cc:260] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:40.111543 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47660.9us
I20260709 13:20:40.112123 24546 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:40.115760 24322 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:40.069546 24379 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:40.123314 17389 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
W20260709 13:20:40.131817 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:40.134680 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 101191us
I20260709 13:20:40.138453 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:40.144748 24516 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:40.084616 24345 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.145906 24472 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:40.172189 17962 leader_election.cc:336] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 1.824s (SENT)
I20260709 13:20:40.183044 17962 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.173108 17204 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b19033ecd72e4ba188910445b70c84d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
W20260709 13:20:40.185707 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51498.7us
I20260709 13:20:40.151055 24492 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:40.151144 24546 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:40.156073 24141 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 1.090s	user 0.010s	sys 0.006s
W20260709 13:20:40.197043 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.199769 24541 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.202894 24506 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:40.204030 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:40.146979 24417 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.193533 24165 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:40.190377 24472 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:40.213681 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 164061us
I20260709 13:20:40.219985 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:40.225682 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.191943 24492 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:40.232151 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:40.232616 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.145083 24524 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.238523 17963 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:40.231243 23987 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:40.230919 24492 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.227294 24568 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.252998 24569 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:20:40.253425 24555 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:40.255954 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:40.256774 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.241263 24322 raft_consensus.cc:2764] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:40.244958 24510 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:40.255185 24367 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.246963 24529 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:20:40.249063 24549 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:20:40.279245 24524 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.293062 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.268640 24555 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.262369 24517 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:20:40.286526 24367 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.293550 24529 consensus_queue.cc:1243] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:40.319758 24367 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:40.321439 24345 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:40.322777 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 66918.8us
I20260709 13:20:40.323649 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.324959 24499 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:40.331501 23756 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:40.290166 24113 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:40.332546 17392 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:40.332679 24113 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:40.333106 24113 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.333765 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:40.291853 24472 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:40.289815 23987 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:40.337613 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:40.292573 24535 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 13:20:40.337705 23987 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.340301 23987 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:40.301174 24555 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:40.343377 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.280691 24546 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:40.322817 24560 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
I20260709 13:20:40.346865 24356 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.351259 24522 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.351868 24522 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.300037 24477 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:40.353446 24477 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:40.353971 24522 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:40.354387 24477 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.369114 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.375546 17999 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:40.365545 24549 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:40.365839 23756 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.397389 24465 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:40.399194 24356 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:40.403577 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.404861 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.405119 24576 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:40.405500 24576 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:40.406328 24576 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.283272 24568 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.404191 24555 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:40.414685 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 209207us
I20260709 13:20:40.367480 23987 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:40.433475 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.438148 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.393662 24549 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:40.429423 24499 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:40.359087 24473 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.448256 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:40.437655 24576 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:40.451116 17395 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:20:40.445140 24549 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.459734 17390 raft_consensus.cc:1217] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 20.12->[22.13-22.13]   Dedup: 22.13->[]
I20260709 13:20:40.460409 17390 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:20:40.462831 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.432662 24465 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:20:40.464946 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.472222 17319 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: [19.15-20.16]
I20260709 13:20:40.496403 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:40.489820 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.497099 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:40.498992 24572 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:40.474596 17388 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:20:40.506361 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:40.507376 17315 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:20:40.507472 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.510713 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.511410 17392 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:40.514746 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.452589 23987 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.515725 17397 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:40.522151 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.467362 24575 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.530853 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.467545 24124 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.532536 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.540987 24264 raft_consensus.cc:3055] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:40.535272 24577 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:40.541450 24264 raft_consensus.cc:740] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:40.541844 24577 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.542297 24264 consensus_queue.cc:260] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.543314 24264 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:40.544013 24577 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:40.545164 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.546603 24517 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:40.547123 24517 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.547652 24568 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:40.551831 24478 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:40.552260 24478 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:40.508946 24492 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.554497 24534 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:40.554884 24534 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:40.555723 24534 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.565936 24555 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:40.585216 24583 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:40.585902 24583 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.588930 24559 raft_consensus.cc:3055] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:40.589346 24559 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:40.589236 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.590152 17315 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:40.590312 24559 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.591563 24559 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:40.588594 24373 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:40.596084 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.597675 24541 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.598834 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:40.599123 17321 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:20:40.599684 17321 pending_rounds.cc:85] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 16
I20260709 13:20:40.599958 17321 pending_rounds.cc:107] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:20:40.600247 17321 raft_consensus.cc:2889] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:40.601096 17320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:40.601538 17319 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:40.601665 17320 raft_consensus.cc:606] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.602095 17320 raft_consensus.cc:614] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:40.602576 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.602110 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.588581 24583 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:40.603248 24478 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.604434 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:40.612272 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.606578 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:40.618862 17466 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:40.616500 24583 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.621526 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:40.622586 24471 raft_consensus.cc:993] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:20:40.623517 17471 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:40.623867 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.624706 17464 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:40.608399 24534 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.623313 24471 raft_consensus.cc:1081] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:20:40.632426 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.634554 17321 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:20:40.631630 24473 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:40.624435 24501 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:40.636749 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.637398 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:40.638108 17319 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:40.638859 17321 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:20:40.639268 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:40.639617 24581 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:20:40.640944 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.641685 17315 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 15: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:40.642047 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.639446 17318 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23. Ops: [20.15-22.16]
I20260709 13:20:40.653348 17962 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:40.653597 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.654824 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:40.660981 17962 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.661888 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:40.662532 17471 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
W20260709 13:20:40.663419 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 237340us
I20260709 13:20:40.659907 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:40.673282 17314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:40.675127 24113 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.667999 17466 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:40.667462 24551 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:40.631470 24517 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:40.610309 24546 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:20:40.684986 17471 raft_consensus.cc:1240] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:40.685242 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.686049 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:40.686633 17471 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:40.685492 24546 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:40.686802 17395 raft_consensus.cc:1240] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:40.673394 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.633441 24492 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:40.692334 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.689334 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:40.687984 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:40.690887 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:40.694495 17464 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.694375 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.695048 17318 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 25.
I20260709 13:20:40.693290 17470 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:40.533077 24575 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.699841 17466 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:40.621538 24583 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.626771 24499 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 13:20:40.699548 24510 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:40.717757 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.719134 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.719237 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.719698 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.720252 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.720294 17389 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.723488 24124 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:40.725425 24571 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:20:40.726707 24528 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:40.729218 24575 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:40.692431 24471 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:20:40.703889 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.733574 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:40.734493 17471 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:40.701957 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.660882 24249 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:40.703204 24379 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:20:40.709604 17320 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:40.735286 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.710345 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.703054 24473 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:20:40.720623 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.741729 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:40.746876 17390 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:40.746938 17389 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:40.747783 17388 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:40.748675 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.708000 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:40.743805 17465 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:40.743903 17322 raft_consensus.cc:1275] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:40.744408 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.757548 17397 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:40.691396 24546 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:40.761979 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:40.761008 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 53097us
I20260709 13:20:40.764061 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:40.764479 17397 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:20:40.764061 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.765216 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.766150 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.767302 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:40.768159 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 64384.4us
I20260709 13:20:40.768491 17397 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:40.768965 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.771106 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.771502 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.772392 17388 raft_consensus.cc:2410] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:20:40.771206 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.774523 24516 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:40.775007 24516 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.775359 24516 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:40.777120 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.741531 23756 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:40.779999 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.764056 24471 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:40.793341 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.780454 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.778252 24395 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:40.782877 24510 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:40.785094 24584 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:40.762507 24575 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:40.788867 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:40.776129 24569 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:40.825418 24594 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:40.826030 24594 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:40.827611 17215 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49294 (request call id 332) took 51899 ms (client timeout 15000 ms). Trace:
I20260709 13:20:40.795241 24471 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.830530 24471 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:40.831219 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:40.828085 17215 rpcz_store.cc:269] 0709 13:19:48.928268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.928501 (+   233us) service_pool.cc:224] Handling call
0709 13:20:40.827501 (+51899000us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:38.285044 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:38.295019 (+  9975us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:38.295099 (+    80us) write_op.cc:435] Acquired schema lock
0709 13:20:38.295125 (+    26us) tablet.cc:662] Decoding operations
0709 13:20:38.308071 (+ 12946us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:38.308164 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:38.308198 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:20:38.308683 (+   485us) tablet.cc:701] Row locks acquired
0709 13:20:38.308733 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:20:38.308916 (+   183us) write_op.cc:270] Start()
0709 13:20:38.309074 (+   158us) write_op.cc:276] Timestamp: P: 1783603238308824 usec, L: 0
0709 13:20:38.309125 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 13:20:38.434359 (+125234us) log.cc:844] Serialized 923 byte log entry
0709 13:20:38.945846 (+511487us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627efe28 00007f7d6622a581 00007f7d66229d58 00007f7d6622e9f1 00007f7d6622e9a9 00007f7d6622e939 00007f7d6622e901 00007f7d6622db2d 000000000038f354 000000000038f199
0709 13:20:39.673128 (+727282us) op_driver.cc:464] REPLICATION: finished
0709 13:20:39.840453 (+167325us) write_op.cc:301] APPLY: starting
0709 13:20:39.861699 (+ 21246us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:39.887036 (+ 25337us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:39.887079 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:39.888471 (+  1392us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:39.888713 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:20:39.888770 (+    57us) write_op.cc:312] APPLY: finished
0709 13:20:39.940098 (+ 51328us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f132a 00007f7d62776f14 00007f7d62776ec3 00007f7d62776e38 00007f7d62776df3 00007f7d627760dc 00007f7d6279fe16 00007f7d62787cbb 00007f7d6277239d 00007f7d62775d75
0709 13:20:39.982724 (+ 42626us) log.cc:844] Serialized 33 byte log entry
0709 13:20:40.048408 (+ 65684us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:40.058500 (+ 10092us) write_op.cc:454] Released schema lock
0709 13:20:40.068694 (+ 10194us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:40.124811 (+ 56117us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:40.133455 (+  8644us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1670111,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":134934,"apply.run_cpu_time_us":6179,"apply.run_wall_time_us":281206,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":287352,"prepare.run_cpu_time_us":48412,"prepare.run_wall_time_us":661102,"raft.queue_time_us":342094,"raft.run_cpu_time_us":24788,"raft.run_wall_time_us":284017,"replication_time_us":1363812,"spinlock_wait_cycles":86289920,"thread_start_us":517014,"threads_started":4,"wal-append.queue_time_us":328599}]]}
I20260709 13:20:40.834892 17318 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:20:40.812223 24546 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.838449 24546 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.842350 24124 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:40.803148 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.843238 17388 raft_consensus.cc:2376] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18. Re-sending same reply.
I20260709 13:20:40.842638 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:40.845273 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.810691 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.854627 17392 raft_consensus.cc:2376] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15. Re-sending same reply.
I20260709 13:20:40.787926 24417 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:40.811754 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.812819 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.771747 24346 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:20:40.818284 24584 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.805358 17396 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
W20260709 13:20:40.874430 24592 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:40.874608 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.875245 17393 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:40.844722 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:40.876590 17287 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:40.814775 17962 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.865460 17391 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:40.879765 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:40.873987 24584 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.812288 24510 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:40.879901 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 164635us
I20260709 13:20:40.819698 23987 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:40.815874 24535 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:40.903700 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.885084 24476 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:40.881603 24395 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:40.886390 24346 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:40.887326 24473 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:40.875801 24113 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:40.913156 24473 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.913595 24473 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:40.914592 24516 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:40.910848 24346 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:40.888723 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 74025.6us
I20260709 13:20:40.921406 24346 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:40.922501 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.922748 24346 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.882988 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.893936 17390 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14.
I20260709 13:20:40.828828 24594 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:40.892899 17286 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:40.880726 23868 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:40.931195 17393 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:40.900928 24510 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.937485 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:40.847071 24367 consensus_queue.cc:1175] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7108577e5754060b7e468a43dfdcdeb" responder_term: 14 status { last_received { term: 13 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:40.938978 17393 raft_consensus.cc:2376] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18. Re-sending same reply.
I20260709 13:20:41.010653 17963 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:41.015805 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:40.983139 17314 raft_consensus.cc:606] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:40.988732 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.967754 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:41.044034 17314 raft_consensus.cc:614] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:40.967634 17388 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:40.908696 24506 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:41.005604 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.001518 17389 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:40.973963 17962 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:41.047322 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 73681.1us
I20260709 13:20:41.023419 17464 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:41.047329 17395 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:40.925945 24476 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:41.050081 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.064424 17390 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 25: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:41.065819 17991 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:20:40.932274 23868 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.067773 17991 pending_rounds.cc:85] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 15
I20260709 13:20:41.068145 17991 pending_rounds.cc:107] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:20:40.939193 24555 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:41.068395 17991 raft_consensus.cc:2889] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:41.063476 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.069680 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.072623 17471 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:41.073406 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.935282 23987 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:40.998781 24549 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.008s
I20260709 13:20:41.044901 24417 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:40.936962 24516 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:41.047680 24506 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.085199 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.085778 17390 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:41.078053 17287 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:41.080106 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.005713 24547 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.089649 17471 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
W20260709 13:20:41.099673 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.100296 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.986352 24583 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:41.049997 24534 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:41.108661 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.112390 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.109465 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.110320 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:41.113870 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:40.961354 24551 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.120s
I20260709 13:20:41.112697 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:41.048708 24541 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:41.074432 23868 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:41.115638 17388 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:41.116019 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:40.938084 24559 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:41.116570 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.937824 24584 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.105477 24506 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:40.978466 24471 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:41.135910 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:41.120865 17320 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:40.981077 24575 consensus_queue.cc:1059] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 13:20:41.130937 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.132071 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:41.114194 24547 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.131734 24534 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:41.137835 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:41.143795 17388 raft_consensus.cc:2376] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18. Re-sending same reply.
I20260709 13:20:41.141544 17389 raft_consensus.cc:2376] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 14. Re-sending same reply.
I20260709 13:20:41.144634 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.119288 24516 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:41.075201 24473 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:41.134756 24576 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.004s
I20260709 13:20:41.151811 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:41.160826 17389 raft_consensus.cc:2376] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19. Re-sending same reply.
I20260709 13:20:41.161916 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.157522 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.112995 24524 consensus_queue.cc:1059] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:20:41.097265 23987 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.174407 23987 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:41.084372 24549 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.176098 17392 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:41.179352 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:41.181221 17390 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:41.180925 24476 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:41.170534 17393 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:41.182096 17390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6758d139882843e5bddc827c260b81a9"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:20:41.182663 17390 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:41.182951 17393 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:41.183456 24549 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:41.183039 17390 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:41.185068 24417 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:41.187036 24473 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:41.167423 24516 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:41.128803 23756 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:20:41.188604 24516 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:41.190464 24547 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:41.193853 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 411568us
I20260709 13:20:41.194523 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.195257 17388 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:41.198141 17388 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:41.202245 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:41.215647 24534 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.203922 24524 consensus_queue.cc:1243] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:41.221755 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:41.223464 17396 raft_consensus.cc:2368] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 21. Current term is 22.
I20260709 13:20:41.226398 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:41.235702 24576 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:41.245085 24584 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:41.244869 23868 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:41.234360 17434 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:41.261308 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:41.263108 17471 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:20:41.264467 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.265148 17471 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.232358 24535 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.262494 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.236169 24555 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:41.282761 17469 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:41.285748 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.237962 24594 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:41.282500 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.290167 17463 raft_consensus.cc:2410] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:41.292384 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:41.293236 17462 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:41.294167 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.287176 17390 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.288995 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:41.295708 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 217768us
I20260709 13:20:41.296178 17391 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:41.296918 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.287859 24555 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.283633 24576 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:41.311360 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.312304 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.329636 17471 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:41.303901 24555 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.334306 23756 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:41.335551 24599 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:41.303840 24600 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:20:41.339785 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.340160 24510 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.307624 24594 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:41.346685 23868 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:41.292141 24535 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.348222 24547 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.393275 17468 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:41.351209 24165 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.353199 17315 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:41.312949 24576 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:41.358867 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46014.2us
I20260709 13:20:41.398237 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:41.399086 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 330175us
I20260709 13:20:41.371891 17465 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:41.391831 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.389936 24599 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:41.409278 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:41.306216 17287 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:41.389261 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.390897 24417 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:41.412593 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 107046us
I20260709 13:20:41.407833 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:41.400552 24593 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:41.361549 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:41.400632 24576 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:41.403198 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:41.418061 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:41.387380 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 281547us
I20260709 13:20:41.412523 23868 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:41.419857 17462 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:41.397145 24165 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.410753 24599 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:41.397413 24547 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.422262 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:41.450207 17468 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:41.450856 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:41.416270 24367 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:41.458107 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:41.408601 24583 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:20:41.468750 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.422173 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.479830 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:41.480279 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:41.411842 17465 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:41.485392 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:41.489816 17392 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:41.486737 17320 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:20:41.487375 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.493763 17992 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:41.483938 17322 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:41.486001 17468 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:41.425364 24573 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:41.487807 17471 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:41.424355 23987 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:41.482802 17996 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 22: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:41.416476 24417 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.506407 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:41.506966 17465 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:41.515400 17465 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:41.481348 24593 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:41.521817 17465 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
W20260709 13:20:41.519048 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60997.3us
I20260709 13:20:41.520638 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:41.524581 17315 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:41.524978 17315 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:41.494841 24577 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:41.535142 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:41.453915 23868 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:41.542654 17469 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:41.503525 24541 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.543797 17468 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:41.546535 17465 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:41.502003 24607 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:41.518296 24591 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:20:41.559487 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.550940 17468 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:41.553908 17471 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:41.550707 17392 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:41.453450 24594 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.496523 24555 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.558460 24591 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:41.562172 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:41.557433 24611 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:41.556097 24541 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.548789 24472 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:41.567654 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 44068.6us
I20260709 13:20:41.716637 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:41.717929 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:41.504741 24573 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.550033 24577 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.734051 24472 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:41.736186 24577 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:41.736294 24472 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:41.737704 24628 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:41.738793 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:41.739398 17396 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:41.559190 24593 raft_consensus.cc:2764] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:20:41.541610 24367 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:41.561673 24583 raft_consensus.cc:2764] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
W20260709 13:20:41.620252 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.703377 17392 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:41.713389 24609 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.293s	user 0.000s	sys 0.004s
W20260709 13:20:41.711236 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47666.5us
W20260709 13:20:41.729272 24612 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:41.731379 23987 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:41.733682 24573 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:41.716434 24611 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.704135 17471 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:20:41.750902 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:41.718058 24606 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.185s	user 0.003s	sys 0.006s
I20260709 13:20:41.765642 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:41.748003 24620 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.296s	user 0.002s	sys 0.008s
I20260709 13:20:41.769490 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:41.767030 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:41.706940 24506 consensus_meta.cc:287] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.008s
I20260709 13:20:41.767397 17993 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:41.783063 17997 raft_consensus.cc:1813] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Handling vote request from an unknown peer b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:41.748157 24577 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.781332 17999 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:20:41.784933 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 67067.1us
I20260709 13:20:41.703218 24395 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:41.781134 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:41.787814 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:41.785539 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:41.786237 17997 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:20:41.790484 17392 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:41.747660 24510 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:41.792202 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.794044 17317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:41.797658 17317 raft_consensus.cc:606] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Received request to transfer leadership to TS c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:41.674815 24584 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260709 13:20:41.796267 17396 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:41.803467 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:41.786402 24610 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.813477 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.814986 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:41.815498 17396 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:41.776362 24124 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:20:41.791719 24395 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:41.803926 24322 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.819633 17396 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:41.804563 24141 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:41.786600 24472 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:20:41.822959 17435 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:41.783296 24506 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.814126 23987 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:41.822614 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:41.838061 24618 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:20:41.840041 24616 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:20:41.830528 24600 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:41.842145 24614 log.cc:927] Time spent T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:20:41.843462 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:41.846648 17467 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:20:41.848404 24636 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:41.849472 17990 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:20:41.849906 17990 pending_rounds.cc:85] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 13
I20260709 13:20:41.850201 17990 pending_rounds.cc:107] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:20:41.844779 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:41.850457 17990 raft_consensus.cc:2889] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:41.857703 17396 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:41.859136 17396 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:41.850461 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:41.867306 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:41.823973 24547 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:41.882692 17396 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:41.848731 24632 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:41.888104 17396 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:41.812870 24630 consensus_queue.cc:1048] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:20:41.824637 24322 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.890713 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:41.868227 24600 raft_consensus.cc:2764] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:41.818634 24610 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.905534 24600 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:41.906466 24610 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:41.868459 24636 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:41.906980 24626 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
I20260709 13:20:41.890821 24632 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:41.899140 24617 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:20:41.907490 17389 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:41.908932 24623 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:20:41.898717 24599 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:41.910835 24555 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:41.900074 24624 log.cc:927] Time spent T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:20:41.880185 24165 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:41.880085 24141 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:41.901232 24627 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:20:41.902740 24322 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:41.904170 24471 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:41.891024 24633 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:41.907526 24632 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:41.900020 24576 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:41.818813 24367 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:41.809726 24591 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:41.934857 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:41.938592 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.916743 24141 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:41.918202 24599 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:41.945312 17463 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 25: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:41.923101 23868 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:41.948586 17469 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:20:41.953698 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:41.961633 24619 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:20:41.962911 17390 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:41.969179 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 101921us
I20260709 13:20:41.976125 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:41.944444 24591 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:41.998832 17286 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:41.964953 24575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.011s	sys 0.036s
I20260709 13:20:41.994694 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:42.001420 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 113899us
I20260709 13:20:42.004208 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40270 (request call id 3965) took 1006 ms. Trace:
I20260709 13:20:42.004386 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:42.007575 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.004864 17390 rpcz_store.cc:276] 0709 13:20:41.043764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.181926 (+138162us) service_pool.cc:224] Handling call
0709 13:20:41.962745 (+780819us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b4c0015e1c0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d60ac0a20 00007f7d60ad1a29 00007f7d60ad213f 00007f7d60a962ab 00007f7d60ac3f3c 00007f7d60ac43fe 00007f7d60d5188b 00007f7d62750495 00007f7d627a130f 00007f7d627eba55 00007f7d677bbcd0
0709 13:20:41.974901 (+ 12156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117575808}
I20260709 13:20:42.010629 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:42.011642 17468 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:42.008791 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.012270 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.012934 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.013542 17464 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
W20260709 13:20:42.003304 24575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.011s	sys 0.037s
I20260709 13:20:42.016904 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:42.017163 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:42.017575 17468 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:42.003024 24599 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:42.006613 24593 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:42.022310 17991 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 13: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:42.020484 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.013629 24610 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:42.013325 24611 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.004340 24471 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:20:42.015120 24573 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:42.030714 23987 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:42.045045 24574 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:42.030838 24633 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:42.072933 24633 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:42.073350 23987 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.074035 24633 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.076977 24573 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:42.076778 17315 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.078045 17315 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:42.077910 24573 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.047359 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:42.049719 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.047458 24610 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:42.060477 17468 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:42.006162 24594 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:20:42.086845 24610 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.015764 24141 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:42.100224 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 52972.8us
I20260709 13:20:42.101398 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:42.068328 24506 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.113174 24648 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:42.112633 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:42.115183 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:42.116055 24645 raft_consensus.cc:2764] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:20:42.116169 24417 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.116757 24645 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:42.117076 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.116796 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:42.117820 24645 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:42.118355 24645 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:42.118513 17435 leader_election.cc:400] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 21. Current term is 22.
I20260709 13:20:42.118871 17435 leader_election.cc:403] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:20:42.119560 24648 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 21. Current term is 22.
I20260709 13:20:42.120141 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:42.120262 24645 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.121419 24322 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:42.122978 17362 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:42.127437 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:42.128787 17315 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:42.099361 24574 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:42.131141 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:42.132387 17464 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:42.104521 24642 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:42.106693 24583 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:42.135861 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.141943 24608 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.142601 24608 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.145037 24608 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.134977 24478 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:42.134866 24642 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.157325 24642 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:42.161695 24574 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.133985 24322 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:42.172509 24583 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:42.173632 24583 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:42.196467 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 73572.9us
I20260709 13:20:42.189421 24577 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:42.196120 24322 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:42.213657 24322 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.215839 24322 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.216295 24322 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.217715 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 3950) took 1749 ms. Trace:
W20260709 13:20:42.218485 24652 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:20:42.229085 24655 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.229727 24655 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.231186 24535 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.232664 24655 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.232801 24395 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.234014 24395 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:42.241075 24541 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.242388 24472 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:42.242782 24472 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:42.243574 24472 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.245784 24593 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:42.216740 24322 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.250501 24322 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.218185 17394 rpcz_store.cc:276] 0709 13:20:40.468077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.468246 (+   169us) service_pool.cc:224] Handling call
0709 13:20:40.468506 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.802201 (+333695us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:41.075625 (+273424us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.292518 (+216893us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:41.292595 (+    77us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:41.292655 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.217472 (+924817us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540023d2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:42.217516 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.217637 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13333,"prepare.queue_time_us":79957,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":3042,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6180,"spinlock_wait_cycles":760032000,"thread_start_us":476162,"threads_started":2,"wal-append.queue_time_us":328818}
I20260709 13:20:42.261525 24472 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:42.267992 24517 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:42.276497 24632 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:42.277103 24622 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.542s	user 0.005s	sys 0.000s
I20260709 13:20:42.277779 24417 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:42.278645 24417 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:42.279002 24417 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:42.279752 24249 raft_consensus.cc:3055] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:42.280224 24249 raft_consensus.cc:740] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:42.279975 24417 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.280392 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:42.276877 24517 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:42.279069 24549 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:20:42.281705 17990 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:42.278856 24632 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:42.288951 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:42.289631 17998 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:42.290421 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:42.290974 17994 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:42.293457 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:42.295329 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:42.284909 24655 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:20:42.296996 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:42.301542 17395 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:20:42.298672 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:42.306067 17394 raft_consensus.cc:2393] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 25: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:42.306284 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:42.284380 24322 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:20:42.300417 24662 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:42.308616 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:42.297456 24417 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:42.330637 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:42.331370 17394 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
W20260709 13:20:42.318171 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.296167 24549 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.309549 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:42.333240 17396 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:42.345124 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:42.345881 17394 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:42.346725 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:42.347321 17396 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:42.355075 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:42.355720 17394 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:42.359058 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:42.359767 17396 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:42.298321 24249 consensus_queue.cc:260] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.364892 17994 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:42.341822 24549 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.369611 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.370956 17396 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:42.370939 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.372596 17395 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:42.371100 24249 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:42.372015 24535 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:42.377250 24535 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.377339 17394 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:42.377665 24535 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:42.381419 24663 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:42.383287 24522 raft_consensus.cc:3055] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:42.383800 24522 raft_consensus.cc:740] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:42.384677 24522 consensus_queue.cc:260] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.386179 24522 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:42.359221 24661 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:42.404738 24395 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:42.407650 17963 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.422588 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.417143 24517 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:42.346343 24642 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.342212 24662 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.429463 24662 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.430054 24662 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:42.413972 24395 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.431156 24395 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:42.434281 24642 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.427618 24541 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:42.435850 24541 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.436270 24541 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:42.420709 24608 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:42.436955 24608 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.437316 24608 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:42.425259 24660 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:20:42.448464 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 140620us
I20260709 13:20:42.432564 24535 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.449455 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:42.451721 24373 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:42.455681 24395 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.459687 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:42.455683 24621 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.666s	user 0.000s	sys 0.001s
I20260709 13:20:42.446799 24524 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.464614 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:42.466300 17393 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:42.446548 24322 consensus_queue.cc:1243] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:42.475778 17393 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:42.477118 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.467797 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:42.477954 24522 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:42.478576 24522 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:42.479162 24671 raft_consensus.cc:2764] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 13:20:42.479491 24522 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.483031 17362 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:42.484062 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:42.466727 24661 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:42.485980 24322 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:42.486438 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2394) took 1226 ms. Trace:
I20260709 13:20:42.486634 24322 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:42.486852 17463 rpcz_store.cc:276] 0709 13:20:41.259596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.298949 (+ 39353us) service_pool.cc:224] Handling call
0709 13:20:42.486229 (+1187280us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54001afed4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:42.486354 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446483328}
I20260709 13:20:42.488406 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1240) took 1179 ms. Trace:
I20260709 13:20:42.490878 24576 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:42.492466 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.468632 24524 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.493714 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.494287 17470 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:42.494431 24524 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.495101 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:42.495651 17470 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:42.495517 24524 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:42.497165 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.500447 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:42.494469 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:42.501466 17318 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 22: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:42.496575 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1195) took 1686 ms. Trace:
I20260709 13:20:42.503443 17315 raft_consensus.cc:1240] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23. Ops: [20.15-22.16]
I20260709 13:20:42.508666 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:42.500658 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:42.514042 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.514165 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.514714 17464 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
I20260709 13:20:42.488775 17469 rpcz_store.cc:276] 0709 13:20:41.308653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.549139 (+240486us) service_pool.cc:224] Handling call
0709 13:20:41.549441 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.973228 (+423787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.488178 (+514950us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54001c02d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:42.488352 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917006720}
I20260709 13:20:42.519891 17468 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:42.462111 24668 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:42.525902 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:42.528779 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:42.529636 17313 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:42.536610 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1242) took 1227 ms. Trace:
I20260709 13:20:42.525902 24661 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:42.541265 17465 rpcz_store.cc:276] 0709 13:20:41.309137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.547300 (+238163us) service_pool.cc:224] Handling call
0709 13:20:41.547537 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.740817 (+193280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.741055 (+   238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:41.741111 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:41.741144 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.536258 (+795114us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54001694d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:42.536337 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.536540 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444083456}
I20260709 13:20:42.542320 24661 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:42.546080 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 175264us
I20260709 13:20:42.514499 24472 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.520315 24583 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.519186 24477 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:42.551290 17287 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:42.548062 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.567612 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:42.566636 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.530670 24632 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:42.569476 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.574884 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.576140 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.549353 24668 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:42.557493 24506 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:42.571373 23756 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:42.572274 24346 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:42.589040 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:42.572345 24518 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:42.571972 24549 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:42.592614 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 108444us
I20260709 13:20:42.577447 24675 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:42.599550 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.583014 24551 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:42.576921 24670 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:42.600946 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:42.602335 17962 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:42.602979 24680 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:42.606202 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.566833 24472 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.609257 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:42.566660 24583 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.617259 24671 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:42.618309 24671 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:42.584015 24471 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:20:42.597611 24346 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:20:42.628616 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.628719 24346 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:42.591004 23756 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:42.633589 23756 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:42.582705 24524 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:20:42.597451 24518 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.633487 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:42.684012 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1205) took 1436 ms. Trace:
I20260709 13:20:42.607334 24670 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.607409 24549 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:42.607113 24517 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:42.591619 24506 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:42.626647 24667 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:20:42.706655 24658 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:42.707422 24658 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.684929 24546 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:42.682960 24249 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:42.716485 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:42.717324 17993 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:42.684621 17392 rpcz_store.cc:276] 0709 13:20:41.247420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.798053 (+550633us) service_pool.cc:224] Handling call
0709 13:20:41.798371 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.798571 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:42.590981 (+792410us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.683631 (+ 92650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.683689 (+    58us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:42.683734 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.683799 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.683941 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":756774,"raft.queue_time_us":60208,"thread_start_us":93260,"threads_started":2}
I20260709 13:20:42.637746 24680 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:42.689625 24395 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.720701 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:42.725405 17391 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:42.684733 24518 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:42.722669 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:42.713568 24535 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:42.746515 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 137368us
I20260709 13:20:42.690611 24670 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:42.718550 24249 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.767756 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:42.720376 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 118105us
I20260709 13:20:42.727372 24478 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.769881 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.755966 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:42.770668 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.771222 17469 raft_consensus.cc:2410] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:42.771739 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:42.773165 24577 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:42.757200 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.776353 17468 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:42.772003 17391 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:42.704785 24517 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.748556 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.783382 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.784617 17996 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:42.785907 17465 raft_consensus.cc:2393] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:42.779667 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.704582 24549 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.788045 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:42.789606 17390 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:42.797745 24472 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.799857 24583 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.809543 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.716387 24546 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.735380 24471 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.742820 24395 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.822602 17470 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:42.821233 17465 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:42.777850 24249 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:42.787398 24591 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:42.840322 24633 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:42.888415 24506 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:42.889297 24517 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:42.889148 24541 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.891270 24541 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.892131 24546 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.877112 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:42.896984 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:42.897724 17998 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:42.735163 24668 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.898797 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:42.842842 24686 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:42.843536 24346 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.787405 24478 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.831584 24471 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:42.845635 24677 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:20:42.846362 17470 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:20:42.857278 24663 raft_consensus.cc:3055] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:42.831929 24583 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:20:42.859575 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1246) took 1547 ms. Trace:
I20260709 13:20:42.862926 17392 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:42.870930 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1247) took 1558 ms. Trace:
I20260709 13:20:42.832370 24395 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:42.881615 24641 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.854s	user 0.000s	sys 0.003s
I20260709 13:20:42.882311 24549 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.868515 23756 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:42.886359 24679 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:42.838516 24680 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.976940 24684 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.977670 24684 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:42.980579 24517 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:42.904217 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:42.981843 17998 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:42.913364 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.982707 17465 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:42.939077 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:42.983279 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.983649 17388 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:42.940001 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:42.902073 24417 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.003s
I20260709 13:20:42.980471 24684 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.944260 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.912813 24608 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.987568 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:42.988327 24608 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.988897 24632 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:42.989370 24632 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:42.989782 24632 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:42.989918 24470 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:42.990451 24470 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.992341 24470 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.958451 24687 consensus_queue.cc:1059] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:20:42.993741 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.993988 24478 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.975104 23756 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.985157 24591 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:42.911450 24686 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.997088 24686 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.986140 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:42.997870 17995 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:42.998369 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:42.952425 17471 rpcz_store.cc:276] 0709 13:20:41.312712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.779981 (+467269us) service_pool.cc:224] Handling call
0709 13:20:41.780298 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.803494 (+ 23196us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:41.816561 (+ 13067us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.897281 (+ 80720us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.914283 (+ 17002us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.915828 (+  1545us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:41.915902 (+    74us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:41.915970 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.453270 (+537300us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18002c17c0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f707522 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:42.869658 (+416388us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b18002c17c0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419
0709 13:20:42.870672 (+  1014us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5400384ad4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:42.870722 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.870866 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23689,"prepare.queue_time_us":43555,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":125,"raft.queue_time_us":1282,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":1876,"spinlock_wait_cycles":85040768,"thread_start_us":61937,"threads_started":1,"wal-append.queue_time_us":115985}
I20260709 13:20:42.999704 24471 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:42.947072 24663 raft_consensus.cc:740] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:43.001122 24346 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:42.950222 17462 rpcz_store.cc:276] 0709 13:20:41.312456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.627339 (+314883us) service_pool.cc:224] Handling call
0709 13:20:41.713308 (+ 85969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.713546 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:20:41.769605 (+ 56059us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.945050 (+175445us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.237962 (+292912us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b18004569a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1
0709 13:20:42.239429 (+  1467us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b18004569a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:42.858985 (+619556us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b18004569a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d623aad70 00007f7d6239e293 00007f7d62393cea 00007f7d6239423a 00007f7d627fea2a 00007f7d6280e0bf 00007f7d6280e038
0709 13:20:42.859225 (+   240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.859276 (+    51us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:42.859322 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.859388 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.859506 (+   118us) inbound_call.cc:177] Queueing success response
0709 13:20:42.881059 (+ 21553us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
Metrics: {"mutex_wait_us":2805,"prepare.queue_time_us":82681,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":82,"raft.queue_time_us":41372,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":3898,"spinlock_wait_cycles":161328512,"thread_start_us":165410,"threads_started":1,"wal-append.queue_time_us":172188}
W20260709 13:20:42.984930 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45035us
I20260709 13:20:43.003355 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:42.985080 24655 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:42.961956 24568 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.007539 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:42.943243 24658 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.002238 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:43.004791 24264 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.026880 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:42.998072 24518 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.034511 24518 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.035401 24264 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:43.037307 17322 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 25: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:43.041407 24591 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:43.042003 24591 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.042397 24591 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:43.044442 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.045464 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.047640 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:43.046931 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.047545 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.049439 17994 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
I20260709 13:20:43.051815 17394 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:43.023178 24655 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:43.086460 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:43.044998 24686 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:43.030231 23756 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:43.071741 24611 raft_consensus.cc:993] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:20:43.068300 24551 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:43.133203 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.133598 17964 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:43.101914 24655 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:43.107597 24679 log.cc:927] Time spent T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:43.136251 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:43.135325 17990 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:43.043865 24568 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.001436 24663 consensus_queue.cc:260] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:43.102816 24686 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:43.068670 24576 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
W20260709 13:20:43.103173 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.200532 17995 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:43.203238 17998 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
W20260709 13:20:43.203576 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:43.205039 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.140103 24611 raft_consensus.cc:1081] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Signalling peer c23a664ebf3347a4934dee377c8b5101 to start an election
I20260709 13:20:43.141505 24681 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:43.226693 24518 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:43.236559 24518 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.238749 24518 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.239051 24662 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:43.239611 24662 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.244305 17963 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:43.247969 24264 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.248808 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:43.249286 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.250989 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.252334 24698 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:43.249636 17389 raft_consensus.cc:2393] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:43.259558 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.202519 24686 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:43.151033 24524 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:43.274343 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.274911 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.276559 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:43.277140 17996 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:43.206487 24675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.013s	sys 0.011s
I20260709 13:20:43.227625 24661 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:43.263754 24663 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:43.284211 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.288718 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.294052 17990 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:20:43.270032 24346 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:43.269562 24698 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:20:43.286945 24675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.013s	sys 0.012s
I20260709 13:20:43.319485 24699 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:43.319712 24698 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.320129 24699 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.315164 24346 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.322500 24699 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.310642 24611 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.323553 24697 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:43.324059 24697 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:43.326366 24697 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.323565 24611 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:43.328286 24568 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.315060 24675 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:43.329526 24611 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.330325 24675 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.333382 24662 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.342664 24249 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.345139 17993 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:43.315982 24473 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.345908 24473 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.347915 24473 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.282696 24551 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.315201 24264 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:43.309396 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 301947us
I20260709 13:20:43.310966 24395 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.323942 24346 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.377156 24632 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:43.295115 24661 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:43.370428 24670 consensus_meta.cc:287] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.003s
I20260709 13:20:43.391184 24249 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.404700 17389 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:43.390223 24593 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:43.392046 24583 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:43.362128 24264 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:43.430325 17360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.1:40163 timed out after 1.846s (SENT) [suppressed 46 similar messages]
I20260709 13:20:43.399039 24670 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.438699 17285 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:43.448127 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:43.451457 17394 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:43.455850 24669 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.007s	user 0.008s	sys 0.006s
I20260709 13:20:43.450577 24477 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:43.460184 24696 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:20:43.441026 24583 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.437959 24593 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.478157 17285 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:43.465181 24703 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:43.485746 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:43.488257 17990 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:43.494513 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 141447us
I20260709 13:20:43.501375 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.501441 17316 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:43.504249 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.504631 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.511682 17318 raft_consensus.cc:2410] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:43.488566 24346 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:43.535143 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.488409 24680 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.540342 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.541549 17320 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:43.551059 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.484798 24686 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:43.555583 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.499581 24700 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:43.559463 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.567456 17996 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 25.
I20260709 13:20:43.541100 24346 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.490899 24591 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.574959 17320 raft_consensus.cc:1240] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:20:43.550835 24576 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.579099 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:43.582084 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 151807us
I20260709 13:20:43.584493 17395 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:43.591010 24707 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:43.591614 24707 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.594501 24707 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.595196 24707 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:43.595803 24707 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:43.597400 24708 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:20:43.598058 24709 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:20:43.601274 24705 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:20:43.594821 24704 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:20:43.606415 24577 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:43.607043 24577 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.582475 24715 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:43.624320 24715 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:42.501888 17397 rpcz_store.cc:276] 0709 13:20:40.810178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.810347 (+   169us) service_pool.cc:224] Handling call
0709 13:20:40.812725 (+  2378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.812994 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:41.232733 (+419739us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.482338 (+249605us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.960919 (+478581us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:42.485698 (+524779us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b18003be660. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:42.495933 (+ 10235us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18003be660. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d5f709a40 00007f7d5f7044e4 00007f7d5f704455 00007f7d661ec3c7 00007f7d627fe9a7 00007f7d6280e0bf 00007f7d6280e038
0709 13:20:42.496123 (+   190us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.496278 (+   155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.496321 (+    43us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:42.496362 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.496421 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.496527 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21347,"prepare.queue_time_us":78754,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":14744,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":5903,"spinlock_wait_cycles":138162560,"thread_start_us":609004,"threads_started":2,"wal-append.queue_time_us":319083}
I20260709 13:20:43.626767 24661 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:43.628171 24692 log.cc:927] Time spent T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.489s	user 0.001s	sys 0.001s
I20260709 13:20:43.636282 24686 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.637751 24583 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.639072 24593 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.639853 24264 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.642879 24577 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.556180 24680 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.646623 24680 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.647567 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.648303 17317 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:43.648626 24379 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:43.649155 24379 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:43.649233 24655 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.650303 24379 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.651552 24379 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:43.651995 24680 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.652184 24591 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.652518 24680 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.574050 24632 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:43.576792 24712 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.654016 24712 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:43.654563 24680 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.656454 24712 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:43.581334 24346 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:43.680972 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.590216 24576 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.681921 24471 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:43.682471 24471 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.683202 24576 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.659525 24633 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:43.649174 24670 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.661763 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.683846 24633 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:43.684427 24716 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:20:43.685078 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.684857 24633 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.685937 24633 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:43.686264 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:43.686031 24714 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 13:20:43.687388 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:43.687780 24710 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:43.662075 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.689177 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1229) took 1105 ms. Trace:
I20260709 13:20:43.689702 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.690421 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:43.662731 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.690908 24535 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.689515 17313 rpcz_store.cc:276] 0709 13:20:42.584047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.584252 (+   205us) service_pool.cc:224] Handling call
0709 13:20:42.597626 (+ 13374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.601518 (+  3892us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:42.615435 (+ 13917us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.886218 (+270783us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b180028ed60. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:43.253862 (+367644us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b180028ed60. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d6239423a 00007f7d627fea2a
0709 13:20:43.505679 (+251817us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.535607 (+ 29928us) log.cc:844] Serialized 26 byte log entry
0709 13:20:43.535804 (+   197us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:43.536103 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.552755 (+ 16652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.552885 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.683753 (+130868us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:43.688961 (+  5208us) raft_consensus.cc:1685] finished
0709 13:20:43.688984 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.689106 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130461,"prepare.queue_time_us":16946,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":83,"raft.queue_time_us":21862,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":14650,"spinlock_wait_cycles":118149504,"thread_start_us":242704,"threads_started":1,"wal-append.queue_time_us":956180}
I20260709 13:20:43.691417 24535 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.691970 17319 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:43.693266 17313 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:43.693656 24535 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:43.626572 24715 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:43.667176 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.695739 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.696429 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.697075 17991 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:43.697178 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.697676 17390 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:43.697853 17394 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:43.698729 17393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5"
dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
 from {username='slave'} at 127.0.0.1:40270
I20260709 13:20:43.699358 17393 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.699700 17393 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.690930 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:43.698757 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.702829 17993 raft_consensus.cc:2410] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:20:43.705600 17388 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:43.706514 24141 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:43.707633 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.708253 17394 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:43.693236 17319 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:43.667804 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.668514 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:43.670076 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:43.711356 17318 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 14.
I20260709 13:20:43.712301 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.712574 17285 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:43.712988 17390 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 25.
I20260709 13:20:43.713413 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:43.666680 24661 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:43.694805 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51628 (request call id 1228) took 1117 ms. Trace:
I20260709 13:20:43.722405 17397 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:43.723536 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:43.727301 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.725167 17322 rpcz_store.cc:276] 0709 13:20:42.576975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.578047 (+  1072us) service_pool.cc:224] Handling call
0709 13:20:43.694622 (+1116575us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54001428d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:43.694732 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021101952}
I20260709 13:20:43.684584 24471 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.698835 24517 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:43.732728 24517 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:43.732798 24552 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:43.733381 24552 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:43.733646 24517 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:43.734200 24552 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.734844 24517 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.735625 17397 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:43.716187 17393 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.737020 24373 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:43.737387 17395 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:43.737910 24373 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:43.737759 24661 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:43.738324 24373 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:43.739282 17314 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 25.
I20260709 13:20:43.739115 24373 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.739920 24661 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:43.740336 24373 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:43.740538 24476 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:43.741108 24476 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.741489 24476 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:43.742172 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.749828 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:43.752157 24264 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:43.752576 24264 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.752925 24264 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:43.751986 24471 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:43.754526 17393 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.754571 17315 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 13.
I20260709 13:20:43.755775 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:43.761179 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:43.761992 17471 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 13.
I20260709 13:20:43.764668 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:43.767568 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.767789 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:43.768220 17388 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:43.768293 17463 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:43.772279 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:43.776270 17397 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:43.776858 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:43.755591 24574 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:43.778460 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:43.781210 17462 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:20:43.782099 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.782615 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.785969 17397 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:43.787480 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:43.781484 17286 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:43.788363 17993 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:43.758169 24611 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:20:43.808736 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:43.811511 17993 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:43.813191 17214 catalog_manager.cc:5697] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 14 to 15, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 15 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.815102 24574 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.815557 24574 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:43.814988 17214 catalog_manager.cc:5697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 15 to 16, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 16 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.789566 24684 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:43.776347 24518 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:20:43.821605 17463 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 25.
I20260709 13:20:43.817660 17214 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:43.789180 24663 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:20:43.829670 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.830334 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:43.830992 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:43.838454 17993 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.844183 24663 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:43.844628 24663 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:43.845440 24663 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.846556 24663 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:43.848696 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:43.849182 17214 catalog_manager.cc:5697] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 9 to 13, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 13 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.851114 17214 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 13 to 14, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 14 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.825665 24518 consensus_queue.cc:1243] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:20:43.853436 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.851680 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:43.827188 24613 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:43.853966 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:43.861708 17463 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:43.862015 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:43.863298 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:43.863583 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:43.873777 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:43.863703 17993 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:43.866421 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:43.874370 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:43.874727 17397 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:43.875784 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:43.876772 17469 raft_consensus.cc:2393] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 25: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:43.869686 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:43.828619 24478 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:43.872586 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:43.878837 17463 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:43.873909 17470 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:43.879773 17471 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:20:43.880601 17464 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:43.873222 17465 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:20:43.885267 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:43.885398 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:43.886574 17462 raft_consensus.cc:2410] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:20:43.827629 24684 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:43.890810 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.891891 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.894800 17397 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:20:43.893611 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:43.895716 17287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.024s	sys 0.013s
I20260709 13:20:43.897399 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:43.898761 17287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.024s	sys 0.013s
I20260709 13:20:43.898838 17463 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:43.897990 17390 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:43.899106 17393 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:43.871518 24613 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.899070 17214 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:43.909137 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.909433 17394 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:43.851318 24477 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:20:43.913792 17992 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:43.879201 24478 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:43.909344 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.882527 24524 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:43.879202 24670 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.917585 17395 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:43.910553 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:43.921350 17466 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:43.918840 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:43.922731 17462 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.896209 24707 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:43.860005 24141 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:20:43.924643 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:43.927517 17469 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 13.
I20260709 13:20:43.928539 17463 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:43.876965 24517 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:43.889212 24249 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:43.910341 24655 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:43.915604 24613 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:43.938738 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:43.920296 24524 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.940081 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1308) took 1149 ms. Trace:
I20260709 13:20:43.937738 17214 catalog_manager.cc:5697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.943516 17992 rpcz_store.cc:276] 0709 13:20:42.783661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.783774 (+   113us) service_pool.cc:224] Handling call
0709 13:20:42.791930 (+  8156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.914383 (+1122453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.932936 (+ 18553us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54005d2354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:43.933115 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2579591936}
I20260709 13:20:43.952284 17462 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:43.953886 17214 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:43.932667 24517 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.956466 24476 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.957671 24517 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:43.939494 24698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.014s	sys 0.025s
W20260709 13:20:43.958280 24698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.014s	sys 0.026s
I20260709 13:20:43.959017 17315 raft_consensus.cc:2368] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:43.959880 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:43.960445 17992 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.950346 24684 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:43.978035 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:43.979502 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:43.980099 17394 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.988180 17214 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:43.945799 24524 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.996420 17214 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:43.924436 24670 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:43.994882 24722 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:20:43.938609 24658 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.057s
I20260709 13:20:44.007251 17214 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 14 to 16, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 16 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.935541 24720 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:20:44.013335 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:43.977639 24478 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.021914 24478 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.023164 24727 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:44.023716 24727 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.009459 17467 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:43.995641 24517 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.028653 17396 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:44.028656 17992 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:44.029882 24518 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.032994 24518 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.035203 24518 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.036662 17468 raft_consensus.cc:2410] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:20:44.041523 24517 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.042881 17466 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:44.043744 24517 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.046167 17394 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:44.057181 24518 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:44.057907 24518 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.061280 24518 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.071280 17214 catalog_manager.cc:5697] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:44.007663 24476 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.031039 24720 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:44.085816 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.086241 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.071244 24470 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.082307 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.085834 24720 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.092191 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.088351 17214 catalog_manager.cc:5697] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 12 to 16, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 16 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:44.097347 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:44.100975 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.098781 24517 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:44.102162 24517 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.102625 24517 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:44.099527 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:44.122133 17465 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:44.085143 24613 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.136114 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.136067 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.138070 17465 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 13:20:44.106997 24727 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:44.139681 17390 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:44.138123 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 216932us
I20260709 13:20:44.145215 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:44.140177 24610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.000s
I20260709 13:20:44.099210 24264 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.146202 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:44.151147 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.151121 17390 pending_rounds.cc:85] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 12
I20260709 13:20:44.154721 17390 pending_rounds.cc:107] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:20:44.150511 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:44.155078 17390 raft_consensus.cc:2889] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:44.156991 17392 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:44.148636 17465 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:44.154332 17388 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:44.159500 17214 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 11 to 13, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 13 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:44.138757 24633 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:44.185482 24633 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:44.186089 24633 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:44.165179 24518 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:44.194692 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:44.202917 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.166739 24674 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.209810 24674 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.217252 24670 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.218559 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.219525 17468 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:44.219977 24670 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:44.159245 24346 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.220588 24670 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.222216 24346 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.222721 24670 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.143492 24728 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.223897 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:44.229185 17321 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:44.174302 24661 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.177210 24712 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:44.181844 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.219862 24714 log.cc:927] Time spent T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:20:44.224505 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.225063 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.241077 17465 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
W20260709 13:20:44.225538 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 75092.9us
I20260709 13:20:44.242929 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:44.243323 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.226151 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62717.7us
I20260709 13:20:44.173702 24720 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.262427 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:44.164279 24610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.014s	sys 0.000s
I20260709 13:20:44.183501 24264 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.254326 17287 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:44.269615 17214 catalog_manager.cc:5697] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 12 to 16, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 16 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:44.146567 24658 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.090s
I20260709 13:20:44.273624 17214 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 14 to 15, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 15 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.237152 24670 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:44.231601 24141 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.290555 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.279960 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:44.236454 24518 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:44.281268 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:44.282162 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:44.295368 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:44.296954 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.283547 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:44.297981 17318 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 23.
I20260709 13:20:44.285696 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.287302 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.291594 17314 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:44.299631 17464 raft_consensus.cc:2410] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:20:44.280134 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:44.267001 24552 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:44.293293 17463 raft_consensus.cc:1240] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:44.312196 17470 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:44.291975 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.302630 17395 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.313133 17389 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:44.294929 17319 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 23.
I20260709 13:20:44.230152 24524 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.306668 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.317826 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:44.318014 17464 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 25.
I20260709 13:20:44.235859 24728 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.288390 17214 catalog_manager.cc:5697] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 13 to 16, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 16 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.308743 17471 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:44.291759 24727 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.304867 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:44.321398 17360 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.307472 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.320520 17470 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:44.321856 17319 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:44.334667 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:44.326045 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:44.241125 24661 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.326776 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:44.327479 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:44.337952 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:44.327575 17214 catalog_manager.cc:5697] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:44.328361 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:44.329466 17992 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:44.329988 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:44.313812 24658 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.331645 17464 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:20:44.342279 17464 pending_rounds.cc:85] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 14
I20260709 13:20:44.295289 24264 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:44.342537 17464 pending_rounds.cc:107] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:20:44.290580 24670 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.335376 17991 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:44.273443 24346 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:44.336170 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:44.337181 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:44.399155 17996 raft_consensus.cc:3060] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.337641 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:44.260721 24741 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:20:44.336462 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:44.267393 24712 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.337630 24141 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:44.416123 24141 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.416203 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.416677 24141 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:44.418448 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.340298 17998 raft_consensus.cc:2368] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21.
I20260709 13:20:44.340556 17994 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:44.342509 17469 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:20:44.420045 17469 pending_rounds.cc:85] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 12
I20260709 13:20:44.420347 17469 pending_rounds.cc:107] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:20:44.318372 17314 raft_consensus.cc:2468] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 23.
I20260709 13:20:44.378801 17395 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:44.381105 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:44.368827 24670 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.340677 24655 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:44.368920 24524 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.343132 17464 raft_consensus.cc:2889] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:44.427542 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:44.427740 24663 consensus_meta.cc:287] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.581s	user 0.005s	sys 0.004s
I20260709 13:20:44.344755 17317 raft_consensus.cc:2393] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:44.428719 17397 raft_consensus.cc:2410] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:20:44.293542 24574 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.343190 24249 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:20:44.430804 24574 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.389809 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:44.431756 17468 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:44.392318 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:44.432492 24728 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:44.392946 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:44.433180 24728 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.433852 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.434053 17320 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:20:44.410097 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 73703.6us
I20260709 13:20:44.435377 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.413988 24712 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:44.414343 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:44.414548 17462 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:44.438310 24661 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.438771 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:44.438947 24661 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:44.439702 24661 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:44.441020 24715 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:44.441790 24715 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:44.420137 24552 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:44.442129 24715 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.442524 24715 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:44.390286 24698 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.444759 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.445175 24698 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.440472 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:44.428207 24141 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.433750 24728 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.447885 24698 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:44.448166 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.450281 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.451613 17395 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:44.454502 24552 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:44.411918 17996 raft_consensus.cc:2468] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:44.455070 24552 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.394596 24264 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:44.458092 24552 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.457778 24264 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.396746 24518 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.273742 24731 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:20:44.432540 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:44.462392 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44064.9us
I20260709 13:20:44.377888 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.467902 17468 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:44.446648 24524 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:44.459551 24715 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.463168 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:44.468672 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 90898.8us
I20260709 13:20:44.420761 17469 raft_consensus.cc:2889] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:44.339454 24727 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.472028 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:44.472734 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.461325 24684 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:44.394043 24707 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.393764 24700 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.448653 24613 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 26 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.408418 24346 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.482008 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:44.450855 24728 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:44.467024 24734 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:20:44.482479 24733 log.cc:927] Time spent T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:20:44.486299 24710 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:44.563807 24700 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:44.563561 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 78547.4us
I20260709 13:20:44.564898 24707 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.565416 24141 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.565951 17462 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:44.566306 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.482708 24552 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.567171 24552 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.567569 24727 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:44.569039 24703 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:44.569527 24552 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.538954 17463 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:44.489257 24684 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:44.570369 24535 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:44.396236 24658 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.571367 24684 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.572621 24684 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:44.573038 24658 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.573642 24658 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:44.574175 24658 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.576215 17962 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:44.466818 24743 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.577240 24731 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:44.483167 24712 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:44.578435 24712 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.578863 24712 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:44.577227 24743 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.580940 24743 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.581724 17313 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:44.582581 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.567607 24707 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.583395 17463 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:44.585243 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:44.586257 17463 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:44.586608 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.587324 17396 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:44.588775 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:44.589900 24686 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:44.590363 24686 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.590858 24686 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:44.591497 17464 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:20:44.479290 24681 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.566120 24141 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:44.595839 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:44.597589 17467 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:44.527977 24478 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.474519 24524 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:44.490279 24249 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:44.600279 17464 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:44.602097 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:44.602958 17315 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:44.609160 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:44.609910 17468 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:44.534896 24346 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:44.611841 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.619199 17467 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:44.615571 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.620108 17395 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
I20260709 13:20:44.612464 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.621237 17463 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 14.
I20260709 13:20:44.621260 17464 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
W20260709 13:20:44.633949 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.637754 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.637722 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:44.638783 17395 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:44.617276 24700 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.642782 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:44.643476 17392 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:44.585501 24472 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 13:20:44.651309 17392 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:44.651995 24744 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:20:44.653736 24674 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.655886 24670 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.608522 24524 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:44.663187 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.664511 24658 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.534668 24373 consensus_queue.cc:1059] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:20:44.665099 17322 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:44.665478 17322 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:44.665755 24373 raft_consensus.cc:3055] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:44.666296 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.667141 17396 raft_consensus.cc:2410] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:20:44.667919 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:44.666265 24373 raft_consensus.cc:740] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:44.666270 17322 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.670387 17322 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:44.481958 24633 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.681269 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:44.682554 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:44.726086 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2228) took 1213 ms. Trace:
W20260709 13:20:44.738466 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 56023.5us
I20260709 13:20:44.702448 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.718528 17396 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:44.683847 17468 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 26.
I20260709 13:20:44.746457 17395 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 26.
I20260709 13:20:44.720628 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:44.748415 17469 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:44.698577 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.702696 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:44.608683 24249 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:44.640656 24517 consensus_meta.cc:287] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:20:44.739490 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:44.760463 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62027.8us
I20260709 13:20:44.607651 24707 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:44.684231 24700 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:44.738364 17316 rpcz_store.cc:276] 0709 13:20:43.512229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.512354 (+   125us) service_pool.cc:224] Handling call
0709 13:20:43.512774 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:43.640464 (+127690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.640491 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:43.641027 (+   536us) log.cc:844] Serialized 52 byte log entry
0709 13:20:43.945915 (+304888us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:43.991402 (+ 45487us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.998217 (+  6815us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.324905 (+326688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.715537 (+390632us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b540043f8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:44.715602 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.725822 (+ 10220us) raft_consensus.cc:1685] finished
0709 13:20:44.725846 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.726027 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79589,"prepare.queue_time_us":98434,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":133063,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":229,"spinlock_wait_cycles":162061696,"thread_start_us":630925,"threads_started":2,"wal-append.queue_time_us":483592}
I20260709 13:20:44.674660 24715 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.796357 17287 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:44.779048 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:44.764633 24249 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:44.780018 24470 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:44.670383 24373 consensus_queue.cc:260] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.761132 24743 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:44.782220 17465 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:44.785277 24703 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:44.801947 24703 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.802364 24703 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:44.696924 24610 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 13:20:44.773499 24517 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.806147 17470 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:44.806982 24517 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:44.808013 24517 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.697332 24395 raft_consensus.cc:2804] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:44.809681 24395 raft_consensus.cc:697] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 23 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:44.810148 24633 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:44.810647 24395 consensus_queue.cc:237] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.812074 24470 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:44.795822 24728 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.813135 24728 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.815109 24728 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:44.801462 24743 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:44.817572 24743 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.790175 24670 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.799575 24707 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:44.812966 24470 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.822898 17322 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:44.807955 24346 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:44.829133 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.833974 17322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 2245) took 1003 ms. Trace:
W20260709 13:20:44.829612 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 127021us
I20260709 13:20:44.834383 17322 rpcz_store.cc:276] 0709 13:20:43.830264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.830973 (+   709us) service_pool.cc:224] Handling call
0709 13:20:44.664948 (+833975us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54003910a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d6276bdc0 00007f7d627f7e18 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:44.833909 (+168961us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698274688}
W20260709 13:20:44.851224 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 54943us
I20260709 13:20:44.834949 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:44.852398 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 276242us
I20260709 13:20:44.877823 24715 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.878520 24715 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:44.888164 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 452847us
I20260709 13:20:44.882324 17962 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:44.895466 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.896579 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:44.900329 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 134633us
I20260709 13:20:44.901696 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:44.902285 17322 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:44.902401 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:44.904698 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:44.907752 24663 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:44.902998 17313 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
W20260709 13:20:44.881739 24471 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:20:44.912245 24346 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:44.912314 24719 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:44.894735 24715 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:44.915313 17322 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 24.
I20260709 13:20:44.915405 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:44.852173 24517 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:44.895797 24727 raft_consensus.cc:2764] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:44.895638 24478 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:44.921844 17360 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.901000 24698 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:44.948388 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.949071 24698 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.900229 24700 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:44.897858 24535 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:44.928097 24712 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:44.922387 24663 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:44.922700 24517 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.945122 24478 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:44.958504 17360 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.958673 24754 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:44.979854 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 61502.3us
W20260709 13:20:44.989658 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 507713us
I20260709 13:20:44.948501 24670 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:45.004025 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 225069us
I20260709 13:20:45.007021 17434 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:44.984380 24517 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:44.962877 24698 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.991837 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:44.994414 17964 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:44.999006 17466 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:45.023746 17393 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:20:45.028352 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:45.035511 17396 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:44.916227 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:45.032969 17390 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:44.992542 24684 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.977665 24703 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.009598 24715 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:45.048454 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 56731us
I20260709 13:20:44.989303 24754 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:45.031118 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:45.051599 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 57260.2us
I20260709 13:20:45.031008 24727 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.055627 17434 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:45.061168 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:45.064040 24728 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:45.066020 24712 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:45.066514 24264 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:45.067898 24752 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:20:45.056430 17360 leader_election.cc:400] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:45.105814 17360 leader_election.cc:403] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:45.085492 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.029831 24757 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:45.088567 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.047679 24633 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:45.047485 24760 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:45.100107 17396 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
W20260709 13:20:45.074519 24755 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:20:45.074064 24751 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:20:45.068787 24753 log.cc:927] Time spent T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:20:45.127864 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:45.049412 24723 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:45.053269 24670 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:45.096880 17434 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:45.102214 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:45.043349 24584 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:20:45.115513 17286 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:45.084391 24754 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.125532 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:45.045019 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 128857us
I20260709 13:20:45.131181 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:45.135046 17396 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:45.144140 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:45.145001 17396 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:45.145726 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:45.146206 17396 raft_consensus.cc:1813] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Handling vote request from an unknown peer b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:45.146631 17396 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:45.117944 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 61692.4us
I20260709 13:20:45.095325 24681 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:45.147269 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:45.153762 17396 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.152282 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:45.160631 17396 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:45.046530 24700 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.130489 24674 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:45.206110 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 90861.1us
I20260709 13:20:45.163231 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:45.114511 24395 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:45.164956 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 65923.8us
I20260709 13:20:45.167479 17435 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:45.076225 24727 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.130718 24663 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:45.166690 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:45.083496 24715 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.105850 24574 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:20:45.135324 24768 raft_consensus.cc:2764] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader election decision vote started in defunct term 25: won
I20260709 13:20:45.138139 24655 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:45.213352 24743 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:45.157430 24707 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:45.153424 24681 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.089148 24478 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.217593 24470 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:45.164412 24611 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:45.087459 24535 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.138456 24723 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.213668 24757 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:45.227849 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 4020) took 1077 ms. Trace:
W20260709 13:20:45.244132 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 181704us
I20260709 13:20:45.241796 17394 rpcz_store.cc:276] 0709 13:20:44.150097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.151299 (+  1202us) service_pool.cc:224] Handling call
0709 13:20:44.151955 (+   656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:44.163218 (+ 11263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:44.163487 (+   269us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:44.230724 (+ 67237us) log.cc:844] Serialized 26 byte log entry
0709 13:20:44.440288 (+209564us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b4800002958. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:20:44.767849 (+327561us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:44.767892 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.767962 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:45.227479 (+459517us) raft_consensus.cc:1685] finished
0709 13:20:45.227508 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.227777 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10901,"raft.queue_time_us":12735,"raft.run_cpu_time_us":2223,"raft.run_wall_time_us":259463,"spinlock_wait_cycles":107223296,"thread_start_us":489164,"threads_started":1,"wal-append.queue_time_us":685459}
I20260709 13:20:45.226274 24658 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:45.230010 24655 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:45.261308 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 118391us
I20260709 13:20:45.249928 24757 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:45.267658 24757 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.226457 24472 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:20:45.253129 24470 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:45.277070 24784 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:45.278015 24264 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.278601 24264 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.280659 24658 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:45.282186 24264 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.281960 24658 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:45.284034 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 120897us
I20260709 13:20:45.283370 24470 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.266692 17962 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:45.288335 24759 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:45.288905 24759 raft_consensus.cc:697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:45.289812 24759 consensus_queue.cc:237] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:45.288362 24762 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:20:45.291779 24686 consensus_meta.cc:287] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.000s
W20260709 13:20:45.293396 24767 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:20:45.263751 24655 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.296818 24249 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.215716 24674 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.236397 24681 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.307276 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:45.304657 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:45.309327 17322 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:20:45.310487 24776 log.cc:927] Time spent T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:45.243026 24611 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:45.314615 24611 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.315654 24611 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:45.249238 24760 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:45.317447 24703 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.317641 24760 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.323100 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.323865 24715 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.326843 24249 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.327737 24757 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.328305 24723 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:45.329592 24552 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:45.330024 24552 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:45.334502 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:45.302181 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:45.338515 17316 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:45.339425 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.340778 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.342967 17313 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:45.292390 24686 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.256143 24761 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:45.344533 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.345835 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.347076 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:45.237341 24743 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.336872 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.351027 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.353091 17391 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 23: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:45.333164 24775 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:20:45.365564 17313 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:45.368281 17320 raft_consensus.cc:2410] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:20:45.337123 24249 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:45.342845 24551 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:20:45.376523 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:45.379459 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 212443us
I20260709 13:20:45.384833 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.388514 17992 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:45.355788 24780 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:45.358682 24781 raft_consensus.cc:2764] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:20:45.387612 24524 consensus_meta.cc:287] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.002s
W20260709 13:20:45.409574 24770 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:45.411036 24741 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:45.411634 24610 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.413092 24141 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:20:45.413414 24774 log.cc:927] Time spent T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:20:45.386703 24552 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.415956 24686 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.395993 24395 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:45.451658 24552 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:45.452818 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 85016.4us
I20260709 13:20:45.397106 24655 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.470504 24655 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:45.437885 24524 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.471279 24743 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:45.473675 24766 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.246s	user 0.003s	sys 0.000s
I20260709 13:20:45.477176 24684 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:45.477725 24684 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.404628 24780 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.479570 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:45.460042 24686 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:45.481290 24727 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:45.481391 24686 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.481820 24684 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:45.462054 24786 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.482394 24684 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:45.483480 24686 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.483584 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:45.390409 24249 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.452943 24741 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.484270 17394 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:45.485744 24249 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:45.485865 24741 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.366954 24761 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.470002 24395 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.399646 24517 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.487879 24761 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.480778 24780 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.390618 24551 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.464826 24373 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.488140 24517 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:45.457793 24783 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:45.499111 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:45.499507 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:45.500524 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.501914 17392 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:45.502344 17389 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:45.506611 17390 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:20:45.510468 17394 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:45.496344 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 278196us
I20260709 13:20:45.472831 24757 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:45.513788 17392 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:45.517387 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:45.513959 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:45.518738 17390 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.514380 17999 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:45.482908 24684 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.536134 24684 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:45.450213 24610 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.522785 24698 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.538368 24610 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:45.515130 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:45.546047 24771 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:20:45.549237 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.492090 24786 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.549628 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:45.550408 17992 raft_consensus.cc:2393] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:45.551457 24786 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:45.552134 17992 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:20:45.497519 24681 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.554361 17998 raft_consensus.cc:2368] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:45.554625 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:45.555318 24681 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:45.491228 24524 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.518079 17392 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:45.519551 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:45.521306 24551 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:45.521720 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.521732 24718 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:45.567821 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 48365.1us
I20260709 13:20:45.569561 17998 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:45.570670 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:45.536262 24779 log.cc:927] Time spent T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:20:45.556958 17992 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 14: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:45.542737 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:45.454842 24141 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:45.565137 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 50116.3us
I20260709 13:20:45.570576 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:45.559522 17390 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:45.578527 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.579366 17993 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 20: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:45.580222 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:45.580480 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.581264 17995 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:45.583585 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.583626 17991 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:45.584350 17994 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:45.579715 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.584887 17990 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:45.586020 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:45.586228 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:45.590394 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.593834 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:45.594157 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.594801 17315 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:45.596102 17995 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:45.597060 17313 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:45.593854 17360 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:45.597246 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.620482 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:45.620803 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.569736 24718 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.572813 24684 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:45.621290 17285 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:45.594910 24686 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:45.628954 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:45.645185 17963 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:45.623660 24743 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:45.624533 24757 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:45.647585 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:45.625499 24718 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.608744 24524 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:20:45.608971 24551 consensus_queue.cc:1059] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:20:45.655421 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:45.630580 24698 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:45.664872 24740 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.013s
I20260709 13:20:45.619549 24681 consensus_queue.cc:1059] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
W20260709 13:20:45.669606 24754 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 13:20:45.644184 24684 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:45.670603 17322 raft_consensus.cc:2410] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:45.624399 24670 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:20:45.671465 24741 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:45.514621 24783 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.646559 24518 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:45.692207 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.631522 24782 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:20:45.652755 24715 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:45.711056 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:45.656883 24686 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.661767 24611 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:45.713505 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 76221.8us
I20260709 13:20:45.713891 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:45.650468 24759 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:20:45.716766 17285 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:45.695587 24471 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.717163 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:45.729921 17360 leader_election.cc:400] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:45.723536 24715 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:45.730610 17360 leader_election.cc:403] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:20:45.730768 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:45.731314 24715 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.731995 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:45.732606 17390 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.717566 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:45.721156 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.721586 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:45.646304 24785 consensus_queue.cc:1059] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:20:45.695778 24741 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:45.675758 24757 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:45.691766 24684 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:45.821810 24684 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.678601 24754 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.735420 24670 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:20:45.735276 24720 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.804370 17390 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:45.778776 24741 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:45.721536 24700 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:45.720568 24686 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.810040 17464 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:20:45.810811 17467 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:45.780606 24728 raft_consensus.cc:2804] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:45.721678 24574 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:45.812106 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.779147 24633 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:45.807606 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:45.784345 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:45.853509 17466 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:45.785210 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:45.774924 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 678100us
I20260709 13:20:45.820127 24757 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.820362 24802 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:45.809542 24723 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:45.832002 17320 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:45.834120 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:45.842047 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.860302 17315 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:45.860400 17316 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:45.861397 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.835148 17997 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:45.847335 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.847661 17469 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:45.848740 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.862767 17314 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:45.792965 24768 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:45.850307 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:45.856470 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:45.866688 17471 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:45.862041 17316 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:45.736416 24471 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.868810 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:45.816197 24712 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:45.874818 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:45.888808 24802 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:45.889024 24141 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:45.904452 17434 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:45.851090 24574 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.837548 24655 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.889967 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:45.830173 24803 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21.
I20260709 13:20:45.857136 24728 raft_consensus.cc:697] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:45.838306 24754 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:45.895287 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:45.942013 17990 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:45.903795 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:45.908031 17466 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:45.889947 24712 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.797696 24478 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
W20260709 13:20:45.913058 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 745576us
I20260709 13:20:45.914132 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:45.894261 24793 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:20:45.921622 24574 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:45.895677 24517 raft_consensus.cc:2764] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:20:45.873020 24723 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:45.932318 17315 raft_consensus.cc:2468] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 24.
I20260709 13:20:45.946338 17393 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:20:45.970837 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 193288us
I20260709 13:20:45.971292 17469 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:45.943722 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
W20260709 13:20:45.993728 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50149.3us
W20260709 13:20:45.974881 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.996811 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.002532 17464 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:45.975593 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:45.977123 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 63098.7us
I20260709 13:20:45.978789 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 4046) took 1204 ms. Trace:
I20260709 13:20:45.921813 24633 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:45.908918 24802 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:46.004433 17462 rpcz_store.cc:276] 0709 13:20:44.774316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.775162 (+   846us) service_pool.cc:224] Handling call
0709 13:20:44.775489 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:44.851274 (+ 75785us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:44.909520 (+ 58246us) log.cc:844] Serialized 14 byte log entry
0709 13:20:45.094247 (+184727us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:45.107901 (+ 13654us) log.cc:844] Serialized 52 byte log entry
0709 13:20:45.108159 (+   258us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:45.108486 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:20:45.132673 (+ 24187us) log.cc:844] Serialized 14 byte log entry
0709 13:20:45.323119 (+190446us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b18004ed300. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1
0709 13:20:45.323652 (+   533us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b18004ed300. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:45.450171 (+126519us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4800210258. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6771daa1 00007f7d67714b37 00007f7d677149ca 00007f7d6780c26f 00007f7d6780bf37 00007f7d6782055c 00007f7d67820508 00007f7d67820488 00007f7d67820443 00007f7d6781f6ec 00007f7d66749a96
0709 13:20:45.733946 (+283775us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b18004ed300. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d666c858f 00007f7d5f707571 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd
0709 13:20:45.978302 (+244356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.978421 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:45.978491 (+    70us) raft_consensus.cc:1685] finished
0709 13:20:45.978515 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.978703 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1727260,"prepare.queue_time_us":242897,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":91,"raft.queue_time_us":733946,"raft.run_cpu_time_us":3729,"raft.run_wall_time_us":627307,"spinlock_wait_cycles":91838848,"thread_start_us":366665,"threads_started":2,"wal-append.queue_time_us":295486}
I20260709 13:20:45.921736 24726 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.001103 17993 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:45.899549 24524 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:46.021539 24524 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.024010 24780 raft_consensus.cc:3055] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:46.024473 24780 raft_consensus.cc:740] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:46.003511 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:46.025256 17315 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:46.025362 24780 consensus_queue.cc:260] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.896278 24768 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:45.985317 24707 raft_consensus.cc:2764] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:20:45.918493 24552 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
W20260709 13:20:46.029994 24787 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.578s	user 0.000s	sys 0.004s
I20260709 13:20:45.934896 24655 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:46.020361 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 44895.8us
I20260709 13:20:45.972586 24731 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:20:46.034601 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:46.034881 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:46.047210 17397 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:46.047377 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 134432us
I20260709 13:20:45.909837 24727 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:20:46.049368 17315 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 15.
I20260709 13:20:46.051522 17392 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:46.009646 24518 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:46.026988 24698 raft_consensus.cc:3055] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:46.024628 24524 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:46.069133 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:46.069953 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.085477 17466 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:46.085616 17462 raft_consensus.cc:2393] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:46.071509 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.087277 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:46.072981 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:46.088397 17469 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:46.089855 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.090595 17466 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:46.089406 17962 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:46.047624 24756 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:46.094264 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.050474 24807 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:46.096349 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.055685 24805 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.095477 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:46.100369 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 127454us
I20260709 13:20:46.059046 24518 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:46.083520 24783 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.108536 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:46.094899 17360 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:46.060781 24686 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:46.131426 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 4040) took 1487 ms (client timeout 1759 ms). Trace:
I20260709 13:20:46.084069 24768 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.123353 24763 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:46.048143 24728 consensus_queue.cc:237] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.108094 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:46.069010 24698 raft_consensus.cc:740] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:20:46.131858 17391 rpcz_store.cc:269] 0709 13:20:44.643740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.662939 (+ 19199us) service_pool.cc:224] Handling call
0709 13:20:46.131245 (+1468306us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b540009c4d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:46.131372 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584383232}
I20260709 13:20:46.089986 24727 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:46.126778 24812 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:46.117554 24754 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.133140 24763 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:46.085646 24757 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:46.163184 17962 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:46.133915 17470 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.099542 24806 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.050802 24726 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.135588 17392 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:20:46.112460 24756 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:46.165365 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 70532.5us
I20260709 13:20:46.182670 17990 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:46.166026 24783 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:46.171773 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 123886us
W20260709 13:20:46.187842 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 72811.1us
I20260709 13:20:46.188117 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.121290 24518 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:46.116672 24373 consensus_meta.cc:287] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.000s
W20260709 13:20:46.189011 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.191398 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:46.192517 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:46.193691 24517 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:46.194015 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.194751 24517 raft_consensus.cc:2804] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:46.195529 24517 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:46.195750 24768 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:46.196116 24517 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:46.195560 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.203202 17434 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.207643 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.209776 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.209957 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.210547 17434 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:46.172923 24763 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:46.214474 17287 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.214677 17468 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:46.176625 24524 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:46.160931 24744 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:20:46.186870 24249 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:46.239588 17360 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:46.240113 17362 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:46.243367 17466 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:46.245066 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.246196 17466 raft_consensus.cc:2410] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 23 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:46.176466 24761 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:20:46.100029 24802 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.177156 24754 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.250896 17462 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:20:46.248540 17962 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:46.253031 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:46.119621 24805 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.212574 24655 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.172789 24727 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.250487 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:46.221582 24373 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:46.225807 24712 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.219646 24524 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:46.221853 24783 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:46.207816 24707 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:20:46.269316 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.285815 17316 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:46.271509 24658 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:46.224404 24811 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:46.265136 17470 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:46.262320 17315 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:20:46.239733 24686 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:46.277437 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:46.244024 24814 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:46.176945 24812 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:46.236469 24249 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.219118 24808 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:20:46.181885 24806 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:46.252822 24141 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 13:20:46.358223 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 118710us
W20260709 13:20:46.321317 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 110826us
I20260709 13:20:46.275657 24802 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:46.276412 24785 raft_consensus.cc:2804] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:46.283674 24524 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:46.281550 24655 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:46.326098 24807 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:46.284644 24712 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:46.294184 24723 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:46.293318 24757 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:46.355428 24249 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.355742 24811 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:46.364413 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 86255.9us
I20260709 13:20:46.364864 17471 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:46.322006 24768 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:46.364605 17434 leader_election.cc:400] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21.
I20260709 13:20:46.326447 24707 consensus_queue.cc:1243] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:20:46.324615 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47300.5us
I20260709 13:20:46.377193 17434 leader_election.cc:403] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:46.323992 24816 raft_consensus.cc:2804] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:46.345323 24346 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:20:46.377763 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:46.328132 24686 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:46.374414 24819 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:20:46.375206 24718 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.001s
I20260709 13:20:46.388360 24718 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:46.362412 24829 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:20:46.381425 24813 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:20:46.398746 24756 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.374872 24757 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:46.402400 24757 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.371801 24785 raft_consensus.cc:697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:46.406603 24805 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.408087 24727 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.407891 24517 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:46.429280 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 66156.4us
I20260709 13:20:46.430238 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:46.432466 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.435206 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.436093 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.436806 17316 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:46.437243 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.437909 17362 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:46.439728 17470 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:20:46.442454 24674 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.445256 24655 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:46.446357 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.446584 24517 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.447381 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:46.448185 17321 raft_consensus.cc:2410] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 13:20:46.448809 24822 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:20:46.431308 24720 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.002s
I20260709 13:20:46.451377 24785 consensus_queue.cc:237] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.453564 24812 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:46.409051 24712 raft_consensus.cc:3055] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:20:46.450862 24827 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:20:46.477730 17316 raft_consensus.cc:1240] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:20:46.449256 24726 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.454487 24811 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:46.455044 24720 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:46.455438 24754 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.456956 24806 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:46.450673 24756 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:20:46.462906 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:46.488330 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 218143us
I20260709 13:20:46.490311 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:46.491497 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:46.458950 24807 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:46.492319 17389 raft_consensus.cc:2410] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 22 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:20:46.492617 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:46.493281 17388 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:46.494691 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:46.494969 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:46.495414 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.466418 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.496238 17321 raft_consensus.cc:1813] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Handling vote request from an unknown peer b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:46.496903 17321 raft_consensus.cc:2393] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:46.495445 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:46.467188 24731 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:46.468938 24816 raft_consensus.cc:697] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:46.469460 24700 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.000s
I20260709 13:20:46.500033 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:46.470825 24741 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.000s
I20260709 13:20:46.500413 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:46.474665 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.507244 17463 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:46.508229 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:46.508764 17463 raft_consensus.cc:3060] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:46.476019 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.479749 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.480908 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.483345 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.510438 17315 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:46.485687 17319 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:46.433393 24833 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:46.487221 24718 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:46.496622 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:46.473989 24789 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:46.500761 17434 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.504154 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.504521 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.505753 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.511602 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:46.515997 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:46.493009 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 393513us
I20260709 13:20:46.477896 24712 raft_consensus.cc:740] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:46.513401 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:46.518661 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.518661 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.381286 24783 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:46.503222 24700 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:46.528975 17316 raft_consensus.cc:2368] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 23. Current term is 24.
I20260709 13:20:46.530793 17320 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:46.531013 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.533386 17463 raft_consensus.cc:2468] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 24.
I20260709 13:20:46.539765 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.540210 17434 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.540761 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:46.530157 17990 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:46.494530 24743 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:20:46.515461 24833 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.553267 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.543888 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:46.552083 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.556265 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:46.532413 24574 consensus_meta.cc:287] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.005s
I20260709 13:20:46.511831 24806 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:46.564787 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.547112 17395 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 17. (term mismatch)
I20260709 13:20:46.555698 24633 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:46.563499 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.564225 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.559176 24517 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:46.521322 24249 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.549549 24727 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:46.509915 24741 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.549472 24812 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:46.564929 17313 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:46.558513 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.576064 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.566141 17395 pending_rounds.cc:85] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 16
I20260709 13:20:46.577142 17395 pending_rounds.cc:107] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 20.17
I20260709 13:20:46.577507 17395 raft_consensus.cc:2889] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:46.578943 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:46.579644 17395 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.570043 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:46.583612 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:46.573136 17391 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:20:46.546466 17963 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:46.590363 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 44010.9us
I20260709 13:20:46.591418 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.593235 17999 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:46.506590 24807 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:46.556461 24789 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:46.560171 24141 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.598172 17991 raft_consensus.cc:1813] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Handling vote request from an unknown peer b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:46.598342 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:46.557619 24833 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:46.569916 24806 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:46.602814 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:46.600767 17991 raft_consensus.cc:2368] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 21. Current term is 22.
I20260709 13:20:46.601220 17322 raft_consensus.cc:1240] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:46.599932 17963 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.559491 24707 consensus_queue.cc:1059] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:20:46.559566 24816 consensus_queue.cc:237] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.608263 24759 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:46.605052 24141 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:46.562461 24524 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.572029 24574 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.549243 24838 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:20:46.599092 24839 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:46.606739 24791 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:46.598672 24518 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.608194 24806 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:46.628485 24759 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
W20260709 13:20:46.617308 24684 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.003s
I20260709 13:20:46.666241 24574 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.648176 24681 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:46.669631 24141 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:46.670876 24249 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:46.654716 24686 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:46.682083 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.683449 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:46.684446 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.686379 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.687896 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:46.688695 17465 raft_consensus.cc:2393] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 14: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:46.655391 17395 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:46.646713 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:46.694123 17462 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.627890 24551 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:20:46.697145 17314 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:46.707019 17465 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:20:46.710530 17465 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:20:46.658627 24712 consensus_queue.cc:260] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.659323 24759 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:46.719224 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 114607us
I20260709 13:20:46.721378 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:46.723335 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.726330 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.728036 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:46.701860 24551 consensus_queue.cc:1243] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer 7241e45fbfca4b46b6df9be8cebcd863 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:46.736028 17462 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:46.740213 17462 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:46.726847 24812 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:46.733580 24707 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:46.786363 24812 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.786859 24812 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:46.733997 24728 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:46.792604 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:46.697928 24684 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.733182 24726 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:46.756150 24846 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:20:46.760548 24741 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.761600 24807 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:46.761937 24471 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.763366 24727 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.826269 24727 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:46.828614 24727 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:46.765270 24524 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:46.697634 24789 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.769500 24786 raft_consensus.cc:3055] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:46.770880 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2261) took 1036 ms. Trace:
I20260709 13:20:46.854120 17313 rpcz_store.cc:276] 0709 13:20:45.734611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.734788 (+   177us) service_pool.cc:224] Handling call
0709 13:20:45.735120 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:46.576037 (+840917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.770605 (+194568us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b5400212354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:46.770816 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1892579712}
I20260709 13:20:46.734651 24840 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:46.721169 24763 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.804934 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:46.862620 17468 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:46.814431 17434 leader_election.cc:400] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 21. Current term is 22.
I20260709 13:20:46.863796 17434 leader_election.cc:403] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:46.864463 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 50263.5us
I20260709 13:20:46.764297 24518 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.830515 24741 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:46.824024 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:46.831323 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:46.824025 24757 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.867280 17320 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.834339 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:46.834950 17317 pending_rounds.cc:85] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting all ops after (but not including) 14
I20260709 13:20:46.871371 17317 pending_rounds.cc:107] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:20:46.871415 17319 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:46.871744 17317 raft_consensus.cc:2889] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:46.836099 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:46.832448 17287 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:46.803781 17470 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:20:46.879190 17320 raft_consensus.cc:2468] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:46.882421 24524 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:46.803303 24833 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.883085 24756 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 20. Current term is 21.
I20260709 13:20:46.883664 17397 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:46.884629 24684 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.859429 24786 raft_consensus.cc:740] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:46.887351 24698 consensus_queue.cc:260] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.887992 24786 consensus_queue.cc:260] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.900082 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:46.891029 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:46.901750 17392 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:46.884755 24833 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:46.897467 17990 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:46.891024 17463 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
W20260709 13:20:46.906980 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 74628.4us
I20260709 13:20:46.891410 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:46.888672 24698 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.917661 17388 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:46.824180 24707 consensus_queue.cc:1059] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.087s
I20260709 13:20:46.927497 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:46.898756 24802 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:46.898165 24633 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.883178 24524 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:20:46.941562 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 341679us
I20260709 13:20:46.897938 24763 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:46.949939 17319 raft_consensus.cc:2468] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
W20260709 13:20:46.939657 24797 log.cc:927] Time spent T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:20:46.913882 24518 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:46.922557 24786 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.882720 24759 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:46.953680 17962 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:46.960714 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:46.966595 17314 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 20: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:46.968228 17962 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:46.973652 17393 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:46.974632 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:46.976038 24518 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:46.977025 24518 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:46.977284 24849 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:46.994256 17391 raft_consensus.cc:1240] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:20:46.984421 17393 raft_consensus.cc:1240] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:46.958984 24707 consensus_queue.cc:1243] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 24.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:20:46.986927 24784 raft_consensus.cc:2804] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:47.017041 17389 raft_consensus.cc:1240] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:47.044663 17995 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:47.011353 24761 raft_consensus.cc:2804] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:47.001566 24684 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:47.053553 24852 log.cc:927] Time spent T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:20:47.030931 24785 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:20:47.061311 24761 raft_consensus.cc:697] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:20:47.095178 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.063782 24784 raft_consensus.cc:697] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:47.100286 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:47.085960 24728 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:20:47.108150 24633 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 21. Current term is 22.
I20260709 13:20:47.020817 24524 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.062465 24684 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:47.098945 24838 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.112408 24703 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.109516 24757 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:47.091748 24806 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:47.181962 24859 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:20:47.217470 17464 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:47.186038 24759 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:47.238104 24684 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:47.239463 24812 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.227618 24761 consensus_queue.cc:237] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.142017 24838 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:47.234213 24806 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:47.234705 24780 raft_consensus.cc:3060] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:47.178747 24703 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:47.211114 24833 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:47.226033 24853 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:20:47.289224 24833 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:47.290097 24865 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:20:47.291637 24862 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:20:47.291848 24833 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:47.293123 24869 log.cc:927] Time spent T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:20:47.294365 24812 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:47.295188 24703 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:47.297089 24838 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:47.298885 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:47.299592 17466 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
W20260709 13:20:47.300633 24858 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260709 13:20:47.282117 24684 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:47.272557 24759 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:20:47.301568 24684 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:47.304379 24684 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:47.302060 24759 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:47.305677 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:47.225891 24784 consensus_queue.cc:237] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.307825 24712 raft_consensus.cc:3060] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:47.309676 24871 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:47.310271 24802 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:47.314277 17466 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:47.330775 17462 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:20:47.327698 24802 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:47.341104 24728 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:47.341789 24728 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:47.344951 24728 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:47.352696 24802 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.355710 24802 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:47.329811 24871 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.360137 24871 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:47.365602 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.313705 24812 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:47.370136 24812 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:47.373574 24870 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:20:47.313807 24759 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:47.375398 24759 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.386487 24759 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:47.383139 24816 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.012s	sys 0.016s
W20260709 13:20:47.388090 24816 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.012s	sys 0.016s
I20260709 13:20:47.394379 24812 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:47.461042 17395 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:47.481367 24757 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.482614 24757 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.495874 24757 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:47.511307 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2442) took 1049 ms. Trace:
I20260709 13:20:47.521194 24816 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:47.522770 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 4071) took 1281 ms. Trace:
I20260709 13:20:47.522552 24816 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:47.541563 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:47.549777 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:47.553781 24768 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:47.554685 24761 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:47.555193 24524 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:47.556176 24524 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.556773 24784 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:47.557265 24784 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:47.512286 17464 rpcz_store.cc:276] 0709 13:20:46.461691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.475802 (+ 14111us) service_pool.cc:224] Handling call
0709 13:20:47.510447 (+1034645us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54003df754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:47.510875 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626266880}
I20260709 13:20:47.562582 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:47.569563 17395 raft_consensus.cc:1240] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:47.569913 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:47.523355 17469 rpcz_store.cc:276] 0709 13:20:46.241628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.242139 (+   511us) service_pool.cc:224] Handling call
0709 13:20:46.754887 (+512748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.755123 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:46.925206 (+170083us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.979816 (+ 54610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.979870 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:46.979910 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.979973 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.520956 (+540983us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b18004af920. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4
0709 13:20:47.522345 (+  1389us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b5400281750. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:47.522539 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126136,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":103,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5507,"spinlock_wait_cycles":1193614464,"thread_start_us":222701,"threads_started":2,"wal-append.queue_time_us":120442}
I20260709 13:20:47.577869 24524 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:47.579281 24723 raft_consensus.cc:3055] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:47.579730 17468 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 16: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:47.571499 17999 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:47.582676 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:47.584218 24812 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:47.568743 24768 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
W20260709 13:20:47.587057 24817 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 1.303s	user 0.002s	sys 0.002s
I20260709 13:20:47.588948 24812 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:47.589591 24812 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:47.592425 24756 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:47.593417 24756 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:47.595074 24840 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:47.595556 24840 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:47.596339 24756 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:47.591403 24812 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.598841 24812 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:47.599071 24844 log.cc:927] Time spent T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.884s	user 0.002s	sys 0.000s
W20260709 13:20:47.600978 24856 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.556s	user 0.002s	sys 0.000s
I20260709 13:20:47.602485 24784 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.579773 24723 raft_consensus.cc:740] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:47.619030 24723 consensus_queue.cc:260] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.620400 24840 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.621997 24840 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:47.631790 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1323) took 1634 ms. Trace:
I20260709 13:20:47.632889 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:47.634289 17469 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:47.632331 17997 rpcz_store.cc:276] 0709 13:20:45.996819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.997419 (+   600us) service_pool.cc:224] Handling call
0709 13:20:46.002343 (+  4924us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:46.002767 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.002799 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:46.008929 (+  6130us) log.cc:844] Serialized 52 byte log entry
0709 13:20:46.171037 (+162108us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:46.171107 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.171202 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:47.586033 (+1414831us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:47.629172 (+ 43139us) raft_consensus.cc:1685] finished
0709 13:20:47.629193 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.631576 (+  2383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1323,"raft.queue_time_us":5764,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":22575,"spinlock_wait_cycles":11651328,"thread_start_us":111265,"threads_started":1,"wal-append.queue_time_us":189214}
I20260709 13:20:47.645617 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1260) took 1107 ms. Trace:
I20260709 13:20:47.646198 17397 rpcz_store.cc:276] 0709 13:20:46.537732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.540918 (+  3186us) service_pool.cc:224] Handling call
0709 13:20:46.541171 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.884017 (+342846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.645009 (+760992us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b540023cdd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:47.645386 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787252480}
W20260709 13:20:47.642998 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.649565 17993 raft_consensus.cc:2468] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:47.657255 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:47.653443 24784 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:47.667287 17469 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:47.668710 24780 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:47.669596 24780 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.672322 24780 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:47.675151 24816 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:47.675557 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1293) took 1177 ms. Trace:
I20260709 13:20:47.676437 17470 rpcz_store.cc:276] 0709 13:20:46.497402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.730247 (+232845us) service_pool.cc:224] Handling call
0709 13:20:46.793353 (+ 63106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.873131 (+ 79778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.674739 (+801608us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b54001617d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:47.675139 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144519552}
I20260709 13:20:47.685016 24670 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.685155 24574 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:47.685981 24670 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.686278 24574 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.665923 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:47.698637 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:47.700790 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.703508 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:47.703872 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:47.705212 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:47.705636 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:47.706007 17388 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:47.706503 17390 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:47.711092 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:47.712355 24703 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:47.713440 24786 consensus_meta.cc:287] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.747s	user 0.007s	sys 0.014s
I20260709 13:20:47.713061 24703 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.704424 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:47.701004 17395 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:20:47.690475 24670 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:47.719602 17999 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:47.722729 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1259) took 1177 ms. Trace:
I20260709 13:20:47.723237 17389 rpcz_store.cc:276] 0709 13:20:46.537430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.537582 (+   152us) service_pool.cc:224] Handling call
0709 13:20:46.537994 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:47.022062 (+484068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.714072 (+692010us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400253354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:47.714365 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101247744}
I20260709 13:20:47.726936 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:47.727332 24728 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:47.727794 17389 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:47.732182 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:47.733096 17397 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:47.733227 17287 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:47.733928 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:47.734470 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:47.735090 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:47.734392 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:47.736805 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 86579.8us
I20260709 13:20:47.737064 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:47.737850 17467 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:47.738003 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:47.739564 24832 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:47.742585 24703 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:47.745129 24832 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:47.746575 24728 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:47.747081 24728 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:47.752140 17470 raft_consensus.cc:1240] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:20:47.752856 17463 raft_consensus.cc:1275] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:20:47.753424 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:47.754539 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.754796 17462 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:47.752140 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:47.755812 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:47.743728 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:47.757210 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 60270.8us
I20260709 13:20:47.743937 17468 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:47.758033 24795 consensus_queue.cc:1059] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:20:47.743978 17437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.760681 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:47.773785 24855 raft_consensus.cc:3055] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:47.760497 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:47.774868 17997 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:47.775228 17991 raft_consensus.cc:1275] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:47.764914 24723 raft_consensus.cc:3060] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:47.762046 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:47.765288 17999 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:47.782305 24757 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:47.748397 24728 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:47.782881 24757 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:47.783496 24757 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:47.778321 24574 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:47.789531 24883 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:20:47.789888 24728 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:47.785984 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 125471us
W20260709 13:20:47.768062 24884 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:20:47.770195 17994 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:47.771801 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 67580.4us
I20260709 13:20:47.774240 24855 raft_consensus.cc:740] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:47.795950 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 1324) took 1299 ms. Trace:
W20260709 13:20:47.795049 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.806298 17993 rpcz_store.cc:276] 0709 13:20:46.495341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.496411 (+  1070us) service_pool.cc:224] Handling call
0709 13:20:47.774474 (+1278063us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54006815d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:47.794963 (+ 20489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465352960}
I20260709 13:20:47.817263 17469 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:47.785535 24670 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:47.822727 17994 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:47.824688 17990 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:20:47.825383 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:47.829720 24855 consensus_queue.cc:260] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.831600 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:47.835548 17997 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:47.833227 24670 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.840196 17362 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:47.840389 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:47.840418 24670 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:47.842049 24808 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:20:47.842326 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:47.843143 24663 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:47.843297 17995 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 20: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:47.843660 24663 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:47.844167 24663 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:47.844249 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 114320us
I20260709 13:20:47.845094 17434 leader_election.cc:400] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 23. Current term is 24.
I20260709 13:20:47.845395 17434 leader_election.cc:403] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:20:47.846613 17434 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:47.847378 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 114533us
I20260709 13:20:47.853616 24757 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.856815 24726 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:47.857475 24727 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163) with higher term. Message: Invalid argument: T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 23. Current term is 24.
I20260709 13:20:47.857709 24726 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:47.858105 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 93455.1us
I20260709 13:20:47.837637 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:47.865950 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:47.870997 17467 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:47.864615 24810 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:20:47.861375 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:47.875947 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:47.878600 17999 raft_consensus.cc:2393] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 23: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:47.833765 24832 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:47.882058 24740 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:47.882565 24740 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.882965 24740 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:47.875847 24855 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:47.897913 24759 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:20:47.899701 24757 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:47.901125 24757 consensus_queue.cc:1059] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:47.902161 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:47.902400 24757 raft_consensus.cc:3055] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:47.902899 24757 raft_consensus.cc:740] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:47.903640 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:47.903841 24663 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:47.907922 24518 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:47.908371 24518 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.908707 24518 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:47.913201 24610 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:47.920281 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.920853 24663 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:47.923050 24759 consensus_queue.cc:1243] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:20:47.946408 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 99940.5us
I20260709 13:20:47.944727 24839 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:47.889451 24832 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.922133 24757 consensus_queue.cc:260] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:47.953076 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 73557.6us
I20260709 13:20:47.954083 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:47.957075 24551 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:47.957331 17394 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:47.958618 24611 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:47.956393 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:47.948217 24839 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:47.974826 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:47.984640 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:47.966311 24723 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:47.991169 24712 consensus_meta.cc:287] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.015s
I20260709 13:20:47.992739 17465 raft_consensus.cc:1275] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:47.995106 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1287) took 1502 ms. Trace:
I20260709 13:20:47.995635 17394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2565) took 1504 ms. Trace:
I20260709 13:20:47.996063 17394 rpcz_store.cc:276] 0709 13:20:46.491179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.492737 (+  1558us) service_pool.cc:224] Handling call
0709 13:20:46.493021 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:47.957976 (+1464955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.995367 (+ 37391us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540023dcd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:47.995577 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3353070336}
I20260709 13:20:47.997800 24784 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:47.995448 17465 rpcz_store.cc:276] 0709 13:20:46.492697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.711370 (+218673us) service_pool.cc:224] Handling call
0709 13:20:46.711638 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:47.993167 (+1281529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.994763 (+  1596us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001c02d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:47.995013 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2944866176}
I20260709 13:20:48.010389 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.011849 24807 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:48.015265 24698 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.004s	user 0.018s	sys 0.002s
W20260709 13:20:48.016310 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 52756.5us
I20260709 13:20:48.018766 24703 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:48.019138 24757 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:48.019382 24703 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:47.984010 24524 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:48.023000 24832 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:48.023833 24885 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.057s	user 0.003s	sys 0.000s
I20260709 13:20:48.024729 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:48.024960 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.025344 17316 raft_consensus.cc:3060] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:48.026527 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:48.030406 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 96441us
I20260709 13:20:48.030616 24373 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:48.032464 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.033057 24712 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:48.035449 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.037137 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.037531 17318 raft_consensus.cc:1240] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:48.037851 17320 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:48.039978 24839 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.040860 24786 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:48.041541 24839 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:48.042625 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.042799 24786 consensus_queue.cc:1048] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:48.043322 17313 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:20:48.040603 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.044147 24786 consensus_queue.cc:1059] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:48.046491 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.047462 24780 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:48.048153 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:48.049209 24786 consensus_queue.cc:1243] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:48.050140 24670 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.050952 17320 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:20:48.052510 24670 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:48.053344 17320 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:48.053412 17318 raft_consensus.cc:1240] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:48.055110 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.057192 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:48.057374 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.057816 17314 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.061025 17316 raft_consensus.cc:2468] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:48.061160 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:48.061760 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:48.062773 24890 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:20:48.063151 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:48.074602 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.063241 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.063494 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:48.064458 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:48.064653 17320 raft_consensus.cc:1275] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:48.064603 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:48.065712 24703 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:48.065907 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:48.066793 24889 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:20:48.068953 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:48.069811 24783 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:48.081869 17318 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:48.082208 17322 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:48.090804 17320 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:48.091020 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:48.101984 24663 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:48.106058 24784 raft_consensus.cc:3055] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:48.106477 24784 raft_consensus.cc:740] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:48.107414 24784 consensus_queue.cc:260] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.113022 24712 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.113651 24712 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.090152 24832 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:48.115893 24712 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:48.100296 24783 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.118093 24783 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:48.118808 17320 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:48.124045 24611 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.124603 24611 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:48.130321 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55847us
I20260709 13:20:48.130630 17314 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:48.125741 24784 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:48.164912 17314 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:48.168319 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:48.175716 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:48.182405 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 119006us
I20260709 13:20:48.181214 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:48.194217 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 68108.1us
I20260709 13:20:48.175102 24703 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:48.153168 24723 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.130234 24518 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.197522 17391 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:48.201145 17388 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 16: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:48.201596 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 138536us
I20260709 13:20:48.180122 24795 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:48.173703 24740 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.195333 24786 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:48.220428 17434 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:48.225313 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:48.221800 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:48.234865 24141 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:48.234963 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:48.235531 24141 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.236622 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:48.238188 17285 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:48.238535 24141 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:48.238997 24726 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.197252 24551 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:20:48.240763 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.241827 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:48.248993 17314 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.244864 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:48.251255 17997 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.242456 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:48.204342 24698 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:20:48.239421 24346 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:48.255158 17317 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 17: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
W20260709 13:20:48.259407 24887 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
I20260709 13:20:48.261101 24803 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:48.212282 24808 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:20:48.264503 17285 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:48.239598 24552 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:48.273015 24893 log.cc:927] Time spent T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:20:48.230347 24812 consensus_queue.cc:1059] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:20:48.274467 24518 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:48.245640 24712 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:48.265861 24803 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:48.290555 24895 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:20:48.290925 24723 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:48.203890 24663 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:20:48.304991 24838 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:48.304827 17285 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:48.305689 17434 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:48.323163 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 60161.5us
I20260709 13:20:48.275383 24840 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.275228 24832 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:48.328140 24740 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:48.252323 24783 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:48.329097 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 63273.1us
I20260709 13:20:48.255326 24141 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:48.239497 24726 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.348245 24816 raft_consensus.cc:3055] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:48.357909 24757 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:48.364735 17314 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:48.320513 24807 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:48.403995 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 128807us
W20260709 13:20:48.383623 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 78889.3us
I20260709 13:20:48.387326 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:48.366020 24712 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:48.407183 17464 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:48.409009 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:48.409363 24712 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.419018 17467 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.421713 24723 raft_consensus.cc:2804] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:48.422279 24723 raft_consensus.cc:697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:48.423179 24723 consensus_queue.cc:237] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.413403 17468 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:20:48.418113 24757 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.414192 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:48.429301 24757 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:48.397200 24839 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:20:48.435779 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:48.436833 24757 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:48.437346 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:48.437386 24757 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:48.438141 24757 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:48.394068 24816 raft_consensus.cc:740] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:48.441015 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.441808 24808 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.392568 24840 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.443994 24840 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:48.392396 24832 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.446520 24832 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:48.447290 17316 raft_consensus.cc:1275] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:20:48.395565 24663 consensus_queue.cc:1243] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:48.448555 24663 consensus_queue.cc:1059] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:48.449477 24663 raft_consensus.cc:3055] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:48.449931 24663 raft_consensus.cc:740] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:48.449594 24826 consensus_queue.cc:1059] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:48.450395 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:48.450840 24663 consensus_queue.cc:260] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.452129 24663 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:48.448539 17469 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:48.456964 24700 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:48.458011 17997 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:48.460008 17467 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:48.461686 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:48.440563 24816 consensus_queue.cc:260] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:48.464310 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 53227.9us
I20260709 13:20:48.469561 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:48.470192 17467 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:48.470872 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:48.489358 17360 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:48.490799 17468 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:20:48.495390 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:48.490842 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:48.497145 17999 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 16.
I20260709 13:20:48.494874 17469 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:48.506659 17991 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:48.405907 24783 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.473356 24551 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.044s
W20260709 13:20:48.534821 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 64018.6us
I20260709 13:20:48.510246 24807 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:48.543596 17963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:48.547159 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 342122us
W20260709 13:20:48.548418 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 291853us
I20260709 13:20:48.509691 24611 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.553710 17362 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:48.554883 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 82540.4us
I20260709 13:20:48.540294 24816 raft_consensus.cc:3060] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:48.559849 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:48.568300 17394 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:48.572059 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:48.572551 17434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.573660 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:48.575193 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:48.577445 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:48.578151 17998 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:48.581836 24726 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:48.584807 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:48.585201 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:48.586403 24518 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:48.586902 24518 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:48.587826 24518 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.588927 24789 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:48.592343 24552 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:48.593959 24552 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:48.594301 24552 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:48.554247 24803 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.595180 24552 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.596448 24552 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:48.601277 17389 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:48.559073 24840 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.562309 24700 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:48.608762 17470 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:48.609750 17467 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
W20260709 13:20:48.560351 24728 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.768s	user 0.012s	sys 0.000s
I20260709 13:20:48.615522 17287 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:48.616629 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:48.545706 24807 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.574191 24670 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:48.656355 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 108512us
I20260709 13:20:48.621261 24808 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:48.613924 24700 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:48.670838 17215 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 13 to 16, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 16 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.675546 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:48.675417 24784 consensus_queue.cc:1048] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:48.676184 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:48.678957 24551 consensus_queue.cc:1048] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:48.681221 24684 raft_consensus.cc:3055] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:48.685235 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:48.686017 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:48.691009 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 75607.1us
I20260709 13:20:48.691154 17313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:48.691601 24141 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:48.692070 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:48.708436 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 88326.2us
I20260709 13:20:48.617555 24726 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.618207 24840 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.711197 17434 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:48.705058 17313 raft_consensus.cc:606] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:48.654453 24670 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:48.649994 24906 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:48.724181 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 160905us
I20260709 13:20:48.701670 24700 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:48.703367 24784 consensus_queue.cc:1243] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:48.708513 24684 raft_consensus.cc:740] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:48.741679 24789 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:48.759616 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49199.5us
I20260709 13:20:48.720006 24698 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:48.775007 17462 raft_consensus.cc:1275] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:20:48.775418 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 99291.1us
I20260709 13:20:48.778138 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:48.782209 17394 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:48.750190 24826 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:48.794943 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 119482us
I20260709 13:20:48.795811 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:48.755842 24141 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:48.720081 24726 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.809527 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:48.808147 24829 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.790222 24698 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:20:48.889259 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 93530.3us
I20260709 13:20:48.802774 24786 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:48.990621 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 100343us
I20260709 13:20:48.993005 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:48.784827 24712 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.816092 24783 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:49.013523 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:49.013849 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:49.014111 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:49.015138 17394 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:49.015187 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:49.015508 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:49.017102 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:49.057159 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 353147us
W20260709 13:20:49.061620 24908 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.286s	user 0.000s	sys 0.000s
I20260709 13:20:49.063934 24670 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:49.061728 24913 log.cc:927] Time spent T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260709 13:20:48.802595 24789 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:48.816789 24478 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.326s
W20260709 13:20:49.110219 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 300747us
W20260709 13:20:49.102496 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 311245us
I20260709 13:20:48.810729 24826 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.989874 24757 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:48.998720 24663 consensus_queue.cc:1048] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 13:20:49.082129 24346 raft_consensus.cc:2764] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:20:49.175808 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 117749us
I20260709 13:20:49.068050 24783 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:49.178488 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 195656us
W20260709 13:20:49.268784 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 455653us
I20260709 13:20:48.895437 24829 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:49.100993 24923 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:49.244056 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:49.277153 17389 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:48.998250 24684 consensus_queue.cc:260] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:49.275452 17436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.269127 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:49.273109 24728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.025s	sys 0.045s
I20260709 13:20:49.180977 24807 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:49.300132 24728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.026s	sys 0.045s
I20260709 13:20:49.109180 24855 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.177s
I20260709 13:20:49.275069 24783 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.125478 24141 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:49.276222 24840 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:49.328076 24728 raft_consensus.cc:2764] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:20:49.334769 17322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.031s	sys 0.068s
W20260709 13:20:49.345700 24912 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.581s	user 0.002s	sys 0.000s
W20260709 13:20:49.349660 24910 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.275s	user 0.006s	sys 0.002s
W20260709 13:20:49.325009 24916 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:20:49.358281 17389 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
W20260709 13:20:49.359326 17322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.031s	sys 0.068s
I20260709 13:20:49.252722 24698 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.325707 24786 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.327085 24783 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:49.319895 24920 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.391431 24920 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.392122 17434 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:49.392779 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.393639 24920 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:49.319473 24922 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:49.398595 17388 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:49.400450 24789 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:49.401154 17315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:49.401803 17315 raft_consensus.cc:606] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:49.401937 24829 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:49.401206 24249 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:49.403288 24249 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.405118 24726 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:49.406489 24932 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:49.407078 24932 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.408808 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 4117) took 1020 ms. Trace:
I20260709 13:20:49.409183 17466 rpcz_store.cc:276] 0709 13:20:48.388212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.388339 (+   127us) service_pool.cc:224] Handling call
0709 13:20:48.400061 (+ 11722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:48.400281 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:48.400307 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:48.413750 (+ 13443us) log.cc:844] Serialized 26 byte log entry
0709 13:20:48.614972 (+201222us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:48.615161 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:48.615257 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:49.348784 (+733527us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:49.408520 (+ 59736us) raft_consensus.cc:1685] finished
0709 13:20:49.408540 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:49.408746 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61799296,"thread_start_us":187410,"threads_started":1,"wal-append.queue_time_us":383417}
I20260709 13:20:49.410573 24712 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:49.414045 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.338716 24923 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
I20260709 13:20:49.417089 17215 catalog_manager.cc:5697] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 3 to 13, term changed from 16 to 21, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to <none>, VOTER b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) evicted. New cstate: current_term: 21 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:49.438829 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1293) took 1048 ms. Trace:
I20260709 13:20:49.439555 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:49.418648 24786 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.439288 17317 rpcz_store.cc:276] 0709 13:20:48.389978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.390112 (+   134us) service_pool.cc:224] Handling call
0709 13:20:48.400983 (+ 10871us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:48.511283 (+110300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:48.511312 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:48.530163 (+ 18851us) log.cc:844] Serialized 52 byte log entry
0709 13:20:48.633131 (+102968us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:48.649885 (+ 16754us) log.cc:844] Serialized 14 byte log entry
0709 13:20:48.699781 (+ 49896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:48.699852 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:49.438576 (+738724us) raft_consensus.cc:1685] finished
0709 13:20:49.438599 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:49.438749 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163278,"prepare.queue_time_us":14143,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":123574,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":13893,"thread_start_us":72113,"threads_started":1,"wal-append.queue_time_us":145019}
I20260709 13:20:49.442027 24786 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:49.443621 24915 log.cc:927] Time spent T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:20:49.433151 24712 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:49.444149 24728 consensus_queue.cc:1048] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:20:49.445214 24712 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:49.452059 24712 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:49.431591 17286 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:49.326227 24826 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:49.339407 24840 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:49.368155 24552 consensus_meta.cc:287] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.769s	user 0.011s	sys 0.000s
W20260709 13:20:49.385547 24741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.032s
W20260709 13:20:49.459580 24741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.004s	sys 0.032s
I20260709 13:20:49.460219 24741 raft_consensus.cc:993] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower b7108577e5754060b7e468a43dfdcdeb to start an election
W20260709 13:20:49.482959 17360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.001s	sys 0.013s
W20260709 13:20:49.484392 17360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.002s	sys 0.013s
W20260709 13:20:49.486479 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 708355us
I20260709 13:20:49.484105 17388 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
W20260709 13:20:49.487176 24723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.009s	sys 0.006s
I20260709 13:20:49.446040 24249 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:49.457048 24786 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:49.502755 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48782us
I20260709 13:20:49.513810 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:49.505401 24757 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:49.484988 24552 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:20:49.517854 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 248820us
I20260709 13:20:49.488703 24741 raft_consensus.cc:1081] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Signalling peer b7108577e5754060b7e468a43dfdcdeb to start an election
W20260709 13:20:49.519827 17964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.012s
W20260709 13:20:49.491585 24723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.009s	sys 0.006s
I20260709 13:20:49.521214 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:49.524827 17360 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:49.539395 17964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.001s	sys 0.013s
W20260709 13:20:49.541091 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 549493us
I20260709 13:20:49.542716 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:49.543546 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:49.543928 17317 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:49.520218 24923 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:49.520334 24932 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:49.547339 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:49.550832 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:49.538488 24552 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:49.536425 24249 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:49.540159 24840 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:49.520442 24786 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.557932 24757 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:49.559840 17991 raft_consensus.cc:2410] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:20:49.566735 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45911.3us
I20260709 13:20:49.562124 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:49.568231 24931 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.602934 24783 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.577245 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:49.583635 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:49.601533 24698 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:49.559093 17321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:49.604904 17321 raft_consensus.cc:606] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:49.605265 24783 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:49.605011 24931 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:49.577358 24249 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.604429 24698 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.607734 24249 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:49.608482 17994 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
I20260709 13:20:49.608349 24552 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:49.609691 24698 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:49.610384 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:49.612142 24728 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:49.613762 24670 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.614400 24670 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.616381 24670 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:49.617822 24670 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:49.618338 24670 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:49.580219 24700 consensus_meta.cc:287] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.809s	user 0.003s	sys 0.005s
I20260709 13:20:49.621240 24700 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.624409 24700 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:49.558321 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:49.575313 17997 raft_consensus.cc:1275] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:49.557139 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:49.603615 17392 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:49.613695 24826 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:49.561219 17995 raft_consensus.cc:2410] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
W20260709 13:20:49.628955 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 70714.8us
I20260709 13:20:49.630913 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:49.632385 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:49.636255 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:49.641512 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:49.649660 17464 raft_consensus.cc:2410] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:20:49.652622 24741 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:49.640908 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:49.576740 24786 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:49.662704 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:49.665377 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:49.629791 24670 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:49.639945 24923 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:49.633350 24728 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:49.673090 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:49.660105 24937 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:49.649500 24723 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:49.600826 24712 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:49.680961 24918 log.cc:927] Time spent T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.501s	user 0.000s	sys 0.001s
I20260709 13:20:49.667805 24740 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:20:49.682754 24760 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:49.683970 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:49.689589 17469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1309) took 1180 ms. Trace:
I20260709 13:20:49.713331 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:49.698894 24924 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:49.718082 24924 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.720350 24924 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:49.722069 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1294) took 1331 ms. Trace:
I20260709 13:20:49.722628 17320 rpcz_store.cc:276] 0709 13:20:48.390262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.390361 (+    99us) service_pool.cc:224] Handling call
0709 13:20:48.401393 (+ 11032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:48.530789 (+129396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:48.530820 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:48.533452 (+  2632us) log.cc:844] Serialized 26 byte log entry
0709 13:20:48.674559 (+141107us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b18004d7520. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6e9e07 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b 00007f7d62393d23 00007f7d623940d1 00007f7d627afa0f
0709 13:20:48.679787 (+  5228us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b18004d7520. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f681c0a 00007f7d68dc1219 00007f7d666c858f 00007f7d5f707571 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd
0709 13:20:48.767427 (+ 87640us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:48.767481 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:48.767544 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:49.620223 (+852679us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:49.721783 (+101560us) raft_consensus.cc:1685] finished
0709 13:20:49.721816 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:49.721994 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93824,"raft.queue_time_us":87066,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2254,"spinlock_wait_cycles":52632320,"thread_start_us":92243,"threads_started":1,"wal-append.queue_time_us":351537}
W20260709 13:20:49.675384 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 133432us
I20260709 13:20:49.698231 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:49.729472 17319 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:49.707286 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:49.708240 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:49.715817 17465 raft_consensus.cc:2393] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 19: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:49.709540 17469 rpcz_store.cc:276] 0709 13:20:48.508903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.509107 (+   204us) service_pool.cc:224] Handling call
0709 13:20:48.509430 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:48.528881 (+ 19451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:48.528913 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:48.546156 (+ 17243us) log.cc:844] Serialized 52 byte log entry
0709 13:20:48.651273 (+105117us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:48.672339 (+ 21066us) log.cc:844] Serialized 14 byte log entry
0709 13:20:48.697903 (+ 25564us) log.cc:844] Serialized 14 byte log entry
0709 13:20:48.751658 (+ 53755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:48.752268 (+   610us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:49.404944 (+652676us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b180018ad20. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f707522 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:49.592071 (+187127us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b180018ad20. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:49.689259 (+ 97188us) raft_consensus.cc:1685] finished
0709 13:20:49.689365 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:49.689536 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101813,"prepare.queue_time_us":21024,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":1590,"raft.queue_time_us":64790,"raft.run_cpu_time_us":512,"raft.run_wall_time_us":24623,"spinlock_wait_cycles":118085888,"thread_start_us":79448,"threads_started":2,"wal-append.queue_time_us":151233}
I20260709 13:20:49.663565 17322 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 15.
I20260709 13:20:49.653352 24826 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.701321 24670 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:49.742518 17466 raft_consensus.cc:2393] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:49.655241 24741 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:49.749146 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:49.750757 17470 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:49.683775 24840 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:20:49.763144 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:49.762485 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:49.775333 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:49.777832 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:49.778471 17469 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:49.780128 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:49.786474 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:49.787778 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:49.741407 24552 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:49.793570 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:49.794710 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:49.796559 17362 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:49.747466 24703 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:49.763459 24723 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.748039 24760 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:49.794193 17392 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:49.798427 17362 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:49.785766 24670 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:49.803982 17466 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:49.795295 17396 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
W20260709 13:20:49.805207 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 156055us
I20260709 13:20:49.806280 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:49.801832 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 65470.4us
I20260709 13:20:49.811666 24757 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:49.805848 24552 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.802312 24808 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:20:49.814584 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:49.799521 24950 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:20:49.819298 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:49.819643 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:49.816766 17466 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:20:49.841671 17435 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
W20260709 13:20:49.846194 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 50370.2us
I20260709 13:20:49.847777 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:49.805768 17465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb"
dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:20:49.852483 17465 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:49.853092 17465 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:49.817763 24938 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:49.938812 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 84345.2us
I20260709 13:20:49.816758 24757 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.850814 24923 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:49.962782 17468 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:49.937625 24920 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:49.957382 24912 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:20:49.994426 17469 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
I20260709 13:20:49.867449 24728 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:49.939791 24808 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:49.958730 24783 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.959113 24757 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:50.021703 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.022439 17469 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:49.983857 24923 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.025177 24476 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.041365 24476 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.043965 24476 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.025862 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.022073 24783 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.045886 17469 pending_rounds.cc:85] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 13
I20260709 13:20:50.046132 24783 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.046301 17469 pending_rounds.cc:107] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:20:50.046801 17469 raft_consensus.cc:2889] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:50.012395 24935 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:50.026239 24826 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:50.025856 24944 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:50.033164 24712 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.034771 24757 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:49.847573 24723 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.028203 24741 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:50.049198 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 189061us
I20260709 13:20:49.958045 24803 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:20:50.009110 24728 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:50.061269 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 242031us
I20260709 13:20:50.022883 24920 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:50.026237 24930 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:20:49.962765 24938 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.039397 24784 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.052260 24923 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:50.071125 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:50.039160 24840 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:50.092819 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.101066 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.076165 24728 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:50.078459 24932 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:50.107674 17465 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.098624 24826 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:50.082162 24920 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:50.119398 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 49240.6us
I20260709 13:20:50.122429 17390 raft_consensus.cc:1240] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 21. Current term is 22. Ops: []
W20260709 13:20:50.125532 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 278586us
I20260709 13:20:50.127767 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.094965 24784 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.058207 24760 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.128350 17466 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
W20260709 13:20:50.129894 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.131261 24967 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.132763 17394 raft_consensus.cc:1240] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:50.135031 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:50.135766 24949 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:20:50.136584 17315 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:50.137156 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.074052 24670 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.137485 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 4114) took 1965 ms. Trace:
I20260709 13:20:50.139142 17465 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.103211 24840 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.121651 24953 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:50.164203 24953 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.167309 24723 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.158264 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:50.167884 24723 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.168012 17322 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:50.168365 17322 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:50.169050 24958 log.cc:927] Time spent T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:20:50.169234 17322 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.170481 17322 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:50.119201 24551 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.172226 24551 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.173619 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.174258 17390 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 23.
I20260709 13:20:50.174539 24551 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.175057 24551 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:50.175100 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.123248 24826 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:50.175664 24551 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:50.194500 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.183948 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:50.189359 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.192682 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:50.178215 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1305) took 1702 ms. Trace:
I20260709 13:20:50.215188 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:50.221362 17391 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:50.214745 17462 rpcz_store.cc:276] 0709 13:20:48.475754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.475936 (+   182us) service_pool.cc:224] Handling call
0709 13:20:48.507809 (+ 31873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:48.775429 (+267620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.177922 (+1402493us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54002e2a54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:50.178146 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610133376}
W20260709 13:20:50.177503 24963 log.cc:927] Time spent T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:50.229894 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.142036 24937 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.118640 24932 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.235486 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:50.238999 17390 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:50.181198 24941 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.240531 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:50.186427 24784 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.178014 24953 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.162256 17463 rpcz_store.cc:276] 0709 13:20:48.172270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.172535 (+   265us) service_pool.cc:224] Handling call
0709 13:20:48.184163 (+ 11628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:48.202991 (+ 18828us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:48.515242 (+312251us) log.cc:844] Serialized 14 byte log entry
0709 13:20:49.404185 (+888943us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b180045c220. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f707522 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:50.136992 (+732807us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b180045c220. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d6239c4bc 00007f7d5f6ea48b 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f704455 00007f7d627ec060 00007f7d627fe716 00007f7d6280f287
0709 13:20:50.137162 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:50.137228 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:50.137273 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.137338 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.137436 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28983,"prepare.queue_time_us":107543,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":33,"raft.queue_time_us":75464,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":7756,"spinlock_wait_cycles":29627648,"thread_start_us":513614,"threads_started":3,"wal-append.queue_time_us":887942}
I20260709 13:20:50.181031 24757 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.179906 24808 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.251015 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.225936 24968 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.168388 24723 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.277119 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.281759 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:50.183928 24967 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.176826 24826 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:50.286044 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 93471.2us
I20260709 13:20:50.228067 24807 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.054s
W20260709 13:20:50.318253 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 76142us
I20260709 13:20:50.320950 17964 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:50.278982 24970 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:50.322247 17993 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:50.325342 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.327466 24964 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:50.327960 24964 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.328311 24964 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:50.328733 24931 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.329789 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.330473 17321 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:50.331429 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.332667 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.349262 17321 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
W20260709 13:20:50.319833 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 75001us
I20260709 13:20:50.299338 24808 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.354190 24938 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.315071 24840 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.273247 24941 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.365526 24552 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.377498 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.365295 24728 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.310828 24962 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.133s
I20260709 13:20:50.251609 24937 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.367655 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:50.338052 17388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 4118) took 1770 ms (client timeout 2148 ms). Trace:
I20260709 13:20:50.362129 24926 consensus_queue.cc:1048] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:50.316128 24920 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.300453 24757 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.300338 24968 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.373509 17322 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:50.401321 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.311457 24663 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.376405 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.352939 24980 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:50.322576 24970 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:50.332559 24931 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:50.400343 17388 rpcz_store.cc:269] 0709 13:20:48.567870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.568063 (+   193us) service_pool.cc:224] Handling call
0709 13:20:50.337817 (+1769754us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b540036f6d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:50.337953 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787904896}
I20260709 13:20:50.405230 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.424338 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:50.426560 17466 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:50.391314 24611 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.412307 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.430467 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.408089 17434 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:50.420112 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:50.435987 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.348003 17390 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
W20260709 13:20:50.437944 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 216989us
I20260709 13:20:50.440565 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.443845 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.446878 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.441772 17315 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:20:50.444810 17390 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:50.427407 24141 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.423434 24807 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.457260 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:50.460914 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 52917us
I20260709 13:20:50.457098 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.424604 24970 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:50.448590 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:50.461910 17396 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:50.442767 24980 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.415939 24757 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.443507 24920 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.442137 24663 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.444212 24983 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.495347 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.416267 24923 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.453971 24826 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:50.516050 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.518957 24986 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.519496 24992 consensus_queue.cc:1059] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:50.519621 24986 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.520565 24992 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:50.520990 24992 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:50.520987 24926 raft_consensus.cc:3055] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:50.521464 24992 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:50.521735 24926 raft_consensus.cc:740] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:20:50.522449 24977 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:20:50.522790 24926 consensus_queue.cc:260] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.486670 24807 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.524107 24926 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:50.525426 17462 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 22: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:50.525640 24807 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.526485 24923 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.528482 24663 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.450587 24931 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.529652 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:50.506392 24980 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.530469 17993 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:50.530699 24985 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.531085 24931 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.531682 24931 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.532306 24980 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.531316 24985 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.532186 24931 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.529645 24941 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.537714 17993 raft_consensus.cc:2410] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:20:50.529862 24723 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.537982 24731 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.537817 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.540441 24731 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.543612 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.508378 24989 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:50.545251 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.544831 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.550238 17321 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:50.463986 24141 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.530486 24967 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.545186 24723 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.547788 24989 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:50.517338 24983 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.514956 24920 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.568295 24964 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.583366 24967 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.585521 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:50.586998 17465 raft_consensus.cc:1240] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:50.589900 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:50.590273 17396 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:50.576967 24723 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.605644 24723 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.581636 24808 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.593693 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.594349 24141 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.596136 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.596697 24982 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:50.606230 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.606449 17469 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:50.591899 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:50.598186 24968 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.600250 24684 raft_consensus.cc:3060] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:50.602032 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.603174 24964 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.605931 24937 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.607268 24985 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.613132 24995 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:50.624378 24995 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.613354 24997 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.614143 17389 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:50.605826 24932 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.649099 24997 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.651126 24986 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.616312 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44546 (request call id 1354) took 1041 ms. Trace:
I20260709 13:20:50.616982 24760 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.621462 24757 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.589941 24967 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:50.642146 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.653316 17994 rpcz_store.cc:276] 0709 13:20:49.574749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.576960 (+  2211us) service_pool.cc:224] Handling call
0709 13:20:50.616116 (+1039156us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b54001a8bd4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:50.616226 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9997568}
I20260709 13:20:50.664670 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:50.654239 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62416.5us
I20260709 13:20:50.656663 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.667219 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.667302 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:50.668226 17394 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:50.668629 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.669095 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:50.669296 24968 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.669651 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.669890 24968 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.670336 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.670850 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.671445 17469 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:50.672206 24968 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.667253 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.669333 17395 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:50.674837 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.658723 17434 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:50.678402 24995 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.664319 24986 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.725438 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.725601 24986 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.726802 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:50.727687 17991 raft_consensus.cc:2410] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:20:50.728003 24986 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.685912 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.729029 24968 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:50.729490 24968 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:50.729925 24968 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:50.695178 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:50.733659 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:50.733955 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:50.663990 24932 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:50.734463 24712 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:50.734850 24932 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:50.735886 24932 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.700491 24757 consensus_queue.cc:1059] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:50.616561 24970 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.702497 24989 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.675431 24937 consensus_queue.cc:1048] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:20:50.753373 24789 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.754062 24789 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.704924 24983 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.664345 24760 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.705721 24931 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.764603 24789 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.706607 24920 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.706979 17999 raft_consensus.cc:1217] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Deduplicated request from leader. Original: 20.13->[21.14-21.14]   Dedup: 21.14->[]
I20260709 13:20:50.766772 17392 raft_consensus.cc:1275] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:20:50.767072 17999 raft_consensus.cc:1240] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:20:50.767230 17392 pending_rounds.cc:85] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 13
I20260709 13:20:50.767504 17392 pending_rounds.cc:107] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:20:50.707969 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:50.767741 17392 raft_consensus.cc:2889] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:50.708686 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:50.710094 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.710480 24967 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.714969 24927 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:50.715659 24700 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:50.716193 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.719210 24992 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.785023 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.661497 24997 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.821781 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.699673 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:50.823804 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.824394 17992 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:50.825291 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.737229 24987 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:50.825855 17992 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:50.734892 24712 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.738147 24985 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:50.737378 17434 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:50.840111 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 102800us
I20260709 13:20:50.738762 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.743041 24731 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:50.845350 17993 raft_consensus.cc:1240] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:50.704869 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.753248 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.847051 17389 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:50.703847 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2459) took 1061 ms. Trace:
I20260709 13:20:50.758358 17315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "b7108577e5754060b7e468a43dfdcdeb"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:50.849143 17315 raft_consensus.cc:606] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Received request to transfer leadership to TS b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:50.849499 17315 raft_consensus.cc:614] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:50.762220 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.763623 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.764354 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.770757 17998 raft_consensus.cc:2410] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:50.772927 17991 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:50.854175 17990 raft_consensus.cc:2410] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:20:50.774215 17999 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:50.779479 17435 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:50.783932 17321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.788481 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:50.789500 24744 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.789690 24760 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.791368 24970 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:50.792632 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.793133 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.793561 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.795217 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.796159 24720 raft_consensus.cc:993] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:20:50.797293 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.797680 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.799108 17962 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:50.799420 24249 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:50.802759 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.773283 24789 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:50.890446 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 91432.5us
I20260709 13:20:50.839661 24985 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.809587 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.811259 24551 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:50.813823 24783 raft_consensus.cc:3055] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:50.819962 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.821826 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.903815 17388 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:50.896965 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.837002 17360 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:50.768600 24962 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:50.881805 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 102426us
I20260709 13:20:50.888541 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.909132 17990 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:50.847739 17470 rpcz_store.cc:276] 0709 13:20:49.642171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.800157 (+157986us) service_pool.cc:224] Handling call
0709 13:20:49.800472 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:49.805024 (+  4552us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:50.128807 (+323783us) log.cc:844] Serialized 14 byte log entry
0709 13:20:50.446682 (+317875us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:50.461538 (+ 14856us) log.cc:844] Serialized 52 byte log entry
0709 13:20:50.488276 (+ 26738us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:50.488337 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.488445 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:50.703601 (+215156us) raft_consensus.cc:1685] finished
0709 13:20:50.703626 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.703785 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32164,"prepare.queue_time_us":155166,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":6137,"raft.queue_time_us":40780,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":33790,"thread_start_us":501634,"threads_started":2,"wal-append.queue_time_us":330313}
I20260709 13:20:50.834159 24987 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.890316 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.805626 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.886742 17994 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
W20260709 13:20:50.911211 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 74303.1us
I20260709 13:20:50.839775 24712 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:50.808157 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:50.910986 17468 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:50.888450 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:50.918783 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:50.885697 24967 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:50.897051 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:50.921916 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.923034 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:50.899894 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 451351us
I20260709 13:20:50.910912 17999 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:50.923676 17463 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:50.892673 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.924110 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:50.924441 17314 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:50.881223 24920 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:50.890125 24931 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:50.902179 24964 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:50.930140 17313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.936555 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:50.937186 17470 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:50.932518 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:50.933014 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 44641.2us
I20260709 13:20:50.897895 24985 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:50.924917 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:50.941464 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.902483 24983 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.885267 24855 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:20:50.941927 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:50.922853 24987 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:50.946094 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.955507 17463 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:50.924410 24970 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:50.922159 24967 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.959730 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:50.898144 24789 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:50.948813 17434 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:50.938354 24723 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:51.003394 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:50.934580 24923 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:50.965256 17963 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:50.935905 24720 raft_consensus.cc:1081] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:20:51.029716 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:51.030097 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 81385us
I20260709 13:20:51.030532 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.997860 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:51.030928 17434 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:51.030764 17467 raft_consensus.cc:2393] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:51.032385 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:50.889716 24744 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:50.941041 24964 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:51.044881 17434 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:50.921573 24962 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:51.000818 17314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:51.046572 17314 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 16.
I20260709 13:20:50.902746 24783 raft_consensus.cc:740] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:51.005797 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 46176.3us
I20260709 13:20:50.998775 24937 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:50.913295 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:50.940899 24141 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:51.035456 24840 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:51.035715 17315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:51.052412 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 139191us
I20260709 13:20:51.053316 17360 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:51.037530 24789 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:51.038169 24965 consensus_queue.cc:1059] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 13:20:51.083436 17467 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:20:51.038381 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 73251.6us
I20260709 13:20:50.999199 24967 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.034272 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:50.967495 24940 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:50.946380 24956 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:50.954855 24983 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:51.036654 24476 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:51.097465 17322 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:51.081307 17470 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:20:50.941931 24920 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:51.049489 24760 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:51.100773 17463 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:20:51.120251 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 75454.2us
I20260709 13:20:51.087399 17462 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:51.122637 17320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1310) took 1449 ms. Trace:
I20260709 13:20:51.137458 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:51.043726 24998 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:51.081478 24808 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:51.049877 24964 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:51.034543 24923 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:51.158788 17362 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:51.049600 24982 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:51.051141 24757 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.051932 24937 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.137658 17320 rpcz_store.cc:276] 0709 13:20:49.673135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.742800 (+ 69665us) service_pool.cc:224] Handling call
0709 13:20:49.774877 (+ 32077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.818157 (+ 43280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:49.818191 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:49.818230 (+    39us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:49.818259 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.122327 (+1304068us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b5400212854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:51.122391 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:51.122565 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99102976}
I20260709 13:20:51.081981 24931 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:51.084311 24906 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:51.151050 24961 log.cc:927] Time spent T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:51.105638 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:51.196616 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 91069.8us
I20260709 13:20:51.155316 24808 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.099853 24940 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.103786 24807 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:51.086011 24989 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:51.159802 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:51.183146 24670 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:51.161005 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:51.187420 24920 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:51.149181 24723 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:51.145277 24812 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.268751 24812 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:51.192298 17360 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:51.193938 17964 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:51.174638 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:51.207378 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 47649us
I20260709 13:20:51.174436 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:51.210057 25005 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 13:20:51.204879 24808 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.211813 24938 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:51.213045 24760 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:51.208520 24807 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.216325 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35788 (request call id 2288) took 1074 ms. Trace:
I20260709 13:20:51.194041 24783 consensus_queue.cc:260] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:51.254290 17467 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:51.193099 24992 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:51.194542 24937 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.194770 24757 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:51.282791 17316 rpcz_store.cc:276] 0709 13:20:50.141487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.452195 (+310708us) service_pool.cc:224] Handling call
0709 13:20:50.467459 (+ 15264us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:50.467842 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:50.467876 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:50.812929 (+345053us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b2c00014ad8. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:20:50.813580 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 13:20:50.997972 (+184392us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:51.044375 (+ 46403us) log.cc:844] Serialized 14 byte log entry
0709 13:20:51.044566 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.044638 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:51.214116 (+169478us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b180003d8a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:20:51.216089 (+  1973us) raft_consensus.cc:1685] finished
0709 13:20:51.216113 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:51.216268 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10471,"prepare.queue_time_us":45800,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2941,"raft.queue_time_us":53376,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":29301,"spinlock_wait_cycles":38407424,"thread_start_us":183980,"threads_started":1,"wal-append.queue_time_us":227802}
I20260709 13:20:51.278972 24986 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:51.192191 24931 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:51.192615 24906 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.272876 17998 raft_consensus.cc:2410] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:20:51.377938 24906 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.194696 24998 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.378772 24786 raft_consensus.cc:3055] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:51.378726 24998 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:51.379280 24786 raft_consensus.cc:740] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:20:51.277674 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 85438.3us
I20260709 13:20:51.382761 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:51.383951 17360 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:51.205371 24940 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:51.278679 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:51.281016 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 87174.4us
I20260709 13:20:51.258261 24670 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:51.390228 17964 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:51.283941 24855 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:51.390322 24670 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:51.391037 24855 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.391444 24855 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:51.276973 24968 consensus_meta.cc:287] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.003s
I20260709 13:20:51.393028 24999 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:51.393384 24989 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.393137 24968 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:51.395493 17468 raft_consensus.cc:1240] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:51.281318 24991 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:20:51.396726 24757 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:51.397974 24783 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:51.350512 17462 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:51.268085 24962 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:51.280712 24938 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.402244 17962 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:51.402727 24938 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.280736 24760 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.404384 24760 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.412995 24703 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:51.413527 24703 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:51.415620 24703 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:51.417233 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:51.356806 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:51.417910 17397 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:51.189008 24982 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:51.284183 24807 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:51.375851 25009 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.231s	user 0.000s	sys 0.004s
I20260709 13:20:51.377012 24744 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:51.377447 24931 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:51.380205 24786 consensus_queue.cc:260] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:51.420852 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:51.421586 24995 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:51.432117 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:51.423898 17360 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:51.370604 24967 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:51.369145 24985 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:51.435810 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:51.377453 25002 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.442s	user 0.002s	sys 0.000s
I20260709 13:20:51.412660 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:51.417631 24728 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:51.462569 17322 raft_consensus.cc:2393] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:51.445788 24986 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:51.467032 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:51.393903 24989 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:51.465075 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 52487us
I20260709 13:20:51.472077 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:51.467918 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:51.437762 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:51.470665 17466 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:51.469950 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:51.434738 24995 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.473768 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:51.483570 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45918.2us
I20260709 13:20:51.484602 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:51.486181 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:51.476348 17322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4"
dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
mode: GRACEFUL
new_leader_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:20:51.490162 17322 raft_consensus.cc:606] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 LEADER]: Received request to transfer leadership to TS 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:51.440269 24920 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:51.543556 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 57474.7us
I20260709 13:20:51.544595 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:51.548614 17318 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:51.553388 24757 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:51.472371 25016 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:51.554390 24811 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:51.554584 25016 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.554854 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:51.554932 24811 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:51.556020 24757 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:51.556897 24998 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:51.557432 24998 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.557889 24998 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:51.558362 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:51.480701 24786 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.503166 24932 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.503862 24995 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:51.480125 24847 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:51.472501 24964 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:51.566373 24723 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:51.640388 24719 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:51.641053 24719 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.641000 24723 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:51.644088 24723 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:51.646648 24967 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:51.648445 24982 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:51.650028 24985 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:51.652246 24983 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:51.548537 24684 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:51.554968 25016 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:51.641798 24719 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.648032 24808 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:51.541535 24803 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:51.542857 24962 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:51.566234 24712 consensus_meta.cc:287] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.000s
W20260709 13:20:51.572157 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:51.657941 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 86387.3us
I20260709 13:20:51.678117 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:51.568804 24973 log.cc:927] Time spent T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:20:51.569586 24987 consensus_meta.cc:287] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.000s
W20260709 13:20:51.663581 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 242821us
I20260709 13:20:51.657409 24684 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.573262 24999 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:51.574093 25002 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:20:51.566316 24926 raft_consensus.cc:2749] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:51.634351 24789 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:20:51.757279 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 79244.8us
I20260709 13:20:51.650058 24811 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:51.947644 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 557431us
I20260709 13:20:51.955004 17999 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:51.657260 24932 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:52.008289 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45571.6us
I20260709 13:20:51.915999 24986 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:52.010619 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:52.049316 17993 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:51.920073 24684 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:52.051981 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.053053 17993 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:51.962437 25012 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.953965 25017 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:52.074762 17215 catalog_manager.cc:5697] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 20, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 20 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.068463 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:51.999199 24803 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:51.894799 24712 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.102092 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:52.015172 24723 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:52.053488 24760 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.001s
I20260709 13:20:52.015313 24847 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:52.131624 24847 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.033146 24703 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:52.135334 24703 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.102183 25017 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.138275 25017 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:52.138583 24703 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:52.116079 24992 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:20:52.141258 24847 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.141413 24941 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:52.142343 24941 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:52.142668 24964 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.143715 24941 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:52.132261 25015 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:20:52.154457 24938 consensus_meta.cc:287] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.751s	user 0.010s	sys 0.000s
I20260709 13:20:52.155076 24938 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.115612 24757 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:52.169647 24757 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.181295 24760 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.184226 24760 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.185593 24989 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.186344 24989 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:52.186946 24989 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:52.194061 25018 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:52.195756 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 4164) took 1342 ms. Trace:
I20260709 13:20:52.196266 17389 rpcz_store.cc:276] 0709 13:20:50.853181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.148677 (+295496us) service_pool.cc:224] Handling call
0709 13:20:51.149042 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:51.155565 (+  6523us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:51.155598 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:51.158400 (+  2802us) log.cc:844] Serialized 26 byte log entry
0709 13:20:51.632346 (+473946us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:51.632414 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.632537 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:52.195476 (+562939us) raft_consensus.cc:1685] finished
0709 13:20:52.195502 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.195681 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6115,"raft.queue_time_us":6819,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":24457,"thread_start_us":427426,"threads_started":1,"wal-append.queue_time_us":774238}
I20260709 13:20:52.198720 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.200232 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:52.201943 25001 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.350s	user 0.000s	sys 0.014s
W20260709 13:20:52.212111 24940 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.000s
I20260709 13:20:52.172552 24757 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:52.222754 17389 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:52.110358 24670 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:51.952980 24987 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.109623 24998 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.241693 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.253158 17389 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:52.254019 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.255048 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:52.246018 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:52.265190 24998 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:52.266364 24987 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:52.267529 17391 raft_consensus.cc:2393] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:52.268254 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:52.269430 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 1323) took 1416 ms. Trace:
I20260709 13:20:52.269553 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:52.269928 17393 raft_consensus.cc:1240] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:52.270469 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:52.273126 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.275995 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:52.280256 25020 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:52.283308 17466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50030 (request call id 4159) took 1479 ms (client timeout 1905 ms). Trace:
I20260709 13:20:52.215966 24723 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:52.283874 17466 rpcz_store.cc:269] 0709 13:20:50.804310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.819643 (+ 15333us) service_pool.cc:224] Handling call
0709 13:20:52.283061 (+1463418us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b5400281754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:52.283207 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305408768}
I20260709 13:20:52.238296 24670 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.285194 24670 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:52.290903 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 4165) took 1289 ms. Trace:
I20260709 13:20:52.293818 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.269824 17463 rpcz_store.cc:276] 0709 13:20:50.853124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.200627 (+347503us) service_pool.cc:224] Handling call
0709 13:20:51.255241 (+ 54614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:51.255658 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:51.255699 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:51.396328 (+140629us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b2c0014aa78. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:20:51.396716 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:20:51.657717 (+261001us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:51.895106 (+237389us) log.cc:844] Serialized 14 byte log entry
0709 13:20:51.895328 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.895406 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:52.269162 (+373756us) raft_consensus.cc:1685] finished
0709 13:20:52.269259 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.269379 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9452,"prepare.queue_time_us":237584,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":1370,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":83,"spinlock_wait_cycles":79500416,"thread_start_us":260590,"threads_started":1,"wal-append.queue_time_us":870512}
I20260709 13:20:52.290829 24812 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.291599 17390 rpcz_store.cc:276] 0709 13:20:51.001408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.398541 (+397133us) service_pool.cc:224] Handling call
0709 13:20:51.398838 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:51.399190 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:51.399219 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:51.399637 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:20:51.659629 (+259992us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:51.659704 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.659811 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:52.290698 (+630887us) raft_consensus.cc:1685] finished
0709 13:20:52.290720 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.290843 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1843,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":259604,"threads_started":1,"wal-append.queue_time_us":889337}
I20260709 13:20:52.269032 17394 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:52.269824 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51620 (request call id 2593) took 1531 ms (client timeout 1644 ms). Trace:
I20260709 13:20:52.270139 17316 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:52.299508 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:52.302544 17391 rpcz_store.cc:269] 0709 13:20:50.738313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.738445 (+   132us) service_pool.cc:224] Handling call
0709 13:20:52.269595 (+1531150us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540038de54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:52.269748 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3272991616}
I20260709 13:20:52.304629 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:52.309499 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2474) took 1721 ms. Trace:
I20260709 13:20:52.309896 17465 rpcz_store.cc:276] 0709 13:20:50.587634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.587978 (+   344us) service_pool.cc:224] Handling call
0709 13:20:50.588355 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:50.588779 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:50.644603 (+ 55824us) log.cc:844] Serialized 14 byte log entry
0709 13:20:50.907456 (+262853us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:50.935262 (+ 27806us) log.cc:844] Serialized 52 byte log entry
0709 13:20:50.935415 (+   153us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:50.935460 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.935524 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:51.376921 (+441397us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:52.300971 (+924050us) raft_consensus.cc:1685] finished
0709 13:20:52.309243 (+  8272us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.309422 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13956,"prepare.queue_time_us":63219,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":42,"raft.queue_time_us":7875,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":33568,"spinlock_wait_cycles":245467008,"thread_start_us":222398,"threads_started":1,"wal-append.queue_time_us":260248}
I20260709 13:20:52.311565 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:52.317835 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.302199 17389 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:52.320830 17390 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:52.085855 25012 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.130543 24803 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.323415 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:52.323920 24712 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.324523 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:52.306856 24937 consensus_meta.cc:287] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.909s	user 0.010s	sys 0.000s
W20260709 13:20:52.309206 24719 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.634s	user 0.006s	sys 0.003s
I20260709 13:20:52.333498 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
W20260709 13:20:52.338601 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 319479us
I20260709 13:20:52.338948 17318 raft_consensus.cc:2410] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:20:52.306352 24998 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:52.322872 24757 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:52.348853 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.262647 24940 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.367532 17999 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:52.371449 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:52.340142 24937 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.377460 17997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:20:52.378751 17997 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:52.379124 17997 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:52.365069 24906 consensus_meta.cc:287] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.987s	user 0.012s	sys 0.000s
I20260709 13:20:52.381081 17319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:52.381516 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.406499 17319 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:52.382395 17315 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:52.386380 24712 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:52.364861 24757 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:52.394906 24855 consensus_meta.cc:287] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.003s	user 0.012s	sys 0.000s
I20260709 13:20:52.364665 24989 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.380039 24986 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:52.395737 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.396368 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:52.343586 24719 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.433570 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:52.414202 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.417209 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.417444 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 4172) took 1003 ms. Trace:
I20260709 13:20:52.417935 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.368681 24938 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:52.422570 17470 raft_consensus.cc:1240] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:52.432467 17997 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.436107 17996 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 20: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:52.436614 17998 raft_consensus.cc:1240] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:52.377498 24808 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:52.426311 24987 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:52.426568 24855 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.437588 24987 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:52.439396 24931 consensus_meta.cc:287] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.972s	user 0.009s	sys 0.000s
I20260709 13:20:52.440032 17993 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 21: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:52.347981 24998 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.440080 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.377317 24249 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:52.406652 17995 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:52.424588 17316 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 23.
I20260709 13:20:52.439342 24855 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:52.421506 17360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.208.4:34493 timed out after 1.916s (SENT) [suppressed 1 similar messages]
I20260709 13:20:52.434906 17388 rpcz_store.cc:276] 0709 13:20:51.413516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.286858 (+873342us) service_pool.cc:224] Handling call
0709 13:20:52.287173 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.348393 (+ 61220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:52.348421 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:52.348468 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:52.348505 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.417220 (+ 68715us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b5400254254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:52.417269 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.417393 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140342656}
I20260709 13:20:52.442282 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:52.392376 24670 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.466892 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:52.462455 25023 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:20:52.463717 25012 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:52.460637 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.459450 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:52.422458 24906 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.443970 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.478734 17996 raft_consensus.cc:2393] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 23: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:52.467026 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:52.446535 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:52.445075 17465 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:52.446218 17322 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:52.423141 25027 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:52.466840 24987 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.435148 24986 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.453418 24249 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.479105 17990 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:52.476462 17390 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:52.487134 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:52.480777 24610 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:52.465370 24847 consensus_queue.cc:1059] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 13:20:52.518783 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 97304us
I20260709 13:20:52.492256 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 4162) took 1653 ms. Trace:
W20260709 13:20:52.494961 25014 log.cc:927] Time spent T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 1.238s	user 0.006s	sys 0.024s
I20260709 13:20:52.486974 25027 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.488180 17471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 4153) took 1685 ms. Trace:
I20260709 13:20:52.526974 17471 rpcz_store.cc:276] 0709 13:20:50.802532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.805296 (+  2764us) service_pool.cc:224] Handling call
0709 13:20:52.487376 (+1682080us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b580002d998. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d6780c0ab 00007f7d6780c131 00007f7d677cdfc0 00007f7d677b8929 00007f7d677b83d2 00007f7d60d2fbd4
0709 13:20:52.487593 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.487797 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:52.487832 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:52.487883 (+    51us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:52.487925 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.487991 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.488116 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29413120}
I20260709 13:20:52.497083 24551 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:52.503063 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:52.504019 17285 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:52.516600 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2481) took 1600 ms. Trace:
I20260709 13:20:52.519510 17393 rpcz_store.cc:276] 0709 13:20:50.838671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.010364 (+171693us) service_pool.cc:224] Handling call
0709 13:20:52.269732 (+1259368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.270507 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.492006 (+221499us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540038de50. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:52.492185 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2837036288}
I20260709 13:20:52.445757 24931 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.546320 24931 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.533179 24998 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.533304 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:52.551558 24906 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.551775 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:52.552428 24940 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.554378 25027 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.530613 24551 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:52.555982 24551 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.557039 24551 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.559219 25030 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:52.560216 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:52.533862 24803 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:52.561643 24786 consensus_meta.cc:287] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.922s	user 0.011s	sys 0.000s
I20260709 13:20:52.562109 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:52.562626 24937 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.563235 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:52.564216 17322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:52.567378 24757 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:52.567647 24684 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.569283 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.517676 24610 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.570413 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.570624 24610 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:52.571415 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:52.573091 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.573549 24719 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.573840 17392 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:52.575417 24986 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.575788 17392 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:52.564411 24249 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:52.578475 24953 consensus_queue.cc:1048] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:52.564743 17322 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:52.580811 17388 raft_consensus.cc:2368] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 23. Current term is 24.
I20260709 13:20:52.582327 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:52.582888 17990 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:52.535328 24783 consensus_meta.cc:287] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.137s	user 0.009s	sys 0.001s
I20260709 13:20:52.536791 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.537367 24811 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:52.531754 17468 rpcz_store.cc:276] 0709 13:20:50.916650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.284958 (+368308us) service_pool.cc:224] Handling call
0709 13:20:51.288255 (+  3297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.395875 (+107620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.516306 (+1120431us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540016b2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:52.516525 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246210816}
W20260709 13:20:52.585441 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 58620.9us
I20260709 13:20:52.571480 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.586886 17316 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:52.593384 17317 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:52.606411 17319 raft_consensus.cc:2468] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:52.618906 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.633136 17393 raft_consensus.cc:2368] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23.
I20260709 13:20:52.620424 17390 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 19.
I20260709 13:20:52.639638 17393 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
W20260709 13:20:52.636893 25016 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: Time spent flushing consensus metadata: real 0.961s	user 0.007s	sys 0.004s
W20260709 13:20:52.637172 24807 consensus_meta.cc:287] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.191s	user 0.006s	sys 0.006s
I20260709 13:20:52.649514 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:52.616303 24811 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:52.644382 17393 raft_consensus.cc:1240] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:52.640169 24720 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:52.663278 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:52.612660 24962 consensus_queue.cc:1059] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:20:52.671875 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:52.669096 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.686170 17990 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:52.667137 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:52.659545 24811 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.688021 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:52.698962 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.690620 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.659225 24783 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:52.653806 25016 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.703299 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:52.722021 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 128314us
I20260709 13:20:52.722816 17995 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 22: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:52.703830 24992 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:52.723966 25016 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.704372 24982 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:52.725212 17463 raft_consensus.cc:1240] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:52.705641 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:52.725474 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:52.716372 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:52.726245 17999 raft_consensus.cc:2410] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:20:52.706162 24923 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.706419 17434 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:52.727136 17434 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:52.728034 17434 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:52.706468 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:52.729856 25020 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:52.730347 25020 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.730749 25020 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.707053 24989 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:52.733186 24989 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.735939 24989 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.707505 24712 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:52.737193 24712 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.739805 24712 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.726135 17317 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:52.747294 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:52.707589 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:52.707995 24812 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.708410 24932 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.688246 24962 consensus_queue.cc:1243] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:52.711081 24968 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.686058 24720 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.717314 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:52.713285 24998 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.749629 17963 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:52.740484 25026 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:52.655010 24757 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:20:52.680944 24980 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:52.655427 24807 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.719795 24986 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:52.761318 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:52.771404 17468 raft_consensus.cc:3060] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:52.698957 24956 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:52.760653 24812 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.762187 17394 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:52.718374 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:52.764853 17471 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:52.721390 24927 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:52.741590 24719 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:52.665449 24803 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.092s
I20260709 13:20:52.770488 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.783972 17389 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:52.758548 24992 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:52.760855 24923 raft_consensus.cc:2804] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:52.775758 17393 raft_consensus.cc:2393] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:52.778103 17963 leader_election.cc:400] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23.
I20260709 13:20:52.787348 17391 raft_consensus.cc:1240] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:52.790958 17963 leader_election.cc:403] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:52.769187 24249 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:52.770884 24684 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.792306 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:52.792439 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 74127.9us
I20260709 13:20:52.793614 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.788050 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.795889 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:52.799317 17393 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:52.799175 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.782349 24789 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.757777 24982 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.815222 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:52.819896 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.818490 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:52.799202 24855 raft_consensus.cc:3060] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:52.774953 24980 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.769709 24998 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.858769 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:52.858830 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:52.784384 24786 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:20:52.786610 25026 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:52.799084 24937 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.840585 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.846493 17464 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 25.
I20260709 13:20:52.815356 24923 raft_consensus.cc:697] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:52.841167 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:52.784178 24986 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.792413 24719 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:52.889222 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:52.890062 17462 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:52.816342 25030 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:20:52.891026 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.872712 17471 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:52.793342 24906 consensus_queue.cc:1059] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:20:52.786120 24927 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:52.876859 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 115306us
I20260709 13:20:52.800513 24983 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:52.904013 25030 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:52.903894 24983 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.904458 25030 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:52.905313 25030 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.906039 24983 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:52.879134 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:52.906556 25030 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.910542 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51620 (request call id 2604) took 1339 ms. Trace:
I20260709 13:20:52.910960 17391 rpcz_store.cc:276] 0709 13:20:51.571619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.319444 (+747825us) service_pool.cc:224] Handling call
0709 13:20:52.319702 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.790740 (+471038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.910314 (+119574us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54001397d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:52.910482 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071550720}
I20260709 13:20:52.913058 17316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
W20260709 13:20:52.879948 17965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.883899 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:52.884029 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:52.820698 24932 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:52.899914 25006 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.960s	user 0.005s	sys 0.017s
I20260709 13:20:52.901577 24812 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.902307 24927 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.826464 24789 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:52.915458 17317 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:52.916191 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:52.917657 17393 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:52.921727 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:52.895532 24757 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:52.923171 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 128925us
I20260709 13:20:52.943588 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:52.930110 17999 raft_consensus.cc:3060] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:52.888267 24786 consensus_queue.cc:1243] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Peer c23a664ebf3347a4934dee377c8b5101 log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:52.900728 24720 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:52.928180 24783 raft_consensus.cc:3055] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:52.885056 24937 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.934341 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:52.956094 17392 raft_consensus.cc:2393] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:52.956333 17469 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:52.951026 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.871757 24684 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.050s
I20260709 13:20:52.935011 24803 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:52.935901 24757 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.959959 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:52.943743 24985 raft_consensus.cc:3055] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:52.963668 17471 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:52.926597 24932 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:52.981240 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:52.979398 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 55948.4us
I20260709 13:20:52.955802 24783 raft_consensus.cc:740] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:52.968753 25033 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:20:52.966163 24757 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:52.967960 24985 raft_consensus.cc:740] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:53.054194 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.038461 24989 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:53.063112 17462 raft_consensus.cc:2468] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:53.047616 24807 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.070171 17469 raft_consensus.cc:2468] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:53.071727 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:53.072016 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 188053us
I20260709 13:20:53.076236 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:52.955524 24923 consensus_queue.cc:237] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:53.134007 17964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.135685 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.136164 17993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 1378) took 1069 ms. Trace:
I20260709 13:20:53.078830 17391 raft_consensus.cc:2368] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 23. Current term is 24.
I20260709 13:20:53.058081 25047 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:53.136577 17993 rpcz_store.cc:276] 0709 13:20:52.066521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.068165 (+  1644us) service_pool.cc:224] Handling call
0709 13:20:53.079714 (+1011549us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400640354. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:53.136110 (+ 56396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826147200}
I20260709 13:20:53.138803 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.141780 17465 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 22: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:52.979651 25026 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.078549 24803 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.145728 17963 leader_election.cc:400] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 23. Current term is 24.
I20260709 13:20:53.182454 17963 leader_election.cc:403] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:20:53.070773 24989 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.131256 24980 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.131505 24982 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.133229 24807 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.040637 24719 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.197505 17999 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
I20260709 13:20:53.202008 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 4158) took 2398 ms. Trace:
I20260709 13:20:53.245326 17470 rpcz_store.cc:276] 0709 13:20:50.803992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.138521 (+334529us) service_pool.cc:224] Handling call
0709 13:20:51.139004 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.436259 (+1297255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.201738 (+765479us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002d4454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:53.201926 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2951479168}
I20260709 13:20:53.188784 17317 raft_consensus.cc:2468] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
I20260709 13:20:53.203114 17997 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.207203 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:53.248813 17466 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:53.235666 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.243526 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.243800 17962 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.197638 17465 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:20:53.258358 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 112819us
W20260709 13:20:53.147964 24551 consensus_meta.cc:287] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.590s	user 0.003s	sys 0.008s
I20260709 13:20:53.262717 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:53.267150 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:53.263985 17360 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:53.258016 17435 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.269838 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.270983 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:53.212708 25043 log.cc:927] Time spent T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 13:20:53.243217 25042 log.cc:927] Time spent T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
W20260709 13:20:53.212174 25055 log.cc:927] Time spent T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:53.278057 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.317013 17317 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:53.317258 17999 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:53.279706 17435 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:53.280728 17318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863"
I20260709 13:20:53.318400 17318 raft_consensus.cc:3055] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:53.265990 17468 raft_consensus.cc:2468] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:20:53.134322 25054 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.176s
I20260709 13:20:53.276248 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:53.262094 24995 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 1.592s	user 0.012s	sys 0.001s
I20260709 13:20:53.201416 24373 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:53.310777 17463 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:53.212371 24723 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.321214 17317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:53.143383 25047 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.209378 24670 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.227046 24989 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.320013 17964 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.281715 24249 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:53.318609 17318 raft_consensus.cc:740] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:53.193549 24789 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.282218 24962 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.273191 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.264931 24992 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 23. Current term is 24.
I20260709 13:20:53.279017 24997 consensus_queue.cc:1059] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:20:53.330542 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:53.268525 24998 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:53.177511 25020 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:53.325798 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46171.9us
I20260709 13:20:53.368942 17997 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 21. Current term is 22. Ops: [19.15-21.16]
I20260709 13:20:53.369975 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.371384 17435 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.312402 24931 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:53.337436 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 261215us
I20260709 13:20:53.373895 17215 catalog_manager.cc:5697] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 14 to 18, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 18 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.282207 24982 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:53.233410 24807 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.348129 24551 raft_consensus.cc:2804] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:53.143397 24985 consensus_queue.cc:260] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.174289 24783 consensus_queue.cc:260] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.289922 17990 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:53.338814 17318 consensus_queue.cc:260] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.324432 24968 raft_consensus.cc:493] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.328001 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:53.364864 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 91748.2us
I20260709 13:20:53.266989 24803 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.330988 24995 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.328766 24983 raft_consensus.cc:2764] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
W20260709 13:20:53.372684 24610 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.802s	user 0.012s	sys 0.000s
I20260709 13:20:53.372431 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.377233 17397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 4170) took 1964 ms. Trace:
I20260709 13:20:53.377553 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:53.380209 17998 raft_consensus.cc:1240] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 19. Current term is 20. Ops: [17.15-19.16]
I20260709 13:20:53.220769 24953 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.109s
I20260709 13:20:53.380941 17215 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:53.389880 17318 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:53.390520 17999 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:53.381560 24840 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:53.369104 24956 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:53.389847 17962 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.333436 24373 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.368942 24937 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:53.388438 24998 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.330608 25053 raft_consensus.cc:2804] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:53.403401 17999 raft_consensus.cc:1240] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:53.390988 24932 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:53.366900 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 89181.2us
I20260709 13:20:53.402513 17360 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:53.404804 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:53.384065 24723 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:53.413262 17991 raft_consensus.cc:1240] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:53.385191 25051 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:53.398224 17397 rpcz_store.cc:276] 0709 13:20:51.412997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.554963 (+141966us) service_pool.cc:224] Handling call
0709 13:20:51.555253 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.573438 (+ 18185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:51.573474 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:51.573513 (+    39us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:51.573550 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.372737 (+1799187us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5400254754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:53.372808 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:53.377181 (+  4373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41358208}
I20260709 13:20:53.364622 24962 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.397953 24551 raft_consensus.cc:697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:53.426239 24807 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.427197 17318 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:53.428125 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.430122 25020 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:53.457581 24720 consensus_queue.cc:1059] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:53.399371 24985 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:53.431391 25012 raft_consensus.cc:993] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: : Instructing follower 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:20:53.458658 25058 raft_consensus.cc:3055] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:53.459092 25012 raft_consensus.cc:1081] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 LEADER]: Signalling peer 3747096bb5074ea2bf86037fd17c1160 to start an election
I20260709 13:20:53.459666 24703 raft_consensus.cc:3055] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:53.459100 25058 raft_consensus.cc:740] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:53.460098 24703 raft_consensus.cc:740] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:53.460947 25058 consensus_queue.cc:260] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.432461 24803 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.412464 24967 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:53.404291 24610 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:53.436122 25030 consensus_meta.cc:287] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.004s
I20260709 13:20:53.473503 17316 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:53.431704 24986 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.436415 24998 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.421037 24992 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:20:53.462332 25057 log.cc:927] Time spent T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:20:53.474328 24992 raft_consensus.cc:697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 23 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:53.474795 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.475276 24992 consensus_queue.cc:237] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.438180 17320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7241e45fbfca4b46b6df9be8cebcd863" is_pre_election: true
I20260709 13:20:53.453043 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51628 (request call id 1326) took 2446 ms. Trace:
W20260709 13:20:53.450809 17361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.446168 25053 raft_consensus.cc:697] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:53.413148 25062 consensus_queue.cc:1175] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3747096bb5074ea2bf86037fd17c1160" responder_term: 15 status { last_received { term: 14 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:53.477592 25062 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:53.477746 25053 consensus_queue.cc:237] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.398748 24968 raft_consensus.cc:515] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.481424 24610 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.462428 24980 raft_consensus.cc:3055] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:53.482667 24980 raft_consensus.cc:740] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:53.482095 24551 consensus_queue.cc:237] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.466662 25047 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.468856 24995 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:53.383805 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:53.470450 24783 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:53.410355 24997 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:53.497021 24997 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.497495 24997 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:53.498082 24968 leader_election.cc:290] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.470010 17215 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 17 to 20, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 20 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.471426 24941 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:53.473385 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 45356.1us
W20260709 13:20:53.474997 24855 consensus_meta.cc:287] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
I20260709 13:20:53.475965 24998 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.509449 17466 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 15.
I20260709 13:20:53.477002 17315 rpcz_store.cc:276] 0709 13:20:50.999704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.184955 (+185251us) service_pool.cc:224] Handling call
0709 13:20:51.209039 (+ 24084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.412034 (+1202995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.445481 (+1033447us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400367254. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:53.445665 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2694366976}
W20260709 13:20:53.437294 25056 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:20:53.460883 24703 consensus_queue.cc:260] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.462108 24670 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:53.511096 17964 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:53.486840 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 82134.6us
I20260709 13:20:53.472323 24757 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.483443 24373 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.486364 24932 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.485203 25051 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.488476 24937 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:53.483532 24980 consensus_queue.cc:260] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:53.509181 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 134437us
W20260709 13:20:53.446463 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 44036.8us
W20260709 13:20:53.562981 17360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.464177 24962 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.564149 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:53.517194 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:53.516455 17215 catalog_manager.cc:5697] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 9 to 15, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 15 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.567456 24997 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:53.568404 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 51297.1us
I20260709 13:20:53.501807 24808 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.569283 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.568673 17215 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.570428 17435 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.570648 17215 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 19, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 19 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.571378 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:53.571449 24968 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:53.572014 24998 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:53.572235 24968 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.572813 24968 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:53.573271 24998 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:53.573012 24808 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.575233 24808 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.572492 17215 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 19, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 19 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:53.576817 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.572054 17466 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:53.578271 17215 catalog_manager.cc:5697] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 15 to 17, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 17 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.580106 17215 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 14 to 19, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 19 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.580590 24968 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.581673 17215 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:53.581393 24997 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.583668 24962 consensus_queue.cc:1059] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:20:53.584517 24968 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:53.584200 17215 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.585830 24998 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:53.592309 17466 raft_consensus.cc:2468] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 26.
I20260709 13:20:53.593906 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.516510 25062 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:53.610845 17964 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:53.611977 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 94305.2us
I20260709 13:20:53.613461 17464 raft_consensus.cc:1240] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:53.518522 24670 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:53.610795 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 221047us
I20260709 13:20:53.518026 24855 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23.
I20260709 13:20:53.603349 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.525993 24249 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:53.615013 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.619702 17215 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 18, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 18 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:53.560158 24937 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.621228 24998 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:53.621304 24937 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:53.621697 17435 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.520696 24829 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.102s
I20260709 13:20:53.622577 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.560636 24703 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.625402 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.626827 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.628449 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.629071 24812 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:53.629407 17215 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 18 to 21, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 21 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:53.630336 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.631160 17215 catalog_manager.cc:5697] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 20 to 21, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 21 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.632153 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.633530 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:53.635442 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.637395 17362 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.614601 24968 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:53.638387 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.619225 24980 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:53.560562 24927 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:20:53.618422 24953 raft_consensus.cc:2804] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:53.661784 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.639263 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.664021 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.664821 17462 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:53.634321 24808 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.638365 24998 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:53.647655 17215 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:53.619114 24670 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:53.641377 24249 raft_consensus.cc:697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:53.658334 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.659301 17991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1379) took 1237 ms. Trace:
I20260709 13:20:53.660719 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.666764 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.667240 17362 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.668012 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:53.638705 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:53.637586 25016 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:53.601195 25026 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:20:53.641127 24373 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:53.560503 24932 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.641109 24986 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:53.686564 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.687361 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:53.692436 17962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.632725 24923 consensus_queue.cc:1059] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:20:53.650616 24610 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:53.692479 17991 rpcz_store.cc:276] 0709 13:20:52.421543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.421697 (+   154us) service_pool.cc:224] Handling call
0709 13:20:52.421961 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:53.419681 (+997720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.658997 (+239316us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54001a9854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:53.659229 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279330560}
I20260709 13:20:53.699594 17362 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.656782 25030 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:53.700758 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 62120.7us
I20260709 13:20:53.700994 25028 raft_consensus.cc:3055] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:20:53.726975 17214 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49282 (request call id 330) took 41507 ms (client timeout 15000 ms). Trace:
W20260709 13:20:53.727676 25068 log.cc:927] Time spent T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:20:53.723805 25054 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:53.729332 25054 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:53.730042 25054 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:53.727463 17214 rpcz_store.cc:269] 0709 13:20:12.117028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.185612 (+ 68584us) service_pool.cc:224] Handling call
0709 13:20:53.613811 (+41428199us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:45.134936 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:45.272960 (+138024us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:45.272997 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:20:45.273015 (+    18us) tablet.cc:662] Decoding operations
0709 13:20:45.274503 (+  1488us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:45.274586 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:45.274614 (+    28us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:20:45.275938 (+  1324us) tablet.cc:701] Row locks acquired
0709 13:20:45.275956 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:20:45.276110 (+   154us) write_op.cc:270] Start()
0709 13:20:45.276221 (+   111us) write_op.cc:276] Timestamp: P: 1783603245276060 usec, L: 0
0709 13:20:45.276241 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:20:45.333300 (+ 57059us) log.cc:844] Serialized 7045 byte log entry
0709 13:20:46.024903 (+691603us) op_driver.cc:464] REPLICATION: finished
0709 13:20:46.182359 (+157456us) write_op.cc:301] APPLY: starting
0709 13:20:46.191573 (+  9214us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:46.776435 (+584862us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:46.776532 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:47.616449 (+839917us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:47.631378 (+ 14929us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:20:47.639501 (+  8123us) write_op.cc:312] APPLY: finished
0709 13:20:47.760603 (+121102us) log.cc:844] Serialized 164 byte log entry
0709 13:20:47.778543 (+ 17940us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d5f6ea0ac 00007f7d68544ab9 00007f7d5f70669b 00007f7d5f70493f 00007f7d5f706c02 00007f7d6238e20b
0709 13:20:47.889918 (+111375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:47.898443 (+  8525us) write_op.cc:454] Released schema lock
0709 13:20:47.898522 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:47.899141 (+   619us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:47.899184 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64016,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":139868,"apply.run_cpu_time_us":49642,"apply.run_wall_time_us":1729214,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":441692,"prepare.run_cpu_time_us":10769,"prepare.run_wall_time_us":385907,"raft.queue_time_us":296015,"raft.run_cpu_time_us":13188,"raft.run_wall_time_us":127368,"replication_time_us":714197,"spinlock_wait_cycles":38530944,"thread_start_us":824497,"threads_started":5,"wal-append.queue_time_us":366394,"wal-append.run_cpu_time_us":38779,"wal-append.run_wall_time_us":2535587}]]}
I20260709 13:20:53.649420 24829 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:20:53.700911 17469 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:53.695825 17215 catalog_manager.cc:5697] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:53.695309 24811 consensus_meta.cc:287] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.954s	user 0.012s	sys 0.000s
W20260709 13:20:53.722028 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 79781.5us
I20260709 13:20:53.686540 24998 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.697225 25020 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:53.723320 25049 log.cc:927] Time spent T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:20:53.720142 24989 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.703430 24803 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:53.741065 17470 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:20:53.725455 24610 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.700392 24953 raft_consensus.cc:697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 26 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:53.781574 24953 consensus_queue.cc:237] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.782306 24249 consensus_queue.cc:237] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.742388 24807 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:53.785905 25071 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:20:53.786269 24757 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.787473 25051 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.788374 25030 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:53.742308 24811 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.789656 25030 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:53.790125 25030 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:53.791317 24811 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.791134 25030 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.747200 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.726894 25028 raft_consensus.cc:740] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
I20260709 13:20:53.776648 17215 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 15 to 22, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 22 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:20:53.734426 24923 raft_consensus.cc:3055] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:53.805675 24923 raft_consensus.cc:740] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:53.806648 24923 consensus_queue.cc:260] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.808184 24923 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.809093 24995 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:53.809895 24995 consensus_queue.cc:1243] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:53.810247 24932 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:53.813557 24803 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:20:53.815606 16192 tablet_server.cc:179] TabletServer@127.15.208.1:0 shutting down...
I20260709 13:20:53.816784 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.794370 24989 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.744596 24783 consensus_queue.cc:1059] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:20:53.825629 24783 raft_consensus.cc:3055] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:53.826049 24783 raft_consensus.cc:740] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:53.826900 24783 consensus_queue.cc:260] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.828178 24783 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:53.799685 24610 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:53.667384 24937 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:53.793613 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 44953.3us
I20260709 13:20:53.686760 24808 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.844614 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.799053 17995 raft_consensus.cc:2468] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
W20260709 13:20:53.801128 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 54056.3us
I20260709 13:20:53.851089 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:53.743721 24998 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.743587 25020 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:53.854776 25020 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.856061 17996 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:53.851783 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:53.852305 24757 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:53.845479 25028 consensus_queue.cc:260] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.853425 24703 consensus_queue.cc:1059] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:53.792783 25030 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:53.857197 24757 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:53.857841 24757 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:53.853926 24808 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.846638 24803 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.859408 24803 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.852360 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.862133 24803 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.856909 24855 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.862805 24808 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:53.863004 24855 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.863636 17362 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.843715 24812 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:53.865235 17362 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:53.865829 24989 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.866202 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.867981 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:53.869091 17991 raft_consensus.cc:2410] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 23 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:20:53.870848 25028 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:53.835513 24670 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.874406 25012 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:53.875608 24807 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:53.876789 24808 raft_consensus.cc:2804] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:53.877344 24940 consensus_queue.cc:1059] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:53.881716 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.882237 24757 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.878225 17362 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:53.882684 24808 raft_consensus.cc:697] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:53.868122 24989 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.887367 24989 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.875619 25062 raft_consensus.cc:3055] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:53.884976 24847 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:53.885510 25012 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:53.868094 24937 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:53.887753 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:53.890215 17991 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:53.887482 24808 consensus_queue.cc:237] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.884462 24670 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.892831 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.897657 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.895411 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:53.895485 24941 consensus_queue.cc:1059] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:53.901518 25053 raft_consensus.cc:2804] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:53.899696 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.888370 25062 raft_consensus.cc:740] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:53.907142 17362 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.912326 25066 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:53.914424 25020 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.917189 17990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 1384) took 1247 ms. Trace:
I20260709 13:20:53.917698 25020 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:53.919070 17363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.917572 17990 rpcz_store.cc:276] 0709 13:20:52.669451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.690305 (+ 20854us) service_pool.cc:224] Handling call
0709 13:20:53.917030 (+1226725us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54006054d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:53.917133 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349917568}
I20260709 13:20:53.923365 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:53.925551 24803 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.926101 24803 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.927629 24985 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.928155 24985 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.928462 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:53.929641 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:53.930182 24985 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.910260 24670 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:20:53.933946 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:53.934630 17397 raft_consensus.cc:2410] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:20:53.937568 17991 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:20:53.938988 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:53.939918 17360 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:53.904722 25053 raft_consensus.cc:697] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:53.940488 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:53.942039 17394 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 23: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:53.943866 17388 raft_consensus.cc:2393] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:53.945437 24807 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:53.945922 24807 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:53.946309 24807 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.938071 24812 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.948025 24812 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.950294 24812 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.950842 25062 consensus_queue.cc:260] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.952221 25062 raft_consensus.cc:3060] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:53.953363 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46334.5us
I20260709 13:20:53.953946 24986 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:53.955196 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:53.956007 24986 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:53.956383 24986 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.956754 24986 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.958038 24757 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:53.959656 25054 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.928144 24803 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.962208 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:53.963279 25053 consensus_queue.cc:237] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.974476 25054 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.977880 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:53.978488 17388 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:53.980321 24989 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:53.980955 17997 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:53.966668 24783 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:53.981771 24783 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:53.982658 24783 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:53.967604 24610 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.987177 24610 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:53.987634 17388 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:53.968900 24985 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:53.989238 24985 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:53.988991 24998 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.989737 24985 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.990106 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:53.990850 17394 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 23: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:53.993857 25063 raft_consensus.cc:3055] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:53.994272 25063 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:53.995111 25063 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:53.996598 25063 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.999527 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 1387) took 1084 ms. Trace:
I20260709 13:20:53.999898 17995 rpcz_store.cc:276] 0709 13:20:52.914731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.915951 (+  1220us) service_pool.cc:224] Handling call
0709 13:20:53.999374 (+1083423us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b540049a2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:53.999472 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665943296}
I20260709 13:20:53.994253 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:54.003441 24986 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.005592 24847 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:54.006163 24847 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:54.006994 24847 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.009456 25031 raft_consensus.cc:3055] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:54.009995 25031 raft_consensus.cc:740] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:54.013571 17360 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:54.011121 25031 consensus_queue.cc:260] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.025163 25031 raft_consensus.cc:3060] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:54.023000 25028 raft_consensus.cc:2804] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:54.028072 25028 raft_consensus.cc:697] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:54.029186 25028 consensus_queue.cc:237] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.034616 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:54.034852 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:54.035562 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:54.036404 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:54.033911 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.037060 17466 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:54.036993 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:54.044593 17468 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 22: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:54.044611 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:54.047219 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:54.047643 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.047876 17464 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:54.047966 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.047327 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.048797 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96090377e5474346a1e4fdadd3c4c7ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.049151 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.049813 17394 raft_consensus.cc:2410] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 22 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:20:54.055418 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.056008 17392 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:54.056938 17388 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:20:54.057168 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:54.057500 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:54.057721 17389 raft_consensus.cc:3060] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:54.058076 17395 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:54.064347 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.066421 17388 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
W20260709 13:20:54.069350 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.076038 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:54.076828 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:54.078629 17388 raft_consensus.cc:1240] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Rejecting Update request from peer b7108577e5754060b7e468a43dfdcdeb for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:54.076395 17395 raft_consensus.cc:2468] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:20:54.085745 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.088048 17389 raft_consensus.cc:2468] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:54.090894 17285 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.093142 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.094270 17392 raft_consensus.cc:2410] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 25 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:20:54.094848 17285 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.100492 17995 raft_consensus.cc:1240] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:54.102586 17990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4"
dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
 from {username='slave'} at 127.0.0.1:44540
I20260709 13:20:54.103740 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:54.104678 17993 raft_consensus.cc:2393] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 23: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:54.107559 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.110898 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:54.111074 17435 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.111840 25016 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:54.114638 17435 leader_election.cc:304] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.081374 24962 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:54.117060 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:54.116642 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.117367 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.116508 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.123699 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:54.105736 25039 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:54.105654 25051 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:54.124276 24967 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:20:54.135814 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 224598us
I20260709 13:20:54.222208 24684 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:54.125669 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:54.121876 25016 raft_consensus.cc:2749] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:54.122552 24986 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:54.224696 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 99098.1us
I20260709 13:20:54.101874 24807 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:54.317998 25080 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:20:54.135929 24967 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:54.125572 24962 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:54.455042 17316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35788 (request call id 2319) took 1554 ms (client timeout 1963 ms). Trace:
W20260709 13:20:54.455545 17316 rpcz_store.cc:269] 0709 13:20:52.883436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.884589 (+  1153us) service_pool.cc:224] Handling call
0709 13:20:54.321293 (+1436704us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b540043f8d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:54.437519 (+116226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286979456}
I20260709 13:20:54.251331 24803 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:54.430567 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.137396 24937 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:54.126961 24989 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.145s
I20260709 13:20:54.252544 24808 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:54.129271 25047 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:54.445798 17992 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
W20260709 13:20:54.449083 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 195275us
I20260709 13:20:54.450358 17464 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
W20260709 13:20:54.452018 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 323125us
I20260709 13:20:54.449667 17990 raft_consensus.cc:476] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 26 LEADER]: Not starting forced leader election -- already a leader
I20260709 13:20:54.464243 17395 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:54.271713 24684 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.457942 24987 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:54.473774 17435 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:54.474627 17362 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:54.455871 24967 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:54.456651 24719 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:54.471698 25081 log.cc:927] Time spent T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.178s	user 0.009s	sys 0.005s
I20260709 13:20:54.462436 24937 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.464373 25030 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.469913 24808 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:54.512312 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.462561 24968 consensus_queue.cc:1059] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:20:54.462953 24985 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.487867 24998 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:54.484508 24986 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:54.464241 24803 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.506429 24937 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:54.523394 24808 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:54.585201 24803 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:54.586020 24807 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:54.587117 24985 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:54.500824 24719 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.590159 24684 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:54.484169 24987 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.545463 24986 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.591791 25053 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:54.613813 25028 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.614477 25028 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.522943 25030 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:54.655263 25031 consensus_meta.cc:287] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.630s	user 0.018s	sys 0.004s
I20260709 13:20:54.591454 24962 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:54.660928 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 218850us
I20260709 13:20:54.663902 25028 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:54.665580 17470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2505) took 1004 ms. Trace:
I20260709 13:20:54.666136 17470 rpcz_store.cc:276] 0709 13:20:53.661439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.661553 (+   114us) service_pool.cc:224] Handling call
0709 13:20:54.665420 (+1003867us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b54000636d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:54.665520 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180461952}
I20260709 13:20:54.666627 17468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32812 (request call id 2503) took 1008 ms. Trace:
I20260709 13:20:54.667212 17468 rpcz_store.cc:276] 0709 13:20:53.658559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.659735 (+  1176us) service_pool.cc:224] Handling call
0709 13:20:54.666368 (+1006633us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54001f0c54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:54.666549 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807619968}
W20260709 13:20:54.670776 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 196217us
I20260709 13:20:54.661016 25030 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:54.700695 25091 log.cc:927] Time spent T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:54.672247 25031 raft_consensus.cc:493] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.702852 24997 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.716964 17992 raft_consensus.cc:1275] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:20:54.708647 24962 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.722267 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.715288 24703 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:54.734970 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.723026 24953 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.738931 24987 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:54.734983 25030 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.740273 25030 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.742571 25030 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:54.746006 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1390) took 1671 ms. Trace:
I20260709 13:20:54.746430 17997 rpcz_store.cc:276] 0709 13:20:53.074407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.372152 (+297745us) service_pool.cc:224] Handling call
0709 13:20:53.980621 (+608469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:53.981310 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:54.745794 (+764484us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54004443d0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f38ad 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:54.745942 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398711040}
I20260709 13:20:54.728950 24719 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:54.737244 24703 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.755510 24703 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:54.729398 24962 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.759608 24962 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:54.719477 25031 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.762203 25031 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:54.762355 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 218706us
I20260709 13:20:54.733640 24986 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:54.769147 24989 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:54.769604 24989 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:20:54.770105 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 296399us
I20260709 13:20:54.770823 17435 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:54.771436 25016 raft_consensus.cc:2804] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:54.771963 25016 raft_consensus.cc:697] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:54.772872 25016 consensus_queue.cc:237] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.773129 24855 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:54.774026 24840 raft_consensus.cc:3055] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:20:54.774113 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 52052us
I20260709 13:20:54.774535 24840 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:54.775138 24931 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:54.775600 24931 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:54.775352 24840 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.776031 24931 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:54.770514 24989 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.773211 24968 raft_consensus.cc:2804] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:54.777560 24989 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:54.777787 24968 raft_consensus.cc:697] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:54.778784 24968 consensus_queue.cc:237] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:54.781684 17435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.782630 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:54.784175 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:54.784720 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:54.785161 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:54.785343 17466 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:54.785853 17471 raft_consensus.cc:2393] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 22: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:54.786523 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:54.787920 17462 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:20:54.789117 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:54.789647 17469 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:54.789933 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:54.790410 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:54.791116 17469 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 16.
I20260709 13:20:54.792230 17469 raft_consensus.cc:1275] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:20:54.792482 17467 raft_consensus.cc:1275] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:54.722648 24997 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.790482 17463 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:54.806393 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.808120 17463 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:54.788827 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:54.795400 25047 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.809712 25047 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.810200 17997 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 26 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:54.811794 25047 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:54.796875 17471 raft_consensus.cc:1240] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:54.776649 24840 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:54.793504 17470 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:54.797616 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:54.798314 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:54.796882 17469 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:54.799291 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:54.804723 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:54.800872 17285 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:54.816191 17388 raft_consensus.cc:1240] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:54.808046 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.817305 17463 raft_consensus.cc:1275] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 13:20:54.806456 17434 leader_election.cc:336] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.818519 17434 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:54.819293 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.819896 17393 raft_consensus.cc:2468] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 18.
I20260709 13:20:54.820129 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.820967 17397 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:54.822746 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.820885 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:54.825049 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 50102us
W20260709 13:20:54.825376 17434 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.825863 17434 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.826340 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:54.827136 17434 leader_election.cc:336] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.827549 17434 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.827704 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:54.828883 25020 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:54.829010 24923 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:54.829802 24684 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:54.830241 24684 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:54.830734 24684 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:54.830248 24962 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:54.833179 24812 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:54.833622 24962 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:54.834079 24962 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:54.834494 17362 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:54.835248 24986 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:20:54.836431 25099 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:54.836866 25099 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:54.837020 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:54.837349 25099 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:54.837881 24985 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:54.838325 24985 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.838675 24985 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:54.841737 17434 leader_election.cc:336] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.844821 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:54.845613 17991 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:54.841907 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:54.847617 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 46849.1us
W20260709 13:20:54.885838 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 44130us
W20260709 13:20:54.886533 17434 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.854550 17999 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:20:54.857282 17391 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:20:54.887205 17391 pending_rounds.cc:85] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Aborting all ops after (but not including) 14
I20260709 13:20:54.887452 17391 pending_rounds.cc:107] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:20:54.887697 17391 raft_consensus.cc:2889] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:54.888106 17391 pending_rounds.cc:107] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:20:54.888378 17391 raft_consensus.cc:2889] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:54.857293 17994 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:54.845700 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:54.846788 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:54.863616 17392 raft_consensus.cc:1240] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:54.860383 24829 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:54.867077 17395 raft_consensus.cc:1240] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Rejecting Update request from peer 3747096bb5074ea2bf86037fd17c1160 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:54.891175 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.846642 24855 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:20:54.892000 17999 raft_consensus.cc:2410] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 25 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:20:54.892093 17434 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.892038 17466 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:54.868933 17993 raft_consensus.cc:1275] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:54.873692 24757 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:20:54.874688 25054 consensus_queue.cc:1059] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:54.875792 24703 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:20:54.860677 25100 consensus_queue.cc:1048] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:20:54.804761 24953 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.886425 17285 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:54.893918 17391 raft_consensus.cc:1275] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:54.853073 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:54.894713 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 48006.1us
W20260709 13:20:54.896248 17434 leader_election.cc:336] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.896575 17997 raft_consensus.cc:2410] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:54.868120 25039 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:54.896314 17285 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:54.897251 17434 leader_election.cc:336] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.897701 17434 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:54.907048 17434 leader_election.cc:336] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.906927 17285 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.907825 17434 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:54.869736 25028 consensus_queue.cc:1048] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 13:20:54.909996 24829 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:54.913483 17434 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.913986 17434 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.886487 24812 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:54.916209 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:54.917968 17990 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:54.918515 24998 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:54.932744 24829 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:20:54.916297 25026 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:54.935552 24829 consensus_queue.cc:1243] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:54.935755 25105 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:54.920822 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.937054 17993 raft_consensus.cc:2410] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:54.936553 25105 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.922515 17996 raft_consensus.cc:1275] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:20:54.924484 25063 raft_consensus.cc:3055] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:54.938184 25063 raft_consensus.cc:740] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:54.924922 24703 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:54.939152 24703 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.939568 25105 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:54.941215 24703 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:54.926930 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:54.927512 25064 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:54.942569 25064 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:54.938079 17996 pending_rounds.cc:85] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 14
I20260709 13:20:54.943398 17996 pending_rounds.cc:107] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:20:54.943648 17996 raft_consensus.cc:2889] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:54.943563 25064 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.892773 25059 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:54.928460 25051 consensus_queue.cc:1059] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:54.944864 25059 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.945609 25051 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:54.946345 25051 raft_consensus.cc:3055] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:54.946684 25051 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:54.947008 25059 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:54.919673 24931 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.928632 25045 consensus_queue.cc:1059] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:20:54.878153 25012 consensus_queue.cc:1059] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:20:54.930285 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:54.934932 17997 raft_consensus.cc:2368] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 22. Current term is 23.
I20260709 13:20:54.928454 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:54.950598 17391 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:54.932513 25058 raft_consensus.cc:3060] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:54.952077 17434 leader_election.cc:336] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.948227 25045 consensus_queue.cc:1243] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 26.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
I20260709 13:20:54.897207 24855 consensus_queue.cc:1243] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer b7108577e5754060b7e468a43dfdcdeb log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:54.954422 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:54.904008 25047 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:54.901311 24986 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:54.899384 25016 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:54.988996 17962 leader_election.cc:336] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.961186 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:54.963032 17467 raft_consensus.cc:1240] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 23. Current term is 24. Ops: []
W20260709 13:20:54.969640 17360 leader_election.cc:336] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.976609 24998 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:54.950749 24923 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:54.935077 24940 raft_consensus.cc:3055] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:54.998832 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.948175 25051 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:54.980648 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:54.982995 17468 raft_consensus.cc:2410] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:20:54.984021 24953 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:54.986447 24986 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.004024 24986 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:54.984943 24808 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:54.991694 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 63314us
I20260709 13:20:54.993139 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:54.989650 17962 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:54.977231 17434 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:54.896463 24967 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:55.000934 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:54.906416 24807 consensus_queue.cc:1048] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:20:54.907734 25039 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:54.985921 25012 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:20:55.009773 17434 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:55.010751 17962 leader_election.cc:336] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.011426 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:55.014957 24931 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:55.016291 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 46697us
I20260709 13:20:54.999179 24855 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.031667 17360 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:55.016325 17993 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:55.017889 17465 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 20.
I20260709 13:20:54.996946 24927 raft_consensus.cc:2804] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:55.038149 17397 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:54.999089 24940 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:54.987200 25099 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:55.058975 24808 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:55.042531 24967 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:55.038443 24927 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:55.046268 25016 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:55.049710 24807 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.021446 24757 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:55.050467 24953 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:55.026134 25075 consensus_queue.cc:1059] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:20:55.051031 24997 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:55.045598 17462 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:55.051730 24783 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:55.052122 24847 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:55.053438 24811 consensus_queue.cc:1059] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:55.135901 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:55.073567 24927 raft_consensus.cc:3060] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:55.040123 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 62923.3us
I20260709 13:20:55.068151 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:55.139875 17434 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.140445 17434 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:54.999586 24937 raft_consensus.cc:515] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.108232 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:55.095569 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:55.143374 17395 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:55.075870 17391 raft_consensus.cc:1275] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:20:55.007596 24684 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:55.129482 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 118164us
I20260709 13:20:55.070626 25045 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
W20260709 13:20:55.132864 17360 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:55.133607 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 80655.2us
W20260709 13:20:55.022521 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.138000 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:55.153155 17360 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:55.153571 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 131105us
I20260709 13:20:55.153784 17388 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:55.138111 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:55.146554 17434 leader_election.cc:336] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:55.154439 17360 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.060287 24855 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:55.156777 17360 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.156817 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:55.060149 25100 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:55.155296 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.157523 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.145514 24931 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.073390 25105 consensus_queue.cc:1048] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:20:55.081362 24987 consensus_queue.cc:1048] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.066s
I20260709 13:20:55.066360 25051 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:55.175117 24931 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.156870 25039 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:55.157864 17360 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:55.186694 17360 leader_election.cc:336] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.163319 17471 raft_consensus.cc:2393] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 23: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:55.081537 25103 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.072s
I20260709 13:20:55.113240 24807 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.148398 25016 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:55.172180 17394 raft_consensus.cc:1240] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:55.144398 24783 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
W20260709 13:20:55.162196 17434 leader_election.cc:336] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.187179 17360 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:55.201258 17360 leader_election.cc:336] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.201689 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:55.202739 17360 leader_election.cc:336] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.203198 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:55.189877 25114 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:55.156612 25030 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:55.205371 25028 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:20:55.201751 17434 leader_election.cc:336] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:55.207448 25108 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:55.207551 24803 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:55.207898 17434 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.208566 24987 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:20:55.209077 17434 leader_election.cc:336] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.186250 24931 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.209168 24940 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:55.210712 24940 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.209692 17434 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:55.213732 24931 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:20:55.214534 17434 leader_election.cc:336] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.215044 17434 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:55.169238 25100 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:55.206254 17360 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.216223 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:55.218148 17360 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.157866 24985 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:55.220188 17360 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.074476 25106 consensus_queue.cc:1059] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.135s
W20260709 13:20:55.230165 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 73398.9us
I20260709 13:20:55.233675 17360 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:55.237080 25016 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:55.237339 25096 raft_consensus.cc:3055] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:55.237875 25096 raft_consensus.cc:740] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:55.237879 25030 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:55.238938 25096 consensus_queue.cc:260] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.240526 25096 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:55.242015 24684 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:55.250283 25099 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:55.254607 24783 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.289222 24829 raft_consensus.cc:3055] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:55.289705 24829 raft_consensus.cc:740] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:55.290026 24757 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:55.258044 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:55.290858 17388 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 17.
I20260709 13:20:55.290632 24829 consensus_queue.cc:260] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:55.293720 25111 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.244s	user 0.000s	sys 0.002s
I20260709 13:20:55.296339 24931 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:55.296921 24931 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.299141 24931 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.260037 24807 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.264312 24855 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:55.236068 25059 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
W20260709 13:20:55.235543 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.302229 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 66742.5us
W20260709 13:20:55.302951 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.303506 17434 leader_election.cc:336] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.303894 17434 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:55.236753 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.304733 24847 raft_consensus.cc:3055] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:20:55.305027 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 68321.5us
I20260709 13:20:55.305235 24847 raft_consensus.cc:740] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:55.305718 17360 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.306093 24847 consensus_queue.cc:260] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:55.306619 17360 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.276875 25063 consensus_queue.cc:260] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.307086 17360 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:55.307807 25063 raft_consensus.cc:3060] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:55.308207 17360 leader_election.cc:336] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.278085 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:55.280895 24985 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:55.281174 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:55.232087 25028 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:55.312952 17464 raft_consensus.cc:1240] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 25. Current term is 26. Ops: []
I20260709 13:20:55.313875 24931 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:20:55.318306 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.318745 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 156465us
W20260709 13:20:55.319366 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.321892 17392 raft_consensus.cc:1240] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:55.323333 25012 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:55.324138 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:55.323979 25012 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.324822 17397 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:55.325171 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:55.325974 17392 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 24: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:55.325857 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:55.326416 25012 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.284495 17396 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 19.
I20260709 13:20:55.256579 24937 leader_election.cc:290] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.310832 17470 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:55.326560 17388 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:55.326697 24985 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.330528 24985 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.331511 25114 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:55.332094 25114 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.283937 25100 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.310823 24807 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:55.337270 17388 raft_consensus.cc:2468] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:55.347811 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:20:55.355000 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 46820.2us
W20260709 13:20:55.355768 17360 leader_election.cc:336] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.356201 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:55.356940 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:55.357334 17360 consensus_peers.cc:597] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.356760 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:55.357931 17360 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.348953 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:55.348596 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:55.359946 17468 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:55.359012 17471 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:55.364387 17394 raft_consensus.cc:1275] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:55.366355 17434 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:55.367264 24967 raft_consensus.cc:2749] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:55.346195 24953 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:55.370527 24757 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:55.335295 25100 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.334721 25012 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.334975 25075 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.372114 24807 consensus_queue.cc:1059] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:55.369140 25106 consensus_queue.cc:1048] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.004s
I20260709 13:20:55.332796 24985 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.368217 24998 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.374853 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:55.432334 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:55.433966 17360 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.435214 17464 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 24: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:55.377395 25054 raft_consensus.cc:3055] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:55.375805 17434 leader_election.cc:400] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 22. Current term is 23.
I20260709 13:20:55.378068 17963 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:55.380797 17362 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:55.383162 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:55.439028 17993 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:55.438504 17434 leader_election.cc:403] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:20:55.385527 24968 consensus_queue.cc:1048] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:20:55.392360 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:55.392962 17471 raft_consensus.cc:1240] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:55.393546 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:55.394919 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:55.435122 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:55.376485 24953 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.409111 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128956e308c048a2af21fae67c6683ef" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:55.412364 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:55.412546 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58526.6us
I20260709 13:20:55.453759 17998 raft_consensus.cc:3060] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:55.454138 17286 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:55.334993 24829 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:55.360711 24986 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:55.344622 24962 consensus_meta.cc:287] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.000s
I20260709 13:20:55.334375 25114 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.392390 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:55.490653 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:55.491503 17999 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:55.436731 24757 raft_consensus.cc:3055] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:20:55.447142 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 66407.4us
I20260709 13:20:55.493197 17435 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:55.492482 24757 raft_consensus.cc:740] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:55.449091 24807 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:55.426409 24610 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:20:55.495050 24757 consensus_queue.cc:260] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.452831 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:55.452998 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 75005us
I20260709 13:20:55.498925 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:55.457850 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 82192.1us
I20260709 13:20:55.502792 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:55.418912 17468 raft_consensus.cc:2468] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:20:55.490625 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:55.503579 17466 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 19: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:55.497010 17391 raft_consensus.cc:1275] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:55.503509 17471 pending_rounds.cc:85] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Aborting all ops after (but not including) 13
I20260709 13:20:55.495890 24807 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.504601 25105 consensus_queue.cc:1048] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:20:55.505170 17471 pending_rounds.cc:107] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:20:55.505347 24807 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:55.505530 17471 raft_consensus.cc:2889] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:55.506378 25105 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:55.466322 17360 leader_election.cc:336] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.507310 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:55.508594 17360 consensus_peers.cc:597] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.509918 25099 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:55.510123 17360 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.510903 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:55.515584 17465 raft_consensus.cc:2410] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:20:55.515151 17360 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:55.442741 25054 raft_consensus.cc:740] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:55.543272 17992 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
W20260709 13:20:55.542560 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 49441.2us
I20260709 13:20:55.549207 17389 raft_consensus.cc:2393] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:55.551959 17362 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:55.553700 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 43607.2us
W20260709 13:20:55.556589 17360 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.557518 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:55.489912 24968 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 22. Current term is 23.
I20260709 13:20:55.424724 25100 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.427362 25012 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.512375 24373 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:55.432802 25075 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:55.569613 25122 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:20:55.570037 25096 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.517302 25115 consensus_queue.cc:1059] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
W20260709 13:20:55.562094 25116 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:55.548121 24923 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:55.562245 25099 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:55.563349 17435 leader_election.cc:304] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:55.570945 24719 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:55.589861 17360 leader_election.cc:336] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.591218 25119 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:55.591581 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 101049us
I20260709 13:20:55.443279 24998 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.551659 24931 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:55.620296 17285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.602743 24373 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:55.548244 24927 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.529965 24757 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.557111 25058 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.585454 25030 raft_consensus.cc:2804] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:55.634127 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:55.684490 17463 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
W20260709 13:20:55.603451 25112 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:20:55.639504 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 76274.7us
W20260709 13:20:55.644308 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 54483.3us
I20260709 13:20:55.590472 24808 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:55.512568 25103 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:55.648451 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 195702us
W20260709 13:20:55.655299 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 156478us
I20260709 13:20:55.612386 25062 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:55.611379 25114 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:55.627467 24684 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.688087 17470 raft_consensus.cc:1275] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:20:55.713439 17288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.612718 25118 consensus_queue.cc:1059] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:20:55.522684 24962 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:55.735446 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 51503.5us
I20260709 13:20:55.657136 24719 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.733462 24937 consensus_queue.cc:1048] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:20:55.675048 24931 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:55.737638 17360 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:55.650972 25054 consensus_queue.cc:260] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:55.650452 24989 raft_consensus.cc:2804] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:55.675722 24373 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:55.636240 25096 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.736001 24980 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.753561 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:55.760246 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 66089.9us
I20260709 13:20:55.644665 24923 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.773651 25114 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:55.774417 25109 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:55.774165 24684 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:55.751053 25030 raft_consensus.cc:697] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:55.667128 25119 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:55.688153 25058 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:55.790372 17360 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:55.669373 24940 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:55.815793 17393 raft_consensus.cc:1240] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:55.792290 24931 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:55.822057 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:55.850332 17468 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:55.736023 25047 consensus_queue.cc:1059] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
W20260709 13:20:55.843353 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 89900us
I20260709 13:20:55.851884 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:55.844901 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 107300us
I20260709 13:20:55.853410 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:55.790711 25045 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:55.822036 24953 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:55.823190 24989 raft_consensus.cc:697] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:55.863517 25045 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.864023 24923 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.865896 25045 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.867611 24847 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:55.871743 24719 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.872337 24720 raft_consensus.cc:3055] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:55.873418 24998 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.874145 24720 raft_consensus.cc:740] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:55.874918 24962 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:55.875227 24720 consensus_queue.cc:260] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:55.876693 25114 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:55.876830 24720 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.878019 25058 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:55.879352 25075 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.884085 25096 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:55.884716 25096 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:55.885172 25096 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:55.885545 25096 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:55.886108 25119 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:55.889250 25144 raft_consensus.cc:3055] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:55.889636 25144 raft_consensus.cc:740] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:55.890419 25144 consensus_queue.cc:260] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:55.891543 25144 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:55.881425 25106 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:55.893221 25106 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:55.893590 25106 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:55.895325 25030 consensus_queue.cc:237] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:55.897820 25012 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.899068 24989 consensus_queue.cc:237] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.884727 24927 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.901942 24684 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:55.903770 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 135906us
I20260709 13:20:55.845904 25054 raft_consensus.cc:3060] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:55.850345 24986 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:55.957191 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 176921us
I20260709 13:20:55.962604 17468 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:55.902384 24807 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.906936 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:55.981828 17392 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:55.987828 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:55.884105 25100 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:55.988770 17392 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:55.833092 24980 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:55.970181 25102 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:20:56.015039 17998 consensus_meta.cc:287] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.002s
I20260709 13:20:56.017148 17998 raft_consensus.cc:2410] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for term 23 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:20:55.736608 24967 consensus_queue.cc:1048] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.248s
I20260709 13:20:56.025866 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:56.027133 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:56.027756 17395 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:56.028393 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:55.992677 25119 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:55.987618 24962 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:56.046397 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.994812 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:56.047374 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.940290 25012 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:20:56.041476 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:56.050657 17388 raft_consensus.cc:2468] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
W20260709 13:20:56.036634 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 129765us
W20260709 13:20:56.051524 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 198188us
I20260709 13:20:56.052379 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:56.024703 24855 raft_consensus.cc:2764] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:20:56.061818 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:56.054416 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 202638us
I20260709 13:20:56.045007 24962 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:56.091717 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 311407us
I20260709 13:20:56.047567 24847 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.044170 25075 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.095772 17463 raft_consensus.cc:1240] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:56.102532 17287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.102586 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.105883 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.104300 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.119812 17467 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
W20260709 13:20:56.123378 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 291636us
I20260709 13:20:56.124922 17464 raft_consensus.cc:2368] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:56.127310 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:56.126153 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.134187 17470 raft_consensus.cc:2468] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 15.
I20260709 13:20:56.136803 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:56.137638 17998 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:56.103813 24962 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:56.106503 25114 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:56.144528 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:56.126029 25045 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.141580 24703 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:56.170161 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 393483us
I20260709 13:20:56.127135 25058 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:20:56.175000 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.197710 17997 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:56.177306 25132 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:56.198458 25132 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.126340 25075 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.175740 25145 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:56.191336 24931 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.193243 24807 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.194406 24980 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:56.145224 24803 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.016s	sys 0.000s
W20260709 13:20:56.194854 24829 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.002s
I20260709 13:20:56.193912 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:56.196154 24757 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
W20260709 13:20:56.198004 25139 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:20:56.198894 25132 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:56.186081 17998 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:20:56.125545 24847 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.168391 25045 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.196460 24373 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.240957 17998 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:20:56.227288 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 77464us
I20260709 13:20:56.192432 25106 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:56.239909 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 144824us
I20260709 13:20:56.242823 17362 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:56.184641 25096 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:56.221302 24803 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.016s	sys 0.001s
W20260709 13:20:56.247421 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.252226 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:56.199967 24703 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.238535 25147 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:20:56.248584 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.229076 24808 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.263543 17998 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:56.266847 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:56.254258 24757 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:56.261751 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.259080 24808 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:56.278476 17360 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.204485 25145 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.290644 17360 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:56.289222 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.295583 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.296169 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.297813 17360 leader_election.cc:336] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.298389 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:56.299823 17998 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
W20260709 13:20:56.300065 17360 leader_election.cc:336] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:56.292260 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 148932us
W20260709 13:20:56.304283 25130 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.549s	user 0.002s	sys 0.000s
I20260709 13:20:56.304922 25076 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:56.307202 17360 leader_election.cc:336] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:56.307514 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.309284 17360 leader_election.cc:336] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.320637 17360 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:56.293274 24757 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:56.327179 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:56.332602 17388 raft_consensus.cc:2393] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:56.310317 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.345695 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:56.345733 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.348439 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.306295 25028 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:56.353971 17471 raft_consensus.cc:2368] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23.
I20260709 13:20:56.358668 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.307000 25148 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:56.315598 24808 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:56.322132 24989 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:56.289438 24807 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:20:56.426658 17996 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:56.426750 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.427978 17990 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
W20260709 13:20:56.432603 17434 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.433372 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:56.361460 25144 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.360973 25156 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:56.416973 25138 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:56.368762 25075 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.368603 25161 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.461086 24373 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.461959 25076 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:56.462594 25076 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.466651 25045 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:56.468382 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.469429 25076 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:56.469889 25106 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:56.470765 25096 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:56.471390 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.472777 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.474911 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.476891 24847 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:56.477679 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:56.449319 25159 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.454083 25156 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:56.488457 17360 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.458818 24953 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:56.456571 25147 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:20:56.512084 17360 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:56.518003 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 62579.1us
I20260709 13:20:56.519510 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
W20260709 13:20:56.518234 17360 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.520145 17993 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 23
W20260709 13:20:56.520078 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.516496 25145 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.522004 25149 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:56.522702 17360 leader_election.cc:336] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:56.523775 17434 leader_election.cc:336] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.533150 17434 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:56.533952 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:56.534726 17389 raft_consensus.cc:2368] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20.
I20260709 13:20:56.535611 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:56.537961 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.539302 17434 leader_election.cc:336] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.541020 17993 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:56.433180 24989 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.543929 17963 leader_election.cc:400] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20.
I20260709 13:20:56.455178 25144 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.545610 17963 leader_election.cc:403] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:20:56.539994 17434 leader_election.cc:336] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.550762 17434 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:20:56.546039 17962 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.514719 25156 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:56.454412 24757 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.521850 24980 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:56.562762 17962 leader_election.cc:336] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:56.562322 17434 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:56.543773 25016 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:56.560793 24807 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.484678 25161 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.559648 25076 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 19. Current term is 20.
I20260709 13:20:56.516973 25159 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.519894 24953 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.567209 25147 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:56.565551 25145 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:56.601085 24703 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.543365 25149 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:56.627576 17360 consensus_peers.cc:597] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.583534 24967 raft_consensus.cc:2804] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:56.649266 24811 raft_consensus.cc:3055] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:56.649716 24811 raft_consensus.cc:740] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:56.650616 24811 consensus_queue.cc:260] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.651224 24373 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.651854 24811 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:56.651926 24373 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.654465 24953 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:56.655957 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:56.657974 25136 log.cc:927] Time spent T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.760s	user 0.002s	sys 0.000s
I20260709 13:20:56.659250 17396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59472 (request call id 1332) took 1237 ms. Trace:
I20260709 13:20:56.659638 17396 rpcz_store.cc:276] 0709 13:20:55.421612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.421795 (+   183us) service_pool.cc:224] Handling call
0709 13:20:55.437032 (+ 15237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:55.446398 (+  9366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:55.446438 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:55.487012 (+ 40574us) log.cc:844] Serialized 26 byte log entry
0709 13:20:55.785690 (+298678us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:55.785751 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:55.785871 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:56.657330 (+871459us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:56.658956 (+  1626us) raft_consensus.cc:1685] finished
0709 13:20:56.658978 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.659193 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168,"raft.queue_time_us":11457,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":45589376,"thread_start_us":222907,"threads_started":1,"wal-append.queue_time_us":342811}
I20260709 13:20:56.662348 17964 leader_election.cc:400] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23.
I20260709 13:20:56.662724 17964 leader_election.cc:403] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:56.576951 24980 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.603431 24807 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:56.668784 25054 consensus_meta.cc:287] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.728s	user 0.012s	sys 0.000s
I20260709 13:20:56.669116 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40270 (request call id 4214) took 1790 ms. Trace:
I20260709 13:20:56.670296 17393 rpcz_store.cc:276] 0709 13:20:54.878806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.878955 (+   149us) service_pool.cc:224] Handling call
0709 13:20:54.879347 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:55.849653 (+970306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.668737 (+819084us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b540023d2d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:56.669057 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2153116544}
I20260709 13:20:56.690351 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:56.702183 17287 leader_election.cc:400] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:56.702739 17287 leader_election.cc:403] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:56.715188 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:56.684789 24373 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.684540 24610 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.670097 24967 raft_consensus.cc:697] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:56.686290 25147 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.722714 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:56.724980 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.630662 25145 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.714839 24927 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:56.736052 24927 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.741266 24927 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:56.742316 24807 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:56.744262 25127 log.cc:927] Time spent T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.919s	user 0.005s	sys 0.005s
I20260709 13:20:56.730224 24703 raft_consensus.cc:2804] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:56.745345 24703 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:56.745481 25167 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:20:56.745801 24703 raft_consensus.cc:3060] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:56.747364 25159 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:56.747975 24931 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.718842 25054 raft_consensus.cc:3060] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:56.686436 24855 consensus_queue.cc:1048] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:20:56.749850 17994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44542 (request call id 1417) took 1363 ms. Trace:
I20260709 13:20:56.750243 17994 rpcz_store.cc:276] 0709 13:20:55.386844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.387039 (+   195us) service_pool.cc:224] Handling call
0709 13:20:55.393193 (+  6154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:55.393581 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:55.393623 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:55.394104 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:20:55.499928 (+105824us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:55.499970 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:55.500043 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:56.743694 (+1243651us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:56.749486 (+  5792us) raft_consensus.cc:1685] finished
0709 13:20:56.749527 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.749785 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":145,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":39245056,"thread_start_us":105533,"threads_started":1,"wal-append.queue_time_us":415175}
I20260709 13:20:56.732810 25147 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.753196 24967 consensus_queue.cc:237] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.755499 25147 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:56.764041 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:56.731513 25169 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 for earlier term 22. Current term is 23.
I20260709 13:20:56.764601 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:56.772025 17393 raft_consensus.cc:3060] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:56.768414 17467 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:56.764775 17394 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:56.767737 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:56.782966 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:56.783922 17467 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:56.786118 17396 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:56.787784 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.788645 17470 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:56.766436 25039 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:56.732405 24610 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.802129 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.795821 25054 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147) with higher term. Message: Invalid argument: T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 16. Current term is 17.
I20260709 13:20:56.808943 17992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44546 (request call id 1406) took 1031 ms. Trace:
I20260709 13:20:56.811640 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.809386 17992 rpcz_store.cc:276] 0709 13:20:55.777434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.777645 (+   211us) service_pool.cc:224] Handling call
0709 13:20:55.789622 (+ 11977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:56.039352 (+249730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.039395 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:56.039938 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:20:56.212681 (+172743us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:56.212759 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.800014 (+587255us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400604854. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:56.800063 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:56.800118 (+    55us) raft_consensus.cc:1685] finished
0709 13:20:56.800132 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.808871 (+  8739us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2680,"raft.queue_time_us":25570,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":36418,"spinlock_wait_cycles":573291392,"thread_start_us":170771,"threads_started":1,"wal-append.queue_time_us":227933}
I20260709 13:20:56.812424 17463 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:56.809404 25039 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.817751 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:56.827831 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 140698us
I20260709 13:20:56.835188 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.809188 25144 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:56.815387 25045 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:56.822286 24987 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:56.847892 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:56.848101 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.842096 25016 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:56.851951 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.858268 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.858513 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:56.860579 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.864048 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.864661 17462 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:56.871102 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.868737 17467 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:20:56.873893 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:56.874688 17468 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:56.887146 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.845639 25161 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.846782 24989 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:56.889775 25030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.009s	sys 0.021s
I20260709 13:20:56.894079 25149 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:56.894593 25176 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:56.901372 25030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.009s	sys 0.021s
W20260709 13:20:56.873611 24962 consensus_meta.cc:287] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.003s
I20260709 13:20:56.855108 25016 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.845799 25045 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.855327 25144 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:56.891494 24985 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:56.891324 25103 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:56.873919 24807 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:56.902123 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:56.905946 25175 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:56.919054 17996 raft_consensus.cc:2393] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 17: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:56.855547 24811 consensus_queue.cc:1059] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:20:56.892108 25148 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:56.849718 24987 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.920428 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.891004 24927 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.913349 25016 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:56.929553 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.933934 17393 raft_consensus.cc:2468] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:56.917665 25144 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.925320 25149 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.921101 25177 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.959539 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.915773 24962 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.927914 25159 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:56.936757 25144 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:56.923316 25175 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.972332 25039 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.973625 24927 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:56.973953 24987 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:56.974323 24610 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:56.921096 25103 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.974911 25045 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:56.977154 25132 consensus_meta.cc:287] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.000s
I20260709 13:20:56.937153 25145 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.977644 17996 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:56.978233 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.921141 24985 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.980273 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.928579 25148 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.984651 25156 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.921542 24807 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:56.990716 24962 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:56.991716 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32812 (request call id 2539) took 1441 ms. Trace:
I20260709 13:20:57.010011 25103 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:57.010412 24807 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:57.010700 25170 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:57.009789 17465 rpcz_store.cc:276] 0709 13:20:55.550624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.552153 (+  1529us) service_pool.cc:224] Handling call
0709 13:20:55.552522 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:55.588911 (+ 36389us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:20:55.656721 (+ 67810us) log.cc:844] Serialized 14 byte log entry
0709 13:20:55.657221 (+   500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:55.657291 (+    70us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:20:55.657355 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:55.840252 (+182897us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b18004cf540. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f6d52a6 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419
0709 13:20:56.991401 (+1151149us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b54001617d4. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f4e01 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:20:56.991476 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.991641 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":274400,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":242,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":13551,"spinlock_wait_cycles":101527680,"thread_start_us":67405,"threads_started":1}
I20260709 13:20:57.011408 25170 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:56.911429 25176 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:57.014267 25156 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:57.014729 25176 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:57.015057 17397 raft_consensus.cc:2393] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 23: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:57.015708 24980 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:57.017797 25170 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:57.026065 25045 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:57.026746 25045 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:57.028410 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.030333 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:57.029824 25045 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:57.036159 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.036608 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.037213 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:57.037479 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.037770 17463 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.039561 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.043277 25148 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:57.045879 24985 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:57.047919 25175 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:56.961812 25177 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:57.049822 17467 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
I20260709 13:20:57.050434 25102 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.050956 25102 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.004281 25132 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.053550 25132 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:57.053964 25062 raft_consensus.cc:3055] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:57.054347 25062 raft_consensus.cc:740] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:57.055099 25062 consensus_queue.cc:260] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.056068 25062 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.007985 25145 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:20:57.058000 17992 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 22: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:56.959661 25149 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:57.059119 25140 log.cc:927] Time spent T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 1.194s	user 0.004s	sys 0.001s
I20260709 13:20:57.059828 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.060106 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.060949 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.061221 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.061910 17470 raft_consensus.cc:2393] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 24: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:56.999200 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.994830 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:56.996030 25159 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.063485 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.064270 17388 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 19: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:57.065032 24931 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:57.057366 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:57.065589 24931 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:57.066052 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:57.067157 25076 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:57.067548 24931 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:57.067740 25178 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:57.067587 25076 raft_consensus.cc:493] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:57.068811 25076 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.072256 25102 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:57.072595 24703 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:57.076598 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 510241us
W20260709 13:20:57.077646 17962 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:57.093770 17963 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:57.060312 25149 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:57.106900 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:57.065184 25159 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:57.097790 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.102056 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.112660 17393 raft_consensus.cc:2393] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:57.112556 17469 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:57.109707 17998 raft_consensus.cc:1240] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:57.110522 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:57.102300 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:57.116065 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.116807 17995 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 19.
I20260709 13:20:57.113224 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.119002 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:57.121937 17391 raft_consensus.cc:1240] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:57.124547 24703 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:57.147675 17997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:57.132278 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:57.151888 17392 raft_consensus.cc:2368] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18.
I20260709 13:20:57.153093 25151 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:57.153321 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.153760 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.133268 17360 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:57.154737 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.154944 25148 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:57.155344 17395 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:57.155416 25148 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:57.141197 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.106746 25170 raft_consensus.cc:3060] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.138159 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:57.131721 24962 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:20:57.157572 17996 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:20:57.134239 17362 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:57.160101 17362 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:57.162094 17362 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:57.110790 25174 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:20:57.165439 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.133625 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:57.174250 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:57.174805 17994 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.132284 25102 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:57.156320 25148 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.175855 17388 raft_consensus.cc:2393] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:57.177804 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.183470 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:57.177760 24962 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:57.185385 24962 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:57.185751 24962 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.186156 24962 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:57.177780 25039 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:57.186864 17215 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 223) took 11644 ms (client timeout 15000 ms). Trace:
I20260709 13:20:57.187716 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.188028 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.188586 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:57.189131 17470 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:57.190395 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.173621 24807 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:57.192332 17434 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:57.190539 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:57.201632 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 91167.4us
I20260709 13:20:57.202338 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:57.215189 17470 raft_consensus.cc:2468] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:20:57.217742 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.218384 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:57.218384 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:57.221859 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.228133 17463 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
W20260709 13:20:57.230888 17434 leader_election.cc:336] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:57.154191 25076 raft_consensus.cc:515] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.181535 25161 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:57.187302 17215 rpcz_store.cc:269] 0709 13:20:45.542986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.543171 (+   185us) service_pool.cc:224] Handling call
0709 13:20:57.186770 (+11643599us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:54.581603 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:54.582496 (+   893us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:54.582566 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:20:54.582587 (+    21us) tablet.cc:662] Decoding operations
0709 13:20:54.584225 (+  1638us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:54.584323 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:54.584350 (+    27us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:20:54.928985 (+344635us) tablet.cc:701] Row locks acquired
0709 13:20:54.929048 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:20:54.929230 (+   182us) write_op.cc:270] Start()
0709 13:20:54.929405 (+   175us) write_op.cc:276] Timestamp: P: 1783603254929160 usec, L: 0
0709 13:20:54.929427 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:20:54.930176 (+   749us) log.cc:844] Serialized 7716 byte log entry
0709 13:20:55.342628 (+412452us) op_driver.cc:464] REPLICATION: finished
0709 13:20:55.385301 (+ 42673us) write_op.cc:301] APPLY: starting
0709 13:20:55.388275 (+  2974us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:55.774891 (+386616us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:55.775012 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:56.480361 (+705349us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:56.480753 (+   392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:20:56.480831 (+    78us) write_op.cc:312] APPLY: finished
0709 13:20:56.487067 (+  6236us) log.cc:844] Serialized 180 byte log entry
0709 13:20:56.752738 (+265671us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:56.753585 (+   847us) write_op.cc:454] Released schema lock
0709 13:20:56.754191 (+   606us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:56.756252 (+  2061us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:56.756394 (+   142us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4848209,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":33735,"apply.run_cpu_time_us":67892,"apply.run_wall_time_us":1370610,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87727,"num_ops":20,"prepare.queue_time_us":570467,"prepare.run_cpu_time_us":73990,"prepare.run_wall_time_us":561081,"raft.queue_time_us":76934,"raft.run_cpu_time_us":1161,"raft.run_wall_time_us":7350,"replication_time_us":413001,"thread_start_us":995721,"threads_started":5,"wal-append.queue_time_us":443141,"wal-append.run_cpu_time_us":5173,"wal-append.run_wall_time_us":1166592}]]}
I20260709 13:20:57.235078 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:57.199659 24807 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.251313 17286 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:57.249781 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 57921us
I20260709 13:20:57.141501 25016 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:57.190196 25103 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:57.190096 25099 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:57.255693 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:57.257635 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:57.221738 24811 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:57.191824 25102 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.265554 24927 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:57.265139 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:57.249223 24937 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:57.233083 24931 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:57.249401 24610 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:57.255551 24807 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.235215 25039 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:57.258957 25045 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:57.260076 25103 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:57.273090 17360 leader_election.cc:336] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:57.273329 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160
I20260709 13:20:57.260941 25145 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:57.297428 17434 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:57.298595 17434 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:57.265827 25012 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:57.276054 17287 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:57.300271 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.301152 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.308203 17463 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:20:57.296341 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:57.254693 25161 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:57.318483 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 45441.3us
I20260709 13:20:57.272436 25177 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:57.296239 25039 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.277755 24703 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:57.347510 25102 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:57.348503 25161 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:57.349043 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 73098.7us
I20260709 13:20:57.348691 25016 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:57.361588 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:57.349789 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 76551.2us
I20260709 13:20:57.363652 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:57.354007 17991 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:57.351773 17964 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:57.365901 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:57.309981 25103 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:57.312119 25151 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:57.355032 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:57.380635 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:57.402902 17990 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:57.276557 24937 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:57.405298 17991 raft_consensus.cc:1275] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:20:57.409391 17991 pending_rounds.cc:85] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 13
I20260709 13:20:57.409713 17991 pending_rounds.cc:107] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:20:57.410043 17991 raft_consensus.cc:2889] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:57.299013 24610 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:57.417514 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62542.4us
I20260709 13:20:57.345444 24811 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:57.352865 25039 raft_consensus.cc:3060] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:57.354686 24927 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:57.321391 25030 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:57.420557 17287 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:57.355029 25045 raft_consensus.cc:2804] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:57.402693 25175 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:57.406742 25182 raft_consensus.cc:2804] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:57.419299 25105 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:57.419785 25161 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:57.433859 25012 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:57.457379 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:57.420792 25147 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:57.422405 25145 consensus_queue.cc:1059] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:20:57.438745 24927 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.407076 25102 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:20:57.448431 25170 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:57.447898 25045 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.449499 25062 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:57.459244 25105 raft_consensus.cc:493] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.480538 17990 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:20:57.460685 25012 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.436908 24811 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.505332 25045 raft_consensus.cc:3060] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:57.473592 24927 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:57.458866 25175 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.496677 25105 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:57.476999 25182 raft_consensus.cc:697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:57.504757 25012 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:57.517066 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 309935us
I20260709 13:20:57.491909 25156 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:57.469333 25144 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.418741 25151 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.471309 25147 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:57.522307 17994 raft_consensus.cc:2468] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 18.
I20260709 13:20:57.506829 25062 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:57.503365 25102 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:57.522313 25076 leader_election.cc:290] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:57.479847 25016 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 13:20:57.551854 25156 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:57.553157 17997 raft_consensus.cc:2468] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:20:57.559613 17360 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:57.507505 24989 consensus_queue.cc:1048] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:20:57.565142 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:57.503371 25099 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:20:57.511824 24967 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:57.570003 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 134182us
I20260709 13:20:57.570327 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.576123 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:57.579391 25099 consensus_queue.cc:1243] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer 3747096bb5074ea2bf86037fd17c1160 log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:57.589293 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984feea4e2564e57923c946b7572e2a0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:57.590201 17462 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.586472 24967 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:57.607645 24967 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:57.642472 24937 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:57.576969 25102 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:57.705106 17360 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 123 similar messages]
I20260709 13:20:57.609279 25062 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:57.604228 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:57.586621 25199 raft_consensus.cc:2804] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:57.705651 17463 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
W20260709 13:20:57.725589 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 121470us
I20260709 13:20:57.706931 17462 raft_consensus.cc:2468] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 23.
I20260709 13:20:57.597373 25182 consensus_queue.cc:237] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.726557 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:57.728528 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:57.729260 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 283932us
I20260709 13:20:57.729277 17467 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
I20260709 13:20:57.732805 17467 raft_consensus.cc:1240] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 22. Current term is 23. Ops: [21.15-22.16]
W20260709 13:20:57.733629 17360 leader_election.cc:336] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:57.734221 24989 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:57.739394 24962 consensus_meta.cc:287] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.553s	user 0.012s	sys 0.004s
W20260709 13:20:57.749392 17360 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:57.750106 17360 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:57.721287 25195 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.122s	user 0.004s	sys 0.003s
I20260709 13:20:57.761116 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:57.716178 24985 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.765393 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:57.770558 17360 leader_election.cc:336] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:57.771113 17360 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:57.773923 17467 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:20:57.785519 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:57.761529 25199 raft_consensus.cc:697] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:57.814641 17390 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:57.758960 24931 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:57.818647 17964 leader_election.cc:304] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:57.752490 24962 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.785063 25145 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.784475 24703 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.777715 25168 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:57.811975 24940 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.767755 24985 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:57.828236 25211 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:57.841799 25175 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:57.847453 25159 raft_consensus.cc:2804] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:20:57.856441 25212 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:20:57.850445 24811 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:58.007197 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 236423us
I20260709 13:20:57.858373 24940 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.070670 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.013845 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.073784 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.015318 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.017582 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:58.077245 17962 leader_election.cc:336] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.078303 17962 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:58.082404 25196 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:58.085350 17360 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:58.087062 17360 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.087690 25102 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.087700 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:58.089255 25102 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:58.091822 17360 leader_election.cc:336] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.092456 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:58.095212 24962 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.096395 24962 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:58.036526 24807 consensus_meta.cc:287] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.000s
I20260709 13:20:57.857923 25039 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.036649 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:57.850171 25138 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:57.854513 25144 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:57.853858 25145 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.162392 25039 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.162905 25145 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:57.889832 25148 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:57.852667 25151 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:57.917095 25156 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:57.923331 25159 raft_consensus.cc:697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
W20260709 13:20:58.165217 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 392247us
I20260709 13:20:58.167163 24985 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.166903 25159 consensus_queue.cc:237] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.856578 25168 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:57.924618 25199 consensus_queue.cc:237] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:57.911204 25200 log.cc:927] Time spent T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:20:57.857898 25201 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:58.179291 25201 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.180958 25147 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:58.181643 17995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44540 (request call id 1906) took 1063 ms. Trace:
I20260709 13:20:57.909834 25211 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.188004 25211 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:57.891413 25215 raft_consensus.cc:3055] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:58.053670 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:58.189340 25215 raft_consensus.cc:740] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:58.190412 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:58.191416 17993 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:20:58.191495 25215 consensus_queue.cc:260] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.033454 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:58.172456 25168 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:58.108395 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:58.113502 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet b19033ecd72e4ba188910445b70c84d5 with delete_type TABLET_DATA_TOMBSTONED (TS b7108577e5754060b7e468a43dfdcdeb not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:38520
I20260709 13:20:58.113876 24610 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.114734 24940 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.115379 24373 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:58.117393 25220 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:58.120309 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 51289.8us
I20260709 13:20:58.121858 17390 raft_consensus.cc:2468] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
W20260709 13:20:58.127899 25189 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.898s	user 0.000s	sys 0.003s
W20260709 13:20:58.130630 25194 log.cc:927] Time spent T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.603s	user 0.001s	sys 0.000s
I20260709 13:20:57.856827 24703 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.148120 24807 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.222925 25201 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:58.224360 24927 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.008s
I20260709 13:20:58.224962 24807 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.224813 24927 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.225042 25148 consensus_queue.cc:1059] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:20:58.226203 24989 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:58.227291 24373 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:58.113377 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 382204us
I20260709 13:20:58.155413 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:58.229741 17286 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:58.230274 17991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:58.231700 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:58.233345 17393 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 23: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:58.233985 25161 raft_consensus.cc:3055] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:58.234436 25161 raft_consensus.cc:740] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:58.235584 17393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40270 (request call id 4257) took 1018 ms. Trace:
I20260709 13:20:58.235711 24989 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:58.236042 17393 rpcz_store.cc:276] 0709 13:20:57.217250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.218164 (+   914us) service_pool.cc:224] Handling call
0709 13:20:58.235289 (+1017125us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400090454. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:58.235504 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2331854592}
I20260709 13:20:58.236421 24989 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.237416 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50030 (request call id 4238) took 1202 ms. Trace:
I20260709 13:20:58.157205 25227 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.238236 24610 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:58.238682 25227 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.239259 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.074985 25228 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:58.235744 25161 consensus_queue.cc:260] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.241333 25228 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.242830 25161 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:58.244115 25228 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.097249 25105 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.239010 24610 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:58.247061 25105 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.248941 17395 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:20:58.250630 17998 raft_consensus.cc:2368] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
W20260709 13:20:58.257560 25045 consensus_meta.cc:287] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.008s
I20260709 13:20:58.258173 25045 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.182250 17995 rpcz_store.cc:276] 0709 13:20:57.118268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.118402 (+   134us) service_pool.cc:224] Handling call
0709 13:20:57.118694 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:57.191108 (+ 72414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:57.191153 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:57.232795 (+ 41642us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b2c00100b48. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d610eda11 00007f7d610fd372 00007f7d6282fa01 00007f7d627f443a 00007f7d627f383e 00007f7d677b8419 00007f7d60d2fbd4 00007f7d60d2fb62 00007f7d60d2fa91 00007f7d60d2fa0c 00007f7d60d2ecc2
0709 13:20:57.233196 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:20:57.472642 (+239446us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:57.472689 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.472754 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:58.180973 (+708219us) raft_consensus.cc:1685] finished
0709 13:20:58.181020 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:58.181419 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74954,"raft.queue_time_us":47964,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":18288,"spinlock_wait_cycles":3185024,"thread_start_us":239150,"threads_started":1,"wal-append.queue_time_us":525182}
I20260709 13:20:58.260914 25045 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.203292 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:58.217375 25220 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.264952 24989 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:58.266878 25220 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.267488 24931 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:58.268033 24989 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:20:58.270463 25231 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.122s	user 0.001s	sys 0.002s
I20260709 13:20:58.268899 24989 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.263475 17997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44542 (request call id 1432) took 1154 ms. Trace:
I20260709 13:20:58.273051 17997 rpcz_store.cc:276] 0709 13:20:57.109001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.111833 (+  2832us) service_pool.cc:224] Handling call
0709 13:20:58.263112 (+1151279us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400687754. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:58.263281 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794860800}
I20260709 13:20:58.268075 24927 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.237838 17465 rpcz_store.cc:276] 0709 13:20:57.035106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.035288 (+   182us) service_pool.cc:224] Handling call
0709 13:20:57.035636 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:57.043024 (+  7388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:57.043058 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:57.043491 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:20:57.403708 (+360217us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:57.405731 (+  2023us) log.cc:844] Serialized 14 byte log entry
0709 13:20:57.414466 (+  8735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.414584 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:58.129551 (+714967us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b4400022b4c. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f62dc85 00007f7d5f62e6a2 00007f7d623a01db 00007f7d6239baaf 00007f7d6238f86e 00007f7d6238ebb6 00007f7d6238e7d8 00007f7d62398221 00007f7d623981d9 00007f7d62398169
0709 13:20:58.236899 (+107348us) raft_consensus.cc:1685] finished
0709 13:20:58.237009 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:58.237223 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14714,"prepare.queue_time_us":1598,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":23496,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":183,"spinlock_wait_cycles":64770304,"thread_start_us":359918,"threads_started":1,"wal-append.queue_time_us":456974}
I20260709 13:20:58.277479 25156 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.277583 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:58.278530 24931 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:58.279260 24931 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.280965 17997 pending_rounds.cc:85] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Aborting all ops after (but not including) 14
I20260709 13:20:58.281140 25220 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:58.281330 17997 pending_rounds.cc:107] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:20:58.281915 17997 raft_consensus.cc:2889] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:58.283551 25205 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:58.202157 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:58.284773 17996 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:58.279552 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:58.222745 24703 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.278263 25156 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:58.268579 25030 consensus_meta.cc:287] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 0.819s	user 0.003s	sys 0.016s
I20260709 13:20:58.290015 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.291767 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:58.292323 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.293208 17435 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:58.293582 24373 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:58.293891 25012 consensus_meta.cc:287] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.743s	user 0.006s	sys 0.014s
I20260709 13:20:58.290261 24989 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:58.299037 17470 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:20:58.303876 17467 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:20:58.315761 17287 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:58.320783 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:58.325428 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 93907us
I20260709 13:20:58.312538 24373 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:58.308190 25227 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.336745 25235 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.341414 17463 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:58.330570 25030 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:58.333738 24931 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.352658 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:58.356946 24989 raft_consensus.cc:2804] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:58.357034 25045 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:58.357462 25230 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.172s	user 0.001s	sys 0.002s
I20260709 13:20:58.357812 25045 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.315074 25012 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.360790 17360 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:58.358403 25045 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:58.367408 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:58.367357 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.365751 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:58.368822 25054 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:58.369059 17362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:58.369524 25054 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.370513 25099 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.371106 25099 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.371927 25054 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.372572 25235 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.373245 25099 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.374766 25235 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.375376 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.376075 17392 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:58.376294 17993 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 25.
I20260709 13:20:58.377261 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:58.377604 25232 log.cc:927] Time spent T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
I20260709 13:20:58.378011 17391 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:58.379025 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.381575 17287 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:58.347036 25211 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:20:58.382470 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:58.361860 25147 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:58.406046 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.409241 17467 raft_consensus.cc:2393] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate 7241e45fbfca4b46b6df9be8cebcd863 in this term.
I20260709 13:20:58.385676 24989 raft_consensus.cc:697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:58.407119 17286 leader_election.cc:400] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18.
I20260709 13:20:58.413727 17286 leader_election.cc:403] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:58.404937 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:58.415383 17393 raft_consensus.cc:1275] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:58.429142 17999 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:58.416716 25235 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:58.437285 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:58.442181 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 80201.4us
I20260709 13:20:58.443110 17286 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:58.444108 25235 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:58.445252 25156 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.418423 25211 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:58.445605 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 229740us
I20260709 13:20:58.447953 25211 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:20:58.449414 25103 consensus_meta.cc:287] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: Time spent flushing consensus metadata: real 1.027s	user 0.008s	sys 0.014s
I20260709 13:20:58.449970 25103 raft_consensus.cc:515] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.452162 25103 leader_election.cc:290] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Requested vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.452942 25151 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.453595 17389 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 20: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:58.453678 25151 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:58.454420 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 72961.3us
I20260709 13:20:58.455327 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:58.456132 25151 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.456209 25235 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:58.456480 17962 leader_election.cc:336] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.436118 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:58.456727 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 124607us
I20260709 13:20:58.458794 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.459266 17396 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
I20260709 13:20:58.459712 25217 raft_consensus.cc:2804] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:20:58.460111 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 108079us
I20260709 13:20:58.461061 24989 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.462329 25012 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.463685 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:58.465353 25228 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:58.470249 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:20:58.470587 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53070.8us
I20260709 13:20:58.439126 25054 raft_consensus.cc:3060] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.475170 17388 raft_consensus.cc:2393] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 23: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:58.425539 25147 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.493515 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:58.494444 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:58.477980 25237 tablet_replica.cc:333] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:20:58.474946 25228 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:58.489861 25151 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:58.488080 25217 raft_consensus.cc:697] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:58.510021 17360 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:58.510834 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:58.501273 25211 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.521221 17465 raft_consensus.cc:2393] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 22: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
W20260709 13:20:58.524827 17434 leader_election.cc:336] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.524425 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.574071 17434 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:58.513870 25228 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:58.571739 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.535262 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:58.583061 17463 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 25.
I20260709 13:20:58.522363 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:58.524694 25153 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:58.514464 25151 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:58.595745 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 151164us
I20260709 13:20:58.535087 17468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.534241 25147 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:58.593719 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:58.521605 25103 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:58.524132 24931 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:58.524981 25213 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:58.598057 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:58.523551 25215 raft_consensus.cc:3060] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:58.525128 25176 consensus_queue.cc:1048] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.070s
W20260709 13:20:58.606081 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 137656us
I20260709 13:20:58.583986 24807 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:58.599326 25151 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:58.609298 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 152908us
I20260709 13:20:58.609592 25216 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:58.610152 25213 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:58.609103 17211 catalog_manager.cc:5697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 16 to 19, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 19 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:58.610365 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.606604 17287 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:58.610697 17465 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:58.603219 25103 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.610920 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:58.609226 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 98090.8us
I20260709 13:20:58.611380 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.607046 24931 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:58.614935 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.616288 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:58.620996 17468 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:58.622581 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:58.624325 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:58.625118 24373 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:58.626108 25211 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.627302 25217 consensus_queue.cc:237] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.628741 25227 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:58.631080 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.686266 17463 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
I20260709 13:20:58.635003 25226 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:58.637859 25237 raft_consensus.cc:2243] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.641360 17999 raft_consensus.cc:2393] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 20: Already voted for candidate 3747096bb5074ea2bf86037fd17c1160 in this term.
I20260709 13:20:58.643553 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.645318 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.647428 25175 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:58.629146 17286 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:58.654644 17464 raft_consensus.cc:3060] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:20:58.677662 17471 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:58.680696 17466 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:58.682257 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 75738.5us
I20260709 13:20:58.681422 24373 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.678583 25103 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:58.684942 17389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59472 (request call id 1349) took 1498 ms (client timeout 1958 ms). Trace:
I20260709 13:20:58.632628 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:20:58.693899 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 77770.6us
I20260709 13:20:58.665843 25213 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:58.696278 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 67266.2us
I20260709 13:20:58.694000 17287 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:58.696527 25237 raft_consensus.cc:2272] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.665567 24807 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 25 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:58.686717 25236 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:20:58.699355 17389 rpcz_store.cc:269] 0709 13:20:57.186485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.187462 (+   977us) service_pool.cc:224] Handling call
0709 13:20:58.677262 (+1489800us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400125054. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627f82fa 00007f7d677b9b17 00007f7d60d346d4 00007f7d60d34662 00007f7d60d34591 00007f7d60d3450c 00007f7d60d337c2 00007f7d60b2f48c 00007f7d60b2e8c6 00007f7d60b2e26f
0709 13:20:58.684866 (+  7604us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2908921088}
I20260709 13:20:58.712404 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:58.715591 17463 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:58.683810 24931 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:58.716696 17962 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.726550 17962 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:58.697260 24373 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:58.727273 25148 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:58.750572 25148 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.751080 25148 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:58.747232 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55491.2us
I20260709 13:20:58.768991 25170 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:58.720295 25220 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:58.727420 25227 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.778107 25227 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.783757 25237 ts_tablet_manager.cc:1916] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:58.785118 17390 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
I20260709 13:20:58.731035 24927 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:58.789523 17287 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
W20260709 13:20:58.804999 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62259us
I20260709 13:20:58.805760 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:58.805990 17465 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:58.717229 25216 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.809248 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:58.809068 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 213594us
I20260709 13:20:58.694497 25226 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.813690 17287 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:58.800371 24927 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.822348 25199 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:20:58.822903 25012 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:58.808791 24940 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:58.833269 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:58.833356 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:58.838173 17360 leader_election.cc:336] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.735489 24807 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.846768 17360 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:20:58.826001 24927 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:58.834051 24940 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.834113 25235 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:58.841454 25149 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.868117 17468 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:20:58.870842 17463 raft_consensus.cc:1275] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:58.878216 25216 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:58.881511 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48141.1us
I20260709 13:20:58.885039 25099 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:58.893707 25148 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:58.894299 17962 leader_election.cc:336] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.894919 17962 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:58.896204 25148 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.898896 25173 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:58.907370 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 99650.5us
I20260709 13:20:58.907140 17211 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:58.910738 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8ac3d116f3443db6462f3a86ce1432" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.912256 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.912549 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.913154 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.913189 17397 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:58.913792 17393 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:58.914287 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:58.914919 17397 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:58.915536 25012 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.913424 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:58.937446 17466 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 25.
I20260709 13:20:58.934572 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:58.940778 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:58.840453 24931 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.840878 25228 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.946482 17464 raft_consensus.cc:2468] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 20.
I20260709 13:20:58.866214 24940 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:58.917768 25045 consensus_meta.cc:287] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260709 13:20:58.997360 25045 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.999483 25045 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.999543 25220 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
W20260709 13:20:58.917536 25233 log.cc:927] Time spent T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:59.000962 25220 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.950486 25012 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:59.001844 25159 consensus_queue.cc:1048] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:59.003103 25220 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.953794 17211 catalog_manager.cc:5697] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:58.955899 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.957437 25213 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.959939 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:58.962544 25228 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:58.964066 17998 raft_consensus.cc:1275] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:58.946646 25147 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:58.965204 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:58.965868 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.933491 25215 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.969310 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:58.970175 17390 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:58.977909 25103 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.979357 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:58.979485 25151 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:58.985631 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:59.022154 17471 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:58.986268 25211 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:58.990793 25226 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:58.991191 25149 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:58.918833 25054 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079) with higher term. Message: Invalid argument: T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 17. Current term is 18.
I20260709 13:20:58.993960 25236 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:58.942847 25176 raft_consensus.cc:2764] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:20:59.013738 17467 raft_consensus.cc:1240] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:59.014552 17397 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 25.
I20260709 13:20:59.019333 17360 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:59.019830 17394 raft_consensus.cc:2393] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 24: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:20:59.024183 17392 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:59.053642 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.010422 25012 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:59.054466 17394 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 25: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:59.054587 17392 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:20:59.056525 17394 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:59.059556 17391 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:59.027724 17393 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:59.017194 25147 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:59.064855 17462 raft_consensus.cc:2393] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:20:59.069229 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 49950.8us
I20260709 13:20:59.070075 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:20:59.072990 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 113123us
I20260709 13:20:59.075664 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:59.075210 25211 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:59.079458 24937 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:59.081211 25216 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:59.081848 25216 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:59.084005 25216 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:59.071830 24927 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.086069 25103 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.077953 17996 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
I20260709 13:20:59.022873 24373 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:59.028426 25215 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.088754 25213 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:59.077512 25236 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:59.098937 24927 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.100977 17470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:59.101475 25151 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:59.101812 17470 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:59.103917 17434 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:59.105057 17434 leader_election.cc:336] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.105846 25175 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:59.107995 25215 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.109529 25236 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:59.096659 25149 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.113023 24373 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:59.067221 25147 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:59.114923 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.080564 25148 consensus_queue.cc:1048] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:20:59.119514 17471 raft_consensus.cc:2468] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 25.
I20260709 13:20:59.077631 25228 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:59.127080 17391 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:59.119856 17470 raft_consensus.cc:2468] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:20:59.079557 25211 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.112689 24940 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.145862 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.135258 25226 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:59.207633 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:59.210440 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.196815 25235 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
W20260709 13:20:59.235944 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 341659us
I20260709 13:20:59.239770 17964 leader_election.cc:304] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
W20260709 13:20:59.240175 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 95747.7us
I20260709 13:20:59.242390 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:59.247169 17471 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:20:59.224066 25012 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.240480 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbe40a17fe40b69ac2ecffb5e51786" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:59.242911 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.239547 25161 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.261462 25161 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:59.263839 25161 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:20:59.265532 25253 log.cc:927] Time spent T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:59.270115 24940 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.220907 25226 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:59.272996 25226 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:59.273597 25211 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:59.274678 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:20:59.275064 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 115743us
I20260709 13:20:59.277127 24931 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:59.280576 25260 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:59.240734 17211 catalog_manager.cc:5697] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 16 to 18, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 18 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:59.289332 17362 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:59.284475 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:59.299101 17389 raft_consensus.cc:2393] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 24: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:59.299347 17962 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.299829 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.302662 17999 raft_consensus.cc:2368] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:20:59.303203 17995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:59.239521 17268 placement_policy_util.cc:248] tablet b19033ecd72e4ba188910445b70c84d5: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:20:59.285159 17211 catalog_manager.cc:5697] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 12 to 13, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 13 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:59.306013 17362 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:20:59.312328 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 97913.2us
I20260709 13:20:59.312578 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:20:59.314951 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 60438.8us
I20260709 13:20:59.313099 17287 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:59.326048 17964 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.335924 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.341614 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:20:59.342244 17999 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:59.343683 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:59.344201 17389 raft_consensus.cc:3060] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:59.326656 24807 raft_consensus.cc:2804] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:59.313745 25149 raft_consensus.cc:2804] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:59.248728 25235 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.322091 25105 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.305186 25012 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:59.389321 25012 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:59.380481 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:59.381665 17211 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 15 to 19, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 19 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:59.382685 24807 raft_consensus.cc:697] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 25 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:59.355502 25147 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.354420 25259 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.374177 25149 raft_consensus.cc:697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:20:59.339002 25228 raft_consensus.cc:2804] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:59.393072 17471 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
W20260709 13:20:59.393162 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 93850.6us
I20260709 13:20:59.355194 25159 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:59.347672 25220 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.415661 25147 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:59.416057 25054 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:59.416697 25054 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:59.417364 24807 consensus_queue.cc:237] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.419040 25054 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:20:59.410029 24373 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.422267 24373 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.422906 17990 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:59.362623 24927 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:20:59.424348 24373 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:59.410225 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 97207us
I20260709 13:20:59.411125 25266 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:20:59.408274 17962 leader_election.cc:336] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.436338 16192 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 17347)
I20260709 13:20:59.437215 24373 consensus_queue.cc:1059] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:59.438304 24373 raft_consensus.cc:3055] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:59.438664 24373 raft_consensus.cc:740] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:59.439498 24373 consensus_queue.cc:260] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.441823 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:59.440712 24373 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:59.442999 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:59.444751 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:59.445343 17397 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:59.444963 17211 catalog_manager.cc:5697] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 9 to 21, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 21 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:59.446035 25259 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.446760 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.448179 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:59.448740 17388 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:59.453464 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:59.455024 17393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:59.412452 25220 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.455706 17393 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:20:59.456248 17992 raft_consensus.cc:1275] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:59.457480 25220 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.458715 17397 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:59.454928 25215 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:59.459298 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:59.464661 17388 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
I20260709 13:20:59.432062 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.433980 17287 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:20:59.475389 24373 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:59.475767 17999 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
I20260709 13:20:59.476269 24373 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:59.480929 17463 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 24. Current term is 25. Ops: []
W20260709 13:20:59.481490 17286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:59.482394 17286 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.485731 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.486172 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.488574 17464 raft_consensus.cc:1240] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:59.489346 17463 raft_consensus.cc:2393] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 23: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
W20260709 13:20:59.472831 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 146914us
I20260709 13:20:59.490898 17471 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:20:59.496392 17391 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:59.499433 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.446671 17211 catalog_manager.cc:5697] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 10 to 20. New cstate: current_term: 20 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:20:59.503827 17211 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 15 to 18, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 18 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:59.511993 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.515542 24373 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.518391 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:20:59.519248 17396 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:59.521658 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.526767 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.433145 25228 raft_consensus.cc:697] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:20:59.530288 17464 raft_consensus.cc:1275] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:59.516917 17285 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:59.536594 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:20:59.537434 17469 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:59.533047 17389 raft_consensus.cc:2468] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:20:59.474642 25266 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:59.548539 17285 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:59.540242 17393 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
I20260709 13:20:59.530551 25012 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:59.542151 24927 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:59.541985 25161 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:59.544312 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.557682 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:59.546118 25237 ts_tablet_manager.cc:1929] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.12
I20260709 13:20:59.458443 25149 consensus_queue.cc:237] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:59.553673 17993 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:20:59.550303 17285 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863; no voters: 
I20260709 13:20:59.568009 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:59.508924 25201 consensus_queue.cc:1048] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:20:59.562381 25045 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:59.570873 25261 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:59.571427 25261 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:59.571727 25228 consensus_queue.cc:237] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.573166 24940 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:59.573259 25266 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.575486 25259 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:20:59.576828 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 168564us
I20260709 13:20:59.559517 25236 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:59.563293 25132 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:20:59.597903 17962 leader_election.cc:336] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.572356 25261 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:20:59.603435 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:20:59.604493 17285 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:59.616523 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.617388 17462 raft_consensus.cc:2393] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241e45fbfca4b46b6df9be8cebcd863 in current term 25: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:59.598178 25237 log.cc:1199] T b19033ecd72e4ba188910445b70c84d5 P b7108577e5754060b7e468a43dfdcdeb: Deleting WAL directory at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/wals/b19033ecd72e4ba188910445b70c84d5
I20260709 13:20:59.622648 17286 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.623908 17396 raft_consensus.cc:2468] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 25.
W20260709 13:20:59.628966 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 69433.5us
I20260709 13:20:59.645176 25155 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:20:59.645949 25155 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:20:59.654042 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 76283.7us
W20260709 13:20:59.655179 17962 leader_election.cc:336] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.655746 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:59.657056 25258 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:59.628518 25012 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:59.666587 25237 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38520 (request call id 0) took 1555 ms. Trace:
I20260709 13:20:59.667220 25237 rpcz_store.cc:276] 0709 13:20:58.111766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:58.112995 (+  1229us) service_pool.cc:224] Handling call
0709 13:20:58.415438 (+302443us) ts_tablet_manager.cc:1151] Deleting tablet b19033ecd72e4ba188910445b70c84d5
0709 13:20:58.430540 (+ 15102us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:20:59.265741 (+835201us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:59.545899 (+280158us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:59.666474 (+120575us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111580,"tablet-delete.queue_time_us":196865,"thread_start_us":96964,"threads_started":1}
I20260709 13:20:59.605959 24927 consensus_queue.cc:1059] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
W20260709 13:20:59.684752 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 50597.1us
I20260709 13:20:59.686391 17286 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.613160 25216 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 13:20:59.690572 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.691479 17469 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:20:59.693388 24703 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:20:59.700629 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 62180.7us
I20260709 13:20:59.705729 17435 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:59.706986 25211 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:59.709935 17434 leader_election.cc:336] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.711774 17434 leader_election.cc:336] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.712348 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.717085 17435 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:59.636660 25176 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:59.619009 25159 consensus_queue.cc:1048] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 13:20:59.734469 24937 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.715721 25236 raft_consensus.cc:3060] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:59.699493 25257 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.722299 25211 raft_consensus.cc:2804] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:20:59.741247 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 66466.5us
I20260709 13:20:59.737969 25257 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:20:59.743806 17962 leader_election.cc:336] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.743870 25257 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.744289 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.732626 25161 raft_consensus.cc:3055] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:59.749017 25161 raft_consensus.cc:740] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:59.750305 25161 consensus_queue.cc:260] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.751993 25161 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:59.724956 25012 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:20:59.756542 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 70200.6us
W20260709 13:20:59.764328 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 52603.8us
W20260709 13:20:59.765317 17434 leader_election.cc:336] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.764259 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 47301.4us
I20260709 13:20:59.773276 17286 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.777288 25257 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.777913 25257 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.779915 25257 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.780140 24703 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.780921 24703 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.782013 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.784790 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.785056 24703 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.787623 17471 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:59.788667 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:20:59.762791 25155 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.793334 25213 raft_consensus.cc:2804] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:59.794306 25213 raft_consensus.cc:697] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 25 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:59.729280 25228 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:20:59.763376 25211 raft_consensus.cc:697] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:20:59.771430 25274 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:59.736342 25176 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.795913 25217 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:20:59.795344 25213 consensus_queue.cc:237] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.829344 17285 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:20:59.830459 17286 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.807657 25266 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.833232 17466 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:20:59.841915 17286 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:59.844909 17286 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.852480 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.847289 25266 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:59.848562 25045 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:59.858006 17397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.854641 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.859869 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.861284 17396 raft_consensus.cc:1240] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Rejecting Update request from peer 7241e45fbfca4b46b6df9be8cebcd863 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:59.862479 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.869253 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.862126 25211 consensus_queue.cc:237] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.841367 24703 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:59.837131 24927 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:20:59.830407 25217 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:20:59.869978 17392 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:20:59.882964 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.897295 17286 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.899573 25264 raft_consensus.cc:3060] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:59.905186 25176 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:20:59.849889 25261 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:59.912096 25054 raft_consensus.cc:3060] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:59.914098 25283 log.cc:927] Time spent T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:20:59.916781 17462 raft_consensus.cc:1275] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:20:59.851334 25265 raft_consensus.cc:3055] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:59.961329 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:20:59.963522 17286 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:20:59.964393 17392 raft_consensus.cc:2393] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 22: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:20:59.884109 25045 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:59.968055 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:20:59.972242 24703 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.975922 25054 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:59.970048 25264 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.978101 25201 consensus_queue.cc:1048] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:20:59.981364 25217 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:20:59.966734 25257 consensus_queue.cc:1059] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:20:59.988648 25236 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:59.997380 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 152247us
I20260709 13:20:59.964829 25265 raft_consensus.cc:740] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:20:59.917218 24927 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:00.010864 17360 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.012181 17360 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.011858 25045 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:00.012650 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:00.014755 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet b19033ecd72e4ba188910445b70c84d5 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:21:00.009116 25257 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:00.017262 25257 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:00.017645 25257 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:00.021713 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:00.031914 17467 raft_consensus.cc:1275] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:21:00.033473 25148 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:00.033648 25265 consensus_queue.cc:260] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:00.034916 25265 raft_consensus.cc:3060] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:00.042843 24927 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:00.046600 17360 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.047605 17360 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.047979 25216 consensus_queue.cc:1048] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:00.048017 17360 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:21:00.052533 17360 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.052906 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:21:00.056680 17360 leader_election.cc:336] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.057075 17360 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.058372 25138 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:00.058420 25302 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:21:00.063915 25295 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.103s	user 0.000s	sys 0.004s
W20260709 13:21:00.067225 17360 leader_election.cc:336] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.068753 17360 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:00.067004 25138 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:00.075765 24807 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:00.071489 17360 leader_election.cc:336] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.078146 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.078903 25302 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:00.080295 17360 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.096740 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 324186us
W20260709 13:21:00.097419 17434 leader_election.cc:336] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.101907 17434 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:00.106351 17394 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:21:00.117067 25271 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:00.120999 25236 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:00.121640 25236 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:00.124768 17388 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:21:00.129135 17434 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.130304 17434 leader_election.cc:336] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.130662 17434 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.131327 17393 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:21:00.131680 17434 leader_election.cc:336] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.132246 17434 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:00.135340 17268 auto_rebalancer.cc:629] Failed to schedule move for tablet 4295303b785442b287bf068dfd2e160c: Illegal state: Replica c23a664ebf3347a4934dee377c8b5101 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:21:00.136359 17434 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.137859 17434 leader_election.cc:336] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.138460 17434 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.146682 25213 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:00.148049 17360 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:00.152105 17360 leader_election.cc:336] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.134305 25176 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:00.157238 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:00.134066 25236 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:00.153975 17360 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.136385 25271 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:21:00.174651 17360 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.179765 17471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:00.186208 17465 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:21:00.187250 17360 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.201846 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:21:00.201987 17360 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.203151 17360 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.203702 17360 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.217965 17466 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:21:00.211962 17360 leader_election.cc:336] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.238226 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:00.188993 24807 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:00.206933 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 59870us
W20260709 13:21:00.240072 17360 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.240631 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:00.217722 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:21:00.242355 17360 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.243109 17360 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.243429 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.189481 25161 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
W20260709 13:21:00.243512 17434 leader_election.cc:336] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.240690 25301 log.cc:927] Time spent T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: Append to log took a long time: real 0.178s	user 0.000s	sys 0.002s
W20260709 13:21:00.245868 17360 leader_election.cc:336] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.224411 25205 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:21:00.201200 24927 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:21:00.206127 25302 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:00.239636 25148 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:00.244570 25217 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:00.209609 25235 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:21:00.245692 25156 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:00.251279 17360 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
W20260709 13:21:00.248392 25306 log.cc:927] Time spent T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:21:00.249926 24703 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:00.277859 24703 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:00.280155 24703 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:00.280364 25148 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:00.281113 25257 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:00.283684 17360 consensus_peers.cc:597] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.285348 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb3b6f88d9b4423a689bae4e9e59333" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:00.295897 17999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:00.297343 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:00.323000 25257 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:00.333426 17285 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.330996 25264 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:00.339793 25264 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:00.341391 25305 log.cc:927] Time spent T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 13:21:00.344580 25257 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:00.337198 24703 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:00.350208 24703 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:00.354993 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 78828.2us
W20260709 13:21:00.355648 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 65567.5us
W20260709 13:21:00.363479 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 116925us
I20260709 13:21:00.364338 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.369387 17287 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.373998 24373 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:00.373276 17434 leader_election.cc:400] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:21:00.374049 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:00.374812 17434 leader_election.cc:403] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:21:00.369509 25312 log.cc:927] Time spent T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
W20260709 13:21:00.436486 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 77904.5us
W20260709 13:21:00.434842 17287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 59617.2us
W20260709 13:21:00.437186 16192 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 17347)
W20260709 13:21:00.437671 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 81227.1us
I20260709 13:21:00.435460 17469 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:21:00.375157 17392 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:00.443356 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.371340 25235 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:00.446542 17287 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.458200 24373 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:00.448040 25313 log.cc:927] Time spent T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: Append to log took a long time: real 0.109s	user 0.001s	sys 0.002s
W20260709 13:21:00.463261 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.454356 25161 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:00.460412 25266 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.466825 24937 raft_consensus.cc:2749] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493) with higher term. Message: Invalid argument: T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb for earlier term 19. Current term is 20.
I20260709 13:21:00.454154 25236 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
W20260709 13:21:00.476969 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 104858us
I20260709 13:21:00.479645 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.463093 25012 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:21:00.490644 25016 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:00.491143 25016 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:00.491559 25016 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:00.494503 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:00.500970 24703 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:00.501124 25205 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:00.502231 25205 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:00.504647 25205 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:00.509440 25266 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:00.514680 17392 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:21:00.517675 17286 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:00.517675 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.520567 25153 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:00.522025 25045 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:00.522445 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:00.522576 25045 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:21:00.511767 25266 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:00.536330 17434 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.537477 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.539860 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:21:00.542454 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 55250.8us
I20260709 13:21:00.545630 17469 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:21:00.547614 17466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
W20260709 13:21:00.548175 17360 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.549263 17466 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:21:00.551134 24937 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:00.552731 25105 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:00.554502 25045 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:00.548684 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.562340 17394 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:21:00.565373 17434 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.566291 17360 consensus_peers.cc:597] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:00.571282 17360 consensus_peers.cc:597] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.572407 17434 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:00.579046 17434 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.580096 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:00.581408 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.581749 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:00.582608 25176 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:00.586270 17394 raft_consensus.cc:1275] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:21:00.588670 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:00.592988 25161 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:00.593787 25213 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:21:00.593962 17360 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.599215 17434 leader_election.cc:336] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.600587 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:21:00.603932 17434 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.606724 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.608960 17467 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:21:00.609854 17434 consensus_peers.cc:597] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:00.610632 17434 leader_election.cc:336] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.619248 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.580806 25326 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:00.636792 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.642601 25264 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:00.644090 25265 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:00.621713 25176 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:00.662441 17466 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 23.
I20260709 13:21:00.624614 25236 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:21:00.652685 24927 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:00.626503 25105 consensus_queue.cc:1048] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:21:00.665786 25012 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:00.701378 17388 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:21:00.632804 25016 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:00.722684 25257 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:21:00.722940 25012 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:00.733253 25012 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:00.750900 17268 auto_rebalancer.cc:629] Failed to schedule move for tablet 8c3bd226d2e04278bed4c50c89f1f5bd: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.790763 25016 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:00.806193 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 183469us
W20260709 13:21:00.807529 25328 log.cc:927] Time spent T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:21:00.818516 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:00.826125 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:21:00.813163 17434 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.827008 17434 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.831185 17471 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:21:00.837574 17471 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
W20260709 13:21:00.841679 17434 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.843991 17394 raft_consensus.cc:1275] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:21:00.846119 17392 raft_consensus.cc:1275] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:21:00.851687 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.852231 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:00.847124 25217 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:00.834146 25333 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:00.872215 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:00.873926 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:21:00.876343 17994 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:21:00.873194 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:21:00.879714 25322 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.377s	user 0.004s	sys 0.000s
I20260709 13:21:00.855212 25105 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:00.881105 25340 consensus_queue.cc:1048] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:00.881101 25105 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:00.889544 25337 log.cc:927] Time spent T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:21:00.926358 25105 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:00.930320 24373 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:00.931102 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:00.932267 24373 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:00.933126 25054 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:00.943670 17285 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:00.868678 25334 consensus_queue.cc:1048] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:21:00.875795 25138 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:21:00.976091 24373 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.979782 24373 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:00.991909 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 89396.1us
I20260709 13:21:00.994024 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:00.984221 25318 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:01.050666 25342 log.cc:927] Time spent T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 13:21:01.064595 25236 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.070430 25236 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.077210 17390 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:21:01.064639 25235 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:01.098470 17360 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.098519 25217 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:01.103111 25236 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.156675 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b59d252a868a4ba8bc72588a2ae450b2" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.163349 17466 raft_consensus.cc:1240] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Rejecting Update request from peer c23a664ebf3347a4934dee377c8b5101 for earlier term 20. Current term is 21. Ops: []
W20260709 13:21:01.180964 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 46686.6us
I20260709 13:21:01.199393 17435 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:01.089416 25235 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.214550 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.215464 17462 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
W20260709 13:21:01.200464 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.193022 25322 log.cc:927] Time spent T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:21:01.184664 25176 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:01.245042 25176 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:01.248052 25176 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:01.241607 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.210347 24937 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:01.181728 25045 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
W20260709 13:21:01.284368 17268 auto_rebalancer.cc:629] Failed to schedule move for tablet 132676f9343f4733b4f07f4587384a56: Illegal state: Replica b7108577e5754060b7e468a43dfdcdeb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:21:01.294827 17268 auto_rebalancer.cc:629] Failed to schedule move for tablet b5bcc05e009f492a9e252332680b738b: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:01.297816 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 181288us
I20260709 13:21:01.294873 24373 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:01.332772 24373 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:01.333289 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 106839us
I20260709 13:21:01.319916 25261 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:01.362461 24373 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:01.383083 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:01.350725 25156 consensus_queue.cc:1059] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:21:01.390879 25261 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:01.394025 25261 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:01.403817 25356 log.cc:927] Time spent T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:21:01.348390 25236 raft_consensus.cc:493] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:01.414043 24373 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:01.427058 17287 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:21:01.429657 25030 raft_consensus.cc:3055] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:21:01.431661 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 156903us
W20260709 13:21:01.437618 16192 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 17347)
I20260709 13:21:01.428654 25161 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:01.452219 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.416813 25054 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.430227 25030 raft_consensus.cc:740] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:21:01.460412 25030 consensus_queue.cc:260] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:01.461860 25030 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:01.415489 25236 raft_consensus.cc:515] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:01.468099 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 217522us
I20260709 13:21:01.469779 17964 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:01.463950 25161 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.484434 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.481138 25132 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:01.494642 17396 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 21.
I20260709 13:21:01.479507 25235 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.504702 17463 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:21:01.501365 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 152032us
I20260709 13:21:01.481077 25161 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:01.522415 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:01.525872 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.488585 25045 raft_consensus.cc:493] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.530490 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.531243 17465 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
I20260709 13:21:01.532086 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:01.536051 17388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.533717 25045 raft_consensus.cc:515] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.539516 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.540673 17996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a5582b6bfb4ac592225b49ce6df9be" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:01.540165 17394 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 24.
W20260709 13:21:01.545388 17434 leader_election.cc:336] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.487308 25054 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.549474 17434 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:01.552925 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.558964 25054 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.549093 25358 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260709 13:21:01.562485 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 80863us
I20260709 13:21:01.573640 17994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c1e66c4a684159ae427b3705522c26" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:01.577071 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:01.567409 25176 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:01.567564 25236 leader_election.cc:290] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:01.587733 25054 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:01.590080 25054 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.590591 25054 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:01.603284 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:01.608345 17285 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:01.610917 25261 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.615639 25161 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.570919 25045 leader_election.cc:290] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.626906 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:21:01.652923 17285 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 44629.2us
W20260709 13:21:01.656582 17286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 79602.9us
I20260709 13:21:01.668983 25045 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:01.675794 17465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.678089 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.678887 17287 leader_election.cc:304] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:01.651924 25375 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.683337 25375 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:01.683823 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.697433 25375 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.659694 24703 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:01.699932 25149 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:01.700212 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e74ac16bb4f19b434bdd25b7bd3af" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.700076 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.700567 25149 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:01.701510 25045 raft_consensus.cc:2749] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.708727 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.709533 25054 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.717694 25054 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.709851 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2679735faeb64bcf9031060956c1e1b9" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.718959 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:01.731802 17463 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:01.735913 17286 leader_election.cc:304] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:01.737246 25054 raft_consensus.cc:2749] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:01.740990 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:01.741568 17389 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:01.744022 17463 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 25.
I20260709 13:21:01.739684 25149 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.753382 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:01.758601 17392 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:01.757090 17389 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 25.
I20260709 13:21:01.769896 25161 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.771524 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.774464 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:01.775157 17469 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:01.777693 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 117268us
W20260709 13:21:01.778549 17360 consensus_peers.cc:597] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.779907 17360 consensus_peers.cc:597] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.774537 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:01.796893 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.801873 24373 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:01.801959 17287 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:01.795851 17286 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:01.800889 24703 raft_consensus.cc:493] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.801365 25375 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.813381 24703 raft_consensus.cc:515] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:01.813611 25375 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.815553 25375 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.816910 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:21:01.820603 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.819361 17360 consensus_peers.cc:597] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.822746 17469 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
W20260709 13:21:01.821375 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.810474 17963 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:01.825873 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.825569 17392 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241e45fbfca4b46b6df9be8cebcd863 in term 22.
I20260709 13:21:01.810173 25161 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:01.828171 17286 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:01.815582 24703 leader_election.cc:290] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:01.834159 24373 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:01.830164 25105 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:01.837955 24373 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:21:01.830902 25012 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:01.840250 24373 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.834820 25161 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 LEADER]: Becoming Leader. State: Replica: 7241e45fbfca4b46b6df9be8cebcd863, State: Running, Role: LEADER
I20260709 13:21:01.849011 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15143e49c9844f47911ff4266f078b54" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.846765 25161 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.850687 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2018cf7711d4001a8a9fae2f46d00f4" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.853600 17287 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:01.858970 25375 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:01.862291 17287 leader_election.cc:304] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:01.864624 25054 raft_consensus.cc:2749] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:01.886731 25375 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.879941 17215 catalog_manager.cc:5697] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 24, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 24 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.893314 25375 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.896278 17215 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 17, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 17 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:01.905695 25385 log.cc:927] Time spent T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:21:01.907822 25375 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.908382 25375 raft_consensus.cc:493] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:01.909133 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.909102 25375 raft_consensus.cc:515] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:01.915427 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.916587 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:01.921267 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:01.922688 25054 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:01.922079 17211 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49282 (request call id 331) took 30192 ms (client timeout 15000 ms). Trace:
I20260709 13:21:01.921893 17215 catalog_manager.cc:5697] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 21 to 22, leader changed from <none> to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 22 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.925271 17215 catalog_manager.cc:5697] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 20 to 21, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 21 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:01.923359 17211 rpcz_store.cc:269] 0709 13:20:31.729377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.737504 (+  8127us) service_pool.cc:224] Handling call
0709 13:21:01.921932 (+30184428us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:59.899444 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:59.900156 (+   712us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:59.900209 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:20:59.900245 (+    36us) tablet.cc:662] Decoding operations
0709 13:20:59.972377 (+ 72132us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:59.972469 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:59.972496 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:20:59.973370 (+   874us) tablet.cc:701] Row locks acquired
0709 13:20:59.973420 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:20:59.973585 (+   165us) write_op.cc:270] Start()
0709 13:20:59.973738 (+   153us) write_op.cc:276] Timestamp: P: 1783603259973518 usec, L: 0
0709 13:20:59.973756 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:20:59.974403 (+   647us) log.cc:844] Serialized 3609 byte log entry
0709 13:21:00.488376 (+513973us) op_driver.cc:464] REPLICATION: finished
0709 13:21:00.740181 (+251805us) write_op.cc:301] APPLY: starting
0709 13:21:00.740329 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:00.807493 (+ 67164us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:00.807643 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:00.884741 (+ 77098us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:00.885136 (+   395us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:21:00.885198 (+    62us) write_op.cc:312] APPLY: finished
0709 13:21:00.885636 (+   438us) log.cc:844] Serialized 89 byte log entry
0709 13:21:00.885862 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:00.886018 (+   156us) write_op.cc:454] Released schema lock
0709 13:21:00.886096 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:00.923938 (+ 37842us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:00.943817 (+ 19879us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8867,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":218019,"apply.run_cpu_time_us":15992,"apply.run_wall_time_us":165847,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41747,"num_ops":9,"prepare.queue_time_us":175704,"prepare.run_cpu_time_us":8982,"prepare.run_wall_time_us":157056,"raft.queue_time_us":212159,"raft.run_cpu_time_us":75735,"raft.run_wall_time_us":154660,"replication_time_us":514422,"thread_start_us":386405,"threads_started":4,"wal-append.queue_time_us":82884,"wal-append.run_cpu_time_us":18157,"wal-append.run_wall_time_us":1829029}]]}
I20260709 13:21:01.929638 17215 catalog_manager.cc:5697] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 23 to 24, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 24 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.931999 17215 catalog_manager.cc:5697] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 20 to 23, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 23 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.933569 17215 catalog_manager.cc:5697] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 19 to 23, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 23 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.934854 17215 catalog_manager.cc:5697] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 23 to 26, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 26 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.940219 17215 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 19 to 20, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 20 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.915694 25375 leader_election.cc:290] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:01.943485 17215 catalog_manager.cc:5697] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 19 to 20, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 20 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.944453 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa77e48390f407cb43bb16febfe2e8d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.947443 17215 catalog_manager.cc:5697] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 19 to 22, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 22 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.948994 25054 raft_consensus.cc:493] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.949600 25054 raft_consensus.cc:515] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:01.949448 17215 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 15 to 23, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 23 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.953364 25054 leader_election.cc:290] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:01.952975 17215 catalog_manager.cc:5697] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 14 to 23, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 23 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.955027 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:01.954587 17215 catalog_manager.cc:5697] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 20 to 23, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 23 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.956190 17215 catalog_manager.cc:5697] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 17 to 23, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 23 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.958262 17215 catalog_manager.cc:5697] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.959519 17215 catalog_manager.cc:5697] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.961189 17215 catalog_manager.cc:5697] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 20, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 20 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.962675 17215 catalog_manager.cc:5697] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.964018 17215 catalog_manager.cc:5697] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 22 to 23, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 23 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.965251 17215 catalog_manager.cc:5697] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.966521 17215 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 18 to 22, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 22 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.967715 17215 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 13 to 21. New cstate: current_term: 21 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:01.968897 17215 catalog_manager.cc:5697] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 12 to 15, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 15 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:01.969511 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e80c2d06f4623a397b7b3d6190f05" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:01.995553 17287 leader_election.cc:304] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:01.996416 25375 raft_consensus.cc:2749] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:02.010151 17287 leader_election.cc:304] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:02.010954 25375 raft_consensus.cc:2749] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:02.015295 25161 raft_consensus.cc:493] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:02.016034 25054 raft_consensus.cc:493] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.015842 25161 raft_consensus.cc:515] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.016577 25054 raft_consensus.cc:515] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.018132 25161 leader_election.cc:290] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.019068 25054 leader_election.cc:290] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.020087 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.020537 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.020709 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452dfe9db12345ae88b3dbbd163f480e" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:02.022874 17286 leader_election.cc:304] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:02.025193 25054 raft_consensus.cc:2749] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:02.028297 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e42c2b9c0d646f1a18c2f8ea4f1a259" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.034822 24373 raft_consensus.cc:493] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:02.035375 24373 raft_consensus.cc:515] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.037425 24373 leader_election.cc:290] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.038909 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.047075 24373 raft_consensus.cc:493] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.047636 24373 raft_consensus.cc:515] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:02.050235 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:02.052470 24373 leader_election.cc:290] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:02.084802 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2566406852d04693963f9fa3f001ff8c" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.087038 17215 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50174 (request call id 224) took 3121 ms. Trace:
I20260709 13:21:02.090034 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72154b87dcf145b2aeae9bf915b34ce0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:21:02.089282 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.090907 17287 leader_election.cc:304] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:21:02.092206 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.094619 24373 raft_consensus.cc:2749] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:02.095467 17287 leader_election.cc:304] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:02.097028 17287 leader_election.cc:304] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:02.099406 24373 raft_consensus.cc:2749] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:02.098176 25054 raft_consensus.cc:2749] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:02.102463 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.087546 17215 rpcz_store.cc:276] 0709 13:20:58.965415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:58.965795 (+   380us) service_pool.cc:224] Handling call
0709 13:21:02.086952 (+3121157us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:01.989151 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:01.989664 (+   513us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:01.989698 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:21:01.989714 (+    16us) tablet.cc:662] Decoding operations
0709 13:21:01.991519 (+  1805us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:01.991606 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:01.991632 (+    26us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:21:01.996824 (+  5192us) tablet.cc:701] Row locks acquired
0709 13:21:01.996869 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:21:01.997030 (+   161us) write_op.cc:270] Start()
0709 13:21:01.997156 (+   126us) write_op.cc:276] Timestamp: P: 1783603261996979 usec, L: 0
0709 13:21:01.997177 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:21:01.997912 (+   735us) log.cc:844] Serialized 9274 byte log entry
0709 13:21:02.017043 (+ 19131us) op_driver.cc:464] REPLICATION: finished
0709 13:21:02.018398 (+  1355us) write_op.cc:301] APPLY: starting
0709 13:21:02.032422 (+ 14024us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:02.049380 (+ 16958us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:02.049593 (+   213us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:02.065062 (+ 15469us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:02.065379 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:21:02.065423 (+    44us) write_op.cc:312] APPLY: finished
0709 13:21:02.065862 (+   439us) log.cc:844] Serialized 212 byte log entry
0709 13:21:02.066687 (+   825us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:02.066911 (+   224us) write_op.cc:454] Released schema lock
0709 13:21:02.066979 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:02.075450 (+  8471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:02.075485 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30272,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":1110,"apply.run_cpu_time_us":29058,"apply.run_wall_time_us":54864,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104447,"num_ops":24,"prepare.queue_time_us":9585,"prepare.run_cpu_time_us":12497,"prepare.run_wall_time_us":18191,"raft.queue_time_us":7488,"raft.run_cpu_time_us":894,"raft.run_wall_time_us":12284,"replication_time_us":19715,"thread_start_us":43840,"threads_started":4,"wal-append.queue_time_us":7552}]]}
I20260709 13:21:02.157958 17215 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 22 to 25, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 25 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:02.160969 17215 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 16 to 24, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 24 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:02.170356 25235 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.170977 25235 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:02.173413 25235 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:02.174345 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:02.174365 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77bea333b0644080b6a74f153a5f03c5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.176661 17287 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:02.174624 17215 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:02.180214 17215 catalog_manager.cc:5697] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 15 to 18, leader changed from 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 18 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:02.182228 17215 catalog_manager.cc:5697] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:02.188930 25375 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:02.208967 17215 catalog_manager.cc:5697] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 15 to 20, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 20 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:02.226495 17220 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49270 (request call id 327) took 103411 ms (client timeout 15000 ms). Trace:
W20260709 13:21:02.226994 17220 rpcz_store.cc:269] 0709 13:19:18.814818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.823096 (+  8278us) service_pool.cc:224] Handling call
0709 13:21:02.226282 (+103403186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":225,"reported_tablets":47,"spinlock_wait_cycles":4352}
W20260709 13:21:02.238169 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:02.245293 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:02.248644 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.261526 17394 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:21:02.263120 25235 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:02.261117 17213 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 13 to 15, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 15 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.275233 17213 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.281992 17213 catalog_manager.cc:5697] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:02.285424 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.286078 17213 catalog_manager.cc:5697] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.290406 17213 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.294354 17213 catalog_manager.cc:5697] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.297048 17213 catalog_manager.cc:5697] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 15 to 17, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 17 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.299710 17213 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.301692 17213 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 21 to 22, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 22 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.304662 17389 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:21:02.312885 25375 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:02.316290 17464 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:21:02.319720 25054 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:21:02.328528 17360 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.362229 17213 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 18 to 19, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 19 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:02.367283 24373 raft_consensus.cc:493] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.368031 24373 raft_consensus.cc:515] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.386970 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:21:02.389847 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.400157 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96336e4c5eb64d4d967c671c9a221e69" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.401057 24373 leader_election.cc:290] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:02.453110 17268 auto_rebalancer.cc:629] Failed to schedule move for tablet af5b45fab0a7463d90e9b2fec8241e1a: Illegal state: Replica c23a664ebf3347a4934dee377c8b5101 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:21:02.470654 17268 auto_rebalancer.cc:629] Failed to schedule move for tablet 34cf7d4eca6445628c0af4ea7b65f11b: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:02.476426 16192 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 17347)
W20260709 13:21:02.485463 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.491780 17469 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:21:02.503840 17285 leader_election.cc:304] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:02.504736 25375 raft_consensus.cc:2749] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:02.518695 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.520977 25161 raft_consensus.cc:493] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.534314 25161 raft_consensus.cc:515] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.535920 25375 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.536545 25375 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.537202 25161 leader_election.cc:290] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.539423 25375 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.540711 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.542666 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:02.547307 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3f7b090266450da9f53ec675edc8f0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.551736 17467 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Refusing update from remote peer 7241e45fbfca4b46b6df9be8cebcd863: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:21:02.562834 17285 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:02.563467 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.568164 17394 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:21:02.572100 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bc2ff6fcd49d8bc55557aa9b1bc3d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.571507 25398 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:02.567808 25375 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:02.575577 17434 consensus_peers.cc:597] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2679735faeb64bcf9031060956c1e1b9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:02.575233 25400 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:21:02.574638 25398 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.582906 25398 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:02.584349 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.585121 17467 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:21:02.586410 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:02.587100 17389 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:21:02.588199 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:02.593091 25397 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:02.597764 25397 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:02.598351 25397 raft_consensus.cc:3060] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:02.602396 24373 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:02.605862 17287 leader_election.cc:304] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:02.606668 25054 raft_consensus.cc:2749] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:02.617453 17434 consensus_peers.cc:597] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:02.623517 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.632097 25397 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.634070 25400 raft_consensus.cc:2955] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:21:02.636183 25397 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:02.637303 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:02.643329 17392 raft_consensus.cc:2955] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:21:02.650949 17389 raft_consensus.cc:2468] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
W20260709 13:21:02.653884 17268 auto_rebalancer.cc:629] Failed to schedule move for tablet cd74e04425094277971ef1f372f80d50: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:02.654021 17963 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:02.655043 25397 raft_consensus.cc:2804] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:02.655915 25397 raft_consensus.cc:697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:21:02.659786 25397 consensus_queue.cc:237] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.665987 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:02.667040 17467 raft_consensus.cc:2393] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 21: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
W20260709 13:21:02.705164 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:02.722055 17213 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49270 (request call id 329) took 40128 ms (client timeout 15000 ms). Trace:
W20260709 13:21:02.722685 17213 rpcz_store.cc:269] 0709 13:20:22.595959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.613562 (+ 17603us) service_pool.cc:224] Handling call
0709 13:21:02.721971 (+40108409us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:02.442444 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:02.443052 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:02.443087 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:21:02.443105 (+    18us) tablet.cc:662] Decoding operations
0709 13:21:02.444245 (+  1140us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:02.444315 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:02.444350 (+    35us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:21:02.476470 (+ 32120us) tablet.cc:701] Row locks acquired
0709 13:21:02.476491 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:21:02.476652 (+   161us) write_op.cc:270] Start()
0709 13:21:02.476775 (+   123us) write_op.cc:276] Timestamp: P: 1783603262476603 usec, L: 0
0709 13:21:02.476798 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:21:02.477483 (+   685us) log.cc:844] Serialized 4000 byte log entry
0709 13:21:02.480342 (+  2859us) op_driver.cc:464] REPLICATION: finished
0709 13:21:02.480798 (+   456us) write_op.cc:301] APPLY: starting
0709 13:21:02.480899 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:02.526570 (+ 45671us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:02.526723 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:02.628284 (+101561us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:02.628533 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:21:02.628584 (+    51us) write_op.cc:312] APPLY: finished
0709 13:21:02.628918 (+   334us) log.cc:844] Serialized 97 byte log entry
0709 13:21:02.630438 (+  1520us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:02.641515 (+ 11077us) write_op.cc:454] Released schema lock
0709 13:21:02.641605 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:02.644256 (+  2651us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:02.644336 (+    80us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":180698,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":265,"apply.run_cpu_time_us":15817,"apply.run_wall_time_us":163419,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41800,"num_ops":10,"prepare.queue_time_us":6087,"prepare.run_cpu_time_us":4481,"prepare.run_wall_time_us":42879,"replication_time_us":3394}]]}
I20260709 13:21:02.731227 25403 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.731885 25403 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:02.736392 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:02.736660 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd74e04425094277971ef1f372f80d50" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.741174 17287 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:02.741905 24373 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:02.734350 25403 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:02.745651 17434 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 201 similar messages]
I20260709 13:21:02.753410 25403 raft_consensus.cc:493] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:02.753978 25403 raft_consensus.cc:515] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.756189 25403 leader_election.cc:290] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.756719 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.757326 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060ed925d51948b7b415b005543f7a9f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.759063 17285 leader_election.cc:304] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:02.759897 25403 raft_consensus.cc:2749] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:02.762550 17216 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 15 to 20, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 20 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.764595 17216 catalog_manager.cc:5697] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.766364 17216 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.768182 17216 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.769821 17216 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 22 to 26, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 26 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.781450 17216 catalog_manager.cc:5697] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.786669 17216 catalog_manager.cc:5697] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.790587 17216 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.792917 17216 catalog_manager.cc:5697] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.809527 17216 catalog_manager.cc:5697] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.822914 17216 catalog_manager.cc:5697] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 10 to 20, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 20 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.825165 25403 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:02.825878 25403 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.825047 17216 catalog_manager.cc:5697] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 13 to 14, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 14 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:02.827750 17360 consensus_peers.cc:597] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.828877 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.837788 17216 catalog_manager.cc:5697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 18 to 21, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 21 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.830358 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed6b0a2fcf5476ab0f8dffeb3536922" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.831286 25403 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.839820 17216 catalog_manager.cc:5697] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.832939 25235 raft_consensus.cc:493] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.840698 17285 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:02.841050 25235 raft_consensus.cc:515] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.841732 25403 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:02.843101 25403 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.843393 25235 leader_election.cc:290] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.843606 25403 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.844123 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.846323 25403 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.846807 25403 raft_consensus.cc:493] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:02.847275 25403 raft_consensus.cc:515] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.849222 17216 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.849927 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:02.850186 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf42e0c75aa14899935b39a4a7437626" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.850684 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.856231 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622554a5186d4910b8476a653411c85d" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.851181 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d82b49da74027abe144db7281b7b0" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.857460 17285 leader_election.cc:304] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:02.851716 25403 leader_election.cc:290] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.858644 25403 raft_consensus.cc:2749] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:02.858490 17216 catalog_manager.cc:5697] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.860630 17216 catalog_manager.cc:5697] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 16 to 20, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 20 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:02.861244 17287 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:02.862885 24373 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:02.859002 17285 leader_election.cc:304] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:02.863783 24373 raft_consensus.cc:2749] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:02.883358 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:02.929124 24373 raft_consensus.cc:493] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:02.929651 24373 raft_consensus.cc:515] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:02.931663 24373 leader_election.cc:290] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:02.937748 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:02.941771 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d6271327d4457ea6b522d9188f4f84" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:02.945164 17287 leader_election.cc:304] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:02.946234 24373 raft_consensus.cc:2749] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:02.960276 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:03.019872 17215 catalog_manager.cc:5697] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 20 to 21, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 21 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:03.051717 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet b19033ecd72e4ba188910445b70c84d5 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:38520
W20260709 13:21:03.052074 17216 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49294 (request call id 335) took 14940 ms (client timeout 15000 ms). Trace:
W20260709 13:21:03.052750 17216 rpcz_store.cc:269] 0709 13:20:48.111382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.111669 (+   287us) service_pool.cc:224] Handling call
0709 13:21:03.051991 (+14940322us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:02.867983 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:02.868553 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:02.868593 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:21:02.868605 (+    12us) tablet.cc:662] Decoding operations
0709 13:21:02.869755 (+  1150us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:02.869819 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:02.869838 (+    19us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:21:02.870735 (+   897us) tablet.cc:701] Row locks acquired
0709 13:21:02.870748 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:21:02.870854 (+   106us) write_op.cc:270] Start()
0709 13:21:02.870957 (+   103us) write_op.cc:276] Timestamp: P: 1783603262870818 usec, L: 0
0709 13:21:02.870971 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:21:02.871599 (+   628us) log.cc:844] Serialized 6695 byte log entry
0709 13:21:02.874145 (+  2546us) op_driver.cc:464] REPLICATION: finished
0709 13:21:02.875668 (+  1523us) write_op.cc:301] APPLY: starting
0709 13:21:02.875750 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:02.899442 (+ 23692us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:02.899542 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:03.003730 (+104188us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:03.004009 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:21:03.004076 (+    67us) write_op.cc:312] APPLY: finished
0709 13:21:03.004454 (+   378us) log.cc:844] Serialized 156 byte log entry
0709 13:21:03.004631 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:03.004799 (+   168us) write_op.cc:454] Released schema lock
0709 13:21:03.004892 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:03.005285 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:03.005319 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":144081,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":1316,"apply.run_cpu_time_us":22928,"apply.run_wall_time_us":129554,"cfile_cache_hit":68,"cfile_cache_hit_bytes":71060,"num_ops":17,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":3921,"prepare.run_wall_time_us":3920,"replication_time_us":3053}]]}
I20260709 13:21:03.065665 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet b19033ecd72e4ba188910445b70c84d5 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:21:03.133091 25235 raft_consensus.cc:493] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:03.133885 25235 raft_consensus.cc:515] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:03.137434 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:03.138348 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc026cf7a3b43b3a05aca657efbaecd" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:03.143594 17285 leader_election.cc:304] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:03.144567 24373 raft_consensus.cc:2749] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:03.145738 25235 leader_election.cc:290] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:03.149631 17389 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:21:03.152426 25398 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:03.218148 25408 ts_tablet_manager.cc:933] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:03.300513 17360 consensus_peers.cc:597] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:03.333045 17360 consensus_peers.cc:597] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:03.381336 25400 raft_consensus.cc:493] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.381897 25400 raft_consensus.cc:515] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:03.384037 25400 leader_election.cc:290] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:03.388618 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:03.389256 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet b19033ecd72e4ba188910445b70c84d5 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:38520
I20260709 13:21:03.393074 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet b19033ecd72e4ba188910445b70c84d5 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
W20260709 13:21:03.394433 17212 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49294 (request call id 334) took 35024 ms (client timeout 15000 ms). Trace:
I20260709 13:21:03.395268 25408 tablet_copy_client.cc:323] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
W20260709 13:21:03.394873 17212 rpcz_store.cc:269] 0709 13:20:28.370179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.370457 (+   278us) service_pool.cc:224] Handling call
0709 13:20:28.545256 (+174799us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b5400002210. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6d00b2 00007f7d68649a89 00007f7d685e1da6 00007f7d685b3088 00007f7d686b137e 00007f7d66b722a4 00007f7d66b72232 00007f7d66b72161 00007f7d66b720dc
0709 13:21:03.394341 (+34849085us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2268632,"reported_tablets":48,"spinlock_wait_cycles":11837184}
I20260709 13:21:03.406242 25415 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:03.406786 25415 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:03.410136 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:03.410981 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bff337c6c8418e8fe0872b92f3bd6f" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:03.413163 17287 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:03.414139 25410 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:03.419950 25415 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:03.428062 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 241162us
I20260709 13:21:03.434568 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0241098ae744cbae27ac900424b754" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:03.440371 17469 raft_consensus.cc:1275] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:21:03.443575 17480 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet 2679735faeb64bcf9031060956c1e1b9 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:21:03.443941 25397 consensus_queue.cc:1048] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:03.444200 17480 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet 2679735faeb64bcf9031060956c1e1b9 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-2679735faeb64bcf9031060956c1e1b9
I20260709 13:21:03.468637 17434 leader_election.cc:304] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:03.473879 25410 raft_consensus.cc:493] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.474452 25410 raft_consensus.cc:515] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:03.476650 25410 leader_election.cc:290] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:03.477782 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:21:03.477981 16192 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 17347)
I20260709 13:21:03.478475 25400 raft_consensus.cc:2749] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:03.490661 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bcc05e009f492a9e252332680b738b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:03.508647 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet b19033ecd72e4ba188910445b70c84d5 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:38520
W20260709 13:21:03.510315 17434 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:03.510980 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:03.511509 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:03.511873 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet b19033ecd72e4ba188910445b70c84d5 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:21:03.460652 17480 tablet_copy_source_session.cc:215] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:21:03.515658 17217 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49294 (request call id 333) took 56357 ms (client timeout 15000 ms). Trace:
I20260709 13:21:03.517194 17287 leader_election.cc:304] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:03.521426 17217 rpcz_store.cc:269] 0709 13:20:07.158038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.167155 (+  9117us) service_pool.cc:224] Handling call
0709 13:20:07.429301 (+262146us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275e090 00007f7d627fcf3a 00007f7d685b31cc 00007f7d686b137e 00007f7d66b722a4 00007f7d66b72232 00007f7d66b72161 00007f7d66b720dc 00007f7d66b71392 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:21:03.515451 (+56086150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25364,"reported_tablets":48,"spinlock_wait_cycles":137280640}
I20260709 13:21:03.522143 25410 raft_consensus.cc:2749] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:03.527842 25408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2679735faeb64bcf9031060956c1e1b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:03.579198 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:03.598270 17214 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 19 to 24. New cstate: current_term: 24 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:03.600164 17214 catalog_manager.cc:5697] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 13 to 17, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 17 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:03.608002 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:03.610400 16192 tablet_replica.cc:333] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.611620 16192 raft_consensus.cc:2243] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.612901 16192 raft_consensus.cc:2272] T 1e69b6a14a654bac9e2288b25123fc4b P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.616315 16192 tablet_replica.cc:333] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.617539 16192 raft_consensus.cc:2243] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.618324 16192 raft_consensus.cc:2272] T b5bcc05e009f492a9e252332680b738b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:03.630654 17219 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49294 (request call id 331) took 99284 ms (client timeout 15000 ms). Trace:
W20260709 13:21:03.633003 17219 rpcz_store.cc:269] 0709 13:19:24.346282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.346530 (+   248us) service_pool.cc:224] Handling call
0709 13:19:24.603541 (+257011us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275e090 00007f7d627fcf3a 00007f7d685b31cc 00007f7d686b137e 00007f7d66b722a4 00007f7d66b72232 00007f7d66b72161 00007f7d66b720dc 00007f7d66b71392 00007f7d60b2f48c 00007f7d60b2e8c6
0709 13:21:03.630427 (+99026886us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40129,"reported_tablets":48,"spinlock_wait_cycles":27996544}
I20260709 13:21:03.619885 17214 catalog_manager.cc:5697] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 15 to 22, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 22 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.618861 25408 tablet_copy_client.cc:806] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:03.627741 17458 tablet_service.cc:1558] Processing DeleteTablet for tablet b19033ecd72e4ba188910445b70c84d5 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:38520
I20260709 13:21:03.642283 25408 tablet_copy_client.cc:670] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:03.643191 17206 catalog_manager.cc:5028] TS b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): tablet b19033ecd72e4ba188910445b70c84d5 (table test-workload [id=8d99dfb6161b4039a64e28b9c9b16e42]) successfully deleted
I20260709 13:21:03.624859 25410 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.644204 25410 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:03.633803 16192 tablet_replica.cc:333] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.646550 25408 tablet_copy_client.cc:538] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:03.646687 25410 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:03.646947 16192 raft_consensus.cc:2243] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.647699 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:03.647926 16192 raft_consensus.cc:2272] T 77bea333b0644080b6a74f153a5f03c5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.649644 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cf7d4eca6445628c0af4ea7b65f11b" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:03.657630 17286 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:03.660501 17214 catalog_manager.cc:5697] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:03.661680 25410 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:03.666381 17214 catalog_manager.cc:5697] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 14 to 21, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1). New cstate: current_term: 21 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:03.661729 16192 tablet_replica.cc:333] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.669997 16192 raft_consensus.cc:2243] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.671192 16192 raft_consensus.cc:2272] T 8c3bd226d2e04278bed4c50c89f1f5bd P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.674116 16192 tablet_replica.cc:333] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.677767 16192 raft_consensus.cc:2243] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.674667 25408 tablet_bootstrap.cc:492] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:21:03.685453 16192 raft_consensus.cc:2272] T 96336e4c5eb64d4d967c671c9a221e69 P 7241e45fbfca4b46b6df9be8cebcd863 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.688978 16192 tablet_replica.cc:333] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.701745 16192 raft_consensus.cc:2243] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.703156 16192 raft_consensus.cc:2272] T ff504a0c820741ecb08279a255054a6c P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.706447 16192 tablet_replica.cc:333] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.707500 16192 raft_consensus.cc:2243] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.708793 16192 raft_consensus.cc:2272] T 4df43493289c4586a02bce2e14a38202 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.712266 16192 tablet_replica.cc:333] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.724969 16192 raft_consensus.cc:2243] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.725749 16192 raft_consensus.cc:2272] T 5fc026cf7a3b43b3a05aca657efbaecd P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.729018 16192 tablet_replica.cc:333] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.730021 16192 raft_consensus.cc:2243] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.730595 16192 raft_consensus.cc:2272] T 34cf7d4eca6445628c0af4ea7b65f11b P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.733711 16192 tablet_replica.cc:333] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.734640 16192 raft_consensus.cc:2243] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.745704 16192 raft_consensus.cc:2272] T 5d53d8e9fcbb4d1b901628952a056ffb P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.752588 16192 tablet_replica.cc:333] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.753739 16192 raft_consensus.cc:2243] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:03.756723 17360 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:03.763154 16192 raft_consensus.cc:2272] T ef8ac3d116f3443db6462f3a86ce1432 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.772588 16192 tablet_replica.cc:333] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.778518 16192 raft_consensus.cc:2243] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.779340 16192 raft_consensus.cc:2272] T 457e80c2d06f4623a397b7b3d6190f05 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.782497 16192 tablet_replica.cc:333] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.783449 16192 raft_consensus.cc:2243] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.784139 16192 raft_consensus.cc:2272] T b0bff337c6c8418e8fe0872b92f3bd6f P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.790740 16192 tablet_replica.cc:333] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.791652 16192 raft_consensus.cc:2243] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.792321 16192 raft_consensus.cc:2272] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.795224 16192 tablet_replica.cc:333] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.798406 16192 raft_consensus.cc:2243] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.799012 16192 raft_consensus.cc:2272] T 15143e49c9844f47911ff4266f078b54 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.802121 16192 tablet_replica.cc:333] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.803071 16192 raft_consensus.cc:2243] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:03.816934 17360 consensus_peers.cc:597] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:03.819353 16192 raft_consensus.cc:2272] T bd3f7b090266450da9f53ec675edc8f0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.863384 16192 tablet_replica.cc:333] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.864311 16192 raft_consensus.cc:2243] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.888648 16192 raft_consensus.cc:2272] T cd74e04425094277971ef1f372f80d50 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.905404 16192 tablet_replica.cc:333] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.913239 25415 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.912832 16192 raft_consensus.cc:2243] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.913972 25415 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:03.914705 16192 raft_consensus.cc:2272] T 2679735faeb64bcf9031060956c1e1b9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.916200 25415 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:03.919750 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:03.919680 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3c6f4045794af59b877ad412ae6450" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:03.920455 25410 raft_consensus.cc:493] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3747096bb5074ea2bf86037fd17c1160)
I20260709 13:21:03.954336 25410 raft_consensus.cc:515] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:03.955482 17285 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:03.956691 25410 leader_election.cc:290] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:03.928653 17214 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49282 (request call id 332) took 8603 ms. Trace:
I20260709 13:21:03.917829 16192 tablet_replica.cc:333] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.957860 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:03.958781 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19033ecd72e4ba188910445b70c84d5" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:03.958781 16192 raft_consensus.cc:2243] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.960512 16192 raft_consensus.cc:2272] T a20d82b49da74027abe144db7281b7b0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.960315 17285 leader_election.cc:304] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:03.945878 17218 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:03.958050 17214 rpcz_store.cc:276] 0709 13:20:55.324900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.325113 (+   213us) service_pool.cc:224] Handling call
0709 13:21:03.928575 (+8603462us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:03.714927 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:03.715496 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:03.715533 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:21:03.715551 (+    18us) tablet.cc:662] Decoding operations
0709 13:21:03.720680 (+  5129us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:03.720764 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:03.720790 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:21:03.723684 (+  2894us) tablet.cc:701] Row locks acquired
0709 13:21:03.723704 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:21:03.723836 (+   132us) write_op.cc:270] Start()
0709 13:21:03.723957 (+   121us) write_op.cc:276] Timestamp: P: 1783603263723792 usec, L: 0
0709 13:21:03.723979 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:21:03.724614 (+   635us) log.cc:844] Serialized 2079 byte log entry
0709 13:21:03.777475 (+ 52861us) op_driver.cc:464] REPLICATION: finished
0709 13:21:03.792975 (+ 15500us) write_op.cc:301] APPLY: starting
0709 13:21:03.793066 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:03.826410 (+ 33344us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:03.826517 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:03.830003 (+  3486us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:03.830205 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:21:03.830255 (+    50us) write_op.cc:312] APPLY: finished
0709 13:21:03.830462 (+   207us) log.cc:844] Serialized 57 byte log entry
0709 13:21:03.831200 (+   738us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:03.831298 (+    98us) write_op.cc:454] Released schema lock
0709 13:21:03.831345 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:03.857103 (+ 25758us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:03.857133 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":48058,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":2126,"apply.run_cpu_time_us":8875,"apply.run_wall_time_us":77212,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":25451,"prepare.run_cpu_time_us":3336,"prepare.run_wall_time_us":17629,"replication_time_us":53341,"thread_start_us":25942,"threads_started":2}]]}
I20260709 13:21:03.956688 25415 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:03.966216 25403 raft_consensus.cc:2749] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:03.967962 16192 tablet_replica.cc:333] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.968924 16192 raft_consensus.cc:2243] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.970000 16192 raft_consensus.cc:2272] T 132676f9343f4733b4f07f4587384a56 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.982332 16192 tablet_replica.cc:333] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:03.982612 25415 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.983143 25415 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:03.985503 25415 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:03.986061 25408 tablet_bootstrap.cc:492] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=1 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:03.987134 25408 tablet_bootstrap.cc:492] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:21:03.986899 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:03.987998 25408 ts_tablet_manager.cc:1403] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.314s	user 0.062s	sys 0.000s
I20260709 13:21:03.983165 16192 raft_consensus.cc:2243] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.991475 16192 raft_consensus.cc:2272] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.995458 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1f8f7b0e44cc38e154e294927d7ff" candidate_uuid: "7241e45fbfca4b46b6df9be8cebcd863" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:03.998755 17286 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241e45fbfca4b46b6df9be8cebcd863; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:04.000679 25403 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:04.007234 25408 raft_consensus.cc:359] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:21:04.009287 17360 consensus_peers.cc:597] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:04.008173 25408 raft_consensus.cc:740] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:21:04.015162 25408 consensus_queue.cc:260] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:21:04.035295 25408 ts_tablet_manager.cc:1434] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:21:04.038370 17480 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-2679735faeb64bcf9031060956c1e1b9 received from {username='slave'} at 127.0.0.1:59988
I20260709 13:21:04.038908 17480 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-2679735faeb64bcf9031060956c1e1b9 on tablet 2679735faeb64bcf9031060956c1e1b9 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:21:04.041386 16192 tablet_replica.cc:333] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.042460 16192 raft_consensus.cc:2243] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.053817 16192 raft_consensus.cc:2272] T 72154b87dcf145b2aeae9bf915b34ce0 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.063055 16192 tablet_replica.cc:333] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.081113 16192 raft_consensus.cc:2243] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.082453 16192 raft_consensus.cc:2272] T 3d0cd72466fe4edf8e126347432dbccb P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.091634 16192 tablet_replica.cc:333] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.100023 16192 raft_consensus.cc:2243] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.096022 17990 raft_consensus.cc:1217] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.15->[24.16-24.16]   Dedup: 24.16->[]
W20260709 13:21:04.100447 17360 consensus_peers.cc:597] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:04.078997 17215 catalog_manager.cc:5697] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 20 to 21, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 21 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:04.103813 17218 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49270 (request call id 330) took 15514 ms (client timeout 15000 ms). Trace:
I20260709 13:21:04.105023 16192 raft_consensus.cc:2272] T 96a5582b6bfb4ac592225b49ce6df9be P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.111469 16192 tablet_replica.cc:333] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.117579 16192 raft_consensus.cc:2243] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.105670 17215 catalog_manager.cc:5697] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:21:04.120476 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:04.121935 17215 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:04.123780 17215 catalog_manager.cc:5697] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 21 to 23, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 23 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:04.126552 17215 catalog_manager.cc:5697] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 21 to 23, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 23 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:04.133857 17215 catalog_manager.cc:5697] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 20 to 21, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 21 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:21:04.104238 17218 rpcz_store.cc:269] 0709 13:20:48.589377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.590648 (+  1271us) service_pool.cc:224] Handling call
0709 13:21:04.103745 (+15513097us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:03.980494 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:03.981081 (+   587us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:03.981120 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:21:03.981134 (+    14us) tablet.cc:662] Decoding operations
0709 13:21:03.981487 (+   353us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:03.981545 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:03.981574 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:21:03.981754 (+   180us) tablet.cc:701] Row locks acquired
0709 13:21:03.981769 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:21:03.981925 (+   156us) write_op.cc:270] Start()
0709 13:21:03.982047 (+   122us) write_op.cc:276] Timestamp: P: 1783603263981874 usec, L: 0
0709 13:21:03.982066 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:21:03.992992 (+ 10926us) log.cc:844] Serialized 538 byte log entry
0709 13:21:04.001836 (+  8844us) op_driver.cc:464] REPLICATION: finished
0709 13:21:04.002300 (+   464us) write_op.cc:301] APPLY: starting
0709 13:21:04.002381 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:04.003275 (+   894us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:04.003375 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:04.004145 (+   770us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:04.004326 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:21:04.004377 (+    51us) write_op.cc:312] APPLY: finished
0709 13:21:04.004576 (+   199us) log.cc:844] Serialized 25 byte log entry
0709 13:21:04.004746 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:04.006280 (+  1534us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540011ec54. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d627efe28 00007f7d6622a581 00007f7d66229d58 00007f7d6622e9f1 00007f7d6622e9a9 00007f7d6622e939 00007f7d6622e901 00007f7d6622db2d 000000000038f354 000000000038f199
0709 13:21:04.004830 (+ -1450us) write_op.cc:454] Released schema lock
0709 13:21:04.007113 (+  2283us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:04.007537 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:04.007564 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":698654,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":3005,"apply.run_wall_time_us":5179,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":14432,"prepare.run_cpu_time_us":5010,"prepare.run_wall_time_us":25961,"replication_time_us":19646,"spinlock_wait_cycles":23633280}]]}
I20260709 13:21:04.125119 16192 raft_consensus.cc:2272] T 622554a5186d4910b8476a653411c85d P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.154407 16192 tablet_replica.cc:333] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.163312 16192 raft_consensus.cc:2243] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.166306 16192 raft_consensus.cc:2272] T 4295303b785442b287bf068dfd2e160c P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.174589 16192 tablet_replica.cc:333] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.164389 17215 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:04.182106 17215 catalog_manager.cc:5697] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:04.183459 17215 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:04.186717 17215 catalog_manager.cc:5697] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 20 to 22, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 22 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:04.185016 16192 raft_consensus.cc:2243] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.207780 16192 raft_consensus.cc:2272] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 7241e45fbfca4b46b6df9be8cebcd863 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.210927 16192 tablet_replica.cc:333] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.213755 16192 raft_consensus.cc:2243] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.214591 16192 raft_consensus.cc:2272] T 060ed925d51948b7b415b005543f7a9f P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.217566 16192 tablet_replica.cc:333] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.212049 17215 catalog_manager.cc:5697] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 14 to 17, leader changed from b7108577e5754060b7e468a43dfdcdeb (127.15.208.3) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 17 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
W20260709 13:21:04.219453 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:04.221349 17215 catalog_manager.cc:5697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 16, term changed from 21 to 24, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3), NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 24 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:04.223522 17215 catalog_manager.cc:5697] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 23 to 25, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 25 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:04.225227 17215 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:04.237701 17215 catalog_manager.cc:5697] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:04.240983 17215 catalog_manager.cc:5697] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "7241e45fbfca4b46b6df9be8cebcd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } }
I20260709 13:21:04.249578 17215 catalog_manager.cc:5697] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 24 to 25, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 25 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:04.226619 16192 raft_consensus.cc:2243] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.251682 16192 raft_consensus.cc:2272] T 6758d139882843e5bddc827c260b81a9 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.254606 16192 tablet_replica.cc:333] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.255595 16192 raft_consensus.cc:2243] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.258168 16192 raft_consensus.cc:2272] T a7e1f8f7b0e44cc38e154e294927d7ff P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.261256 16192 tablet_replica.cc:333] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.264092 16192 raft_consensus.cc:2243] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.271847 16192 raft_consensus.cc:2272] T a5d6271327d4457ea6b522d9188f4f84 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.282039 16192 tablet_replica.cc:333] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.290632 16192 raft_consensus.cc:2243] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:04.300401 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:04.313134 16192 pending_rounds.cc:70] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Trying to abort 1 pending ops.
I20260709 13:21:04.317176 16192 pending_rounds.cc:77] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863: Aborting op as it isn't in flight: id { term: 16 index: 13 } timestamp: 7305638915046637568 op_type: NO_OP noop_request { }
I20260709 13:21:04.327463 16192 raft_consensus.cc:2889] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:04.327877 16192 raft_consensus.cc:2272] T 7c3c6f4045794af59b877ad412ae6450 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.365191 16192 tablet_replica.cc:333] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.366060 16192 raft_consensus.cc:2243] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.366598 16192 raft_consensus.cc:2272] T 213e74ac16bb4f19b434bdd25b7bd3af P 7241e45fbfca4b46b6df9be8cebcd863 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.369345 16192 tablet_replica.cc:333] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.370064 16192 raft_consensus.cc:2243] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.377830 16192 raft_consensus.cc:2272] T 7601a632a565453b83b93c1020924101 P 7241e45fbfca4b46b6df9be8cebcd863 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.390980 16192 tablet_replica.cc:333] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.391826 16192 raft_consensus.cc:2243] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.392907 16192 raft_consensus.cc:2272] T 036c02de798949eeb02d27e9dd520825 P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.395727 16192 tablet_replica.cc:333] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.396448 16192 raft_consensus.cc:2243] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.417589 16192 raft_consensus.cc:2272] T 1b85187304c149c58d33a53cb3005a02 P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.420470 16192 tablet_replica.cc:333] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.434509 16192 raft_consensus.cc:2243] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.435079 16192 raft_consensus.cc:2272] T f2018cf7711d4001a8a9fae2f46d00f4 P 7241e45fbfca4b46b6df9be8cebcd863 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.437717 16192 tablet_replica.cc:333] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.438432 16192 raft_consensus.cc:2243] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.439399 16192 raft_consensus.cc:2272] T 2e1a5ebc1019411290bc16a4e1cab89b P 7241e45fbfca4b46b6df9be8cebcd863 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.474419 16192 tablet_replica.cc:333] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.475164 16192 raft_consensus.cc:2243] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.475728 16192 raft_consensus.cc:2272] T a4c1e66c4a684159ae427b3705522c26 P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.491595 16192 tablet_replica.cc:333] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.492388 16192 raft_consensus.cc:2243] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.501561 16192 raft_consensus.cc:2272] T af5b45fab0a7463d90e9b2fec8241e1a P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.504359 16192 tablet_replica.cc:333] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
W20260709 13:21:04.508140 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:04.510003 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:04.512300 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:04.513180 16192 raft_consensus.cc:2243] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.513859 16192 raft_consensus.cc:2272] T b19033ecd72e4ba188910445b70c84d5 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.516582 16192 tablet_replica.cc:333] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.517338 16192 raft_consensus.cc:2243] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.517830 16192 raft_consensus.cc:2272] T 2566406852d04693963f9fa3f001ff8c P 7241e45fbfca4b46b6df9be8cebcd863 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.520539 16192 tablet_replica.cc:333] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.536995 17215 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49294 (request call id 336) took 1222 ms. Trace:
I20260709 13:21:04.537458 17215 rpcz_store.cc:276] 0709 13:21:03.314422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.318255 (+  3833us) service_pool.cc:224] Handling call
0709 13:21:04.536899 (+1218644us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:04.282586 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:04.283124 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:04.283171 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:21:04.283192 (+    21us) tablet.cc:662] Decoding operations
0709 13:21:04.284634 (+  1442us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:04.284694 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:04.284722 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:21:04.286036 (+  1314us) tablet.cc:701] Row locks acquired
0709 13:21:04.286057 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:21:04.286210 (+   153us) write_op.cc:270] Start()
0709 13:21:04.286326 (+   116us) write_op.cc:276] Timestamp: P: 1783603264286158 usec, L: 0
0709 13:21:04.286347 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:21:04.287005 (+   658us) log.cc:844] Serialized 6756 byte log entry
0709 13:21:04.291872 (+  4867us) op_driver.cc:464] REPLICATION: finished
0709 13:21:04.293081 (+  1209us) write_op.cc:301] APPLY: starting
0709 13:21:04.293162 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:04.312492 (+ 19330us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:04.312620 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:04.352565 (+ 39945us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:04.352918 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:21:04.352969 (+    51us) write_op.cc:312] APPLY: finished
0709 13:21:04.353373 (+   404us) log.cc:844] Serialized 156 byte log entry
0709 13:21:04.354171 (+   798us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:04.354343 (+   172us) write_op.cc:454] Released schema lock
0709 13:21:04.354406 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:04.388309 (+ 33903us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:04.388346 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75539,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":970,"apply.run_cpu_time_us":23015,"apply.run_wall_time_us":95163,"cfile_cache_hit":68,"cfile_cache_hit_bytes":71060,"num_ops":17,"prepare.queue_time_us":3080,"prepare.run_cpu_time_us":4714,"prepare.run_wall_time_us":7484,"replication_time_us":5205}]]}
I20260709 13:21:04.540957 16192 raft_consensus.cc:2243] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.542107 16192 raft_consensus.cc:2272] T ff6cbb1194424d7fb250bdb904d367ab P 7241e45fbfca4b46b6df9be8cebcd863 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.544816 16192 tablet_replica.cc:333] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.545523 16192 raft_consensus.cc:2243] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:04.546485 16192 raft_consensus.cc:2272] T 3c3278087b524fbab2103bd52cc56710 P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.578373 16192 tablet_replica.cc:333] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.580274 16192 raft_consensus.cc:2243] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.588176 16192 raft_consensus.cc:2272] T bf42e0c75aa14899935b39a4a7437626 P 7241e45fbfca4b46b6df9be8cebcd863 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.590966 16192 tablet_replica.cc:333] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.591661 16192 raft_consensus.cc:2243] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.592319 16192 raft_consensus.cc:2272] T 452dfe9db12345ae88b3dbbd163f480e P 7241e45fbfca4b46b6df9be8cebcd863 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.601824 16192 tablet_replica.cc:333] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863: stopping tablet replica
I20260709 13:21:04.609041 16192 raft_consensus.cc:2243] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:04.611877 16192 raft_consensus.cc:2272] T aaa77e48390f407cb43bb16febfe2e8d P 7241e45fbfca4b46b6df9be8cebcd863 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:04.651261 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:04.670266 25416 raft_consensus.cc:1064] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:21:04.678762 25416 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:04.708593 17360 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:04.719828 17990 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:21:04.722765 25333 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:04.740252 17389 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:21:04.741892 25416 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:04.743099 25425 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:04.743647 25425 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:04.745625 17434 consensus_peers.cc:597] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:04.745929 25425 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:04.747264 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:04.755842 25425 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:04.756426 25425 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:04.758496 25425 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:04.759502 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:21:04.764622 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:04.776858 17360 leader_election.cc:336] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.777501 17360 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:21:04.797516 17360 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.798063 25425 raft_consensus.cc:2749] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:04.804513 17360 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:04.807663 25425 raft_consensus.cc:2749] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:04.822739 25333 raft_consensus.cc:2955] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:04.825923 17998 raft_consensus.cc:2955] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:04.834249 25400 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:04.834868 25400 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:04.837157 25400 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:04.839921 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:21:04.841887 17434 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.842345 17434 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:04.843073 25400 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:04.853753 17219 catalog_manager.cc:5697] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 16 to 17, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:04.860093 17389 raft_consensus.cc:2955] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:04.864995 25416 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:04.865594 25416 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:04.867707 25416 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:04.879310 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:04.880216 17394 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:21:04.885061 25325 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:04.885675 25325 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:04.890610 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:04.892783 25416 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:04.893718 25416 raft_consensus.cc:493] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:04.894127 25416 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:04.895576 17360 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:04.926831 17434 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.928145 25325 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:04.936194 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:04.936915 17462 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:21:04.940053 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:04.941109 25425 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:04.944231 25425 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:04.945149 25425 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:04.952386 25325 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:04.953673 25325 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:04.955874 25325 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:04.973631 25425 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:04.977494 25416 raft_consensus.cc:515] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:04.979707 17462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3bd226d2e04278bed4c50c89f1f5bd" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:04.982597 17462 raft_consensus.cc:3060] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:04.984102 25416 leader_election.cc:290] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:04.988021 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:04.990054 25325 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:04.990638 25325 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:04.991173 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d53d8e9fcbb4d1b901628952a056ffb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:04.991906 17389 raft_consensus.cc:3060] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:04.992930 25325 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:04.993906 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:21:05.001031 17360 leader_election.cc:336] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.001606 17360 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 3747096bb5074ea2bf86037fd17c1160, 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:05.005851 17462 raft_consensus.cc:2468] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
I20260709 13:21:05.009058 17362 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.009965 25402 raft_consensus.cc:2804] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:21:05.021955 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:05.022526 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:05.022890 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:05.035430 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:05.037636 25325 raft_consensus.cc:2749] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:05.038683 17360 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:05.039292 17360 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.039671 17360 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:05.040385 25325 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:05.043540 25397 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:21:05.043956 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:05.044171 25397 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:05.049238 25397 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.049605 25402 raft_consensus.cc:697] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:21:05.050746 25402 consensus_queue.cc:237] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:05.062280 17962 leader_election.cc:336] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.063869 25105 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.064430 25105 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:05.069854 25105 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:05.070705 17962 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.079939 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:05.080648 17394 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:21:05.082130 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:05.084825 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:05.085991 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:05.087138 25397 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:05.087641 25397 raft_consensus.cc:493] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.088063 25397 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:05.088989 25350 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:05.101415 25397 raft_consensus.cc:515] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:05.105376 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:05.108999 17962 leader_election.cc:336] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.110154 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff504a0c820741ecb08279a255054a6c" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:05.110764 17392 raft_consensus.cc:3060] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:05.113940 25425 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.117094 17389 raft_consensus.cc:2468] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
I20260709 13:21:05.118290 17435 leader_election.cc:304] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.119064 25416 raft_consensus.cc:2804] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:05.119557 25416 raft_consensus.cc:697] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:21:05.122120 17392 raft_consensus.cc:2468] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:21:05.120409 25416 consensus_queue.cc:237] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.123463 17963 leader_election.cc:304] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:05.124332 25350 raft_consensus.cc:2804] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:05.126282 25430 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.127293 25430 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.129320 25430 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.123529 25397 leader_election.cc:290] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.132318 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:05.132949 17394 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 26.
W20260709 13:21:05.135169 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:05.136283 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.137516 25325 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.138036 25325 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:05.140122 25325 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:05.146014 25350 raft_consensus.cc:697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:21:05.146724 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:05.147408 17990 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:21:05.148674 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.147377 25350 consensus_queue.cc:237] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:05.149873 25425 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:05.150318 25425 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.150722 25425 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:05.137542 25400 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:05.155485 25400 raft_consensus.cc:493] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.155978 25400 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:21:05.158972 17360 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.196071 25425 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:05.220438 17463 consensus_queue.cc:237] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:05.222295 25425 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:05.198740 25400 raft_consensus.cc:515] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:05.204473 17360 consensus_peers.cc:597] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:05.226634 25400 leader_election.cc:290] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.232048 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df43493289c4586a02bce2e14a38202" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:21:05.232738 17990 raft_consensus.cc:3060] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:05.239898 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e69b6a14a654bac9e2288b25123fc4b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:05.240562 17392 raft_consensus.cc:3060] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:05.240658 17389 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:21:05.242573 25440 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:21:05.242898 17360 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.246981 17990 raft_consensus.cc:2468] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
W20260709 13:21:05.213917 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:05.212256 17434 leader_election.cc:336] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.247139 17392 raft_consensus.cc:2468] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 27.
W20260709 13:21:05.250716 17434 leader_election.cc:336] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.251250 17435 leader_election.cc:304] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.252252 25440 raft_consensus.cc:2804] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:21:05.252808 25440 raft_consensus.cc:697] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 27 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:21:05.253747 25440 consensus_queue.cc:237] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.263063 17214 catalog_manager.cc:5697] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 23 to 24, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 24 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.265333 17360 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:05.266144 25325 raft_consensus.cc:2804] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:05.266690 25325 raft_consensus.cc:697] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:21:05.267607 25325 consensus_queue.cc:237] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:05.269222 25425 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.269784 25425 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.270794 25416 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.271389 25416 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.272738 25425 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.273658 25416 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.278482 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:05.279102 17463 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 22.
I20260709 13:21:05.280114 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:05.280812 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.278982 25400 raft_consensus.cc:2955] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:05.282480 17392 raft_consensus.cc:2955] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:05.283885 17219 catalog_manager.cc:5697] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 23 to 24, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 24 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:05.280872 17389 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 22.
I20260709 13:21:05.287856 25425 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:05.289719 25425 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.290297 25425 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:05.279273 17215 catalog_manager.cc:5697] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 21 to 22, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 22 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:05.294417 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.296160 25416 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:05.296557 25416 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.296947 25416 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:05.298400 25430 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.299010 25430 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.299021 17990 raft_consensus.cc:1275] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:21:05.303567 25430 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.307600 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:05.316867 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2679735faeb64bcf9031060956c1e1b9 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:21:05.321854 17360 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.327353 25416 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.331530 25416 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.342357 25425 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.343816 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:05.344664 17392 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 23: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:21:05.351857 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:05.352860 17463 raft_consensus.cc:2393] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 23: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:21:05.344741 25425 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:05.354132 17360 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.370663 17215 catalog_manager.cc:5697] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 26 to 27, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 27 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:05.372153 17362 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:05.376302 25440 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.376933 25440 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:05.378885 17434 leader_election.cc:336] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.379041 25440 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.376066 25416 consensus_queue.cc:1048] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:21:05.379734 25425 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:05.387274 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:05.388069 17389 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:21:05.390146 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.391016 25440 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:05.391458 25440 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.391824 25440 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:05.393087 25425 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.392560 17219 catalog_manager.cc:5697] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 22 to 23, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 23 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.393658 25425 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.401292 25425 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:05.401342 17360 leader_election.cc:336] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:05.404505 17434 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.404820 17998 raft_consensus.cc:2955] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:05.405413 17434 leader_election.cc:336] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.416473 17434 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:05.407784 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:21:05.415863 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:05.417305 25416 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:05.418195 17463 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:21:05.419471 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:05.420660 25425 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:05.421072 25425 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.421443 25425 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:05.430579 17434 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.433984 17434 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:05.433149 25425 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.441268 25440 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.444379 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132676f9343f4733b4f07f4587384a56" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:05.444996 17389 raft_consensus.cc:3060] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:05.445356 17360 leader_election.cc:336] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.446185 25416 raft_consensus.cc:2749] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:05.459309 17389 raft_consensus.cc:2468] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
I20260709 13:21:05.460103 25425 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.464552 25440 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:05.477133 17360 consensus_peers.cc:597] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.477185 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4295303b785442b287bf068dfd2e160c" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:05.482441 17467 raft_consensus.cc:3060] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:05.478459 17435 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.477387 17219 catalog_manager.cc:5697] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index 17 to 18, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 24 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.496131 17467 raft_consensus.cc:2468] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
W20260709 13:21:05.498464 17434 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.499730 25440 raft_consensus.cc:2804] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:05.501741 17469 raft_consensus.cc:1275] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:21:05.503697 17362 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:05.509829 25402 raft_consensus.cc:2804] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:05.510231 25416 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.510324 25402 raft_consensus.cc:697] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:21:05.510800 25416 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.511270 25402 consensus_queue.cc:237] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.513104 25416 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.508498 25440 raft_consensus.cc:697] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:21:05.520640 25440 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.521226 25325 consensus_queue.cc:1048] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:05.524878 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:05.531231 25325 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.531785 25325 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.533958 25325 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:05.537743 17962 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.539559 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:05.540254 17467 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
I20260709 13:21:05.542994 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.546787 25425 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:21:05.548177 17434 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.547238 25425 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.560006 25425 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:05.577064 17360 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.599910 25440 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
W20260709 13:21:05.602918 17434 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.603449 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:05.605051 17219 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 23 to 24, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 24 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:05.615135 17214 catalog_manager.cc:5697] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 23 to 24, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 24 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.600585 25440 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.586998 25425 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.610517 25416 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:05.644797 25440 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.631170 25430 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.649601 25430 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.665985 17392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:05.666256 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:05.667227 25402 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.667824 25402 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:05.669875 17434 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.670202 25449 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.652622 25430 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.670955 17434 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:05.673593 17434 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.674170 17434 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:05.674968 25449 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.678206 25425 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.679319 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:05.680150 17467 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 20.
I20260709 13:21:05.684688 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036c02de798949eeb02d27e9dd520825" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:05.685588 17467 raft_consensus.cc:3060] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:05.682781 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.677505 25449 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.681388 25400 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:05.688512 25333 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:05.704689 17467 raft_consensus.cc:2468] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
I20260709 13:21:05.695822 25325 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:05.697067 25450 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.701583 25430 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.731313 25402 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:05.721695 25438 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.709746 25325 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.713856 25451 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.761212 25451 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.715947 25450 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.763545 25451 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.722877 25430 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.751657 17362 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.749939 17998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:05.793169 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:05.796182 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:05.796947 17467 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 23.
W20260709 13:21:05.804380 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 72070.4us
I20260709 13:21:05.765030 25450 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.806329 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.748208 25438 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:05.807286 25425 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:05.807793 25425 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.808169 25425 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:05.810556 25449 raft_consensus.cc:2804] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:05.811113 25449 raft_consensus.cc:697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:21:05.811964 25449 consensus_queue.cc:237] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.812966 17998 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
W20260709 13:21:05.814864 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:05.748338 25325 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:05.823829 25430 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:05.833892 17204 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 93538.1us
I20260709 13:21:05.844893 17394 raft_consensus.cc:1275] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:21:05.845696 25456 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.847211 25456 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:05.846697 17962 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.851606 25452 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.852268 25452 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.854652 25452 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.849645 25402 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.855667 25402 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.857734 25402 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.859820 25456 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.863104 25438 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:05.850153 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2679735faeb64bcf9031060956c1e1b9: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.871706 25425 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:05.882707 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 74206.2us
I20260709 13:21:05.878530 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.884728 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
W20260709 13:21:05.887056 17360 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:05.887832 17360 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:05.888451 17360 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.884156 25400 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.889573 25400 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.890730 25402 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:05.891161 25402 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.891536 25402 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:05.891784 25400 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:05.892390 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:05.893093 17467 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 25.
I20260709 13:21:05.894483 25425 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.896113 17392 raft_consensus.cc:1275] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 27 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:21:05.896358 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:05.897063 17467 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 17.
I20260709 13:21:05.897984 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:05.899645 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:05.900322 17395 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 17.
W20260709 13:21:05.900213 17360 leader_election.cc:336] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.901692 17360 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:05.903358 17392 raft_consensus.cc:1275] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:21:05.904258 25425 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:05.905014 17360 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.907430 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:05.907967 17469 raft_consensus.cc:3060] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:05.900712 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.911270 25400 consensus_queue.cc:1048] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:05.911751 17362 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.912694 25449 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:05.913153 25449 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.913010 25438 consensus_queue.cc:1048] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:05.913542 25449 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:05.915731 17469 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 24.
I20260709 13:21:05.918200 25325 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.919348 17389 raft_consensus.cc:2393] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 21: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:21:05.919411 25452 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:05.920132 25452 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.920724 25452 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:05.922415 17362 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.931108 25450 raft_consensus.cc:2804] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:05.931630 25450 raft_consensus.cc:697] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:21:05.932528 25450 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.934851 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:05.938947 25400 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:05.938861 25461 consensus_queue.cc:1048] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:05.939569 25400 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:05.940043 25400 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:05.938894 17990 raft_consensus.cc:1275] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:05.941586 17214 catalog_manager.cc:5697] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 23 to 24, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 24 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:05.952265 16192 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17343)
I20260709 13:21:05.977285 25402 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:05.979398 25402 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:05.982088 25452 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.984356 25452 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:05.986290 17434 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:05.987062 17434 consensus_peers.cc:597] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.987727 17434 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:05.988212 17434 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:05.985160 25325 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:05.937808 25449 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:05.996932 17434 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.996783 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:05.999543 17463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b45fab0a7463d90e9b2fec8241e1a" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:06.003077 25449 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 26 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:06.013659 25457 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:06.014410 25457 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:05.998340 25430 raft_consensus.cc:3060] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:06.019186 25457 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:06.019726 25462 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:06.020465 25462 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:06.023181 25462 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:06.037926 17467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b85187304c149c58d33a53cb3005a02" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:06.038540 17467 raft_consensus.cc:3060] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:06.039026 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:06.039626 17395 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 25.
I20260709 13:21:06.046783 17390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:06.047425 17390 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
I20260709 13:21:06.041116 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:06.058925 25400 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:06.060364 17469 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c23a664ebf3347a4934dee377c8b5101 in current term 18: Already voted for candidate b7108577e5754060b7e468a43dfdcdeb in this term.
I20260709 13:21:06.061575 17467 raft_consensus.cc:2468] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 26.
I20260709 13:21:06.063530 25400 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:06.071843 17362 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:06.072597 25325 raft_consensus.cc:2804] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:06.073071 25325 raft_consensus.cc:697] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 26 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:21:06.073798 25325 consensus_queue.cc:237] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:06.074227 17395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:06.075273 17395 raft_consensus.cc:2393] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7108577e5754060b7e468a43dfdcdeb in current term 18: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:21:06.074261 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:21:06.080892 17434 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:06.078024 25400 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:06.084265 25400 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:06.084767 25400 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:21:06.084791 17434 leader_election.cc:336] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:06.086174 25462 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:06.090050 25462 raft_consensus.cc:493] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7241e45fbfca4b46b6df9be8cebcd863)
I20260709 13:21:06.093075 25462 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:06.098526 17214 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 23 to 24, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 24 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.102063 25400 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:06.115305 25430 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:06.121028 25462 raft_consensus.cc:515] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:06.123149 25462 leader_election.cc:290] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:06.126281 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:06.127523 17389 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:21:06.127990 17394 raft_consensus.cc:2393] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3747096bb5074ea2bf86037fd17c1160 in current term 25: Already voted for candidate c23a664ebf3347a4934dee377c8b5101 in this term.
I20260709 13:21:06.171504 17394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3278087b524fbab2103bd52cc56710" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:06.164592 17463 raft_consensus.cc:2468] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 21.
I20260709 13:21:06.172323 17394 raft_consensus.cc:3060] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:06.119084 25400 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:06.174196 17360 consensus_peers.cc:597] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:06.175009 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:06.175096 17389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6cbb1194424d7fb250bdb904d367ab" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
W20260709 13:21:06.175513 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 89810.3us
I20260709 13:21:06.175765 17389 raft_consensus.cc:3060] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:21:06.176000 17434 leader_election.cc:336] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:06.186832 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6758d139882843e5bddc827c260b81a9" candidate_uuid: "c23a664ebf3347a4934dee377c8b5101" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:21:06.187592 17992 raft_consensus.cc:3060] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:06.191706 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:06.196197 17464 raft_consensus.cc:1275] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:21:06.196365 17362 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:06.204779 17389 raft_consensus.cc:2468] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 26.
I20260709 13:21:06.208062 17435 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:06.192907 25461 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:21:06.207743 25456 raft_consensus.cc:2804] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:06.214057 25333 raft_consensus.cc:2804] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:06.205973 25425 consensus_queue.cc:1048] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 13:21:06.240312 17394 raft_consensus.cc:2468] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 25.
I20260709 13:21:06.248785 25333 raft_consensus.cc:697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 26 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:21:06.249802 25333 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:06.216001 25450 consensus_queue.cc:1048] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 13:21:06.256705 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 55149.3us
I20260709 13:21:06.256333 25456 raft_consensus.cc:697] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:21:06.258769 25456 consensus_queue.cc:237] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:06.257527 17434 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:06.262053 17434 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:06.262101 17992 raft_consensus.cc:2468] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c23a664ebf3347a4934dee377c8b5101 in term 25.
I20260709 13:21:06.269407 25463 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:06.277791 17435 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:06.278599 25461 raft_consensus.cc:2804] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:06.279129 25461 raft_consensus.cc:697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 25 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
W20260709 13:21:06.282889 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:06.284241 17360 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:06.285051 17360 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:06.285624 17360 leader_election.cc:336] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:06.285861 17360 leader_election.cc:304] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:06.275352 25462 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:06.279974 25461 consensus_queue.cc:237] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:06.304169 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:06.307789 17434 leader_election.cc:336] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:06.308578 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:06.309173 17434 leader_election.cc:336] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:06.305294 17360 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:06.310993 17360 consensus_peers.cc:597] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:06.317875 17219 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 25 to 26, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 26 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:06.322156 17360 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101; no voters: 
W20260709 13:21:06.343107 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 150249us
I20260709 13:21:06.306813 25476 raft_consensus.cc:2749] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:06.352954 25471 raft_consensus.cc:2804] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:21:06.425871 25484 log.cc:927] Time spent T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:21:06.430135 17360 consensus_peers.cc:597] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:06.443881 25471 raft_consensus.cc:697] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 25 LEADER]: Becoming Leader. State: Replica: c23a664ebf3347a4934dee377c8b5101, State: Running, Role: LEADER
I20260709 13:21:06.445130 25471 consensus_queue.cc:237] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:06.465016 17462 raft_consensus.cc:1275] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:21:06.493041 25451 consensus_queue.cc:1048] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:06.543428 17463 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:21:06.574681 25489 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
W20260709 13:21:06.645257 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 48884.3us
I20260709 13:21:06.674072 17219 catalog_manager.cc:5697] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 24 to 25, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 25 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:06.677525 17467 raft_consensus.cc:1275] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:21:06.684595 25475 consensus_queue.cc:1048] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:21:06.704046 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:06.716037 17360 consensus_peers.cc:597] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:06.716881 17360 consensus_peers.cc:597] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:06.728459 17214 catalog_manager.cc:5697] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 25 to 26, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 26 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.746650 17214 catalog_manager.cc:5697] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 20 to 21, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 21 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:06.746529 17360 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:06.750847 17360 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:06.751147 17360 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
W20260709 13:21:06.752663 17360 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:06.753412 17360 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:06.754066 17360 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:06.759750 17462 raft_consensus.cc:1275] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:21:06.772900 25477 raft_consensus.cc:2749] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:21:06.814076 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 57152.2us
I20260709 13:21:06.806478 25477 consensus_queue.cc:1048] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:21:06.909086 17391 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:21:06.916286 17214 catalog_manager.cc:5697] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: term changed from 24 to 25, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to c23a664ebf3347a4934dee377c8b5101 (127.15.208.2). New cstate: current_term: 25 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:06.929297 17360 consensus_peers.cc:597] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:06.929981 17360 consensus_peers.cc:597] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:06.943809 17434 consensus_peers.cc:597] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:06.966894 16192 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:06.972075 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:06.976734 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:06.946514 25462 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
W20260709 13:21:06.990229 17268 auto_rebalancer.cc:629] Failed to schedule move for tablet af5b45fab0a7463d90e9b2fec8241e1a: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:21:06.994474 17360 consensus_peers.cc:597] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:06.995313 17360 consensus_peers.cc:597] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:06.994807 17396 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:21:06.997416 25494 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.997939 25494 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:07.007464 17469 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:21:07.007627 17391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:07.008237 17391 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:21:07.011441 25325 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:07.013266 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 
I20260709 13:21:07.014302 25491 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:07.014742 25491 raft_consensus.cc:493] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.015132 25491 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:07.000908 25494 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:07.028280 17360 consensus_peers.cc:597] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:07.033721 17360 consensus_peers.cc:597] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e1a5ebc1019411290bc16a4e1cab89b. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:07.036861 17434 consensus_peers.cc:597] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:07.041594 25449 raft_consensus.cc:2955] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:21:07.048624 17469 raft_consensus.cc:2955] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:21:07.044420 25491 raft_consensus.cc:515] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:07.049602 17992 raft_consensus.cc:1275] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:21:07.057698 17396 raft_consensus.cc:1275] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:21:07.063295 25325 consensus_queue.cc:1048] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:21:07.064895 17434 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:07.085983 17360 consensus_peers.cc:597] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:07.086615 17360 consensus_peers.cc:597] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:07.093696 25333 consensus_queue.cc:1048] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:21:07.099385 17360 consensus_peers.cc:597] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:07.106545 17214 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 16, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 24 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:21:07.138923 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cd72466fe4edf8e126347432dbccb" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:07.139580 17396 raft_consensus.cc:3060] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:07.142253 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:07.142804 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:07.151383 17434 leader_election.cc:336] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:07.166236 25491 leader_election.cc:290] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:07.181118 17396 raft_consensus.cc:2468] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
I20260709 13:21:07.183568 17435 leader_election.cc:304] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:07.191529 25333 raft_consensus.cc:2804] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:07.192114 25333 raft_consensus.cc:697] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:21:07.193058 25333 consensus_queue.cc:237] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:07.201740 17464 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
W20260709 13:21:07.223567 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:07.256139 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:07.258004 17396 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:21:07.261003 25491 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:07.260516 17214 catalog_manager.cc:5697] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 22 to 24, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 24 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.282130 25462 raft_consensus.cc:2955] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 26 LEADER]: Committing config change with OpId 26.17: config changed from index -1 to 17, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:21:07.291997 17396 raft_consensus.cc:2955] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index -1 to 17, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
W20260709 13:21:07.296947 17434 consensus_peers.cc:597] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:07.298558 17434 consensus_peers.cc:597] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff6cbb1194424d7fb250bdb904d367ab. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:07.334715 17204 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55798.1us
I20260709 13:21:07.343809 17214 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index -1 to 17, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 26 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
W20260709 13:21:07.370065 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2679735faeb64bcf9031060956c1e1b9: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:07.373425 17464 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:21:07.380132 17396 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:21:07.381533 25494 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:21:07.386211 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:07.388897 25333 raft_consensus.cc:2955] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Committing config change with OpId 24.14: config changed from index -1 to 14, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:21:07.391644 17396 raft_consensus.cc:2955] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index -1 to 14, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } } }
I20260709 13:21:07.416862 17214 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: config changed from index -1 to 14, NON_VOTER 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) added. New cstate: current_term: 24 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:07.419910 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493): Couldn't send request to peer 3747096bb5074ea2bf86037fd17c1160. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 132676f9343f4733b4f07f4587384a56. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:07.447093 25514 ts_tablet_manager.cc:933] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:07.484730 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:07.497624 25514 tablet_copy_client.cc:323] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.2:33079
I20260709 13:21:07.523187 17407 tablet_copy_service.cc:140] P c23a664ebf3347a4934dee377c8b5101: Received BeginTabletCopySession request for tablet 2e1a5ebc1019411290bc16a4e1cab89b from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59472)
I20260709 13:21:07.523783 17407 tablet_copy_service.cc:161] P c23a664ebf3347a4934dee377c8b5101: Beginning new tablet copy session on tablet 2e1a5ebc1019411290bc16a4e1cab89b from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59472: session id = 3747096bb5074ea2bf86037fd17c1160-2e1a5ebc1019411290bc16a4e1cab89b
I20260709 13:21:07.532881 17407 tablet_copy_source_session.cc:215] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:07.540078 25514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1a5ebc1019411290bc16a4e1cab89b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:07.542295 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:07.542882 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:07.565234 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:07.584941 25514 tablet_copy_client.cc:806] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:07.585661 25514 tablet_copy_client.cc:670] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
W20260709 13:21:07.594411 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:07.592701 25514 tablet_copy_client.cc:538] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:21:07.601733 17434 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:07.630196 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:07.659471 25514 tablet_bootstrap.cc:492] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
W20260709 13:21:07.739836 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:07.746096 17360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111) [suppressed 401 similar messages]
W20260709 13:21:07.752966 17360 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:07.821940 17391 raft_consensus.cc:1275] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:21:07.824296 25333 consensus_queue.cc:1048] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:07.834434 25516 ts_tablet_manager.cc:933] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:07.837628 25519 ts_tablet_manager.cc:933] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: Initiating tablet copy from peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:07.847853 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:07.862128 25494 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.862733 25494 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:07.868335 25494 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:07.871726 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101" is_pre_election: true
I20260709 13:21:07.872483 17396 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 18.
W20260709 13:21:07.873034 17434 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:07.873783 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:07.875514 25494 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:07.876101 25494 raft_consensus.cc:493] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.876545 25494 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:07.911397 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:07.916918 25519 tablet_copy_client.cc:323] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
W20260709 13:21:07.930975 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:07.940645 17360 consensus_peers.cc:597] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:07.916710 25516 tablet_copy_client.cc:323] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Beginning tablet copy session from remote peer at address 127.15.208.3:33147
I20260709 13:21:07.944916 17480 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet ff6cbb1194424d7fb250bdb904d367ab from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:21:07.945500 17480 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet ff6cbb1194424d7fb250bdb904d367ab from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-ff6cbb1194424d7fb250bdb904d367ab
I20260709 13:21:07.956910 17481 tablet_copy_service.cc:140] P b7108577e5754060b7e468a43dfdcdeb: Received BeginTabletCopySession request for tablet 132676f9343f4733b4f07f4587384a56 from peer 3747096bb5074ea2bf86037fd17c1160 ({username='slave'} at 127.0.0.1:59988)
I20260709 13:21:07.957587 17481 tablet_copy_service.cc:161] P b7108577e5754060b7e468a43dfdcdeb: Beginning new tablet copy session on tablet 132676f9343f4733b4f07f4587384a56 from peer 3747096bb5074ea2bf86037fd17c1160 at {username='slave'} at 127.0.0.1:59988: session id = 3747096bb5074ea2bf86037fd17c1160-132676f9343f4733b4f07f4587384a56
W20260709 13:21:07.967429 16192 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 17343)
I20260709 13:21:07.976001 25494 raft_consensus.cc:515] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:07.983800 17481 tablet_copy_source_session.cc:215] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:08.022930 25519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132676f9343f4733b4f07f4587384a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.010555 17480 tablet_copy_source_session.cc:215] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:08.040658 25516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6cbb1194424d7fb250bdb904d367ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:08.060292 25514 tablet_bootstrap.cc:492] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:08.061391 25514 tablet_bootstrap.cc:492] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:21:08.062239 25514 ts_tablet_manager.cc:1403] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.403s	user 0.048s	sys 0.013s
I20260709 13:21:08.072265 25494 leader_election.cc:290] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Requested vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:08.075950 17396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601a632a565453b83b93c1020924101" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c23a664ebf3347a4934dee377c8b5101"
I20260709 13:21:08.076566 17396 raft_consensus.cc:3060] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:08.085906 17434 leader_election.cc:336] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:08.086994 17396 raft_consensus.cc:2468] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 19.
I20260709 13:21:08.088557 17435 leader_election.cc:304] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101; no voters: 7241e45fbfca4b46b6df9be8cebcd863
I20260709 13:21:08.090000 25494 raft_consensus.cc:2804] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:08.094496 25494 raft_consensus.cc:697] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:21:08.099090 25494 consensus_queue.cc:237] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:08.100942 25514 raft_consensus.cc:359] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:21:08.113015 25514 raft_consensus.cc:740] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
I20260709 13:21:08.113696 25514 consensus_queue.cc:260] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:21:08.116253 25514 ts_tablet_manager.cc:1434] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 13:21:08.136134 17407 tablet_copy_service.cc:342] P c23a664ebf3347a4934dee377c8b5101: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-2e1a5ebc1019411290bc16a4e1cab89b received from {username='slave'} at 127.0.0.1:59472
I20260709 13:21:08.136628 17407 tablet_copy_service.cc:434] P c23a664ebf3347a4934dee377c8b5101: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-2e1a5ebc1019411290bc16a4e1cab89b on tablet 2e1a5ebc1019411290bc16a4e1cab89b with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:21:08.144954 25516 tablet_copy_client.cc:806] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:08.145658 25516 tablet_copy_client.cc:670] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:08.150518 25516 tablet_copy_client.cc:538] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:08.161460 25516 tablet_bootstrap.cc:492] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:21:08.169447 25519 tablet_copy_client.cc:806] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:08.170229 25519 tablet_copy_client.cc:670] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:08.220156 17214 catalog_manager.cc:5697] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 17 to 19, leader changed from 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 19 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:08.363929 17360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 54233.8us
W20260709 13:21:08.370594 17962 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.386816 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 68889.2us
I20260709 13:21:08.415925 25519 tablet_copy_client.cc:538] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:21:08.420975 17360 consensus_peers.cc:597] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.505352 17434 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.577394 17434 consensus_peers.cc:597] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.588341 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:08.590215 17434 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:08.610812 25519 tablet_bootstrap.cc:492] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap starting.
I20260709 13:21:08.641363 17396 raft_consensus.cc:1275] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:21:08.648289 17434 consensus_peers.cc:597] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:08.650754 25462 consensus_queue.cc:1048] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:21:08.654237 17360 consensus_peers.cc:597] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:08.668280 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:08.670933 17204 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 51572.4us
W20260709 13:21:08.696224 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2679735faeb64bcf9031060956c1e1b9: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:08.704449 17992 raft_consensus.cc:1217] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.15->[24.16-24.16]   Dedup: 24.16->[]
W20260709 13:21:08.731660 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:08.768949 17360 consensus_peers.cc:597] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.805375 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:08.870695 25516 tablet_bootstrap.cc:492] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=1 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:08.903507 25516 tablet_bootstrap.cc:492] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:21:08.911043 25516 ts_tablet_manager.cc:1403] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.750s	user 0.041s	sys 0.029s
I20260709 13:21:08.914860 25516 raft_consensus.cc:359] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:21:08.915843 25516 raft_consensus.cc:740] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
W20260709 13:21:08.916895 17360 consensus_peers.cc:597] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:08.916564 25516 consensus_queue.cc:260] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:21:08.920048 25516 ts_tablet_manager.cc:1434] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:08.925733 17480 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-ff6cbb1194424d7fb250bdb904d367ab received from {username='slave'} at 127.0.0.1:59988
I20260709 13:21:08.926285 17480 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-ff6cbb1194424d7fb250bdb904d367ab on tablet ff6cbb1194424d7fb250bdb904d367ab with peer 3747096bb5074ea2bf86037fd17c1160
W20260709 13:21:08.948221 17360 consensus_peers.cc:597] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:08.968261 16192 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 17343)
I20260709 13:21:09.031090 25519 tablet_bootstrap.cc:492] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:09.040808 25519 tablet_bootstrap.cc:492] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: Bootstrap complete.
I20260709 13:21:09.045557 25519 ts_tablet_manager.cc:1403] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: Time spent bootstrapping tablet: real 0.435s	user 0.050s	sys 0.017s
I20260709 13:21:09.052241 25519 raft_consensus.cc:359] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:21:09.069418 25519 raft_consensus.cc:740] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Initialized, Role: LEARNER
W20260709 13:21:09.088486 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:09.105495 17360 consensus_peers.cc:597] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:09.084780 25519 consensus_queue.cc:260] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: NON_VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: true } }
I20260709 13:21:09.111032 25519 ts_tablet_manager.cc:1434] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.002s
I20260709 13:21:09.138486 17480 tablet_copy_service.cc:342] P b7108577e5754060b7e468a43dfdcdeb: Request end of tablet copy session 3747096bb5074ea2bf86037fd17c1160-132676f9343f4733b4f07f4587384a56 received from {username='slave'} at 127.0.0.1:59988
I20260709 13:21:09.139147 17480 tablet_copy_service.cc:434] P b7108577e5754060b7e468a43dfdcdeb: ending tablet copy session 3747096bb5074ea2bf86037fd17c1160-132676f9343f4733b4f07f4587384a56 on tablet 132676f9343f4733b4f07f4587384a56 with peer 3747096bb5074ea2bf86037fd17c1160
I20260709 13:21:09.176713 25449 raft_consensus.cc:1064] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:21:09.181366 25449 consensus_queue.cc:237] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:09.212167 17360 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:09.236112 17360 consensus_peers.cc:597] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:09.291163 17992 raft_consensus.cc:1217] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 LEARNER]: Deduplicated request from leader. Original: 26.16->[26.17-26.17]   Dedup: 26.17->[]
I20260709 13:21:09.291939 17469 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:21:09.295050 25449 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:09.304689 17992 raft_consensus.cc:1275] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Refusing update from remote peer c23a664ebf3347a4934dee377c8b5101: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:21:09.324954 25535 consensus_queue.cc:1048] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:21:09.327303 17360 consensus_peers.cc:597] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:09.364233 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:09.377153 17360 consensus_peers.cc:597] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:09.391462 17998 raft_consensus.cc:1217] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.13->[24.14-24.14]   Dedup: 24.14->[]
W20260709 13:21:09.423759 17360 consensus_peers.cc:597] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:09.442837 25449 raft_consensus.cc:2955] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:09.475128 17992 raft_consensus.cc:2955] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:09.501662 17466 raft_consensus.cc:2955] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:09.513213 17360 consensus_peers.cc:597] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:09.521809 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:09.523490 17219 catalog_manager.cc:5697] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 16 to 17, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "c23a664ebf3347a4934dee377c8b5101" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:09.538201 17360 consensus_peers.cc:597] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:09.557396 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:09.588327 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:09.646688 17434 consensus_peers.cc:597] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:09.755232 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:09.762467 17434 consensus_peers.cc:597] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:09.767663 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:09.804669 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:09.811895 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:09.826290 17360 consensus_peers.cc:597] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:09.874881 25333 raft_consensus.cc:1064] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:21:09.877703 25333 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 15, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:09.907645 17394 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 13:21:09.910769 17434 consensus_peers.cc:597] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:09.913060 25462 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:21:09.915393 17998 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:21:09.917156 25462 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:21:09.968786 16192 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 17343)
I20260709 13:21:09.988076 25462 raft_consensus.cc:2955] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 26 LEADER]: Committing config change with OpId 26.18: config changed from index 17 to 18, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:10.021998 17434 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:10.058367 17998 raft_consensus.cc:2955] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 17 to 18, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:10.060618 17394 raft_consensus.cc:2955] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index 17 to 18, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:10.063334 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:10.063868 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:10.071964 25560 raft_consensus.cc:1064] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: attempting to promote NON_VOTER 3747096bb5074ea2bf86037fd17c1160 to VOTER
I20260709 13:21:10.074832 25560 consensus_queue.cc:237] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 12, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:10.085163 17214 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: config changed from index 17 to 18, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } attrs { replace: true } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:10.112406 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:10.189349 17998 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEARNER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:21:10.192442 25462 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:10.196026 17396 raft_consensus.cc:1275] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:21:10.197463 17466 consensus_queue.cc:237] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:10.198046 25333 consensus_queue.cc:1048] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:21:10.211177 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:10.219583 17394 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:21:10.221241 25333 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:21:10.226027 17992 raft_consensus.cc:1275] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:21:10.228564 25559 raft_consensus.cc:2955] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 26 LEADER]: Committing config change with OpId 26.19: config changed from index 18 to 19, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:10.240713 17360 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:10.240197 17394 raft_consensus.cc:2955] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 18 to 19, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:10.246904 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.248770 25560 consensus_queue.cc:1048] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:21:10.253371 17206 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff6cbb1194424d7fb250bdb904d367ab with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:10.259639 17992 raft_consensus.cc:2955] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 18 to 19, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:10.275955 17215 catalog_manager.cc:5697] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 18 to 19, VOTER 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1) evicted. New cstate: current_term: 26 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:10.276641 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:10.294974 25333 raft_consensus.cc:2955] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index 14 to 15, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:10.301723 17394 raft_consensus.cc:2955] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 14 to 15, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:10.323410 17215 catalog_manager.cc:5697] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 reported cstate change: config changed from index 14 to 15, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
I20260709 13:21:10.335490 17992 raft_consensus.cc:2955] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 14 to 15, 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } } }
W20260709 13:21:10.368727 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:10.401427 17204 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.15.208.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 56420.4us
W20260709 13:21:10.405900 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff6cbb1194424d7fb250bdb904d367ab: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:10.467006 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:10.499600 17360 consensus_peers.cc:597] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:10.571329 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:10.641966 17962 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.666343 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:10.770961 17434 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.818434 17434 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:10.910771 17360 consensus_peers.cc:597] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.969347 16192 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:10.971843 17434 consensus_peers.cc:597] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:11.162439 17434 consensus_peers.cc:597] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.179040 17360 consensus_peers.cc:597] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:11.182190 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:11.198808 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:11.221100 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:11.337014 17360 consensus_peers.cc:597] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:11.417950 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:11.448130 17360 consensus_peers.cc:597] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.527068 17360 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:11.590487 17360 consensus_peers.cc:597] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:11.605525 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:11.618608 17360 consensus_peers.cc:597] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.657673 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff6cbb1194424d7fb250bdb904d367ab: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:11.681154 17360 consensus_peers.cc:597] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.713318 17360 consensus_peers.cc:597] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.919767 17360 consensus_peers.cc:597] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:11.933497 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:11.969857 16192 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:12.003098 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58046.7us
W20260709 13:21:12.023103 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 84170us
W20260709 13:21:12.057650 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 46212.8us
W20260709 13:21:12.071533 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.112349 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 102309us
W20260709 13:21:12.137247 17434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:34493, user_credentials={real_user=slave}} blocked reactor thread for 125259us
W20260709 13:21:12.145401 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.146013 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.160046 17360 consensus_peers.cc:597] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:12.165349 17360 consensus_peers.cc:597] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.165762 17360 consensus_peers.cc:597] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:12.212227 17434 consensus_peers.cc:597] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:12.221565 17362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 51298us
W20260709 13:21:12.260592 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.292814 17360 consensus_peers.cc:597] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.300302 17434 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:12.318602 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.601645 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.681427 17360 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.721436 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.743012 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.761926 17204 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111) [suppressed 458 similar messages]
W20260709 13:21:12.785300 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff6cbb1194424d7fb250bdb904d367ab: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:12.786885 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.810740 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.866354 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.869251 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:12.870287 17360 consensus_peers.cc:597] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.969925 18020 debug-util.cc:398] Leaking SignalData structure 0x7b08002db1e0 after lost signal to thread 16195
W20260709 13:21:12.971298 18020 debug-util.cc:398] Leaking SignalData structure 0x7b0800365a00 after lost signal to thread 17254
W20260709 13:21:12.972918 16192 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:12.975164 18020 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed000 after lost signal to thread 17421
W20260709 13:21:12.976574 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:12.981392 18020 debug-util.cc:398] Leaking SignalData structure 0x7b0800370980 after lost signal to thread 17495
W20260709 13:21:12.982820 18020 debug-util.cc:398] Leaking SignalData structure 0x7b080042d680 after lost signal to thread 18023
W20260709 13:21:13.037122 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:13.081385 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:13.116937 17434 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:13.118785 17434 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.292152 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:13.329407 17360 consensus_peers.cc:597] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.332463 17962 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.524143 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:13.540747 17360 consensus_peers.cc:597] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:13.557989 17434 consensus_peers.cc:597] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:13.649863 17434 consensus_peers.cc:597] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.674495 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:13.688723 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:13.799083 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:13.812184 17360 consensus_peers.cc:597] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:13.930881 17360 consensus_peers.cc:597] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.973428 16192 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:14.062668 17360 consensus_peers.cc:597] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:14.055838 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:14.143688 17360 consensus_peers.cc:597] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:14.156412 17360 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:14.334041 17963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 67145.3us
W20260709 13:21:14.351249 17360 consensus_peers.cc:597] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:14.407025 17360 consensus_peers.cc:597] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:14.433414 17360 consensus_peers.cc:597] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:14.515895 17360 consensus_peers.cc:597] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:14.577950 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:14.606549 17360 consensus_peers.cc:597] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:14.616870 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:14.629117 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:14.647482 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:14.726737 17360 consensus_peers.cc:597] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:14.731640 17434 consensus_peers.cc:597] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:14.794312 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:14.907852 17360 consensus_peers.cc:597] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:14.916101 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff6cbb1194424d7fb250bdb904d367ab: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:14.938711 17434 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:14.973927 16192 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:15.014021 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.059098 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.061196 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.135699 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.185753 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.204602 17360 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.225284 17964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:33147, user_credentials={real_user=slave}} blocked reactor thread for 79834.9us
W20260709 13:21:15.259963 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.287290 17360 consensus_peers.cc:597] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.302284 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:15.411911 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.574472 17434 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.644986 17434 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:15.653460 17360 consensus_peers.cc:597] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:15.693135 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.722345 17962 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:15.822796 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.839134 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.905148 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:15.968122 17360 consensus_peers.cc:597] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:15.974911 16192 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:15.976948 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:16.077814 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:16.129550 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:16.203487 17434 consensus_peers.cc:597] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:16.346393 17434 consensus_peers.cc:597] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:16.427003 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:16.430056 17360 consensus_peers.cc:597] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:16.561100 17360 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:16.561890 17360 consensus_peers.cc:597] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:16.649065 17360 consensus_peers.cc:597] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:16.675706 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:16.704442 17360 consensus_peers.cc:597] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:16.733923 17360 consensus_peers.cc:597] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:16.845542 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:16.975399 16192 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:16.983129 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.043608 17360 consensus_peers.cc:597] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:17.056074 17360 consensus_peers.cc:597] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:17.154206 17360 consensus_peers.cc:597] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.169737 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.185371 17360 consensus_peers.cc:597] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:17.191391 17434 consensus_peers.cc:597] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:17.218771 17360 consensus_peers.cc:597] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:17.237515 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.271143 17360 consensus_peers.cc:597] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.485040 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.536334 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.633613 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.664553 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.694885 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.707911 17434 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:17.759083 17360 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.771150 17434 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111) [suppressed 447 similar messages]
W20260709 13:21:17.973277 17360 consensus_peers.cc:597] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:17.975924 16192 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:18.014909 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:18.050338 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:18.055617 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:18.066861 17434 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:18.082546 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:18.182888 17434 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:18.192225 17962 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:18.267869 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:18.441495 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:18.453574 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:18.461136 17360 consensus_peers.cc:597] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:18.525311 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:18.571475 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:18.585788 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:18.592664 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:18.766531 17360 consensus_peers.cc:597] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:18.799500 17434 consensus_peers.cc:597] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:18.864955 17360 consensus_peers.cc:597] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:18.930490 17360 consensus_peers.cc:597] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:18.976800 16192 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:18.977530 17360 consensus_peers.cc:597] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:19.096139 17434 consensus_peers.cc:597] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:19.101703 17360 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:19.104110 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:19.120635 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff6cbb1194424d7fb250bdb904d367ab: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:19.145112 17360 consensus_peers.cc:597] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:19.280336 17360 consensus_peers.cc:597] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:19.349712 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:19.370574 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:19.420322 17360 consensus_peers.cc:597] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:19.436910 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:19.473181 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:19.557410 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:19.570159 17360 consensus_peers.cc:597] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:19.620101 17360 consensus_peers.cc:597] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:19.624567 17360 consensus_peers.cc:597] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:19.636329 17360 consensus_peers.cc:597] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:19.657861 17434 consensus_peers.cc:597] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:19.880198 17360 consensus_peers.cc:597] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:19.896587 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:19.977342 16192 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 17343)
W20260709 13:21:19.989516 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.216322 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 53404.9us
W20260709 13:21:20.238046 17360 consensus_peers.cc:597] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.270263 17434 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:20.287973 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.323874 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.477373 17360 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.507303 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.550110 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.577442 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.584316 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.584995 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.735196 17434 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:20.749821 17434 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:20.784965 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:20.799628 17962 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:20.849023 17360 consensus_peers.cc:597] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:20.982111 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:21.017186 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:21.084700 17360 consensus_peers.cc:597] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:21.135604 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:21.136620 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:21.261257 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:21.348049 17360 consensus_peers.cc:597] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:21.372267 17360 consensus_peers.cc:597] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:21.398566 17434 consensus_peers.cc:597] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:21.461745 17434 consensus_peers.cc:597] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:21.463688 17360 consensus_peers.cc:597] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:21.466495 17360 consensus_peers.cc:597] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:21.527809 17360 consensus_peers.cc:597] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:21.545156 17360 consensus_peers.cc:597] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:21.594269 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:21.679306 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:21.785784 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:21.825133 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:21.820647 17360 consensus_peers.cc:597] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:21.843185 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:21.977322 16192 tablet_server.cc:196] TabletServer@127.15.208.1:0 shutdown complete.
W20260709 13:21:22.057310 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:22.060997 17360 consensus_peers.cc:597] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:22.112709 17360 consensus_peers.cc:597] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:22.129125 17360 consensus_peers.cc:597] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:22.181202 17360 consensus_peers.cc:597] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:22.194216 17360 consensus_peers.cc:597] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:22.318509 17360 consensus_peers.cc:597] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:22.336898 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:22.393641 16192 tablet_server.cc:179] TabletServer@127.15.208.2:0 shutting down...
W20260709 13:21:22.404721 17963 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.424924 17963 consensus_peers.cc:597] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.472728 17435 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.483129 17435 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.526939 17209 maintenance_manager.cc:419] P 6a4082b2c6894817acb2d2a07603a4d6: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033335
W20260709 13:21:22.543071 17435 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.544551 17435 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.579783 17963 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.581480 17435 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.588798 17963 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.589664 17963 consensus_peers.cc:597] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.594249 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:21:22.594988 17435 consensus_peers.cc:597] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.597193 16192 tablet_replica.cc:333] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.598347 16192 raft_consensus.cc:2243] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:22.599442 17963 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.608369 16192 raft_consensus.cc:2272] T 1e69b6a14a654bac9e2288b25123fc4b P c23a664ebf3347a4934dee377c8b5101 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.613561 16192 tablet_replica.cc:333] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.614569 16192 raft_consensus.cc:2243] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.616240 16192 raft_consensus.cc:2272] T 77bea333b0644080b6a74f153a5f03c5 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.628489 16192 tablet_replica.cc:333] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.629468 16192 raft_consensus.cc:2243] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.630882 16192 raft_consensus.cc:2272] T 4df43493289c4586a02bce2e14a38202 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.633924 16192 tablet_replica.cc:333] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.634881 16192 raft_consensus.cc:2243] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.635545 16192 raft_consensus.cc:2272] T b5bcc05e009f492a9e252332680b738b P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:22.637506 17435 consensus_peers.cc:597] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.648228 17435 consensus_peers.cc:597] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.648983 17435 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.659296 16192 tablet_replica.cc:333] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.660373 16192 raft_consensus.cc:2243] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.661125 16192 raft_consensus.cc:2272] T 96336e4c5eb64d4d967c671c9a221e69 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.664319 16192 tablet_replica.cc:333] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.665232 16192 raft_consensus.cc:2243] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:21:22.671995 17963 consensus_peers.cc:597] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.684907 16192 raft_consensus.cc:2272] T 8c3bd226d2e04278bed4c50c89f1f5bd P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.690079 16192 tablet_replica.cc:333] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.691097 16192 raft_consensus.cc:2243] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.692420 16192 raft_consensus.cc:2272] T ff504a0c820741ecb08279a255054a6c P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.695393 16192 tablet_replica.cc:333] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.701709 16192 raft_consensus.cc:2243] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.702831 16192 raft_consensus.cc:2272] T 5fc026cf7a3b43b3a05aca657efbaecd P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.709185 16192 tablet_replica.cc:333] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.710112 16192 raft_consensus.cc:2243] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.721849 16192 raft_consensus.cc:2272] T 16a281c8bb174a28b9e029139de7e00b P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.725769 16192 tablet_replica.cc:333] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
W20260709 13:21:22.719758 17963 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.726640 16192 raft_consensus.cc:2243] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.727468 16192 raft_consensus.cc:2272] T 5d53d8e9fcbb4d1b901628952a056ffb P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.715794 17208 maintenance_manager.cc:643] P 6a4082b2c6894817acb2d2a07603a4d6: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.188s	user 0.037s	sys 0.011s Metrics: {"bytes_written":7448,"delete_count":0,"lbm_write_time_us":5887,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":17133,"threads_started":1,"update_count":301,"wal-append.queue_time_us":16850}
I20260709 13:21:22.730818 16192 tablet_replica.cc:333] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.731508 17209 maintenance_manager.cc:419] P 6a4082b2c6894817acb2d2a07603a4d6: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.377455
I20260709 13:21:22.731750 16192 raft_consensus.cc:2243] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.736311 16192 raft_consensus.cc:2272] T ef8ac3d116f3443db6462f3a86ce1432 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.747794 16192 tablet_replica.cc:333] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.748971 16192 raft_consensus.cc:2243] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.750808 16192 raft_consensus.cc:2272] T cd74e04425094277971ef1f372f80d50 P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.754060 16192 tablet_replica.cc:333] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.759781 16192 raft_consensus.cc:2243] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.761721 16192 raft_consensus.cc:2272] T 2679735faeb64bcf9031060956c1e1b9 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.770318 16192 tablet_replica.cc:333] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.771311 16192 raft_consensus.cc:2243] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.772461 16192 raft_consensus.cc:2272] T 34cf7d4eca6445628c0af4ea7b65f11b P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:22.772819 17435 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 437 similar messages]
I20260709 13:21:22.775315 16192 tablet_replica.cc:333] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
W20260709 13:21:22.775555 17435 consensus_peers.cc:597] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:22.776281 17963 consensus_peers.cc:597] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.785902 16192 raft_consensus.cc:2243] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.786768 16192 raft_consensus.cc:2272] T 7bb3b6f88d9b4423a689bae4e9e59333 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.790318 16192 tablet_replica.cc:333] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.791225 16192 raft_consensus.cc:2243] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.792457 16192 raft_consensus.cc:2272] T bd3f7b090266450da9f53ec675edc8f0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:22.793008 17435 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.795363 16192 tablet_replica.cc:333] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.803239 16192 raft_consensus.cc:2243] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.805063 16192 raft_consensus.cc:2272] T 15143e49c9844f47911ff4266f078b54 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.808183 16192 tablet_replica.cc:333] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.821463 16192 raft_consensus.cc:2243] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.822649 16192 raft_consensus.cc:2272] T 3d0cd72466fe4edf8e126347432dbccb P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.827502 16192 tablet_replica.cc:333] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
W20260709 13:21:22.827693 17435 consensus_peers.cc:597] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.828433 16192 raft_consensus.cc:2243] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:21:22.829244 17963 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.830011 16192 raft_consensus.cc:2272] T 96a5582b6bfb4ac592225b49ce6df9be P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.834113 16192 tablet_replica.cc:333] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
W20260709 13:21:22.839296 17435 consensus_peers.cc:597] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.839828 16192 raft_consensus.cc:2243] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.842414 16192 raft_consensus.cc:2272] T 72154b87dcf145b2aeae9bf915b34ce0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.850831 16192 tablet_replica.cc:333] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.852198 16192 raft_consensus.cc:2243] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:22.853271 17435 consensus_peers.cc:597] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.853597 16192 raft_consensus.cc:2272] T 457e80c2d06f4623a397b7b3d6190f05 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.856769 16192 tablet_replica.cc:333] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.865545 16192 raft_consensus.cc:2243] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.867056 16192 raft_consensus.cc:2272] T 24bd9827b3204adba8158c0366088793 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:22.867203 17434 consensus_peers.cc:597] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:22.878893 17435 consensus_peers.cc:597] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:22.880463 16192 tablet_replica.cc:333] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.881691 16192 raft_consensus.cc:2243] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:22.882544 16192 raft_consensus.cc:2272] T 622554a5186d4910b8476a653411c85d P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.886638 16192 tablet_replica.cc:333] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:22.896647 16192 raft_consensus.cc:2243] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:21:22.898980 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:22.900557 16192 raft_consensus.cc:2272] T 4295303b785442b287bf068dfd2e160c P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:22.946734 16192 tablet_replica.cc:333] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
W20260709 13:21:22.951498 17360 consensus_peers.cc:597] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:22.950439 16192 raft_consensus.cc:2243] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:22.959012 16192 raft_consensus.cc:2272] T a7e1f8f7b0e44cc38e154e294927d7ff P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:22.970851 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:22.997450 16192 tablet_replica.cc:333] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.007611 16192 raft_consensus.cc:2243] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.013616 16192 raft_consensus.cc:2272] T b59d252a868a4ba8bc72588a2ae450b2 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.016973 16192 tablet_replica.cc:333] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.017879 16192 raft_consensus.cc:2243] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:23.019313 16192 raft_consensus.cc:2272] T 7c3c6f4045794af59b877ad412ae6450 P c23a664ebf3347a4934dee377c8b5101 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.022162 16192 tablet_replica.cc:333] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.022984 16192 raft_consensus.cc:2243] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:23.024103 16192 raft_consensus.cc:2272] T 58b200038e814f72ae96c61b0e1dd286 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.026898 16192 tablet_replica.cc:333] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.027665 16192 raft_consensus.cc:2243] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.028949 16192 raft_consensus.cc:2272] T ff6cbb1194424d7fb250bdb904d367ab P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.036172 16192 tablet_replica.cc:333] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.037113 16192 raft_consensus.cc:2243] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:23.038542 16192 raft_consensus.cc:2272] T af5b45fab0a7463d90e9b2fec8241e1a P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.041273 16192 tablet_replica.cc:333] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.042037 16192 raft_consensus.cc:2243] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.042770 16192 raft_consensus.cc:2272] T 96090377e5474346a1e4fdadd3c4c7ab P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.046005 16192 tablet_replica.cc:333] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.046810 16192 raft_consensus.cc:2243] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.047446 16192 raft_consensus.cc:2272] T 6c0241098ae744cbae27ac900424b754 P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.050623 16192 tablet_replica.cc:333] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.051519 16192 raft_consensus.cc:2243] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.052439 16192 raft_consensus.cc:2272] T 3c3278087b524fbab2103bd52cc56710 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.055207 16192 tablet_replica.cc:333] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.055994 16192 raft_consensus.cc:2243] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.056653 16192 raft_consensus.cc:2272] T 452dfe9db12345ae88b3dbbd163f480e P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.059813 16192 tablet_replica.cc:333] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.060695 16192 raft_consensus.cc:2243] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.061653 16192 raft_consensus.cc:2272] T 213e74ac16bb4f19b434bdd25b7bd3af P c23a664ebf3347a4934dee377c8b5101 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.064718 16192 tablet_replica.cc:333] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.065471 16192 raft_consensus.cc:2243] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.066272 16192 raft_consensus.cc:2272] T 128956e308c048a2af21fae67c6683ef P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.068893 16192 tablet_replica.cc:333] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.069679 16192 raft_consensus.cc:2243] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.070416 16192 raft_consensus.cc:2272] T 984feea4e2564e57923c946b7572e2a0 P c23a664ebf3347a4934dee377c8b5101 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.073161 16192 tablet_replica.cc:333] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.074146 16192 raft_consensus.cc:2243] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:23.076704 16192 raft_consensus.cc:2272] T 2e1a5ebc1019411290bc16a4e1cab89b P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.087917 16192 tablet_replica.cc:333] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
W20260709 13:21:23.093863 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:23.098420 16192 raft_consensus.cc:2243] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.099953 16192 raft_consensus.cc:2272] T 7601a632a565453b83b93c1020924101 P c23a664ebf3347a4934dee377c8b5101 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.102952 16192 tablet_replica.cc:333] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
W20260709 13:21:23.098580 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:23.111238 16192 raft_consensus.cc:2243] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:23.112638 16192 raft_consensus.cc:2272] T 036c02de798949eeb02d27e9dd520825 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.127821 16192 tablet_replica.cc:333] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.131119 16192 raft_consensus.cc:2243] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:23.138062 16192 raft_consensus.cc:2272] T 1b85187304c149c58d33a53cb3005a02 P c23a664ebf3347a4934dee377c8b5101 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.143620 16192 tablet_replica.cc:333] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.146131 16192 raft_consensus.cc:2243] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:23.151542 16192 raft_consensus.cc:2272] T c824a7378ba243ca96d57d97c47847c9 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:23.150269 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2679735faeb64bcf9031060956c1e1b9: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:23.154922 16192 tablet_replica.cc:333] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.155719 16192 raft_consensus.cc:2243] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.156662 16192 raft_consensus.cc:2272] T 132676f9343f4733b4f07f4587384a56 P c23a664ebf3347a4934dee377c8b5101 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.161557 16192 tablet_replica.cc:333] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
W20260709 13:21:23.168042 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:23.171380 16192 raft_consensus.cc:2243] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:23.181883 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:23.193867 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:23.196952 17962 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:23.203464 16192 raft_consensus.cc:2272] T 9ecbe40a17fe40b69ac2ecffb5e51786 P c23a664ebf3347a4934dee377c8b5101 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.214255 16192 tablet_replica.cc:333] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.217480 16192 raft_consensus.cc:2243] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:23.229928 16192 raft_consensus.cc:2272] T 6758d139882843e5bddc827c260b81a9 P c23a664ebf3347a4934dee377c8b5101 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.235709 16192 tablet_replica.cc:333] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.241528 16192 raft_consensus.cc:2243] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:23.243103 16192 raft_consensus.cc:2272] T b19033ecd72e4ba188910445b70c84d5 P c23a664ebf3347a4934dee377c8b5101 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:23.220916 17208 maintenance_manager.cc:643] P 6a4082b2c6894817acb2d2a07603a4d6: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.486s	user 0.101s	sys 0.031s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":28623,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":66418,"dirs.run_cpu_time_us":548,"dirs.run_wall_time_us":3803,"lbm_read_time_us":2700,"lbm_reads_lt_1ms":26,"lbm_write_time_us":10569,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":11,"peak_mem_usage":315275,"reinsert_count":0,"thread_start_us":66819,"threads_started":2,"update_count":325}
I20260709 13:21:23.249145 17209 maintenance_manager.cc:419] P 6a4082b2c6894817acb2d2a07603a4d6: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:21:23.250038 17208 maintenance_manager.cc:643] P 6a4082b2c6894817acb2d2a07603a4d6: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 13:21:23.246095 16192 tablet_replica.cc:333] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101: stopping tablet replica
I20260709 13:21:23.273563 16192 raft_consensus.cc:2243] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:23.274842 16192 raft_consensus.cc:2272] T 8c4c351b74b044eab8a6561b3eb27a1b P c23a664ebf3347a4934dee377c8b5101 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:23.401520 17434 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:23.407202 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:23.508335 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:23.518589 17963 connection.cc:573] client connection to 127.15.208.2:33079 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:21:23.557510 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:23.598727 17434 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:23.687335 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:23.753974 25649 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:23.754635 25649 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:23.768911 17434 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:23.776151 25649 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:23.794720 17435 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:23.796135 17435 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:23.798193 25649 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:23.853993 25634 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:23.854627 25634 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:23.857338 25622 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:23.857899 25622 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:23.860224 25622 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:23.863538 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:21:23.869642 17962 leader_election.cc:336] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:23.875336 25634 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:23.875923 17963 leader_election.cc:336] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:23.876729 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:23.878625 25634 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:23.880874 25634 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:23.881408 25634 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:23.889854 17962 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:23.894083 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:23.895797 25634 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:23.896409 17963 leader_election.cc:336] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:23.904901 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:23.906575 25634 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:23.920257 17963 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:23.921445 17963 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:23.925879 25622 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:23.969401 25648 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:23.970021 25648 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:23.972174 25648 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:23.977895 25649 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:23.978470 25649 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:23.989352 25634 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:23.989997 25634 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:23.992285 25634 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:23.980743 25649 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:23.994155 25649 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:23.997908 25649 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:24.000320 25649 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:23.997291 17435 leader_election.cc:336] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:24.001571 17435 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:24.003127 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:24.030241 17435 leader_election.cc:336] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:24.034322 17963 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:24.037102 17434 leader_election.cc:336] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.041148 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.042184 25653 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:24.042268 17434 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.045027 17434 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.047374 25653 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:24.059568 25648 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.060137 25648 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:24.062306 25648 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:24.063799 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:21:24.067881 17435 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.079445 25622 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.080222 25622 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.083984 25622 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:24.093547 17964 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:24.094636 17963 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.097074 25634 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:24.105597 17962 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.107266 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:24.106729 17434 leader_election.cc:336] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.108188 17434 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.109033 25653 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:24.109899 25622 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:24.120584 17434 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.121196 17434 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.122251 25653 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:24.124915 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:24.134060 25653 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.134624 25653 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.137248 25653 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:24.138255 25622 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.138890 25622 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.141755 25648 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.142295 25648 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:24.144625 17435 leader_election.cc:336] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.144251 25648 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:24.147953 17963 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:24.150643 17435 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:24.150822 17962 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.151348 17962 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.152559 25622 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:24.153263 25634 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:24.158772 17993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:24.159389 17993 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 23.
I20260709 13:21:24.159636 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:24.160616 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:24.161276 17992 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 25.
I20260709 13:21:24.164872 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.165678 25653 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:24.166060 25653 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.166427 25653 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:24.175235 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.176121 25648 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:24.176510 25648 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.176892 25648 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:24.183890 25653 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.185437 25648 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.187896 25653 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:24.189401 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a281c8bb174a28b9e029139de7e00b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:21:24.190135 17992 raft_consensus.cc:3060] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:24.191959 17435 leader_election.cc:336] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.197746 17992 raft_consensus.cc:2468] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
W20260709 13:21:24.200194 17435 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.201872 25648 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:24.202186 17434 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.203644 25622 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.203912 25649 raft_consensus.cc:2804] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:24.204174 25622 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.206276 25622 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:24.206723 25622 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.207160 25622 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.213685 25655 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.214365 25655 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:24.213622 25649 raft_consensus.cc:697] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:21:24.215759 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b200038e814f72ae96c61b0e1dd286" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:21:24.191897 25653 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.216454 17992 raft_consensus.cc:3060] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:24.216615 25653 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.216887 25649 consensus_queue.cc:237] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:24.223353 17435 leader_election.cc:336] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:24.223541 17963 leader_election.cc:336] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.227000 25622 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:24.223393 17992 raft_consensus.cc:2468] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 26.
I20260709 13:21:24.228152 25655 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:24.229611 17434 leader_election.cc:336] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:24.226050 17962 leader_election.cc:336] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.230103 25655 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.230698 25653 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:24.232609 17435 leader_election.cc:336] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.230765 25655 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:24.233045 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.234900 25655 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:24.235249 17963 leader_election.cc:336] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.230362 17962 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:24.248648 17962 leader_election.cc:336] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.249015 25622 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:24.249142 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:24.250078 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:24.251639 25657 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.252358 25654 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:24.252223 25657 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:24.254755 25657 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:24.240386 25648 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:24.255391 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:21:24.239286 17434 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:24.270339 17435 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.271831 17434 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.277923 25648 raft_consensus.cc:2804] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:24.278389 25648 raft_consensus.cc:697] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 26 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:21:24.278422 17434 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.279402 25648 consensus_queue.cc:237] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.281121 25657 raft_consensus.cc:2749] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:24.286341 17434 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.289739 25634 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.290347 25634 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.277034 25649 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.298609 17464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:24.291383 25649 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:24.304913 25634 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:24.305562 17963 leader_election.cc:336] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.306031 17963 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.305428 17214 catalog_manager.cc:5697] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 23 to 24, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 24 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.307305 25622 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:24.308037 25622 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.308518 25622 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.310047 17435 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:24.314273 17435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:33079, user_credentials={real_user=slave}} blocked reactor thread for 58905us
I20260709 13:21:24.313458 25649 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:24.312951 25622 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:24.315059 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
W20260709 13:21:24.316056 17963 leader_election.cc:336] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.316998 25655 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:24.318655 17469 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 21.
I20260709 13:21:24.320961 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.322077 25622 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:24.322463 25622 raft_consensus.cc:493] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.322826 25622 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:24.330468 25622 raft_consensus.cc:515] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.342543 25655 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.343357 25649 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:21:24.344504 17434 leader_election.cc:336] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.346127 25655 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:24.346247 25649 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.348176 25655 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:24.348205 25649 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:24.349877 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:24.350593 17992 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 20.
W20260709 13:21:24.351884 17434 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.353156 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:21:24.353976 25655 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:24.354391 25655 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:21:24.345484 17435 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.354800 25655 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:24.354974 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
W20260709 13:21:24.357000 17963 leader_election.cc:336] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.363699 25655 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.367219 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bd9827b3204adba8158c0366088793" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:24.367859 17469 raft_consensus.cc:3060] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:24.368218 17435 leader_election.cc:336] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.364637 25622 leader_election.cc:290] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:24.368678 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.369469 25649 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:24.368469 25655 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:24.367358 25648 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:24.372987 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824a7378ba243ca96d57d97c47847c9" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160"
I20260709 13:21:24.373612 17992 raft_consensus.cc:3060] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:24.379429 17469 raft_consensus.cc:2468] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 22.
I20260709 13:21:24.380192 17992 raft_consensus.cc:2468] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 21.
I20260709 13:21:24.382767 17964 leader_election.cc:304] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.384178 25634 raft_consensus.cc:2804] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:24.381785 17434 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:21:24.384650 25634 raft_consensus.cc:697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:21:24.385623 25634 consensus_queue.cc:237] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.386216 25655 raft_consensus.cc:2804] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:24.386938 25655 raft_consensus.cc:697] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Becoming Leader. State: Replica: b7108577e5754060b7e468a43dfdcdeb, State: Running, Role: LEADER
I20260709 13:21:24.387838 25655 consensus_queue.cc:237] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:24.393832 17434 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:24.397372 25648 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.397955 25648 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.400167 25648 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
I20260709 13:21:24.401446 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
W20260709 13:21:24.407212 17435 leader_election.cc:336] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:24.418183 17435 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.419428 17435 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.423642 25655 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:24.424877 17435 leader_election.cc:336] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.426806 17214 catalog_manager.cc:5697] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 25 to 26, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 26 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.428576 17214 catalog_manager.cc:5697] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb reported cstate change: term changed from 20 to 21, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to b7108577e5754060b7e468a43dfdcdeb (127.15.208.3). New cstate: current_term: 21 leader_uuid: "b7108577e5754060b7e468a43dfdcdeb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.437956 17219 catalog_manager.cc:5697] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 21 to 22, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 22 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:24.445142 17435 leader_election.cc:336] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.445750 17435 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 3747096bb5074ea2bf86037fd17c1160, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.446506 25648 raft_consensus.cc:2749] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:24.459257 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:24.471194 25634 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.471738 25634 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.473881 25634 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:24.475140 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb" is_pre_election: true
I20260709 13:21:24.475801 17469 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 17.
I20260709 13:21:24.476872 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 
I20260709 13:21:24.478065 25634 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:24.478451 25634 raft_consensus.cc:493] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
W20260709 13:21:24.479102 17963 leader_election.cc:336] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.478860 25634 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:24.499780 25634 raft_consensus.cc:515] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:24.502126 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:24.508750 17963 leader_election.cc:336] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.512722 25634 leader_election.cc:290] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Requested vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:24.513671 17469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4c351b74b044eab8a6561b3eb27a1b" candidate_uuid: "3747096bb5074ea2bf86037fd17c1160" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7108577e5754060b7e468a43dfdcdeb"
I20260709 13:21:24.514279 17469 raft_consensus.cc:3060] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:24.522807 17469 raft_consensus.cc:2468] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3747096bb5074ea2bf86037fd17c1160 in term 18.
I20260709 13:21:24.527717 17964 leader_election.cc:304] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.529318 25639 raft_consensus.cc:2804] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:24.530094 25639 raft_consensus.cc:697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Becoming Leader. State: Replica: 3747096bb5074ea2bf86037fd17c1160, State: Running, Role: LEADER
I20260709 13:21:24.532315 25639 consensus_queue.cc:237] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:24.537299 17434 consensus_peers.cc:597] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:24.541718 16192 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17418)
I20260709 13:21:24.542973 25655 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.543768 25655 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:24.548871 25634 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:24.549553 25634 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:24.552127 17435 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.553359 25655 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:24.562721 17962 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.565382 17992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:24.566051 17992 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
W20260709 13:21:24.571564 17963 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:24.572170 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.573710 25622 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:24.595489 25634 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:24.608104 17434 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:24.610332 17434 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:24.611234 25648 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:24.626783 17219 catalog_manager.cc:5697] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 reported cstate change: term changed from 17 to 18, leader changed from c23a664ebf3347a4934dee377c8b5101 (127.15.208.2) to 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4). New cstate: current_term: 18 leader_uuid: "3747096bb5074ea2bf86037fd17c1160" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:24.674903 17963 consensus_peers.cc:597] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:24.679549 17435 consensus_peers.cc:597] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.680886 17434 consensus_peers.cc:597] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:24.739218 17435 consensus_peers.cc:597] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.768000 17434 consensus_peers.cc:597] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:25.290356 17434 consensus_peers.cc:597] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:25.291102 17434 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:25.311231 25655 raft_consensus.cc:493] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:25.333249 25655 raft_consensus.cc:515] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:25.335739 17992 raft_consensus.cc:1275] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:21:25.336100 25655 leader_election.cc:290] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:25.319919 17963 consensus_peers.cc:597] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.337234 17963 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:25.337626 17992 raft_consensus.cc:1275] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
W20260709 13:21:25.338790 17963 consensus_peers.cc:597] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:25.339497 17963 consensus_peers.cc:597] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:25.341413 17963 consensus_peers.cc:597] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:25.342824 17466 raft_consensus.cc:1275] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260709 13:21:25.346463 17435 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:25.346524 17992 raft_consensus.cc:1275] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Refusing update from remote peer b7108577e5754060b7e468a43dfdcdeb: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 13:21:25.347364 17963 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.354465 17435 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.356743 17435 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.357486 17435 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.358134 17435 consensus_peers.cc:597] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.358675 17435 consensus_peers.cc:597] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:25.359294 17435 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.359858 17435 consensus_peers.cc:597] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:25.365692 17463 raft_consensus.cc:1275] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Refusing update from remote peer 3747096bb5074ea2bf86037fd17c1160: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:21:25.366807 17435 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:25.371111 17963 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.371690 17963 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.376374 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:25.377096 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:25.379516 25671 consensus_queue.cc:1048] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:21:25.386070 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:25.395337 25671 consensus_queue.cc:1048] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:21:25.414281 17435 consensus_peers.cc:597] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:25.417948 25655 consensus_queue.cc:1048] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:25.420503 25655 consensus_queue.cc:1048] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:21:25.430217 25670 consensus_queue.cc:1048] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:21:25.432595 17434 leader_election.cc:336] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:25.433225 17434 leader_election.cc:304] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:25.434389 25670 raft_consensus.cc:2749] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:25.435604 25671 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:25.436196 25671 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:25.438561 25671 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:25.450002 17962 leader_election.cc:336] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:25.451057 17963 leader_election.cc:336] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:25.451627 17963 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:25.452574 25671 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:25.475178 17435 consensus_peers.cc:597] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.540263 17435 consensus_peers.cc:597] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:25.542372 25674 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:25.543084 25674 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:25.546871 25674 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:25.562270 17435 consensus_peers.cc:597] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.562427 17963 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:25.566349 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:25.566959 17435 consensus_peers.cc:597] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.573226 17962 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:25.575263 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:25.581568 25671 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:25.628387 25671 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:25.629120 25671 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:25.636366 17963 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:25.645147 17962 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:25.646237 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:25.645707 25671 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:25.647104 25639 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:25.648726 17434 consensus_peers.cc:597] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:25.649114 17435 consensus_peers.cc:597] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.658766 17963 consensus_peers.cc:597] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.669122 17435 consensus_peers.cc:597] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.706491 17963 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:25.712605 25649 raft_consensus.cc:493] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:25.713230 25649 raft_consensus.cc:515] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:25.717505 25649 leader_election.cc:290] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:25.724599 17435 leader_election.cc:336] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:25.726977 17434 leader_election.cc:336] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:25.727473 17434 leader_election.cc:304] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:25.728665 25649 raft_consensus.cc:2749] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:25.749109 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:25.751701 17962 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:25.761348 25649 raft_consensus.cc:493] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:25.762009 25649 raft_consensus.cc:515] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:25.777333 17435 leader_election.cc:336] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:25.783301 25649 leader_election.cc:290] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:25.792025 17963 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.797677 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800386e40 after lost signal to thread 16195
W20260709 13:21:25.798955 17251 debug-util.cc:398] Leaking SignalData structure 0x7b08003872c0 after lost signal to thread 17254
W20260709 13:21:25.800350 17251 debug-util.cc:398] Leaking SignalData structure 0x7b08003865c0 after lost signal to thread 17495
W20260709 13:21:25.801641 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800036260 after lost signal to thread 18023
W20260709 13:21:25.802163 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800036080 after lost signal to thread 25653
W20260709 13:21:25.809437 17434 leader_election.cc:336] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:25.810073 17434 leader_election.cc:304] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:25.832011 25668 raft_consensus.cc:2749] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:25.841334 17435 consensus_peers.cc:597] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:25.892990 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:25.937075 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:25.940053 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:25.972391 17434 consensus_peers.cc:597] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:25.992380 17434 consensus_peers.cc:597] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:25.998283 25649 raft_consensus.cc:493] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:25.998908 25649 raft_consensus.cc:515] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:26.009568 17434 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:26.011588 17435 leader_election.cc:336] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:26.012076 17435 leader_election.cc:304] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.013015 25649 leader_election.cc:290] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:26.013635 25668 raft_consensus.cc:2749] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:21:26.033478 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:26.080060 17434 consensus_peers.cc:597] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:26.130910 25649 raft_consensus.cc:493] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:26.131502 25649 raft_consensus.cc:515] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:26.133673 25649 leader_election.cc:290] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
I20260709 13:21:26.152402 25668 raft_consensus.cc:493] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:26.152922 25668 raft_consensus.cc:515] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:26.154803 25668 leader_election.cc:290] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:26.155627 17962 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:26.156116 25670 raft_consensus.cc:493] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:26.156685 25670 raft_consensus.cc:515] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:26.161844 25670 leader_election.cc:290] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:26.163856 17434 leader_election.cc:336] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:26.170137 17435 leader_election.cc:336] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:26.177134 17435 leader_election.cc:304] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.180907 25649 raft_consensus.cc:2749] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:26.180011 17434 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:26.195760 17434 leader_election.cc:336] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:26.197045 17435 leader_election.cc:336] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:26.197995 17435 leader_election.cc:304] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.210579 25649 raft_consensus.cc:2749] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:26.211589 17435 leader_election.cc:336] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:26.213863 17435 leader_election.cc:304] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.216691 25649 raft_consensus.cc:2749] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:26.291468 25649 raft_consensus.cc:493] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:26.292034 25649 raft_consensus.cc:515] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:26.294368 25649 leader_election.cc:290] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:26.310631 17434 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:26.312115 17435 leader_election.cc:336] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:26.312573 17435 leader_election.cc:304] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.313804 25649 raft_consensus.cc:2749] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:26.339720 25639 raft_consensus.cc:493] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:26.340408 25639 raft_consensus.cc:515] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:26.342748 25639 leader_election.cc:290] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:26.348165 17962 leader_election.cc:336] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:26.350117 17963 leader_election.cc:336] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:26.350561 17963 leader_election.cc:304] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.352207 25671 raft_consensus.cc:2749] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:26.375182 17434 consensus_peers.cc:597] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:26.383793 25668 raft_consensus.cc:493] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:26.384382 25668 raft_consensus.cc:515] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
I20260709 13:21:26.386217 25639 raft_consensus.cc:493] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:26.386773 25639 raft_consensus.cc:515] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:26.389724 25639 leader_election.cc:290] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:26.391582 17435 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:26.392423 25668 leader_election.cc:290] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:26.395529 17963 leader_election.cc:336] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:26.396546 17962 leader_election.cc:336] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:26.396960 17962 leader_election.cc:304] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.397660 25639 raft_consensus.cc:2749] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:26.399819 17434 leader_election.cc:336] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:26.400315 17434 leader_election.cc:304] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.401072 25668 raft_consensus.cc:2749] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:26.431123 17962 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:26.436033 25693 raft_consensus.cc:493] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:26.436640 25693 raft_consensus.cc:515] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:26.438901 25693 leader_election.cc:290] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:26.444432 17962 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:26.449347 17963 leader_election.cc:336] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:26.450363 17963 leader_election.cc:304] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.451541 25693 raft_consensus.cc:2749] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:26.452477 16192 tablet_server.cc:196] TabletServer@127.15.208.2:0 shutdown complete.
I20260709 13:21:26.462643 25668 raft_consensus.cc:493] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:26.463291 25668 raft_consensus.cc:515] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } attrs { replace: true } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:26.473939 17435 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:26.477453 17990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1a5ebc1019411290bc16a4e1cab89b" candidate_uuid: "b7108577e5754060b7e468a43dfdcdeb" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3747096bb5074ea2bf86037fd17c1160" is_pre_election: true
I20260709 13:21:26.478276 17990 raft_consensus.cc:2468] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7108577e5754060b7e468a43dfdcdeb in term 24.
I20260709 13:21:26.478538 25668 leader_election.cc:290] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), 3747096bb5074ea2bf86037fd17c1160 (127.15.208.4:34493)
W20260709 13:21:26.482354 17434 leader_election.cc:336] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:26.482905 17434 leader_election.cc:304] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160, b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.485905 25649 raft_consensus.cc:2749] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:26.525187 25649 raft_consensus.cc:493] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:26.525810 25649 raft_consensus.cc:515] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } }
W20260709 13:21:26.536191 17435 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:26.539963 25649 leader_election.cc:290] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:26.540787 17434 leader_election.cc:336] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:26.541311 17434 leader_election.cc:304] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7108577e5754060b7e468a43dfdcdeb; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:26.543898 25649 raft_consensus.cc:2749] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:26.731319 17434 consensus_peers.cc:597] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:21:26.750116 16192 tablet_server.cc:179] TabletServer@127.15.208.3:0 shutting down...
W20260709 13:21:26.768362 17964 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:26.777191 17962 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:26.801728 17964 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:26.853328 17962 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:26.863466 17964 consensus_peers.cc:597] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:26.864785 17964 consensus_peers.cc:597] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:26.865602 17964 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:26.869597 17964 consensus_peers.cc:597] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:26.895051 17964 consensus_peers.cc:597] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.907799 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:26.913838 16192 tablet_replica.cc:333] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.915853 16192 raft_consensus.cc:2243] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:26.917215 16192 raft_consensus.cc:2272] T 1e69b6a14a654bac9e2288b25123fc4b P b7108577e5754060b7e468a43dfdcdeb [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:26.920701 16192 tablet_replica.cc:333] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.921581 16192 raft_consensus.cc:2243] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:26.922812 16192 raft_consensus.cc:2272] T b5bcc05e009f492a9e252332680b738b P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:26.927652 16192 tablet_replica.cc:333] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.928468 16192 raft_consensus.cc:2243] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:26.930131 16192 raft_consensus.cc:2272] T 77bea333b0644080b6a74f153a5f03c5 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:26.933023 16192 tablet_replica.cc:333] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.933813 16192 raft_consensus.cc:2243] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:26.935562 17964 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.939225 16192 raft_consensus.cc:2272] T 8c3bd226d2e04278bed4c50c89f1f5bd P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:26.952710 16192 tablet_replica.cc:333] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.953626 16192 raft_consensus.cc:2243] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:26.954771 16192 raft_consensus.cc:2272] T 16a281c8bb174a28b9e029139de7e00b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:26.957386 16192 tablet_replica.cc:333] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.958256 16192 raft_consensus.cc:2243] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:26.958940 16192 raft_consensus.cc:2272] T cd74e04425094277971ef1f372f80d50 P b7108577e5754060b7e468a43dfdcdeb [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:26.959928 17964 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.962056 16192 tablet_replica.cc:333] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.964790 16192 raft_consensus.cc:2243] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:26.965919 16192 raft_consensus.cc:2272] T a20d82b49da74027abe144db7281b7b0 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:26.969092 16192 tablet_replica.cc:333] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
W20260709 13:21:26.969491 17964 consensus_peers.cc:597] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.970191 16192 raft_consensus.cc:2243] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:26.971417 16192 raft_consensus.cc:2272] T 2679735faeb64bcf9031060956c1e1b9 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:26.974658 16192 tablet_replica.cc:333] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.975497 16192 raft_consensus.cc:2243] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:26.976174 16192 raft_consensus.cc:2272] T 34cf7d4eca6445628c0af4ea7b65f11b P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:26.984097 16192 tablet_replica.cc:333] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.984977 16192 raft_consensus.cc:2243] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:26.986068 16192 raft_consensus.cc:2272] T 7bb3b6f88d9b4423a689bae4e9e59333 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:26.988765 16192 tablet_replica.cc:333] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.990826 16192 raft_consensus.cc:2243] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:26.991907 16192 raft_consensus.cc:2272] T 5d53d8e9fcbb4d1b901628952a056ffb P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:26.995275 16192 tablet_replica.cc:333] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:26.996133 16192 raft_consensus.cc:2243] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.002238 16192 raft_consensus.cc:2272] T b0bff337c6c8418e8fe0872b92f3bd6f P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:27.005767 17964 consensus_peers.cc:597] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.007055 16192 tablet_replica.cc:333] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.007942 16192 raft_consensus.cc:2243] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.008777 16192 raft_consensus.cc:2272] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.028250 16192 tablet_replica.cc:333] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.033871 16192 raft_consensus.cc:2243] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.035288 16192 raft_consensus.cc:2272] T c824a7378ba243ca96d57d97c47847c9 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.051189 16192 tablet_replica.cc:333] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.052099 16192 raft_consensus.cc:2243] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:21:27.056689 17964 consensus_peers.cc:597] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.059141 16192 raft_consensus.cc:2272] T 132676f9343f4733b4f07f4587384a56 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:27.059422 17434 consensus_peers.cc:597] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:27.064707 16192 tablet_replica.cc:333] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.065850 16192 raft_consensus.cc:2243] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.068027 16192 raft_consensus.cc:2272] T 457e80c2d06f4623a397b7b3d6190f05 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.074316 16192 tablet_replica.cc:333] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.075335 16192 raft_consensus.cc:2243] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.076802 16192 raft_consensus.cc:2272] T 72154b87dcf145b2aeae9bf915b34ce0 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.082589 16192 tablet_replica.cc:333] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.083459 16192 raft_consensus.cc:2243] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:21:27.090430 17964 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.084723 16192 raft_consensus.cc:2272] T 3d0cd72466fe4edf8e126347432dbccb P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.094216 16192 tablet_replica.cc:333] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.095155 16192 raft_consensus.cc:2243] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.096077 16192 raft_consensus.cc:2272] T 15143e49c9844f47911ff4266f078b54 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.098799 16192 tablet_replica.cc:333] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
W20260709 13:21:27.102268 17964 consensus_peers.cc:597] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.103235 16192 raft_consensus.cc:2243] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.104475 16192 raft_consensus.cc:2272] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.107259 16192 tablet_replica.cc:333] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.108011 16192 raft_consensus.cc:2243] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.109054 16192 raft_consensus.cc:2272] T 4295303b785442b287bf068dfd2e160c P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.118016 16192 tablet_replica.cc:333] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.119217 16192 raft_consensus.cc:2243] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.120112 16192 raft_consensus.cc:2272] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P b7108577e5754060b7e468a43dfdcdeb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.122713 16192 tablet_replica.cc:333] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.123486 16192 raft_consensus.cc:2243] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.124155 16192 raft_consensus.cc:2272] T 060ed925d51948b7b415b005543f7a9f P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.126879 16192 tablet_replica.cc:333] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.127653 16192 raft_consensus.cc:2243] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.128273 16192 raft_consensus.cc:2272] T 9ecbe40a17fe40b69ac2ecffb5e51786 P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.130894 16192 tablet_replica.cc:333] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
W20260709 13:21:27.136463 17964 consensus_peers.cc:597] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 -> Peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Couldn't send request to peer b7108577e5754060b7e468a43dfdcdeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.131644 16192 raft_consensus.cc:2243] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.137635 16192 raft_consensus.cc:2272] T a4c1e66c4a684159ae427b3705522c26 P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.140282 16192 tablet_replica.cc:333] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.141137 16192 raft_consensus.cc:2243] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.142235 16192 raft_consensus.cc:2272] T b59d252a868a4ba8bc72588a2ae450b2 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.145032 16192 tablet_replica.cc:333] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.145892 16192 raft_consensus.cc:2243] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.146736 16192 raft_consensus.cc:2272] T a7e1f8f7b0e44cc38e154e294927d7ff P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.149349 16192 tablet_replica.cc:333] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.150204 16192 raft_consensus.cc:2243] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.151046 16192 raft_consensus.cc:2272] T af5b45fab0a7463d90e9b2fec8241e1a P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.153786 16192 tablet_replica.cc:333] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.154639 16192 raft_consensus.cc:2243] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.155292 16192 raft_consensus.cc:2272] T 96090377e5474346a1e4fdadd3c4c7ab P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.158018 16192 tablet_replica.cc:333] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.158823 16192 raft_consensus.cc:2243] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.159408 16192 raft_consensus.cc:2272] T 6c0241098ae744cbae27ac900424b754 P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.162803 16192 tablet_replica.cc:333] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.169031 16192 raft_consensus.cc:2243] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.169988 16192 raft_consensus.cc:2272] T 8c4c351b74b044eab8a6561b3eb27a1b P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.172541 16192 tablet_replica.cc:333] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.173425 16192 raft_consensus.cc:2243] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.174304 16192 raft_consensus.cc:2272] T 2566406852d04693963f9fa3f001ff8c P b7108577e5754060b7e468a43dfdcdeb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.177121 16192 tablet_replica.cc:333] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.177917 16192 raft_consensus.cc:2243] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.178989 16192 raft_consensus.cc:2272] T ff6cbb1194424d7fb250bdb904d367ab P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.181557 16192 tablet_replica.cc:333] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.182265 16192 raft_consensus.cc:2243] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.183661 16192 raft_consensus.cc:2272] T 3c3278087b524fbab2103bd52cc56710 P b7108577e5754060b7e468a43dfdcdeb [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.186430 16192 tablet_replica.cc:333] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.187216 16192 raft_consensus.cc:2243] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.187829 16192 raft_consensus.cc:2272] T bf42e0c75aa14899935b39a4a7437626 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.190687 16192 tablet_replica.cc:333] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.191394 16192 raft_consensus.cc:2243] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.191978 16192 raft_consensus.cc:2272] T a5d6271327d4457ea6b522d9188f4f84 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.194538 16192 tablet_replica.cc:333] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.195326 16192 raft_consensus.cc:2243] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.214107 16192 raft_consensus.cc:2272] T 58b200038e814f72ae96c61b0e1dd286 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.218356 16192 tablet_replica.cc:333] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.219743 16192 raft_consensus.cc:2243] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.221401 16192 raft_consensus.cc:2272] T 213e74ac16bb4f19b434bdd25b7bd3af P b7108577e5754060b7e468a43dfdcdeb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.224061 16192 tablet_replica.cc:333] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.224813 16192 raft_consensus.cc:2243] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.225893 16192 raft_consensus.cc:2272] T 128956e308c048a2af21fae67c6683ef P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.228544 16192 tablet_replica.cc:333] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.245723 16192 raft_consensus.cc:2243] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.246639 16192 raft_consensus.cc:2272] T 984feea4e2564e57923c946b7572e2a0 P b7108577e5754060b7e468a43dfdcdeb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.249140 16192 tablet_replica.cc:333] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.249862 16192 raft_consensus.cc:2243] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.250659 16192 raft_consensus.cc:2272] T f2018cf7711d4001a8a9fae2f46d00f4 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.261221 25694 raft_consensus.cc:493] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:27.261755 25694 raft_consensus.cc:515] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:27.263774 25694 leader_election.cc:290] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:27.270145 17963 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:27.274785 17962 leader_election.cc:336] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:27.275635 17962 leader_election.cc:304] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:27.279479 25694 raft_consensus.cc:2749] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:27.284402 16192 tablet_replica.cc:333] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.285303 16192 raft_consensus.cc:2243] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.286407 16192 raft_consensus.cc:2272] T 2e1a5ebc1019411290bc16a4e1cab89b P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.289265 16192 tablet_replica.cc:333] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.290026 16192 raft_consensus.cc:2243] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:27.291302 16192 raft_consensus.cc:2272] T 7601a632a565453b83b93c1020924101 P b7108577e5754060b7e468a43dfdcdeb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.294154 16192 tablet_replica.cc:333] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.294850 16192 raft_consensus.cc:2243] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.295766 16192 raft_consensus.cc:2272] T 036c02de798949eeb02d27e9dd520825 P b7108577e5754060b7e468a43dfdcdeb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.304268 16192 tablet_replica.cc:333] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.305017 16192 raft_consensus.cc:2243] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.305748 16192 raft_consensus.cc:2272] T 1b85187304c149c58d33a53cb3005a02 P b7108577e5754060b7e468a43dfdcdeb [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.308252 16192 tablet_replica.cc:333] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.308985 16192 raft_consensus.cc:2243] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.309679 16192 raft_consensus.cc:2272] T aaa77e48390f407cb43bb16febfe2e8d P b7108577e5754060b7e468a43dfdcdeb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:27.312156 16192 tablet_replica.cc:333] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb: stopping tablet replica
I20260709 13:21:27.312793 16192 raft_consensus.cc:2243] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:27.313479 16192 raft_consensus.cc:2272] T 24bd9827b3204adba8158c0366088793 P b7108577e5754060b7e468a43dfdcdeb [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:27.375494 17963 consensus_peers.cc:597] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:27.392604 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff6cbb1194424d7fb250bdb904d367ab: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:27.425778 17962 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:21:27.444640 25639 raft_consensus.cc:493] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:27.445288 25639 raft_consensus.cc:515] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:27.448712 25639 leader_election.cc:290] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:27.459332 17963 leader_election.cc:336] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:27.462931 17962 leader_election.cc:336] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:27.463500 17962 leader_election.cc:304] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:27.469726 25639 raft_consensus.cc:2749] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:27.586886 17963 consensus_peers.cc:597] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:27.637183 17962 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:27.664951 17963 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:27.725383 17962 consensus_peers.cc:597] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:27.734484 17962 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:27.741645 17963 consensus_peers.cc:597] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:27.757635 17963 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:27.758543 17963 consensus_peers.cc:597] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:27.801597 17962 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111) [suppressed 629 similar messages]
W20260709 13:21:27.814678 17962 consensus_peers.cc:597] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:27.821677 17963 consensus_peers.cc:597] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:27.879262 17963 consensus_peers.cc:597] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:27.911839 17963 consensus_peers.cc:597] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:27.988735 17963 consensus_peers.cc:597] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:28.066381 25671 raft_consensus.cc:493] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.067061 25671 raft_consensus.cc:515] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:28.069983 25671 leader_election.cc:290] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:28.098773 17964 leader_election.cc:336] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
W20260709 13:21:28.108597 17962 leader_election.cc:336] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:28.109212 17962 leader_election.cc:304] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:28.123481 25671 raft_consensus.cc:2749] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:28.128345 25671 raft_consensus.cc:493] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.128991 25671 raft_consensus.cc:515] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:28.138622 25671 leader_election.cc:290] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:28.143942 17963 leader_election.cc:336] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:28.148691 17963 consensus_peers.cc:597] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:28.177922 17964 leader_election.cc:336] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
I20260709 13:21:28.178483 17964 leader_election.cc:304] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:28.180153 25671 raft_consensus.cc:2749] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:28.183804 25639 raft_consensus.cc:493] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.184325 25639 raft_consensus.cc:515] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:28.185729 17962 consensus_peers.cc:597] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:21:28.186729 25639 leader_election.cc:290] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:28.184692 25671 raft_consensus.cc:493] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.187484 25671 raft_consensus.cc:515] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:28.190716 25671 leader_election.cc:290] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:28.195724 17963 leader_election.cc:336] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:28.196329 17962 leader_election.cc:336] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:28.198818 17964 leader_election.cc:336] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
I20260709 13:21:28.199311 17964 leader_election.cc:304] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:28.200280 25671 raft_consensus.cc:2749] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:28.201395 17964 leader_election.cc:336] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
I20260709 13:21:28.201848 17964 leader_election.cc:304] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:28.202682 25639 raft_consensus.cc:2749] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:28.210882 25639 raft_consensus.cc:493] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.211530 25639 raft_consensus.cc:515] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:28.214061 25639 leader_election.cc:290] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:28.218941 17964 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
W20260709 13:21:28.219457 17963 leader_election.cc:336] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:28.219928 17963 leader_election.cc:304] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:28.220690 25639 raft_consensus.cc:2749] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:28.228705 25671 raft_consensus.cc:493] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.229274 25671 raft_consensus.cc:515] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:28.231287 25671 leader_election.cc:290] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:28.236670 17963 leader_election.cc:336] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:28.237201 17964 leader_election.cc:336] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
I20260709 13:21:28.237704 17964 leader_election.cc:304] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:28.238826 25639 raft_consensus.cc:2749] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:28.266721 25639 raft_consensus.cc:493] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.267455 25639 raft_consensus.cc:515] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } attrs { replace: true } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:28.270638 25639 leader_election.cc:290] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:28.271955 25671 raft_consensus.cc:493] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c23a664ebf3347a4934dee377c8b5101)
I20260709 13:21:28.276068 25671 raft_consensus.cc:515] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
W20260709 13:21:28.276569 17963 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:28.278345 25671 leader_election.cc:290] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079)
W20260709 13:21:28.279426 17964 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
I20260709 13:21:28.279918 17964 leader_election.cc:304] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:28.280647 25671 raft_consensus.cc:2749] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:28.282734 17962 leader_election.cc:336] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:28.283819 17963 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
W20260709 13:21:28.285426 17962 leader_election.cc:336] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:28.286831 17962 leader_election.cc:304] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:28.287792 25671 raft_consensus.cc:2749] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:28.298602 16192 tablet_server.cc:196] TabletServer@127.15.208.3:0 shutdown complete.
I20260709 13:21:28.359334 25671 raft_consensus.cc:493] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.360064 25671 raft_consensus.cc:515] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:28.362569 25671 leader_election.cc:290] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:28.368021 17964 leader_election.cc:336] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
W20260709 13:21:28.368587 17963 leader_election.cc:336] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:28.369086 17963 leader_election.cc:304] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:28.369998 25671 raft_consensus.cc:2749] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:21:28.406386 17962 consensus_peers.cc:597] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:28.407792 16192 tablet_server.cc:179] TabletServer@127.15.208.4:0 shutting down...
I20260709 13:21:28.414359 25671 raft_consensus.cc:493] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.414984 25671 raft_consensus.cc:515] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:28.419356 25671 leader_election.cc:290] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:28.421471 17964 leader_election.cc:336] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
W20260709 13:21:28.429545 17962 consensus_peers.cc:597] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:28.433105 17963 leader_election.cc:336] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:28.433679 17963 leader_election.cc:304] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:28.434486 25671 raft_consensus.cc:2749] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:28.448113 17962 consensus_peers.cc:597] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:21:28.463510 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:28.464322 16192 tablet_replica.cc:333] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.465080 16192 raft_consensus.cc:2243] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.465672 16192 raft_consensus.cc:2272] T 132676f9343f4733b4f07f4587384a56 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.468032 16192 tablet_replica.cc:333] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.468732 16192 raft_consensus.cc:2243] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.469228 16192 raft_consensus.cc:2272] T b0bff337c6c8418e8fe0872b92f3bd6f P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.471316 16192 tablet_replica.cc:333] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.471843 16192 raft_consensus.cc:2243] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.472705 16192 raft_consensus.cc:2272] T 24bd9827b3204adba8158c0366088793 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.474679 16192 tablet_replica.cc:333] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.475260 16192 raft_consensus.cc:2243] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.475773 16192 raft_consensus.cc:2272] T 96a5582b6bfb4ac592225b49ce6df9be P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.477969 16192 tablet_replica.cc:333] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.478525 16192 raft_consensus.cc:2243] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.478982 16192 raft_consensus.cc:2272] T 128956e308c048a2af21fae67c6683ef P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.481334 16192 tablet_replica.cc:333] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.481959 16192 raft_consensus.cc:2243] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.482604 16192 raft_consensus.cc:2272] T ef8ac3d116f3443db6462f3a86ce1432 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.485553 16192 tablet_replica.cc:333] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.486482 16192 raft_consensus.cc:2243] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.487237 16192 raft_consensus.cc:2272] T 2e1a5ebc1019411290bc16a4e1cab89b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.488871 17963 consensus_peers.cc:597] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 -> Peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Couldn't send request to peer c23a664ebf3347a4934dee377c8b5101. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:28.490657 16192 tablet_replica.cc:333] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.491544 16192 raft_consensus.cc:2243] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.492599 16192 raft_consensus.cc:2272] T 984feea4e2564e57923c946b7572e2a0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.495326 16192 tablet_replica.cc:333] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.495957 16192 raft_consensus.cc:2243] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.496780 16192 raft_consensus.cc:2272] T 622554a5186d4910b8476a653411c85d P 3747096bb5074ea2bf86037fd17c1160 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.527931 25701 raft_consensus.cc:493] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.530872 16192 tablet_replica.cc:333] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.530015 25701 raft_consensus.cc:515] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c23a664ebf3347a4934dee377c8b5101" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 33079 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:28.533869 16192 raft_consensus.cc:2243] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.537356 16192 raft_consensus.cc:2272] T bd3f7b090266450da9f53ec675edc8f0 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.539022 25701 leader_election.cc:290] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
W20260709 13:21:28.547857 17963 leader_election.cc:336] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c23a664ebf3347a4934dee377c8b5101 (127.15.208.2:33079): Network error: Client connection negotiation failed: client connection to 127.15.208.2:33079: connect: Connection refused (error 111)
I20260709 13:21:28.549296 16192 tablet_replica.cc:333] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.551280 16192 raft_consensus.cc:2243] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.552721 16192 raft_consensus.cc:2272] T a20d82b49da74027abe144db7281b7b0 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.557360 17962 consensus_peers.cc:597] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:21:28.557767 16192 tablet_replica.cc:333] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.559746 16192 raft_consensus.cc:2243] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.562291 16192 raft_consensus.cc:2272] T 2679735faeb64bcf9031060956c1e1b9 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.562469 17964 leader_election.cc:336] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
I20260709 13:21:28.563059 17964 leader_election.cc:304] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: b7108577e5754060b7e468a43dfdcdeb, c23a664ebf3347a4934dee377c8b5101
I20260709 13:21:28.564143 25703 raft_consensus.cc:2749] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:28.566870 16192 tablet_replica.cc:333] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.568259 16192 raft_consensus.cc:2243] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.569206 16192 raft_consensus.cc:2272] T 7bb3b6f88d9b4423a689bae4e9e59333 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.572443 16192 tablet_replica.cc:333] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.573583 16192 raft_consensus.cc:2243] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.577205 16192 raft_consensus.cc:2272] T 579bc2ff6fcd49d8bc55557aa9b1bc3d P 3747096bb5074ea2bf86037fd17c1160 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.580534 16192 tablet_replica.cc:333] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.581561 16192 raft_consensus.cc:2243] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.583665 16192 raft_consensus.cc:2272] T 5fc026cf7a3b43b3a05aca657efbaecd P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.587632 16192 tablet_replica.cc:333] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.589037 16192 raft_consensus.cc:2243] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.593391 16192 raft_consensus.cc:2272] T f2018cf7711d4001a8a9fae2f46d00f4 P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.594564 25703 raft_consensus.cc:493] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7108577e5754060b7e468a43dfdcdeb)
I20260709 13:21:28.595321 25703 raft_consensus.cc:515] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7241e45fbfca4b46b6df9be8cebcd863" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40163 } } peers { permanent_uuid: "b7108577e5754060b7e468a43dfdcdeb" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33147 } } peers { permanent_uuid: "3747096bb5074ea2bf86037fd17c1160" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 34493 } attrs { promote: false } }
I20260709 13:21:28.597121 16192 tablet_replica.cc:333] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.597903 25703 leader_election.cc:290] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163), b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147)
I20260709 13:21:28.598253 16192 raft_consensus.cc:2243] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.599814 16192 raft_consensus.cc:2272] T 6758d139882843e5bddc827c260b81a9 P 3747096bb5074ea2bf86037fd17c1160 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.603888 16192 tablet_replica.cc:333] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
W20260709 13:21:28.604018 17964 leader_election.cc:336] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7108577e5754060b7e468a43dfdcdeb (127.15.208.3:33147): Network error: Client connection negotiation failed: client connection to 127.15.208.3:33147: connect: Connection refused (error 111)
I20260709 13:21:28.605168 16192 raft_consensus.cc:2243] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:28.606456 17962 leader_election.cc:336] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:28.607038 17962 leader_election.cc:304] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3747096bb5074ea2bf86037fd17c1160; no voters: 7241e45fbfca4b46b6df9be8cebcd863, b7108577e5754060b7e468a43dfdcdeb
I20260709 13:21:28.607897 25701 raft_consensus.cc:2749] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:28.608731 16192 raft_consensus.cc:2272] T c824a7378ba243ca96d57d97c47847c9 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.612694 16192 tablet_replica.cc:333] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.614120 16192 raft_consensus.cc:2243] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.616544 16192 raft_consensus.cc:2272] T ff6cbb1194424d7fb250bdb904d367ab P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.621066 16192 tablet_replica.cc:333] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.621771 16192 raft_consensus.cc:2243] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.623867 16192 raft_consensus.cc:2272] T bf42e0c75aa14899935b39a4a7437626 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.627056 16192 tablet_replica.cc:333] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.627796 16192 raft_consensus.cc:2243] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.629606 16192 raft_consensus.cc:2272] T 9ecbe40a17fe40b69ac2ecffb5e51786 P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.632334 16192 tablet_replica.cc:333] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.633193 16192 raft_consensus.cc:2243] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.633968 16192 raft_consensus.cc:2272] T b59d252a868a4ba8bc72588a2ae450b2 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.638176 16192 tablet_replica.cc:333] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.638958 16192 raft_consensus.cc:2243] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.641016 16192 raft_consensus.cc:2272] T a5d6271327d4457ea6b522d9188f4f84 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.641839 17962 consensus_peers.cc:597] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 -> Peer 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): Couldn't send request to peer 7241e45fbfca4b46b6df9be8cebcd863. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:21:28.643908 16192 tablet_replica.cc:333] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.644830 16192 raft_consensus.cc:2243] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.645736 16192 raft_consensus.cc:2272] T 7c3c6f4045794af59b877ad412ae6450 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.648981 16192 tablet_replica.cc:333] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.649673 16192 raft_consensus.cc:2243] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.650614 16192 raft_consensus.cc:2272] T 58b200038e814f72ae96c61b0e1dd286 P 3747096bb5074ea2bf86037fd17c1160 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.653105 16192 tablet_replica.cc:333] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.653847 16192 raft_consensus.cc:2243] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.654629 16192 raft_consensus.cc:2272] T 16a281c8bb174a28b9e029139de7e00b P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.658414 16192 tablet_replica.cc:333] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.659349 16192 raft_consensus.cc:2243] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.660800 16192 raft_consensus.cc:2272] T 060ed925d51948b7b415b005543f7a9f P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.664564 16192 tablet_replica.cc:333] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.665258 16192 raft_consensus.cc:2243] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.666595 16192 raft_consensus.cc:2272] T 2566406852d04693963f9fa3f001ff8c P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.669421 16192 tablet_replica.cc:333] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.670090 16192 raft_consensus.cc:2243] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.671803 16192 raft_consensus.cc:2272] T ff504a0c820741ecb08279a255054a6c P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.674561 16192 tablet_replica.cc:333] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.675161 16192 raft_consensus.cc:2243] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.676970 16192 raft_consensus.cc:2272] T 6c0241098ae744cbae27ac900424b754 P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.679853 16192 tablet_replica.cc:333] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.680893 16192 raft_consensus.cc:2243] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.682581 16192 raft_consensus.cc:2272] T 96090377e5474346a1e4fdadd3c4c7ab P 3747096bb5074ea2bf86037fd17c1160 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.685312 16192 tablet_replica.cc:333] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.686038 16192 raft_consensus.cc:2243] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.687294 16192 raft_consensus.cc:2272] T 4df43493289c4586a02bce2e14a38202 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.690959 16192 tablet_replica.cc:333] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.691545 16192 raft_consensus.cc:2243] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.692251 16192 raft_consensus.cc:2272] T 6ed6b0a2fcf5476ab0f8dffeb3536922 P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.695017 16192 tablet_replica.cc:333] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.695659 16192 raft_consensus.cc:2243] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.697712 16192 raft_consensus.cc:2272] T a4c1e66c4a684159ae427b3705522c26 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.700719 16192 tablet_replica.cc:333] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.701408 16192 raft_consensus.cc:2243] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.703472 16192 raft_consensus.cc:2272] T 452dfe9db12345ae88b3dbbd163f480e P 3747096bb5074ea2bf86037fd17c1160 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.706187 16192 tablet_replica.cc:333] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.706796 16192 raft_consensus.cc:2243] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.708446 16192 raft_consensus.cc:2272] T b19033ecd72e4ba188910445b70c84d5 P 3747096bb5074ea2bf86037fd17c1160 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.711383 16192 tablet_replica.cc:333] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.711962 16192 raft_consensus.cc:2243] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.713989 16192 raft_consensus.cc:2272] T 8c4c351b74b044eab8a6561b3eb27a1b P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.716903 16192 tablet_replica.cc:333] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.717566 16192 raft_consensus.cc:2243] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.719099 16192 raft_consensus.cc:2272] T 4e42c2b9c0d646f1a18c2f8ea4f1a259 P 3747096bb5074ea2bf86037fd17c1160 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.721572 16192 tablet_replica.cc:333] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.722198 16192 raft_consensus.cc:2243] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.723784 16192 raft_consensus.cc:2272] T aaa77e48390f407cb43bb16febfe2e8d P 3747096bb5074ea2bf86037fd17c1160 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.726706 16192 tablet_replica.cc:333] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160: stopping tablet replica
I20260709 13:21:28.727293 16192 raft_consensus.cc:2243] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.728754 16192 raft_consensus.cc:2272] T 96336e4c5eb64d4d967c671c9a221e69 P 3747096bb5074ea2bf86037fd17c1160 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.083387 16192 tablet_server.cc:196] TabletServer@127.15.208.4:0 shutdown complete.
I20260709 13:21:29.192284 16192 master.cc:562] Master@127.15.208.62:46299 shutting down...
W20260709 13:21:29.241183 17268 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:21:29.241478 17268 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:29.241734 17268 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:39.589139 17204 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111) [suppressed 98 similar messages]
W20260709 13:21:39.592975 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2679735faeb64bcf9031060956c1e1b9: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
W20260709 13:21:43.831750 17204 catalog_manager.cc:4755] TS 7241e45fbfca4b46b6df9be8cebcd863 (127.15.208.1:40163): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff6cbb1194424d7fb250bdb904d367ab: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40163: connect: Connection refused (error 111)
I20260709 13:21:46.253996 16192 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.254980 16192 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.255342 16192 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6a4082b2c6894817acb2d2a07603a4d6: stopping tablet replica
I20260709 13:21:46.416771 16192 master.cc:584] Master@127.15.208.62:46299 shutdown complete.
I20260709 13:21:46.474346 16192 test_util.cc:182] -----------------------------------------------
I20260709 13:21:46.474562 16192 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603004946521-16192-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (275235 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:21:46.478056 16192 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.208.62:41075
I20260709 13:21:46.479184 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:46.485306 25709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.485342 25710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.486330 25712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.486675 16192 server_base.cc:1061] running on GCE node
I20260709 13:21:46.490188 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:46.490367 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:46.490476 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603306490465 us; error 0 us; skew 500 ppm
I20260709 13:21:46.490921 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:46.493242 16192 webserver.cc:533] Webserver started at http://127.15.208.62:46665/ using document root <none> and password file <none>
I20260709 13:21:46.493693 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:46.493845 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:46.494058 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:46.495251 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/master-0-root/instance:
uuid: "cddca48df7264204bfd14ae81d32a6a3"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-w3b1"
I20260709 13:21:46.502120 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.006s
I20260709 13:21:46.506603 25717 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.507371 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:21:46.507720 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/master-0-root
uuid: "cddca48df7264204bfd14ae81d32a6a3"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-w3b1"
I20260709 13:21:46.508013 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:46.529877 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:46.531147 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:46.570019 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.62:41075
I20260709 13:21:46.570111 25768 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.62:41075 every 8 connection(s)
I20260709 13:21:46.574343 25769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:46.586229 25769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3: Bootstrap starting.
I20260709 13:21:46.591070 25769 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:46.595310 25769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3: No bootstrap required, opened a new log
I20260709 13:21:46.597505 25769 raft_consensus.cc:359] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cddca48df7264204bfd14ae81d32a6a3" member_type: VOTER }
I20260709 13:21:46.597970 25769 raft_consensus.cc:385] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:46.598322 25769 raft_consensus.cc:740] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cddca48df7264204bfd14ae81d32a6a3, State: Initialized, Role: FOLLOWER
I20260709 13:21:46.599009 25769 consensus_queue.cc:260] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cddca48df7264204bfd14ae81d32a6a3" member_type: VOTER }
I20260709 13:21:46.599483 25769 raft_consensus.cc:399] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:46.599738 25769 raft_consensus.cc:493] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:46.600005 25769 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:46.604697 25769 raft_consensus.cc:515] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cddca48df7264204bfd14ae81d32a6a3" member_type: VOTER }
I20260709 13:21:46.605329 25769 leader_election.cc:304] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cddca48df7264204bfd14ae81d32a6a3; no voters: 
I20260709 13:21:46.606491 25769 leader_election.cc:290] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:46.606922 25772 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:46.608333 25772 raft_consensus.cc:697] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 1 LEADER]: Becoming Leader. State: Replica: cddca48df7264204bfd14ae81d32a6a3, State: Running, Role: LEADER
I20260709 13:21:46.609141 25772 consensus_queue.cc:237] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cddca48df7264204bfd14ae81d32a6a3" member_type: VOTER }
I20260709 13:21:46.609628 25769 sys_catalog.cc:565] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:46.615571 25774 sys_catalog.cc:455] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cddca48df7264204bfd14ae81d32a6a3. Latest consensus state: current_term: 1 leader_uuid: "cddca48df7264204bfd14ae81d32a6a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cddca48df7264204bfd14ae81d32a6a3" member_type: VOTER } }
I20260709 13:21:46.616099 25774 sys_catalog.cc:458] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:46.617213 25773 sys_catalog.cc:455] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cddca48df7264204bfd14ae81d32a6a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cddca48df7264204bfd14ae81d32a6a3" member_type: VOTER } }
I20260709 13:21:46.617894 25773 sys_catalog.cc:458] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:46.617992 25779 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:46.623185 25779 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:46.628242 16192 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:46.633538 25779 catalog_manager.cc:1383] Generated new cluster ID: c59b41d03e03401f8c09b79f625eaf04
I20260709 13:21:46.633829 25779 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:46.655396 25779 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:46.656708 25779 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:46.671411 25779 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3: Generated new TSK 0
I20260709 13:21:46.672287 25779 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:46.694931 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:46.701520 25790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.702958 25791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.704397 25793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.705251 16192 server_base.cc:1061] running on GCE node
I20260709 13:21:46.707329 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:46.707545 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:46.707723 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603306707688 us; error 0 us; skew 500 ppm
I20260709 13:21:46.708261 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:46.710764 16192 webserver.cc:533] Webserver started at http://127.15.208.1:34151/ using document root <none> and password file <none>
I20260709 13:21:46.711236 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:46.711427 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:46.711699 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:46.712929 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/instance:
uuid: "8e453645ce774c99b4b4aafb4362719b"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-w3b1"
I20260709 13:21:46.717501 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:21:46.720814 25798 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.721907 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:21:46.722259 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-0-root
uuid: "8e453645ce774c99b4b4aafb4362719b"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-w3b1"
I20260709 13:21:46.722586 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:46.739813 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:46.741035 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:46.742470 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:46.744786 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:46.745064 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.745333 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:46.745518 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.787515 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.1:34819
I20260709 13:21:46.787642 25860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.1:34819 every 8 connection(s)
I20260709 13:21:46.792770 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:46.802950 25865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.804220 25866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.807657 25868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.807723 16192 server_base.cc:1061] running on GCE node
I20260709 13:21:46.810787 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:46.810987 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:46.811112 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603306811101 us; error 0 us; skew 500 ppm
I20260709 13:21:46.811668 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:46.814633 16192 webserver.cc:533] Webserver started at http://127.15.208.2:38905/ using document root <none> and password file <none>
I20260709 13:21:46.815227 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:46.815447 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:46.815739 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:46.816217 25861 heartbeater.cc:344] Connected to a master server at 127.15.208.62:41075
I20260709 13:21:46.816699 25861 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:46.817448 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/instance:
uuid: "00dbc14fa82f4a22b1cab8f3691196de"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-w3b1"
I20260709 13:21:46.817718 25861 heartbeater.cc:507] Master 127.15.208.62:41075 requested a full tablet report, sending...
I20260709 13:21:46.820068 25734 ts_manager.cc:194] Registered new tserver with Master: 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:46.822454 25734 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55916
I20260709 13:21:46.822798 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:46.827353 25873 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.828191 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:46.828511 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-1-root
uuid: "00dbc14fa82f4a22b1cab8f3691196de"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-w3b1"
I20260709 13:21:46.828771 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:46.856895 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:46.858182 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:46.859707 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:46.862063 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:46.862236 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.862531 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:46.862673 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.904569 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.2:46717
I20260709 13:21:46.904690 25935 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.2:46717 every 8 connection(s)
I20260709 13:21:46.909762 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:46.917562 25939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.919988 25940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.920701 16192 server_base.cc:1061] running on GCE node
W20260709 13:21:46.922371 25942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.923671 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:46.923959 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:46.924211 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603306924193 us; error 0 us; skew 500 ppm
I20260709 13:21:46.924446 25936 heartbeater.cc:344] Connected to a master server at 127.15.208.62:41075
I20260709 13:21:46.924880 25936 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:46.924960 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:46.925827 25936 heartbeater.cc:507] Master 127.15.208.62:41075 requested a full tablet report, sending...
I20260709 13:21:46.927887 25734 ts_manager.cc:194] Registered new tserver with Master: 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:46.928063 16192 webserver.cc:533] Webserver started at http://127.15.208.3:45271/ using document root <none> and password file <none>
I20260709 13:21:46.928663 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:46.928848 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:46.929188 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:46.929591 25734 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55918
I20260709 13:21:46.930609 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/instance:
uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-w3b1"
I20260709 13:21:46.935228 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:46.938583 25947 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.939328 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:21:46.939627 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-2-root
uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-w3b1"
I20260709 13:21:46.939895 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:46.961033 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:46.962319 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:46.963853 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:46.966096 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:46.966331 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.966581 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:46.966755 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:47.007680 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.3:43721
I20260709 13:21:47.007777 26009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.3:43721 every 8 connection(s)
I20260709 13:21:47.013161 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:47.021531 26013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:47.023593 26014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:47.027288 16192 server_base.cc:1061] running on GCE node
W20260709 13:21:47.027202 26016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:47.027647 26010 heartbeater.cc:344] Connected to a master server at 127.15.208.62:41075
I20260709 13:21:47.028189 26010 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:47.028745 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:47.029080 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:47.029223 26010 heartbeater.cc:507] Master 127.15.208.62:41075 requested a full tablet report, sending...
I20260709 13:21:47.029330 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603307029307 us; error 0 us; skew 500 ppm
I20260709 13:21:47.030303 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:47.031669 25734 ts_manager.cc:194] Registered new tserver with Master: d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:47.033169 16192 webserver.cc:533] Webserver started at http://127.15.208.4:35275/ using document root <none> and password file <none>
I20260709 13:21:47.033427 25734 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55924
I20260709 13:21:47.033767 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:47.034029 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:47.034308 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:47.035894 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-3-root/instance:
uuid: "3cb7aae2a23a47c180432cb646577fd6"
format_stamp: "Formatted at 2026-07-09 13:21:47 on dist-test-slave-w3b1"
I20260709 13:21:47.040535 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:21:47.044073 26021 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:47.044929 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:21:47.045215 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-3-root
uuid: "3cb7aae2a23a47c180432cb646577fd6"
format_stamp: "Formatted at 2026-07-09 13:21:47 on dist-test-slave-w3b1"
I20260709 13:21:47.045450 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:47.074810 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:47.076121 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:47.077591 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:47.079859 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:47.080080 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:47.080356 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:47.080518 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:47.128499 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.4:35175
I20260709 13:21:47.128598 26083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.4:35175 every 8 connection(s)
I20260709 13:21:47.144974 26084 heartbeater.cc:344] Connected to a master server at 127.15.208.62:41075
I20260709 13:21:47.145406 26084 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:47.146133 26084 heartbeater.cc:507] Master 127.15.208.62:41075 requested a full tablet report, sending...
I20260709 13:21:47.148445 25734 ts_manager.cc:194] Registered new tserver with Master: 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:47.149471 16192 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017559579s
I20260709 13:21:47.150511 25734 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55930
I20260709 13:21:47.184731 25734 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55934:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:21:47.413267 25901 tablet_service.cc:1511] Processing CreateTablet for tablet 71b7bc1778ac476b9576cf48b4353789 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:47.413980 25974 tablet_service.cc:1511] Processing CreateTablet for tablet 9336cac5990e43cbab1b688c336b02bd (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:47.414888 25901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b7bc1778ac476b9576cf48b4353789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.415449 25974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9336cac5990e43cbab1b688c336b02bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.418197 25900 tablet_service.cc:1511] Processing CreateTablet for tablet 9336cac5990e43cbab1b688c336b02bd (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:47.419711 25900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9336cac5990e43cbab1b688c336b02bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.421252 25975 tablet_service.cc:1511] Processing CreateTablet for tablet 71b7bc1778ac476b9576cf48b4353789 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:47.422634 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b7bc1778ac476b9576cf48b4353789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.425720 26049 tablet_service.cc:1511] Processing CreateTablet for tablet 71b7bc1778ac476b9576cf48b4353789 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:47.426330 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 9336cac5990e43cbab1b688c336b02bd (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:47.427227 26049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b7bc1778ac476b9576cf48b4353789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.427969 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9336cac5990e43cbab1b688c336b02bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.432080 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 5422aebfcb69407490575715e7e6cd18 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:47.432417 26048 tablet_service.cc:1511] Processing CreateTablet for tablet 5422aebfcb69407490575715e7e6cd18 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:47.433581 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5422aebfcb69407490575715e7e6cd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.434007 26048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5422aebfcb69407490575715e7e6cd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.440398 25899 tablet_service.cc:1511] Processing CreateTablet for tablet 5422aebfcb69407490575715e7e6cd18 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:47.442377 25899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5422aebfcb69407490575715e7e6cd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.446877 25824 tablet_service.cc:1511] Processing CreateTablet for tablet b633a2406cc3422abe7f6adda14a8386 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:47.448395 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b633a2406cc3422abe7f6adda14a8386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.464046 25973 tablet_service.cc:1511] Processing CreateTablet for tablet b633a2406cc3422abe7f6adda14a8386 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:47.465569 25973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b633a2406cc3422abe7f6adda14a8386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.472189 26047 tablet_service.cc:1511] Processing CreateTablet for tablet b633a2406cc3422abe7f6adda14a8386 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:47.473734 26047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b633a2406cc3422abe7f6adda14a8386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.493525 25901 tablet_service.cc:1511] Processing CreateTablet for tablet f2fd2c216d4f4c11b81198c731099343 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:47.494995 25901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2fd2c216d4f4c11b81198c731099343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.500805 25824 tablet_service.cc:1511] Processing CreateTablet for tablet f2fd2c216d4f4c11b81198c731099343 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:47.503329 25975 tablet_service.cc:1511] Processing CreateTablet for tablet f2fd2c216d4f4c11b81198c731099343 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:47.505681 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2fd2c216d4f4c11b81198c731099343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.505278 26046 tablet_service.cc:1511] Processing CreateTablet for tablet d1f90d8c21b9479cab6a633e8615dfef (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:47.506031 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2fd2c216d4f4c11b81198c731099343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.506747 26046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f90d8c21b9479cab6a633e8615dfef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.513327 25825 tablet_service.cc:1511] Processing CreateTablet for tablet d1f90d8c21b9479cab6a633e8615dfef (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:47.515276 25898 tablet_service.cc:1511] Processing CreateTablet for tablet d1f90d8c21b9479cab6a633e8615dfef (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:47.516739 25898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f90d8c21b9479cab6a633e8615dfef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.530100 26104 tablet_bootstrap.cc:492] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:47.531024 25972 tablet_service.cc:1511] Processing CreateTablet for tablet 40f87eb5e589466fa0bc8c00974bdd91 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:47.532500 25972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f87eb5e589466fa0bc8c00974bdd91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.538102 26105 tablet_bootstrap.cc:492] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:47.542042 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f90d8c21b9479cab6a633e8615dfef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.544242 26106 tablet_bootstrap.cc:492] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:47.545111 26045 tablet_service.cc:1511] Processing CreateTablet for tablet 40f87eb5e589466fa0bc8c00974bdd91 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:47.546554 26045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f87eb5e589466fa0bc8c00974bdd91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.552394 26106 tablet_bootstrap.cc:654] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.558873 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 40f87eb5e589466fa0bc8c00974bdd91 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:47.559729 26104 tablet_bootstrap.cc:654] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.560320 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f87eb5e589466fa0bc8c00974bdd91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.566829 26107 tablet_bootstrap.cc:492] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:47.576869 26047 tablet_service.cc:1511] Processing CreateTablet for tablet 9b69a58c24c44d16b7aeed68a23964a5 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:47.580242 25823 tablet_service.cc:1511] Processing CreateTablet for tablet 969350a564f340bc8bd087df45015f7d (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:47.588811 26107 tablet_bootstrap.cc:654] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.576911 25973 tablet_service.cc:1511] Processing CreateTablet for tablet 9b69a58c24c44d16b7aeed68a23964a5 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:47.601806 25972 tablet_service.cc:1511] Processing CreateTablet for tablet 969350a564f340bc8bd087df45015f7d (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:47.602728 25973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b69a58c24c44d16b7aeed68a23964a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.603642 25972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969350a564f340bc8bd087df45015f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.604389 26047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b69a58c24c44d16b7aeed68a23964a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.606824 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969350a564f340bc8bd087df45015f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.582409 26105 tablet_bootstrap.cc:654] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.582599 25901 tablet_service.cc:1511] Processing CreateTablet for tablet 969350a564f340bc8bd087df45015f7d (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:47.570039 25899 tablet_service.cc:1511] Processing CreateTablet for tablet 9b69a58c24c44d16b7aeed68a23964a5 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:47.612140 25901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969350a564f340bc8bd087df45015f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.612933 25899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b69a58c24c44d16b7aeed68a23964a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.617967 25898 tablet_service.cc:1511] Processing CreateTablet for tablet 244656e8e9b646c48e9b5b92ed53ba51 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:47.619442 25898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244656e8e9b646c48e9b5b92ed53ba51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.622085 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 244656e8e9b646c48e9b5b92ed53ba51 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:47.623615 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244656e8e9b646c48e9b5b92ed53ba51. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:47.625156 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:47.627767 25975 tablet_service.cc:1511] Processing CreateTablet for tablet e56d8e51e0714bcfac360118807d6e0f (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:47.638319 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56d8e51e0714bcfac360118807d6e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.639242 26106 tablet_bootstrap.cc:492] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:47.639921 26106 ts_tablet_manager.cc:1403] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.011s
I20260709 13:21:47.631302 25826 tablet_service.cc:1511] Processing CreateTablet for tablet e56d8e51e0714bcfac360118807d6e0f (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:47.642458 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56d8e51e0714bcfac360118807d6e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.629063 26046 tablet_service.cc:1511] Processing CreateTablet for tablet e56d8e51e0714bcfac360118807d6e0f (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:47.644136 25900 tablet_service.cc:1511] Processing CreateTablet for tablet 50ec9041a9b841bb91cd06da0192130e (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:47.645726 25900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ec9041a9b841bb91cd06da0192130e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.645977 25974 tablet_service.cc:1511] Processing CreateTablet for tablet 50ec9041a9b841bb91cd06da0192130e (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:47.647339 25974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ec9041a9b841bb91cd06da0192130e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.648617 25824 tablet_service.cc:1511] Processing CreateTablet for tablet 5469483e48bf4675b18b42b3279e8f4c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:47.650146 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5469483e48bf4675b18b42b3279e8f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.651316 26048 tablet_service.cc:1511] Processing CreateTablet for tablet 50ec9041a9b841bb91cd06da0192130e (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:47.652555 26048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ec9041a9b841bb91cd06da0192130e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.657629 26046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56d8e51e0714bcfac360118807d6e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.625749 26045 tablet_service.cc:1511] Processing CreateTablet for tablet 244656e8e9b646c48e9b5b92ed53ba51 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:47.662011 26045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244656e8e9b646c48e9b5b92ed53ba51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.636003 26107 tablet_bootstrap.cc:492] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:47.665526 26107 ts_tablet_manager.cc:1403] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.014s
I20260709 13:21:47.676818 26106 raft_consensus.cc:359] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:47.683825 26106 raft_consensus.cc:385] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.684186 26106 raft_consensus.cc:740] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.693687 25897 tablet_service.cc:1511] Processing CreateTablet for tablet 5469483e48bf4675b18b42b3279e8f4c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:47.695114 25897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5469483e48bf4675b18b42b3279e8f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.697424 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 757888a24b0145f2b16b34ac466a31d1 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:47.698753 26049 tablet_service.cc:1511] Processing CreateTablet for tablet 757888a24b0145f2b16b34ac466a31d1 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:47.698809 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 757888a24b0145f2b16b34ac466a31d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.702652 26105 tablet_bootstrap.cc:492] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:47.702407 25896 tablet_service.cc:1511] Processing CreateTablet for tablet 757888a24b0145f2b16b34ac466a31d1 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:47.703240 26105 ts_tablet_manager.cc:1403] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.166s	user 0.022s	sys 0.008s
I20260709 13:21:47.704035 25896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 757888a24b0145f2b16b34ac466a31d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.706009 25972 tablet_service.cc:1511] Processing CreateTablet for tablet 5469483e48bf4675b18b42b3279e8f4c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:47.708699 25972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5469483e48bf4675b18b42b3279e8f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.712116 26106 consensus_queue.cc:260] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:47.713826 26104 tablet_bootstrap.cc:492] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:47.673620 26107 raft_consensus.cc:359] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:47.724761 26049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 757888a24b0145f2b16b34ac466a31d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.724011 26107 raft_consensus.cc:385] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.725389 26107 raft_consensus.cc:740] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.726178 26107 consensus_queue.cc:260] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:47.726692 26105 raft_consensus.cc:359] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:47.727546 26105 raft_consensus.cc:385] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.727867 26105 raft_consensus.cc:740] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.732110 26105 consensus_queue.cc:260] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:47.732136 25821 tablet_service.cc:1511] Processing CreateTablet for tablet df82fd13f8664091b9b38e193d84780b (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:47.735988 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df82fd13f8664091b9b38e193d84780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.723341 25975 tablet_service.cc:1511] Processing CreateTablet for tablet df82fd13f8664091b9b38e193d84780b (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:47.737622 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df82fd13f8664091b9b38e193d84780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.741567 26048 tablet_service.cc:1511] Processing CreateTablet for tablet df82fd13f8664091b9b38e193d84780b (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:47.743037 26048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df82fd13f8664091b9b38e193d84780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.724050 26104 ts_tablet_manager.cc:1403] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.194s	user 0.013s	sys 0.013s
I20260709 13:21:47.750622 26106 ts_tablet_manager.cc:1434] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.004s
I20260709 13:21:47.751716 25861 heartbeater.cc:499] Master 127.15.208.62:41075 was elected leader, sending a full tablet report...
I20260709 13:21:47.752068 26106 tablet_bootstrap.cc:492] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:47.750587 26104 raft_consensus.cc:359] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:47.755051 26104 raft_consensus.cc:385] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.760092 26104 raft_consensus.cc:740] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.761313 26104 consensus_queue.cc:260] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:47.775151 26106 tablet_bootstrap.cc:654] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.780850 26010 heartbeater.cc:499] Master 127.15.208.62:41075 was elected leader, sending a full tablet report...
W20260709 13:21:47.792402 25862 tablet.cc:2406] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:47.793512 26104 ts_tablet_manager.cc:1434] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:21:47.798139 26104 tablet_bootstrap.cc:492] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:47.802800 25900 tablet_service.cc:1511] Processing CreateTablet for tablet df402c226a164b7b945723f607f9aa75 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:47.806396 25900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df402c226a164b7b945723f607f9aa75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.808573 26107 ts_tablet_manager.cc:1434] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.143s	user 0.013s	sys 0.004s
I20260709 13:21:47.809938 26107 tablet_bootstrap.cc:492] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:47.811630 26084 heartbeater.cc:499] Master 127.15.208.62:41075 was elected leader, sending a full tablet report...
I20260709 13:21:47.817224 26105 ts_tablet_manager.cc:1434] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.114s	user 0.032s	sys 0.022s
I20260709 13:21:47.818066 25936 heartbeater.cc:499] Master 127.15.208.62:41075 was elected leader, sending a full tablet report...
I20260709 13:21:47.818424 26105 tablet_bootstrap.cc:492] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:47.827567 26104 tablet_bootstrap.cc:654] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.831342 25975 tablet_service.cc:1511] Processing CreateTablet for tablet df402c226a164b7b945723f607f9aa75 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:47.834401 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df402c226a164b7b945723f607f9aa75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.835287 26105 tablet_bootstrap.cc:654] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.833297 26107 tablet_bootstrap.cc:654] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.848389 26106 tablet_bootstrap.cc:492] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:47.846390 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 166158c4e1034da1a83f153661381868 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:47.850339 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166158c4e1034da1a83f153661381868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.853004 26107 tablet_bootstrap.cc:492] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:47.860493 26107 ts_tablet_manager.cc:1403] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.004s
I20260709 13:21:47.864121 25900 tablet_service.cc:1511] Processing CreateTablet for tablet 166158c4e1034da1a83f153661381868 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:47.849221 26106 ts_tablet_manager.cc:1403] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.015s
I20260709 13:21:47.845293 26048 tablet_service.cc:1511] Processing CreateTablet for tablet df402c226a164b7b945723f607f9aa75 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:47.866653 26048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df402c226a164b7b945723f607f9aa75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.872014 25972 tablet_service.cc:1511] Processing CreateTablet for tablet 166158c4e1034da1a83f153661381868 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:47.873926 25972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166158c4e1034da1a83f153661381868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.868052 26106 raft_consensus.cc:359] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:47.875432 26049 tablet_service.cc:1511] Processing CreateTablet for tablet 9c34519b693147019b76e75d995c4975 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:47.876029 26106 raft_consensus.cc:385] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.876794 26106 raft_consensus.cc:740] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.876959 26049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c34519b693147019b76e75d995c4975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.877679 26106 consensus_queue.cc:260] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:47.879722 26106 ts_tablet_manager.cc:1434] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.004s
I20260709 13:21:47.873868 25900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166158c4e1034da1a83f153661381868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.885330 26106 tablet_bootstrap.cc:492] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:47.889886 25821 tablet_service.cc:1511] Processing CreateTablet for tablet 9c34519b693147019b76e75d995c4975 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:47.890568 26104 tablet_bootstrap.cc:492] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:47.891199 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c34519b693147019b76e75d995c4975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.891088 26104 ts_tablet_manager.cc:1403] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.016s
I20260709 13:21:47.895237 26106 tablet_bootstrap.cc:654] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.907140 25896 tablet_service.cc:1511] Processing CreateTablet for tablet 9c34519b693147019b76e75d995c4975 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:47.908522 25896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c34519b693147019b76e75d995c4975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.908344 25973 tablet_service.cc:1511] Processing CreateTablet for tablet 5dbb2ef09cdc4bf08cda0e5159a5bab0 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:47.909716 25973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dbb2ef09cdc4bf08cda0e5159a5bab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.887770 26107 raft_consensus.cc:359] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:47.918365 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 5dbb2ef09cdc4bf08cda0e5159a5bab0 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:47.918833 25897 tablet_service.cc:1511] Processing CreateTablet for tablet 9c42a92a5a0247a499aa3493980d57f4 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:47.919759 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dbb2ef09cdc4bf08cda0e5159a5bab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.920219 25897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c42a92a5a0247a499aa3493980d57f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.917831 26107 raft_consensus.cc:385] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.895265 26104 raft_consensus.cc:359] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:47.921821 26107 raft_consensus.cc:740] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.922943 26104 raft_consensus.cc:385] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.927461 26113 raft_consensus.cc:493] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:47.928628 26113 raft_consensus.cc:515] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:47.931273 26113 leader_election.cc:290] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:47.932149 26046 tablet_service.cc:1511] Processing CreateTablet for tablet 9c42a92a5a0247a499aa3493980d57f4 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:47.933862 26046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c42a92a5a0247a499aa3493980d57f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.937785 25972 tablet_service.cc:1511] Processing CreateTablet for tablet 9c42a92a5a0247a499aa3493980d57f4 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:47.927802 26104 raft_consensus.cc:740] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.945802 26104 consensus_queue.cc:260] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:47.942786 26048 tablet_service.cc:1511] Processing CreateTablet for tablet 5dbb2ef09cdc4bf08cda0e5159a5bab0 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:47.939868 26107 consensus_queue.cc:260] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:47.946396 25972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c42a92a5a0247a499aa3493980d57f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.954052 26048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dbb2ef09cdc4bf08cda0e5159a5bab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.954603 26105 tablet_bootstrap.cc:492] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:47.956341 26105 ts_tablet_manager.cc:1403] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.019s
I20260709 13:21:47.960191 26104 ts_tablet_manager.cc:1434] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
I20260709 13:21:47.998355 26105 raft_consensus.cc:359] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:47.999953 26112 raft_consensus.cc:493] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.006225 26112 raft_consensus.cc:515] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.006506 25898 tablet_service.cc:1511] Processing CreateTablet for tablet 2b625185a5664b86ad39dc782dfb71c1 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:48.007923 25898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b625185a5664b86ad39dc782dfb71c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.000890 26114 raft_consensus.cc:493] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.008510 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 2b625185a5664b86ad39dc782dfb71c1 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:48.009269 26114 raft_consensus.cc:515] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.009842 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b625185a5664b86ad39dc782dfb71c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.011461 25974 tablet_service.cc:1511] Processing CreateTablet for tablet 2b625185a5664b86ad39dc782dfb71c1 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:48.012115 26114 leader_election.cc:290] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:48.014036 26112 leader_election.cc:290] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:48.001011 26104 tablet_bootstrap.cc:492] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:48.012739 25974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b625185a5664b86ad39dc782dfb71c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.017051 26105 raft_consensus.cc:385] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.029803 26105 raft_consensus.cc:740] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.035735 26105 consensus_queue.cc:260] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.038059 26105 ts_tablet_manager.cc:1434] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.078s	user 0.001s	sys 0.012s
I20260709 13:21:48.039108 26105 tablet_bootstrap.cc:492] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:48.040735 26104 tablet_bootstrap.cc:654] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.053891 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 9f82b9479b4249b9b78a11bf5c355ddf (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:48.056807 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f82b9479b4249b9b78a11bf5c355ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.062162 26106 tablet_bootstrap.cc:492] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:48.062305 25975 tablet_service.cc:1511] Processing CreateTablet for tablet e224ef22951c499c9fceb8ce339a349a (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:48.062808 26106 ts_tablet_manager.cc:1403] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.182s	user 0.015s	sys 0.016s
I20260709 13:21:48.063684 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e224ef22951c499c9fceb8ce339a349a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.070152 26107 ts_tablet_manager.cc:1434] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.209s	user 0.010s	sys 0.005s
I20260709 13:21:48.073446 26107 tablet_bootstrap.cc:492] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:48.078364 25973 tablet_service.cc:1511] Processing CreateTablet for tablet 3b1da671c9454f06b4568be0a7d96ba6 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:48.079841 25973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b1da671c9454f06b4568be0a7d96ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.105595 26106 raft_consensus.cc:359] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.106514 26106 raft_consensus.cc:385] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.106874 26106 raft_consensus.cc:740] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.107728 26106 consensus_queue.cc:260] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.111604 26115 raft_consensus.cc:493] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.111927 26112 raft_consensus.cc:493] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.112228 26115 raft_consensus.cc:515] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.112428 26112 raft_consensus.cc:515] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.124886 25821 tablet_service.cc:1511] Processing CreateTablet for tablet e224ef22951c499c9fceb8ce339a349a (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:48.126107 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e224ef22951c499c9fceb8ce339a349a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.135833 25900 tablet_service.cc:1511] Processing CreateTablet for tablet 3b1da671c9454f06b4568be0a7d96ba6 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:48.137326 25900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b1da671c9454f06b4568be0a7d96ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.141316 26046 tablet_service.cc:1511] Processing CreateTablet for tablet 9f82b9479b4249b9b78a11bf5c355ddf (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:48.142828 26046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f82b9479b4249b9b78a11bf5c355ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.143433 25896 tablet_service.cc:1511] Processing CreateTablet for tablet 9f82b9479b4249b9b78a11bf5c355ddf (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:48.144764 25896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f82b9479b4249b9b78a11bf5c355ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.146435 26106 ts_tablet_manager.cc:1434] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.083s	user 0.004s	sys 0.004s
I20260709 13:21:48.118016 26112 leader_election.cc:290] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:48.118142 26115 leader_election.cc:290] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:48.147934 26106 tablet_bootstrap.cc:492] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:48.150755 26107 tablet_bootstrap.cc:654] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.161373 26049 tablet_service.cc:1511] Processing CreateTablet for tablet e224ef22951c499c9fceb8ce339a349a (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:48.162743 26049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e224ef22951c499c9fceb8ce339a349a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.162289 26045 tablet_service.cc:1511] Processing CreateTablet for tablet 3b1da671c9454f06b4568be0a7d96ba6 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:48.163795 26045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b1da671c9454f06b4568be0a7d96ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.190178 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:48.192128 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:48.192764 25911 raft_consensus.cc:2468] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:48.195345 25898 tablet_service.cc:1511] Processing CreateTablet for tablet 4f217c0d15b04aa38110ee2f881fc575 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:48.197288 25898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f217c0d15b04aa38110ee2f881fc575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.198961 26105 tablet_bootstrap.cc:654] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:48.201349 25802 leader_election.cc:343] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.202421 25802 leader_election.cc:304] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:48.204099 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:48.205091 25836 raft_consensus.cc:2468] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:48.206106 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 4f217c0d15b04aa38110ee2f881fc575 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:48.206784 26112 raft_consensus.cc:2804] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:48.207171 26112 raft_consensus.cc:493] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:48.207480 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f217c0d15b04aa38110ee2f881fc575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.207513 26112 raft_consensus.cc:3060] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.209461 26023 leader_election.cc:304] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:48.210496 26113 raft_consensus.cc:2804] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:48.210882 26113 raft_consensus.cc:493] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:48.211330 26113 raft_consensus.cc:3060] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.228053 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:48.228443 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:48.228905 25985 raft_consensus.cc:2468] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:48.217108 26112 raft_consensus.cc:515] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.239552 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
W20260709 13:21:48.242573 26025 leader_election.cc:343] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.244626 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:48.249163 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:48.249967 25985 raft_consensus.cc:2468] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:48.251556 25874 leader_election.cc:304] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:48.252122 26106 tablet_bootstrap.cc:654] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.252565 26114 raft_consensus.cc:2804] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:48.252981 26114 raft_consensus.cc:493] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:48.253337 26114 raft_consensus.cc:3060] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.258210 25972 tablet_service.cc:1511] Processing CreateTablet for tablet 4f217c0d15b04aa38110ee2f881fc575 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:48.259970 25972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f217c0d15b04aa38110ee2f881fc575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.261198 26104 tablet_bootstrap.cc:492] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:48.263281 26104 ts_tablet_manager.cc:1403] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.284s	user 0.034s	sys 0.011s
I20260709 13:21:48.268141 25836 raft_consensus.cc:2393] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dbc14fa82f4a22b1cab8f3691196de in current term 1: Already voted for candidate 8e453645ce774c99b4b4aafb4362719b in this term.
I20260709 13:21:48.270169 26104 raft_consensus.cc:359] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.264816 26113 raft_consensus.cc:515] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.270985 26104 raft_consensus.cc:385] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.261135 26114 raft_consensus.cc:515] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.276806 26112 leader_election.cc:290] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:48.277287 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:48.283569 25897 tablet_service.cc:1511] Processing CreateTablet for tablet 4521a8865b384a5f8afb98fb858cc318 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:48.286118 26059 raft_consensus.cc:2393] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:48.287112 26114 leader_election.cc:290] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:48.287663 26113 leader_election.cc:290] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:48.290278 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:48.291123 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:48.298828 25985 raft_consensus.cc:3060] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.299311 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:48.292254 25911 raft_consensus.cc:2393] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate 00dbc14fa82f4a22b1cab8f3691196de in this term.
I20260709 13:21:48.293821 25897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4521a8865b384a5f8afb98fb858cc318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.296818 26138 raft_consensus.cc:493] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.285291 26104 raft_consensus.cc:740] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.297356 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:48.301607 26138 raft_consensus.cc:515] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.301998 25801 leader_election.cc:304] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:48.303012 26107 tablet_bootstrap.cc:492] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:48.303634 26107 ts_tablet_manager.cc:1403] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.230s	user 0.017s	sys 0.000s
I20260709 13:21:48.303402 26104 consensus_queue.cc:260] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.298015 26105 tablet_bootstrap.cc:492] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:48.298080 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:48.294126 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:48.305495 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:48.313360 25834 raft_consensus.cc:2393] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d01fccfd609b4182a5d43a7f6b4ae503 in current term 1: Already voted for candidate 8e453645ce774c99b4b4aafb4362719b in this term.
I20260709 13:21:48.314673 26045 tablet_service.cc:1511] Processing CreateTablet for tablet 8e56b5dacf8443239fe2cd7fcc3286bb (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:48.315490 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b7bc1778ac476b9576cf48b4353789" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:48.316005 26045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e56b5dacf8443239fe2cd7fcc3286bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.316177 25911 raft_consensus.cc:2468] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:48.316891 25949 leader_election.cc:304] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:48.317538 25802 leader_election.cc:304] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:48.305867 26105 ts_tablet_manager.cc:1403] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.267s	user 0.017s	sys 0.006s
I20260709 13:21:48.307811 26107 raft_consensus.cc:359] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.309115 26138 leader_election.cc:290] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:48.309758 25974 tablet_service.cc:1511] Processing CreateTablet for tablet 8e56b5dacf8443239fe2cd7fcc3286bb (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:48.321899 25836 raft_consensus.cc:2393] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dbc14fa82f4a22b1cab8f3691196de in current term 1: Already voted for candidate 8e453645ce774c99b4b4aafb4362719b in this term.
I20260709 13:21:48.322600 25974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e56b5dacf8443239fe2cd7fcc3286bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.322381 26025 leader_election.cc:304] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:48.321074 26107 raft_consensus.cc:385] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.323606 26113 raft_consensus.cc:2804] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:48.324096 26025 leader_election.cc:343] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.324468 26113 raft_consensus.cc:493] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:48.331594 26113 raft_consensus.cc:3060] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.318804 26112 raft_consensus.cc:3060] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.333479 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 8e56b5dacf8443239fe2cd7fcc3286bb (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:48.323870 26107 raft_consensus.cc:740] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.334944 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e56b5dacf8443239fe2cd7fcc3286bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.334869 26107 consensus_queue.cc:260] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.340725 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 4521a8865b384a5f8afb98fb858cc318 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:48.342195 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4521a8865b384a5f8afb98fb858cc318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.349027 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b7bc1778ac476b9576cf48b4353789" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:48.278226 26048 tablet_service.cc:1511] Processing CreateTablet for tablet 4521a8865b384a5f8afb98fb858cc318 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:48.350553 25984 raft_consensus.cc:2468] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:48.353279 26048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4521a8865b384a5f8afb98fb858cc318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.355815 26107 ts_tablet_manager.cc:1434] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260709 13:21:48.359798 25899 tablet_service.cc:1511] Processing CreateTablet for tablet 015dfd3d2a2e4732876fa91c804d5f58 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:48.361217 25899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015dfd3d2a2e4732876fa91c804d5f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.369007 26107 tablet_bootstrap.cc:492] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:48.375286 26140 raft_consensus.cc:2749] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:48.373047 26104 ts_tablet_manager.cc:1434] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260709 13:21:48.388489 26104 tablet_bootstrap.cc:492] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:48.395660 25973 tablet_service.cc:1511] Processing CreateTablet for tablet 015dfd3d2a2e4732876fa91c804d5f58 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:48.397416 25973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015dfd3d2a2e4732876fa91c804d5f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.398236 26104 tablet_bootstrap.cc:654] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.405050 25985 raft_consensus.cc:2468] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:48.405857 26115 raft_consensus.cc:2749] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:48.405692 26045 tablet_service.cc:1511] Processing CreateTablet for tablet 015dfd3d2a2e4732876fa91c804d5f58 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:48.407445 26045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015dfd3d2a2e4732876fa91c804d5f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.398315 26113 raft_consensus.cc:515] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.417351 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b7bc1778ac476b9576cf48b4353789" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:48.418247 25910 raft_consensus.cc:3060] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.422142 26105 raft_consensus.cc:359] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.423095 26105 raft_consensus.cc:385] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.423506 26105 raft_consensus.cc:740] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.424183 26115 raft_consensus.cc:493] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.424998 26115 raft_consensus.cc:515] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.430191 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:48.433867 25949 leader_election.cc:343] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.435252 26106 tablet_bootstrap.cc:492] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:48.435822 26106 ts_tablet_manager.cc:1403] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.288s	user 0.018s	sys 0.008s
I20260709 13:21:48.437327 26115 leader_election.cc:290] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:48.437165 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 83fcb34b2da1456c9b298616cda786a4 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:48.438556 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fcb34b2da1456c9b298616cda786a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.439357 26107 tablet_bootstrap.cc:654] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.438966 26106 raft_consensus.cc:359] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.439761 26106 raft_consensus.cc:385] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.440058 26106 raft_consensus.cc:740] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.441051 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b7bc1778ac476b9576cf48b4353789" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:48.440783 26106 consensus_queue.cc:260] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.441697 25984 raft_consensus.cc:3060] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.433264 26113 leader_election.cc:290] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:21:48.389743 25802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:46717, user_credentials={real_user=slave}} blocked reactor thread for 57135.7us
I20260709 13:21:48.446201 25874 leader_election.cc:304] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:48.446264 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:48.448038 26114 raft_consensus.cc:2804] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:48.448344 25951 leader_election.cc:343] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.448871 25951 leader_election.cc:304] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:48.444561 26105 consensus_queue.cc:260] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.450259 26115 raft_consensus.cc:2749] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:48.457823 25896 tablet_service.cc:1511] Processing CreateTablet for tablet 83fcb34b2da1456c9b298616cda786a4 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:48.459288 25896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fcb34b2da1456c9b298616cda786a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.460949 25910 raft_consensus.cc:2468] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:48.462291 26025 leader_election.cc:304] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:48.462762 25974 tablet_service.cc:1511] Processing CreateTablet for tablet 83fcb34b2da1456c9b298616cda786a4 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:48.464102 25974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fcb34b2da1456c9b298616cda786a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.465811 26113 raft_consensus.cc:2804] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:48.466544 26113 raft_consensus.cc:697] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:48.469219 26113 consensus_queue.cc:237] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.467945 26045 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8ea7f0acae4a2fb1fac24abac35b6f (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:48.471632 26045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8ea7f0acae4a2fb1fac24abac35b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.481350 26114 raft_consensus.cc:697] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:48.486246 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8ea7f0acae4a2fb1fac24abac35b6f (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:48.489833 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8ea7f0acae4a2fb1fac24abac35b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.494232 26112 raft_consensus.cc:2749] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:48.495496 25898 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8ea7f0acae4a2fb1fac24abac35b6f (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:48.503713 25898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8ea7f0acae4a2fb1fac24abac35b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.504007 26104 tablet_bootstrap.cc:492] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:48.504771 26104 ts_tablet_manager.cc:1403] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.116s	user 0.016s	sys 0.029s
I20260709 13:21:48.510471 25835 raft_consensus.cc:2468] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:48.496730 26114 consensus_queue.cc:237] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.501850 26106 ts_tablet_manager.cc:1434] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 13:21:48.516674 26106 tablet_bootstrap.cc:492] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:48.519121 26023 leader_election.cc:304] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de
I20260709 13:21:48.520334 26138 raft_consensus.cc:2804] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:48.514026 26105 ts_tablet_manager.cc:1434] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.193s	user 0.025s	sys 0.014s
I20260709 13:21:48.502425 25984 raft_consensus.cc:2468] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:48.537623 25972 tablet_service.cc:1511] Processing CreateTablet for tablet 61dbdaf9ef5f4640b9150440ef18c88c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:48.538769 26046 tablet_service.cc:1511] Processing CreateTablet for tablet 61dbdaf9ef5f4640b9150440ef18c88c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:48.539506 25972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61dbdaf9ef5f4640b9150440ef18c88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.538785 26112 raft_consensus.cc:493] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.541700 26112 raft_consensus.cc:515] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.545794 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:48.540750 26046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61dbdaf9ef5f4640b9150440ef18c88c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:48.549953 25799 leader_election.cc:343] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.548516 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:48.552968 26105 tablet_bootstrap.cc:492] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:48.553154 26059 raft_consensus.cc:2468] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:48.554571 26112 leader_election.cc:290] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:48.566200 26138 raft_consensus.cc:697] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:48.565626 26104 raft_consensus.cc:359] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:48.591257 26105 tablet_bootstrap.cc:654] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.593957 25821 tablet_service.cc:1511] Processing CreateTablet for tablet 61dbdaf9ef5f4640b9150440ef18c88c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:48.595424 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61dbdaf9ef5f4640b9150440ef18c88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.598541 25801 leader_election.cc:304] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:48.600299 26112 raft_consensus.cc:2804] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:48.600790 26112 raft_consensus.cc:493] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:48.601133 26112 raft_consensus.cc:3060] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.583793 26104 raft_consensus.cc:385] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.607502 25897 tablet_service.cc:1511] Processing CreateTablet for tablet d150b2f01c6a49f284817b4f031c89de (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:48.608888 25897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d150b2f01c6a49f284817b4f031c89de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.617875 25973 tablet_service.cc:1511] Processing CreateTablet for tablet d150b2f01c6a49f284817b4f031c89de (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:48.619694 25973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d150b2f01c6a49f284817b4f031c89de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:48.627871 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:48.629665 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 46e40f11ff0b4d47bda6cd2c01a752e8 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:48.631335 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e40f11ff0b4d47bda6cd2c01a752e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.635365 25975 tablet_service.cc:1511] Processing CreateTablet for tablet 46e40f11ff0b4d47bda6cd2c01a752e8 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:48.637121 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e40f11ff0b4d47bda6cd2c01a752e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.639487 26142 raft_consensus.cc:493] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.640139 26142 raft_consensus.cc:515] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.641664 25734 catalog_manager.cc:5697] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.643893 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:48.644786 25835 raft_consensus.cc:2393] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dbc14fa82f4a22b1cab8f3691196de in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:48.604887 26104 raft_consensus.cc:740] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.649828 26112 raft_consensus.cc:515] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.657069 26146 raft_consensus.cc:493] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.656881 26138 consensus_queue.cc:237] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.651614 26142 leader_election.cc:290] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:48.659245 26107 tablet_bootstrap.cc:492] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:48.662683 26107 ts_tablet_manager.cc:1403] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.306s	user 0.042s	sys 0.046s
I20260709 13:21:48.663797 26105 tablet_bootstrap.cc:492] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:48.664264 26105 ts_tablet_manager.cc:1403] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.140s	user 0.019s	sys 0.043s
I20260709 13:21:48.658929 25898 tablet_service.cc:1511] Processing CreateTablet for tablet 46e40f11ff0b4d47bda6cd2c01a752e8 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:48.667491 25898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e40f11ff0b4d47bda6cd2c01a752e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.667946 26105 raft_consensus.cc:359] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.669050 26105 raft_consensus.cc:385] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.669425 26105 raft_consensus.cc:740] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.670733 26105 consensus_queue.cc:260] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.671556 26107 raft_consensus.cc:359] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.672423 26107 raft_consensus.cc:385] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.674017 26105 ts_tablet_manager.cc:1434] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:21:48.685016 26105 tablet_bootstrap.cc:492] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:48.675321 26146 raft_consensus.cc:515] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:48.692801 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:48.694420 26105 tablet_bootstrap.cc:654] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.692757 26112 leader_election.cc:290] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:48.693023 26106 tablet_bootstrap.cc:654] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.698733 26048 tablet_service.cc:1511] Processing CreateTablet for tablet d150b2f01c6a49f284817b4f031c89de (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:48.700117 26048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d150b2f01c6a49f284817b4f031c89de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.672794 26107 raft_consensus.cc:740] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.701792 26107 consensus_queue.cc:260] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.704066 26107 ts_tablet_manager.cc:1434] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:21:48.705152 26104 consensus_queue.cc:260] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:48.688650 26146 leader_election.cc:290] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:48.779115 25900 tablet_service.cc:1511] Processing CreateTablet for tablet bbe43c0e1b72475da18a3ce2febfa9e3 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:48.753738 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:48.908829 25835 raft_consensus.cc:2393] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cb7aae2a23a47c180432cb646577fd6 in current term 1: Already voted for candidate 8e453645ce774c99b4b4aafb4362719b in this term.
I20260709 13:21:48.909286 25900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe43c0e1b72475da18a3ce2febfa9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.708953 26104 ts_tablet_manager.cc:1434] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.204s	user 0.007s	sys 0.004s
I20260709 13:21:48.800876 25968 tablet_service.cc:1511] Processing CreateTablet for tablet 04360fb80eea42d7960ef5c2e4858275 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:48.912034 25968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04360fb80eea42d7960ef5c2e4858275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.907002 26112 raft_consensus.cc:493] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.912528 26104 tablet_bootstrap.cc:492] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:48.820333 25819 tablet_service.cc:1511] Processing CreateTablet for tablet 04360fb80eea42d7960ef5c2e4858275 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:48.927376 26106 tablet_bootstrap.cc:492] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:48.928313 26106 ts_tablet_manager.cc:1403] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.412s	user 0.010s	sys 0.005s
I20260709 13:21:48.928778 25819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04360fb80eea42d7960ef5c2e4858275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.930488 26112 raft_consensus.cc:515] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:48.797994 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:48.810950 26043 tablet_service.cc:1511] Processing CreateTablet for tablet 1f46a3b3a20d4dcbb895c0b6bba0a6c6 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:48.935118 26115 raft_consensus.cc:493] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:48.935675 25799 leader_election.cc:343] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.936673 26043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f46a3b3a20d4dcbb895c0b6bba0a6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.935112 26114 raft_consensus.cc:493] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.937922 26114 raft_consensus.cc:515] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.939951 26138 raft_consensus.cc:493] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.940663 26138 raft_consensus.cc:515] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:48.935736 26115 raft_consensus.cc:515] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:48.943295 26138 leader_election.cc:290] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:48.945690 26042 tablet_service.cc:1511] Processing CreateTablet for tablet 04360fb80eea42d7960ef5c2e4858275 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:48.829898 25730 catalog_manager.cc:5697] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:48.947463 26042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04360fb80eea42d7960ef5c2e4858275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.947917 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f90d8c21b9479cab6a633e8615dfef" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:48.769048 25826 tablet_service.cc:1511] Processing CreateTablet for tablet fe1deaadec34478f9d16b69e2cd0742a (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:21:48.949928 25875 leader_election.cc:343] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.950234 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f87eb5e589466fa0bc8c00974bdd91" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:48.950836 26115 leader_election.cc:290] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:48.951098 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe1deaadec34478f9d16b69e2cd0742a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.951483 26114 leader_election.cc:290] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:48.951306 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 7f86ad3167cc43d48b4c3c06d197cd23 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:48.906329 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:48.953435 26059 raft_consensus.cc:3060] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.953610 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f86ad3167cc43d48b4c3c06d197cd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.795406 25895 tablet_service.cc:1511] Processing CreateTablet for tablet 1f46a3b3a20d4dcbb895c0b6bba0a6c6 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:21:48.914855 26154 log.cc:927] Time spent T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:21:48.958247 25895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f46a3b3a20d4dcbb895c0b6bba0a6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.789440 25969 tablet_service.cc:1511] Processing CreateTablet for tablet ed0345d6849a4fcd8a00fa6dd75bad07 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:48.965987 26041 tablet_service.cc:1511] Processing CreateTablet for tablet cbb6cace1a274a589bb22b03411c0afe (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:48.967872 26041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb6cace1a274a589bb22b03411c0afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.966261 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f90d8c21b9479cab6a633e8615dfef" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:48.969173 25910 raft_consensus.cc:2468] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:48.970109 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
W20260709 13:21:48.971849 25802 leader_election.cc:343] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.971953 26025 leader_election.cc:304] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:48.772312 25824 tablet_service.cc:1511] Processing CreateTablet for tablet 3b7fe3b03581401f935bfe2a3c432484 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:48.975324 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b7fe3b03581401f935bfe2a3c432484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.830054 26049 tablet_service.cc:1511] Processing CreateTablet for tablet fe1deaadec34478f9d16b69e2cd0742a (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:48.979480 26049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe1deaadec34478f9d16b69e2cd0742a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.980695 25899 tablet_service.cc:1511] Processing CreateTablet for tablet 7f86ad3167cc43d48b4c3c06d197cd23 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:48.982653 25899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f86ad3167cc43d48b4c3c06d197cd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.979529 26138 raft_consensus.cc:2804] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:48.983148 26138 raft_consensus.cc:493] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:48.983520 26138 raft_consensus.cc:3060] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:49.002537 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:49.003412 25984 raft_consensus.cc:2468] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:49.005019 25799 leader_election.cc:304] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de
I20260709 13:21:49.006227 26112 leader_election.cc:290] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:49.006923 26112 raft_consensus.cc:2804] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:49.007431 26112 raft_consensus.cc:493] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:49.007846 26112 raft_consensus.cc:3060] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.757906 25896 tablet_service.cc:1511] Processing CreateTablet for tablet fe1deaadec34478f9d16b69e2cd0742a (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:49.014199 25896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe1deaadec34478f9d16b69e2cd0742a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.015944 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:49.018142 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f90d8c21b9479cab6a633e8615dfef" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:49.019709 25876 leader_election.cc:304] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:49.021482 26114 raft_consensus.cc:3060] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:49.023447 26106 raft_consensus.cc:359] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:21:49.024266 25949 leader_election.cc:343] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:49.024290 26106 raft_consensus.cc:385] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:49.025746 26106 raft_consensus.cc:740] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:49.026567 26106 consensus_queue.cc:260] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:48.785748 25970 tablet_service.cc:1511] Processing CreateTablet for tablet bbe43c0e1b72475da18a3ce2febfa9e3 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:49.032301 26142 consensus_queue.cc:1048] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:48.705180 26107 tablet_bootstrap.cc:492] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:48.784154 25823 tablet_service.cc:1511] Processing CreateTablet for tablet ed0345d6849a4fcd8a00fa6dd75bad07 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:49.061054 26146 consensus_queue.cc:1048] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:21:48.819136 26047 tablet_service.cc:1511] Processing CreateTablet for tablet 3b7fe3b03581401f935bfe2a3c432484 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:48.787596 25971 tablet_service.cc:1511] Processing CreateTablet for tablet 3b7fe3b03581401f935bfe2a3c432484 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:48.784154 25901 tablet_service.cc:1511] Processing CreateTablet for tablet ed0345d6849a4fcd8a00fa6dd75bad07 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:48.812608 26044 tablet_service.cc:1511] Processing CreateTablet for tablet bbe43c0e1b72475da18a3ce2febfa9e3 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:48.825634 25967 tablet_service.cc:1511] Processing CreateTablet for tablet cbb6cace1a274a589bb22b03411c0afe (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:48.793359 25820 tablet_service.cc:1511] Processing CreateTablet for tablet 1f46a3b3a20d4dcbb895c0b6bba0a6c6 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:48.807504 25894 tablet_service.cc:1511] Processing CreateTablet for tablet cbb6cace1a274a589bb22b03411c0afe (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:49.066206 25969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed0345d6849a4fcd8a00fa6dd75bad07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.089362 26106 ts_tablet_manager.cc:1434] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.161s	user 0.007s	sys 0.005s
W20260709 13:21:49.066457 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 61540.3us
I20260709 13:21:49.113855 25893 tablet_service.cc:1511] Processing CreateTablet for tablet 162133acfbc941968cb2dd81ad3d7f46 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:49.117115 26040 tablet_service.cc:1511] Processing CreateTablet for tablet 162133acfbc941968cb2dd81ad3d7f46 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:49.114089 25818 tablet_service.cc:1511] Processing CreateTablet for tablet 162133acfbc941968cb2dd81ad3d7f46 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:49.114234 25970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe43c0e1b72475da18a3ce2febfa9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.121106 25901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed0345d6849a4fcd8a00fa6dd75bad07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.121905 25893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162133acfbc941968cb2dd81ad3d7f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.112162 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed0345d6849a4fcd8a00fa6dd75bad07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.129447 25818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162133acfbc941968cb2dd81ad3d7f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.131529 26047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b7fe3b03581401f935bfe2a3c432484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.133563 26114 raft_consensus.cc:2749] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:49.138612 25894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb6cace1a274a589bb22b03411c0afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.142547 25820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f46a3b3a20d4dcbb895c0b6bba0a6c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:48.804457 26022 leader_election.cc:343] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:49.105154 26059 raft_consensus.cc:2468] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:49.153236 26040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162133acfbc941968cb2dd81ad3d7f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.150909 26045 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb960d6f3ef4634a29335330aa1c58c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:49.165711 26045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb960d6f3ef4634a29335330aa1c58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.156013 26138 raft_consensus.cc:515] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:49.166734 26058 raft_consensus.cc:2393] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dbc14fa82f4a22b1cab8f3691196de in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:49.167240 26022 leader_election.cc:304] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:49.168712 26146 raft_consensus.cc:2749] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:49.177213 26023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 243729us
I20260709 13:21:49.177640 26138 leader_election.cc:290] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:49.152140 25967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb6cace1a274a589bb22b03411c0afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.153980 25821 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb960d6f3ef4634a29335330aa1c58c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:49.180392 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb960d6f3ef4634a29335330aa1c58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.180776 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f90d8c21b9479cab6a633e8615dfef" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:49.181766 25910 raft_consensus.cc:3060] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:49.186579 25801 leader_election.cc:304] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:49.189647 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f90d8c21b9479cab6a633e8615dfef" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:49.191048 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f90d8c21b9479cab6a633e8615dfef" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:49.192210 25876 leader_election.cc:304] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:49.151355 26107 tablet_bootstrap.cc:654] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:49.169476 26022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 365417us
I20260709 13:21:49.202875 25972 tablet_service.cc:1511] Processing CreateTablet for tablet 7f86ad3167cc43d48b4c3c06d197cd23 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:49.203137 25974 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb960d6f3ef4634a29335330aa1c58c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:49.204387 25972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f86ad3167cc43d48b4c3c06d197cd23. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:49.210608 26023 leader_election.cc:343] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:49.211750 26158 raft_consensus.cc:493] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:49.212301 26158 raft_consensus.cc:515] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:49.214046 26105 tablet_bootstrap.cc:492] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:49.214690 26105 ts_tablet_manager.cc:1403] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.540s	user 0.036s	sys 0.031s
I20260709 13:21:49.214787 26158 leader_election.cc:290] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:49.214994 25898 tablet_service.cc:1511] Processing CreateTablet for tablet 000a2e7a3f5d41cfa0490dc7b23be634 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:49.216373 25898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000a2e7a3f5d41cfa0490dc7b23be634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.217240 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f87eb5e589466fa0bc8c00974bdd91" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:49.218876 25974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb960d6f3ef4634a29335330aa1c58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.218772 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f87eb5e589466fa0bc8c00974bdd91" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:49.219556 25984 raft_consensus.cc:2468] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:49.223304 25799 leader_election.cc:304] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:49.235734 26048 tablet_service.cc:1511] Processing CreateTablet for tablet 000a2e7a3f5d41cfa0490dc7b23be634 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:49.203089 26157 raft_consensus.cc:2804] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:49.240829 26106 tablet_bootstrap.cc:492] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:21:49.256258 26023 leader_election.cc:343] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:49.258644 25910 raft_consensus.cc:2468] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:49.260046 26025 leader_election.cc:304] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:49.260952 26146 raft_consensus.cc:2804] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:49.241180 25801 leader_election.cc:343] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:49.247781 26114 consensus_queue.cc:1048] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:21:49.263183 26157 raft_consensus.cc:697] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:49.264271 26157 consensus_queue.cc:237] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:49.265399 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 0262be24b803413883f14155c6e4c640 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:49.266718 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0262be24b803413883f14155c6e4c640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.250864 26044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe43c0e1b72475da18a3ce2febfa9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.144831 26112 raft_consensus.cc:515] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:49.248395 26138 consensus_queue.cc:1048] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:21:49.278930 26138 consensus_queue.cc:1048] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:49.282155 25973 tablet_service.cc:1511] Processing CreateTablet for tablet 000a2e7a3f5d41cfa0490dc7b23be634 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:49.284694 25971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b7fe3b03581401f935bfe2a3c432484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.288430 26160 raft_consensus.cc:2749] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:49.304148 25973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000a2e7a3f5d41cfa0490dc7b23be634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.249311 26158 raft_consensus.cc:2804] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:49.306511 26158 raft_consensus.cc:493] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:49.306957 26158 raft_consensus.cc:3060] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:49.354046 26048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000a2e7a3f5d41cfa0490dc7b23be634. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:49.371933 25718 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 69565.5us
I20260709 13:21:49.383705 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f87eb5e589466fa0bc8c00974bdd91" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
W20260709 13:21:49.385581 25950 leader_election.cc:343] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:49.386088 25950 leader_election.cc:304] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:49.387282 26115 raft_consensus.cc:2749] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:49.353655 26146 raft_consensus.cc:697] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:49.399317 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:49.400035 25985 raft_consensus.cc:3060] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:49.395752 26112 leader_election.cc:290] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:49.413975 26167 consensus_queue.cc:1048] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:49.418072 25721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.208.2:46717, user_credentials={real_user=slave}} blocked reactor thread for 71953.2us
I20260709 13:21:49.389606 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:49.429000 25900 tablet_service.cc:1511] Processing CreateTablet for tablet 0262be24b803413883f14155c6e4c640 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:49.431622 25900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0262be24b803413883f14155c6e4c640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.434113 26106 tablet_bootstrap.cc:654] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:49.437927 26104 tablet_bootstrap.cc:654] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:49.452569 25967 tablet_service.cc:1511] Processing CreateTablet for tablet 0262be24b803413883f14155c6e4c640 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:21:49.423918 26023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 152137us
I20260709 13:21:49.486184 26107 tablet_bootstrap.cc:492] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:49.486888 26107 ts_tablet_manager.cc:1403] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.782s	user 0.029s	sys 0.014s
W20260709 13:21:49.483384 25802 leader_election.cc:343] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:49.495908 26042 tablet_service.cc:1511] Processing CreateTablet for tablet 84a6ea62d4ba491aaf3c705964525771 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:49.497526 25734 catalog_manager.cc:5697] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } }
I20260709 13:21:49.498947 25985 raft_consensus.cc:2468] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:49.500587 25799 leader_election.cc:304] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de
I20260709 13:21:49.501911 26112 raft_consensus.cc:2804] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:49.502470 26112 raft_consensus.cc:697] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:49.503476 26112 consensus_queue.cc:237] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:49.521095 26146 consensus_queue.cc:237] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:49.524677 26107 raft_consensus.cc:359] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:49.525808 26107 raft_consensus.cc:385] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:49.526190 26107 raft_consensus.cc:740] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
W20260709 13:21:49.531008 25718 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 52319.2us
I20260709 13:21:49.534844 25967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0262be24b803413883f14155c6e4c640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.561422 26042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a6ea62d4ba491aaf3c705964525771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.572899 25819 tablet_service.cc:1511] Processing CreateTablet for tablet 84a6ea62d4ba491aaf3c705964525771 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:49.574502 25819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a6ea62d4ba491aaf3c705964525771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.576164 25975 tablet_service.cc:1511] Processing CreateTablet for tablet bad2bafd1f44402cbf2f7d5ca62a7508 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:49.577711 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad2bafd1f44402cbf2f7d5ca62a7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.577596 26041 tablet_service.cc:1511] Processing CreateTablet for tablet bad2bafd1f44402cbf2f7d5ca62a7508 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:49.540613 26105 raft_consensus.cc:359] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:49.585642 26105 raft_consensus.cc:385] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:49.586043 26105 raft_consensus.cc:740] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:49.586236 26106 tablet_bootstrap.cc:492] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:49.586834 26106 ts_tablet_manager.cc:1403] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.346s	user 0.020s	sys 0.007s
I20260709 13:21:49.586922 26105 consensus_queue.cc:260] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:49.587110 25970 tablet_service.cc:1511] Processing CreateTablet for tablet 981001373c784e27a4ec5bef4b640b77 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:49.589035 25970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981001373c784e27a4ec5bef4b640b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.594328 25823 tablet_service.cc:1511] Processing CreateTablet for tablet 400ea59a8a0048199f9090a390dd25f7 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:49.596220 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400ea59a8a0048199f9090a390dd25f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.592008 25825 tablet_service.cc:1511] Processing CreateTablet for tablet bad2bafd1f44402cbf2f7d5ca62a7508 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:49.615324 25898 tablet_service.cc:1511] Processing CreateTablet for tablet 84a6ea62d4ba491aaf3c705964525771 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:49.617055 25898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a6ea62d4ba491aaf3c705964525771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.600751 25894 tablet_service.cc:1511] Processing CreateTablet for tablet 981001373c784e27a4ec5bef4b640b77 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:49.621735 26105 ts_tablet_manager.cc:1434] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.407s	user 0.015s	sys 0.002s
I20260709 13:21:49.622390 25894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981001373c784e27a4ec5bef4b640b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.624644 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad2bafd1f44402cbf2f7d5ca62a7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.620635 26106 raft_consensus.cc:359] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:49.628239 26041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad2bafd1f44402cbf2f7d5ca62a7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.628239 26106 raft_consensus.cc:385] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:49.629598 26106 raft_consensus.cc:740] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:49.630530 26106 consensus_queue.cc:260] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:49.631983 26043 tablet_service.cc:1511] Processing CreateTablet for tablet 981001373c784e27a4ec5bef4b640b77 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:49.633776 26106 ts_tablet_manager.cc:1434] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.011s
I20260709 13:21:49.633939 26043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981001373c784e27a4ec5bef4b640b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.517671 25730 catalog_manager.cc:5697] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:49.639300 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:49.635303 26106 tablet_bootstrap.cc:492] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:49.551875 26107 consensus_queue.cc:260] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:21:49.659125 26022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 119043us
I20260709 13:21:49.666858 25901 tablet_service.cc:1511] Processing CreateTablet for tablet 400ea59a8a0048199f9090a390dd25f7 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:49.668496 25901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400ea59a8a0048199f9090a390dd25f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.676699 26104 tablet_bootstrap.cc:492] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:49.679412 26105 tablet_bootstrap.cc:492] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:49.679498 26104 ts_tablet_manager.cc:1403] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.768s	user 0.027s	sys 0.012s
I20260709 13:21:49.683825 26104 raft_consensus.cc:359] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:49.684784 26104 raft_consensus.cc:385] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:49.685170 26104 raft_consensus.cc:740] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:49.678474 26158 raft_consensus.cc:515] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:49.680641 26106 tablet_bootstrap.cc:654] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:49.711925 25826 consensus_meta.cc:287] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.011s
I20260709 13:21:49.718330 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f87eb5e589466fa0bc8c00974bdd91" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:49.719034 25984 raft_consensus.cc:3060] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:49.723991 26158 leader_election.cc:290] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:49.725080 25826 tablet_service.cc:1511] Processing CreateTablet for tablet b4ef1a919b9a4fd5b21ef202381e6f54 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:49.726598 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ef1a919b9a4fd5b21ef202381e6f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.727690 25984 raft_consensus.cc:2468] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:49.729058 25799 leader_election.cc:304] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:49.728881 25734 catalog_manager.cc:5697] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.730139 26158 raft_consensus.cc:2804] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:49.730628 26158 raft_consensus.cc:697] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:49.731436 26158 consensus_queue.cc:237] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:49.731792 25900 tablet_service.cc:1511] Processing CreateTablet for tablet b4ef1a919b9a4fd5b21ef202381e6f54 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:49.736701 25975 tablet_service.cc:1511] Processing CreateTablet for tablet 400ea59a8a0048199f9090a390dd25f7 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:49.737856 25900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ef1a919b9a4fd5b21ef202381e6f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.737929 25969 tablet_service.cc:1511] Processing CreateTablet for tablet fd7cba52ce9343d1bee167ea3364a7f9 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:49.737929 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400ea59a8a0048199f9090a390dd25f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.741233 25969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7cba52ce9343d1bee167ea3364a7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.744758 26105 tablet_bootstrap.cc:654] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:49.698274 26025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:46717, user_credentials={real_user=slave}} blocked reactor thread for 47655us
I20260709 13:21:49.784708 26160 raft_consensus.cc:493] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:49.785338 26160 raft_consensus.cc:515] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:49.787606 26160 leader_election.cc:290] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:49.788408 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:49.802181 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:49.803076 25984 raft_consensus.cc:2393] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dbc14fa82f4a22b1cab8f3691196de in current term 1: Already voted for candidate 8e453645ce774c99b4b4aafb4362719b in this term.
I20260709 13:21:49.804804 25874 leader_election.cc:304] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:49.806888 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f87eb5e589466fa0bc8c00974bdd91" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:49.807546 26058 raft_consensus.cc:3060] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:49.814359 26048 tablet_service.cc:1511] Processing CreateTablet for tablet b4ef1a919b9a4fd5b21ef202381e6f54 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:49.815650 26048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ef1a919b9a4fd5b21ef202381e6f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.824466 26160 raft_consensus.cc:3060] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:49.827661 26107 ts_tablet_manager.cc:1434] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.340s	user 0.012s	sys 0.000s
I20260709 13:21:49.831607 26047 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44542 (request call id 25) took 1024 ms. Trace:
I20260709 13:21:49.833187 25971 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39884 (request call id 25) took 1053 ms. Trace:
I20260709 13:21:49.833647 25971 rpcz_store.cc:276] 0709 13:21:48.780447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:48.785977 (+  5530us) service_pool.cc:224] Handling call
0709 13:21:49.118844 (+332867us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b58009b3198. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d5f58fdb1 00007f7d5f6cfb71 00007f7d5f6cfa22 00007f7d685e8c09 00007f7d67742ee0 00007f7d67828831 00007f7d67805ac3 00007f7d677b4400 00007f7d60c39af4 00007f7d60c39a82 00007f7d60c399b1
0709 13:21:49.118981 (+   137us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.152987 (+ 34006us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.430507 (+277520us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:49.794333 (+363826us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:49.833127 (+ 38794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4117376}
I20260709 13:21:49.765535 26104 consensus_queue.cc:260] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:49.843150 26045 tablet_service.cc:1511] Processing CreateTablet for tablet fd7cba52ce9343d1bee167ea3364a7f9 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:49.844662 26045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7cba52ce9343d1bee167ea3364a7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:49.845301 26104 ts_tablet_manager.cc:1434] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.165s	user 0.002s	sys 0.006s
I20260709 13:21:49.845867 26107 tablet_bootstrap.cc:492] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:49.855224 26104 tablet_bootstrap.cc:492] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:49.856082 26058 raft_consensus.cc:2468] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:49.832079 26047 rpcz_store.cc:276] 0709 13:21:48.807253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:48.817541 (+ 10288us) service_pool.cc:224] Handling call
0709 13:21:49.078564 (+261023us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.085829 (+  7265us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.518867 (+433038us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:49.830994 (+312127us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:49.831540 (+   546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:49.870496 26044 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44542 (request call id 26) took 1062 ms. Trace:
I20260709 13:21:49.871074 26044 rpcz_store.cc:276] 0709 13:21:48.807727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:48.811146 (+  3419us) service_pool.cc:224] Handling call
0709 13:21:49.091887 (+280741us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.096022 (+  4135us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.644598 (+548576us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:49.869918 (+225320us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:49.870411 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:49.884881 26158 consensus_queue.cc:1048] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:21:49.910887 26107 tablet_bootstrap.cc:654] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.642858 26105 tablet_bootstrap.cc:492] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:50.643517 26105 ts_tablet_manager.cc:1403] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.979s	user 0.024s	sys 0.012s
I20260709 13:21:50.648041 26191 raft_consensus.cc:493] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:50.648623 26191 raft_consensus.cc:515] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:50.650147 26105 raft_consensus.cc:359] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:50.650903 26105 raft_consensus.cc:385] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:50.651207 26105 raft_consensus.cc:740] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:50.651425 26191 leader_election.cc:290] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:50.651999 26105 consensus_queue.cc:260] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:50.653602 26105 ts_tablet_manager.cc:1434] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:50.655424 26105 tablet_bootstrap.cc:492] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
W20260709 13:21:50.655961 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.000s	sys 0.011s
W20260709 13:21:50.656356 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.000s	sys 0.011s
I20260709 13:21:50.663375 26105 tablet_bootstrap.cc:654] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.667824 26105 tablet_bootstrap.cc:492] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:50.668298 26105 ts_tablet_manager.cc:1403] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
W20260709 13:21:50.670110 25826 consensus_meta.cc:287] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: Time spent flushing consensus metadata: real 0.814s	user 0.016s	sys 0.004s
I20260709 13:21:50.671419 26105 raft_consensus.cc:359] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:50.672159 26105 raft_consensus.cc:385] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:50.672472 26105 raft_consensus.cc:740] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:50.673260 26105 consensus_queue.cc:260] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:50.675189 26105 ts_tablet_manager.cc:1434] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:50.676268 26105 tablet_bootstrap.cc:492] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:50.677728 25826 tablet_service.cc:1511] Processing CreateTablet for tablet fd7cba52ce9343d1bee167ea3364a7f9 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:50.681317 25819 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53322 (request call id 34) took 1109 ms. Trace:
I20260709 13:21:50.681833 26105 tablet_bootstrap.cc:654] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.681726 25819 rpcz_store.cc:276] 0709 13:21:49.571598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:49.571760 (+   162us) service_pool.cc:224] Handling call
0709 13:21:49.573909 (+  2149us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.574015 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.696782 (+122767us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:49.863973 (+167191us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:50.681240 (+817267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408}
I20260709 13:21:50.688495 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7cba52ce9343d1bee167ea3364a7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.702664 26104 tablet_bootstrap.cc:654] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:50.710829 25732 catalog_manager.cc:5697] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.726543 25900 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf0142f8c8d4e7e9a4edc4e88bb184c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:50.726406 25819 tablet_service.cc:1511] Processing CreateTablet for tablet 50052343bec74747b699a16e53a348b6 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:50.734598 25835 raft_consensus.cc:3060] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:50.735497 25900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf0142f8c8d4e7e9a4edc4e88bb184c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.735939 25819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50052343bec74747b699a16e53a348b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.727101 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f90d8c21b9479cab6a633e8615dfef" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:50.737504 25909 raft_consensus.cc:2393] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:50.743383 25967 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf0142f8c8d4e7e9a4edc4e88bb184c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:21:50.731019 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:50.747673 25975 tablet_service.cc:1511] Processing CreateTablet for tablet 50052343bec74747b699a16e53a348b6 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:50.750799 25898 tablet_service.cc:1511] Processing CreateTablet for tablet 50052343bec74747b699a16e53a348b6 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:50.751930 25898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50052343bec74747b699a16e53a348b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.759614 25967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf0142f8c8d4e7e9a4edc4e88bb184c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.762162 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50052343bec74747b699a16e53a348b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.765864 25894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51528 (request call id 35) took 1166 ms. Trace:
I20260709 13:21:50.769722 25826 tablet_service.cc:1511] Processing CreateTablet for tablet b576e68fb75f4973a322f1566d0fd69c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:50.770920 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b576e68fb75f4973a322f1566d0fd69c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:50.770867 26040 consensus_meta.cc:287] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6: Time spent flushing consensus metadata: real 0.912s	user 0.013s	sys 0.004s
I20260709 13:21:50.782582 26040 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44542 (request call id 30) took 1746 ms. Trace:
I20260709 13:21:50.782992 26040 rpcz_store.cc:276] 0709 13:21:49.036308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:49.036603 (+   295us) service_pool.cc:224] Handling call
0709 13:21:49.118175 (+ 81572us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.118302 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.858905 (+740603us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:50.782030 (+923125us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:50.782515 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:50.766305 25894 rpcz_store.cc:276] 0709 13:21:49.599047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:49.599300 (+   253us) service_pool.cc:224] Handling call
0709 13:21:49.621810 (+ 22510us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.621959 (+   149us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.883588 (+261629us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:50.765179 (+881591us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:50.765776 (+   597us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:21:50.791214 26042 consensus_meta.cc:287] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6: Time spent flushing consensus metadata: real 0.953s	user 0.013s	sys 0.006s
I20260709 13:21:50.792696 25970 tablet_service.cc:1511] Processing CreateTablet for tablet e42cec7e321749d39d2184b40221df6c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:50.793864 26042 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44542 (request call id 33) took 1303 ms. Trace:
I20260709 13:21:50.794286 26042 rpcz_store.cc:276] 0709 13:21:49.490847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:49.494549 (+  3702us) service_pool.cc:224] Handling call
0709 13:21:49.496961 (+  2412us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.497062 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.837682 (+340620us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:50.793364 (+955682us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:50.793812 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:50.793979 25970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42cec7e321749d39d2184b40221df6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.807103 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5cee043c4a449188a031808c1da79e (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:50.810585 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5cee043c4a449188a031808c1da79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.813081 25820 tablet_service.cc:1511] Processing CreateTablet for tablet 011e0b4473294a54a4e5b968a1bee812 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:50.814920 25820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011e0b4473294a54a4e5b968a1bee812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.812116 25975 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5cee043c4a449188a031808c1da79e (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:50.826828 25975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5cee043c4a449188a031808c1da79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.833755 25819 tablet_service.cc:1511] Processing CreateTablet for tablet e42cec7e321749d39d2184b40221df6c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:50.835242 25819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42cec7e321749d39d2184b40221df6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.843598 25900 tablet_service.cc:1511] Processing CreateTablet for tablet a91a957dc23746599c956ea9b45f3fba (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:50.843861 25898 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5cee043c4a449188a031808c1da79e (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:21:50.844559 26160 consensus_meta.cc:287] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent flushing consensus metadata: real 1.020s	user 0.004s	sys 0.009s
I20260709 13:21:50.844872 25900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a91a957dc23746599c956ea9b45f3fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.845017 26160 raft_consensus.cc:2749] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:50.845515 25898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5cee043c4a449188a031808c1da79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.850018 26178 consensus_queue.cc:1048] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:21:50.866331 26105 tablet_bootstrap.cc:492] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:50.866165 25894 tablet_service.cc:1511] Processing CreateTablet for tablet 011e0b4473294a54a4e5b968a1bee812 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:50.868187 25894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011e0b4473294a54a4e5b968a1bee812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.866999 26105 ts_tablet_manager.cc:1403] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.191s	user 0.035s	sys 0.056s
I20260709 13:21:50.875663 26104 tablet_bootstrap.cc:492] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:50.876246 26104 ts_tablet_manager.cc:1403] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 1.021s	user 0.046s	sys 0.026s
I20260709 13:21:50.876791 26105 raft_consensus.cc:359] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:50.877511 26105 raft_consensus.cc:385] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:50.877748 26105 raft_consensus.cc:740] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:50.883155 26115 raft_consensus.cc:493] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:50.883690 26115 raft_consensus.cc:515] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:50.886713 26115 leader_election.cc:290] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:50.887455 26105 consensus_queue.cc:260] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:50.889590 26105 ts_tablet_manager.cc:1434] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:21:50.889822 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 1821e793dcc0499d9d8a707ea4f8d0d2 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:50.891072 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1821e793dcc0499d9d8a707ea4f8d0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.893756 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:50.894600 26058 raft_consensus.cc:2393] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d01fccfd609b4182a5d43a7f6b4ae503 in current term 1: Already voted for candidate 8e453645ce774c99b4b4aafb4362719b in this term.
I20260709 13:21:50.895098 25901 tablet_service.cc:1511] Processing CreateTablet for tablet b576e68fb75f4973a322f1566d0fd69c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:50.896543 25901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b576e68fb75f4973a322f1566d0fd69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.900520 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:50.902340 25949 leader_election.cc:304] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:50.902805 26104 raft_consensus.cc:359] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:50.903563 26115 raft_consensus.cc:3060] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:50.904299 26105 tablet_bootstrap.cc:492] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
W20260709 13:21:50.906720 26041 consensus_meta.cc:287] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6: Time spent flushing consensus metadata: real 1.119s	user 0.012s	sys 0.005s
I20260709 13:21:50.922510 26042 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf0142f8c8d4e7e9a4edc4e88bb184c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:50.923360 25969 tablet_service.cc:1511] Processing CreateTablet for tablet 1821e793dcc0499d9d8a707ea4f8d0d2 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:50.923909 26042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf0142f8c8d4e7e9a4edc4e88bb184c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.925802 26040 tablet_service.cc:1511] Processing CreateTablet for tablet b576e68fb75f4973a322f1566d0fd69c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:21:50.926272 25765 debug-util.cc:398] Leaking SignalData structure 0x7b0800292f00 after lost signal to thread 16195
I20260709 13:21:50.927124 26040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b576e68fb75f4973a322f1566d0fd69c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:50.927640 25765 debug-util.cc:398] Leaking SignalData structure 0x7b08000460c0 after lost signal to thread 25768
I20260709 13:21:50.930145 26045 tablet_service.cc:1511] Processing CreateTablet for tablet e42cec7e321749d39d2184b40221df6c (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:50.930882 26047 tablet_service.cc:1511] Processing CreateTablet for tablet 011e0b4473294a54a4e5b968a1bee812 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:50.931275 26045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42cec7e321749d39d2184b40221df6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.932092 26047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011e0b4473294a54a4e5b968a1bee812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.934136 26049 tablet_service.cc:1511] Processing CreateTablet for tablet 1821e793dcc0499d9d8a707ea4f8d0d2 (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:50.934204 26044 tablet_service.cc:1511] Processing CreateTablet for tablet a91a957dc23746599c956ea9b45f3fba (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:50.935212 26160 raft_consensus.cc:493] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:50.935527 26049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1821e793dcc0499d9d8a707ea4f8d0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.935698 26160 raft_consensus.cc:515] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:50.939786 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244656e8e9b646c48e9b5b92ed53ba51" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:50.926246 26048 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44542 (request call id 36) took 1113 ms. Trace:
I20260709 13:21:50.945514 26048 rpcz_store.cc:276] 0709 13:21:49.813292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:49.813434 (+   142us) service_pool.cc:224] Handling call
0709 13:21:49.815189 (+  1755us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.815279 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.845693 (+ 30414us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:49.891801 (+ 46108us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:50.926187 (+1034386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:50.903607 26104 raft_consensus.cc:385] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:50.941232 26160 leader_election.cc:290] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:50.958087 26041 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44542 (request call id 34) took 1381 ms. Trace:
I20260709 13:21:50.959080 26044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a91a957dc23746599c956ea9b45f3fba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:50.960940 25875 leader_election.cc:343] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:50.961208 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244656e8e9b646c48e9b5b92ed53ba51" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:50.961673 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f90d8c21b9479cab6a633e8615dfef" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:50.958087 26142 raft_consensus.cc:493] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:50.963102 26142 raft_consensus.cc:515] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:50.965752 25801 leader_election.cc:304] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:50.966514 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b69a58c24c44d16b7aeed68a23964a5" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:50.966751 25823 consensus_meta.cc:287] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: Time spent flushing consensus metadata: real 1.182s	user 0.013s	sys 0.010s
I20260709 13:21:50.967849 26189 raft_consensus.cc:2749] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:50.968573 26189 consensus_queue.cc:1048] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:50.968950 26178 consensus_queue.cc:1048] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:50.970511 25876 leader_election.cc:343] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:50.970989 25876 leader_election.cc:304] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:50.951216 26104 raft_consensus.cc:740] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:50.971774 26160 raft_consensus.cc:2749] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:50.964676 25969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1821e793dcc0499d9d8a707ea4f8d0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:50.958683 26041 rpcz_store.cc:276] 0709 13:21:49.576346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:49.576523 (+   177us) service_pool.cc:224] Handling call
0709 13:21:49.578664 (+  2141us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.578763 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.787543 (+208780us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:50.914482 (+1126939us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:50.958017 (+ 43535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:50.967844 25823 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53322 (request call id 36) took 1377 ms. Trace:
I20260709 13:21:50.951313 26115 raft_consensus.cc:2749] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:50.974229 25823 rpcz_store.cc:276] 0709 13:21:49.590438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:49.592984 (+  2546us) service_pool.cc:224] Handling call
0709 13:21:49.595541 (+  2557us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.595686 (+   145us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.784017 (+188331us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:50.967296 (+1183279us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:50.967784 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:50.976308 26142 leader_election.cc:290] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:50.972440 26104 consensus_queue.cc:260] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:50.983587 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b69a58c24c44d16b7aeed68a23964a5" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
W20260709 13:21:50.984977 25876 leader_election.cc:343] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:50.985827 26104 ts_tablet_manager.cc:1434] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.106s	user 0.003s	sys 0.005s
I20260709 13:21:50.987221 26104 tablet_bootstrap.cc:492] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
W20260709 13:21:50.993076 25874 leader_election.cc:343] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:50.993922 26043 consensus_meta.cc:287] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6: Time spent flushing consensus metadata: real 1.167s	user 0.014s	sys 0.003s
I20260709 13:21:51.005591 26043 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44542 (request call id 35) took 1420 ms. Trace:
I20260709 13:21:51.006042 26043 rpcz_store.cc:276] 0709 13:21:49.585228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:49.610828 (+ 25600us) service_pool.cc:224] Handling call
0709 13:21:49.633294 (+ 22466us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:49.633398 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:49.826432 (+193034us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:51.005120 (+1178688us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:51.005534 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:51.007143 25874 leader_election.cc:304] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:51.008050 26142 raft_consensus.cc:2749] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:51.008790 26112 consensus_queue.cc:1048] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:51.014026 26105 tablet_bootstrap.cc:654] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.022070 26190 consensus_queue.cc:1048] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:51.023550 26190 consensus_queue.cc:1048] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:51.037537 25973 tablet_service.cc:1511] Processing CreateTablet for tablet a91a957dc23746599c956ea9b45f3fba (DEFAULT_TABLE table=test-workload [id=9440ff50dcff468e922382aa08623b46]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:51.041772 25973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a91a957dc23746599c956ea9b45f3fba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:51.042868 25765 debug-util.cc:398] Leaking SignalData structure 0x7b080006ffc0 after lost signal to thread 25860
W20260709 13:21:51.043242 25765 debug-util.cc:398] Leaking SignalData structure 0x7b080006fee0 after lost signal to thread 25861
W20260709 13:21:51.044384 25765 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3860 after lost signal to thread 25935
W20260709 13:21:51.052152 25765 debug-util.cc:398] Leaking SignalData structure 0x7b08000a11c0 after lost signal to thread 26009
I20260709 13:21:51.024755 26190 consensus_queue.cc:1048] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
W20260709 13:21:51.060212 25765 debug-util.cc:398] Leaking SignalData structure 0x7b0800333440 after lost signal to thread 26083
W20260709 13:21:51.065505 25765 debug-util.cc:398] Leaking SignalData structure 0x7b0800397a00 after lost signal to thread 26084
I20260709 13:21:51.095255 26106 tablet_bootstrap.cc:492] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:51.095834 26106 ts_tablet_manager.cc:1403] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 1.461s	user 0.023s	sys 0.025s
I20260709 13:21:51.107757 26106 raft_consensus.cc:359] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.121443 26106 raft_consensus.cc:385] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.129441 26106 raft_consensus.cc:740] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.130291 26106 consensus_queue.cc:260] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.145516 26105 tablet_bootstrap.cc:492] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:51.146112 26105 ts_tablet_manager.cc:1403] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.256s	user 0.019s	sys 0.001s
I20260709 13:21:51.160974 26107 tablet_bootstrap.cc:492] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:51.161578 26107 ts_tablet_manager.cc:1403] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 1.333s	user 0.032s	sys 0.011s
I20260709 13:21:51.156306 26105 raft_consensus.cc:359] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.166584 26105 raft_consensus.cc:385] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.166942 26105 raft_consensus.cc:740] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.174746 26105 consensus_queue.cc:260] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.182799 26105 ts_tablet_manager.cc:1434] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 13:21:51.178683 26106 ts_tablet_manager.cc:1434] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.083s	user 0.004s	sys 0.007s
I20260709 13:21:51.164470 26107 raft_consensus.cc:359] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.194249 26104 tablet_bootstrap.cc:654] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.181566 26160 raft_consensus.cc:493] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.197268 26160 raft_consensus.cc:515] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.201404 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969350a564f340bc8bd087df45015f7d" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:51.202999 25874 leader_election.cc:343] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.204102 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969350a564f340bc8bd087df45015f7d" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:51.204701 26107 raft_consensus.cc:385] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.204815 25836 raft_consensus.cc:2468] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:51.205309 26107 raft_consensus.cc:740] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.200150 26160 leader_election.cc:290] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:51.208012 26107 consensus_queue.cc:260] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.210276 25875 leader_election.cc:304] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:51.210554 26105 tablet_bootstrap.cc:492] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:51.211213 26160 raft_consensus.cc:2804] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.213052 26160 raft_consensus.cc:493] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.214576 26160 raft_consensus.cc:3060] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.220681 26107 ts_tablet_manager.cc:1434] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:21:51.222029 25732 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55916 (request call id 12) took 1427 ms. Trace:
I20260709 13:21:51.225185 26107 tablet_bootstrap.cc:492] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:51.231740 26106 tablet_bootstrap.cc:492] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:51.237447 25730 catalog_manager.cc:5697] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } }
I20260709 13:21:51.238806 26106 tablet_bootstrap.cc:654] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.242918 26105 tablet_bootstrap.cc:654] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.225096 25732 rpcz_store.cc:276] 0709 13:21:49.787230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:49.824547 (+ 37317us) service_pool.cc:224] Handling call
0709 13:21:51.214381 (+1389834us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:50.804005 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:50.804655 (+   650us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:50.804701 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:21:50.804728 (+    27us) tablet.cc:662] Decoding operations
0709 13:21:50.833339 (+ 28611us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:50.833448 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:50.833495 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:21:50.833733 (+   238us) tablet.cc:701] Row locks acquired
0709 13:21:50.833754 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:21:50.833949 (+   195us) write_op.cc:270] Start()
0709 13:21:50.834101 (+   152us) write_op.cc:276] Timestamp: P: 1783603310833888 usec, L: 0
0709 13:21:50.834143 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:21:50.835167 (+  1024us) log.cc:844] Serialized 537 byte log entry
0709 13:21:51.029599 (+194432us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54007b6220. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d6275d571 00007f7d62769dbe 00007f7d62774930 00007f7d627748d8 00007f7d62774858 00007f7d62774813 00007f7d62773a9c 00007f7d6865f626 00007f7d68659dd8 00007f7d627b07cb 00007f7d627b32c0
0709 13:21:51.126606 (+ 97007us) op_driver.cc:464] REPLICATION: finished
0709 13:21:51.201155 (+ 74549us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b180045f6a0. stack: 00007f7d5f6d5343 00007f7d5f6d5240 00007f7d5f0641d4 00007f7d68da2304 00007f7d68da2299 00007f7d685cfde1 00007f7d685dc5b1 00007f7d5f7073f3 00007f7d5f7097c1 00007f7d5f709779 00007f7d5f709709 00007f7d5f7096d1 00007f7d5f7089cd 000000000038f354 000000000038f199 00007f7d5f6ea83a
0709 13:21:51.201298 (+   143us) write_op.cc:301] APPLY: starting
0709 13:21:51.201377 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:51.201481 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:51.201500 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:51.201761 (+   261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:51.201916 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:21:51.201978 (+    62us) write_op.cc:312] APPLY: finished
0709 13:21:51.202164 (+   186us) log.cc:844] Serialized 22 byte log entry
0709 13:21:51.202323 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:51.202407 (+    84us) write_op.cc:454] Released schema lock
0709 13:21:51.202451 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:51.202824 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:51.202854 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9383,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":53938,"apply.run_cpu_time_us":1500,"apply.run_wall_time_us":1501,"num_ops":1,"prepare.queue_time_us":69422,"prepare.run_cpu_time_us":22753,"prepare.run_wall_time_us":99946,"raft.queue_time_us":96191,"raft.run_cpu_time_us":16094,"raft.run_wall_time_us":50387,"replication_time_us":292312,"spinlock_wait_cycles":45580928,"thread_start_us":195584,"threads_started":4,"wal-append.queue_time_us":45102}]]}
I20260709 13:21:51.250394 26107 tablet_bootstrap.cc:654] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.255223 26104 tablet_bootstrap.cc:492] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:51.254937 26160 raft_consensus.cc:515] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.255748 26104 ts_tablet_manager.cc:1403] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.269s	user 0.009s	sys 0.008s
I20260709 13:21:51.257223 26160 leader_election.cc:290] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:51.258025 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969350a564f340bc8bd087df45015f7d" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:51.258651 25836 raft_consensus.cc:3060] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.262848 26104 raft_consensus.cc:359] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.263461 26104 raft_consensus.cc:385] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.263752 26104 raft_consensus.cc:740] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.277324 26105 tablet_bootstrap.cc:492] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:51.277868 26105 ts_tablet_manager.cc:1403] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.000s
I20260709 13:21:51.281008 26105 raft_consensus.cc:359] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.281761 26105 raft_consensus.cc:385] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.282063 26105 raft_consensus.cc:740] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.282461 25836 raft_consensus.cc:2468] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:51.283713 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969350a564f340bc8bd087df45015f7d" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:51.284529 26107 tablet_bootstrap.cc:492] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:51.284390 25875 leader_election.cc:304] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:51.285159 26107 ts_tablet_manager.cc:1403] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.007s
I20260709 13:21:51.288661 26107 raft_consensus.cc:359] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.289446 26107 raft_consensus.cc:385] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.289762 26107 raft_consensus.cc:740] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.290688 26105 consensus_queue.cc:260] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.291944 26107 consensus_queue.cc:260] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.293218 26142 raft_consensus.cc:2804] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.273181 26104 consensus_queue.cc:260] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.296062 26104 ts_tablet_manager.cc:1434] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.040s	user 0.002s	sys 0.006s
I20260709 13:21:51.297236 26104 tablet_bootstrap.cc:492] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:51.300712 26105 ts_tablet_manager.cc:1434] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:21:51.301025 25983 raft_consensus.cc:3060] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.304191 26106 tablet_bootstrap.cc:492] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:51.308074 26106 ts_tablet_manager.cc:1403] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.010s
I20260709 13:21:51.309307 26105 tablet_bootstrap.cc:492] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:51.311142 26106 raft_consensus.cc:359] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.311950 26106 raft_consensus.cc:385] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.312242 26106 raft_consensus.cc:740] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.312968 26106 consensus_queue.cc:260] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.313532 26142 raft_consensus.cc:697] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:51.314903 26106 ts_tablet_manager.cc:1434] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:21:51.314807 26142 consensus_queue.cc:237] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.315956 26106 tablet_bootstrap.cc:492] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:51.318604 25983 raft_consensus.cc:2468] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:51.304227 26104 tablet_bootstrap.cc:654] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.306594 26107 ts_tablet_manager.cc:1434] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:21:51.326524 26107 tablet_bootstrap.cc:492] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:51.327742 26106 tablet_bootstrap.cc:654] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.339583 26106 tablet_bootstrap.cc:492] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:51.343031 26104 tablet_bootstrap.cc:492] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:51.325183 26105 tablet_bootstrap.cc:654] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.344261 26106 ts_tablet_manager.cc:1403] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.001s
I20260709 13:21:51.344713 26104 ts_tablet_manager.cc:1403] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.004s
I20260709 13:21:51.339720 26107 tablet_bootstrap.cc:654] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.348444 26104 raft_consensus.cc:359] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.349177 26104 raft_consensus.cc:385] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.349445 26104 raft_consensus.cc:740] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.350281 26104 consensus_queue.cc:260] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.356242 26106 raft_consensus.cc:359] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.357026 26106 raft_consensus.cc:385] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.357333 26106 raft_consensus.cc:740] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.358012 26106 consensus_queue.cc:260] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.358526 26104 ts_tablet_manager.cc:1434] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:21:51.359630 26104 tablet_bootstrap.cc:492] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:51.360510 26106 ts_tablet_manager.cc:1434] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:21:51.361708 26106 tablet_bootstrap.cc:492] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:51.363333 26105 tablet_bootstrap.cc:492] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:51.366194 26105 ts_tablet_manager.cc:1403] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.009s
I20260709 13:21:51.376046 26105 raft_consensus.cc:359] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.376952 26105 raft_consensus.cc:385] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.377328 26105 raft_consensus.cc:740] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.367798 26227 raft_consensus.cc:493] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.369597 26106 tablet_bootstrap.cc:654] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.378300 26105 consensus_queue.cc:260] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.380877 26105 ts_tablet_manager.cc:1434] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:21:51.377996 26104 tablet_bootstrap.cc:654] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.382200 26105 tablet_bootstrap.cc:492] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:51.381477 26227 raft_consensus.cc:515] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.388098 26106 tablet_bootstrap.cc:492] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:51.388623 26106 ts_tablet_manager.cc:1403] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.003s
I20260709 13:21:51.389894 26105 tablet_bootstrap.cc:654] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.391554 26222 raft_consensus.cc:493] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.392319 26107 tablet_bootstrap.cc:492] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:51.392105 26222 raft_consensus.cc:515] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.392825 26107 ts_tablet_manager.cc:1403] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.000s
I20260709 13:21:51.393046 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:51.393748 25836 raft_consensus.cc:2468] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:51.395496 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56d8e51e0714bcfac360118807d6e0f" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:51.396270 26222 leader_election.cc:290] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
W20260709 13:21:51.397302 25950 leader_election.cc:343] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.395605 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56d8e51e0714bcfac360118807d6e0f" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:51.398165 25836 raft_consensus.cc:2468] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:51.397338 26106 raft_consensus.cc:359] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.398347 25731 catalog_manager.cc:5697] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:51.399770 26107 raft_consensus.cc:359] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.400665 26107 raft_consensus.cc:385] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.400125 26106 raft_consensus.cc:385] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.399937 25949 leader_election.cc:304] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:51.401008 26107 raft_consensus.cc:740] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.401093 26106 raft_consensus.cc:740] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.398418 25875 leader_election.cc:304] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:51.401867 26222 raft_consensus.cc:2804] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.402273 26222 raft_consensus.cc:493] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.402070 26106 consensus_queue.cc:260] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.402635 26222 raft_consensus.cc:3060] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.404146 26106 ts_tablet_manager.cc:1434] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:21:51.405507 26106 tablet_bootstrap.cc:492] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:51.409183 26231 raft_consensus.cc:2804] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.410650 26231 raft_consensus.cc:493] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.411113 26231 raft_consensus.cc:3060] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.411860 26222 raft_consensus.cc:515] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.409852 26107 consensus_queue.cc:260] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.414460 26222 leader_election.cc:290] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:51.417551 26227 leader_election.cc:290] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:51.418027 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:51.418366 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56d8e51e0714bcfac360118807d6e0f" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:51.418493 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56d8e51e0714bcfac360118807d6e0f" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:51.418877 25836 raft_consensus.cc:3060] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:51.420779 25950 leader_election.cc:343] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.424659 26107 ts_tablet_manager.cc:1434] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.004s
I20260709 13:21:51.427327 26107 tablet_bootstrap.cc:492] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
W20260709 13:21:51.428490 25874 leader_election.cc:343] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.431042 26104 tablet_bootstrap.cc:492] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:51.431519 26104 ts_tablet_manager.cc:1403] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.001s
I20260709 13:21:51.433504 26107 tablet_bootstrap.cc:654] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.434321 26104 raft_consensus.cc:359] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.435029 26104 raft_consensus.cc:385] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.435297 26104 raft_consensus.cc:740] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.436038 26104 consensus_queue.cc:260] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.440716 26231 raft_consensus.cc:515] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.441356 26104 ts_tablet_manager.cc:1434] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:21:51.442463 26106 tablet_bootstrap.cc:654] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.442569 26104 tablet_bootstrap.cc:492] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:51.443737 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:51.444435 25834 raft_consensus.cc:3060] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.446163 25836 raft_consensus.cc:2468] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:51.448272 26227 raft_consensus.cc:493] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.449219 26104 tablet_bootstrap.cc:654] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.448871 26227 raft_consensus.cc:515] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.449868 25949 leader_election.cc:304] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:51.450997 26222 raft_consensus.cc:2804] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.451445 26222 raft_consensus.cc:697] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:21:51.452325 26222 consensus_queue.cc:237] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.453526 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec9041a9b841bb91cd06da0192130e" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:51.454187 26057 raft_consensus.cc:2468] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:51.455489 25876 leader_election.cc:304] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:51.456355 26142 raft_consensus.cc:2804] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.456707 26142 raft_consensus.cc:493] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.451516 26227 leader_election.cc:290] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:51.457127 26142 raft_consensus.cc:3060] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.457808 25834 raft_consensus.cc:2468] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:51.459443 25875 leader_election.cc:304] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:51.460932 26227 raft_consensus.cc:2804] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.461380 26227 raft_consensus.cc:697] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:51.461421 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec9041a9b841bb91cd06da0192130e" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:51.462111 25983 raft_consensus.cc:2468] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:51.462375 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:51.464003 26231 leader_election.cc:290] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:21:51.464268 25874 leader_election.cc:343] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.462302 26227 consensus_queue.cc:237] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.467013 26142 raft_consensus.cc:515] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.474701 26115 raft_consensus.cc:493] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.475229 26115 raft_consensus.cc:515] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.478416 26115 leader_election.cc:290] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:51.479784 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec9041a9b841bb91cd06da0192130e" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:51.480213 26107 tablet_bootstrap.cc:492] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:51.480424 26057 raft_consensus.cc:3060] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.480957 26107 ts_tablet_manager.cc:1403] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.007s
I20260709 13:21:51.481742 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b69a58c24c44d16b7aeed68a23964a5" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:51.482448 25909 raft_consensus.cc:2468] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:51.484560 26107 raft_consensus.cc:359] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.485509 26107 raft_consensus.cc:385] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.486049 26107 raft_consensus.cc:740] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.487103 26107 consensus_queue.cc:260] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.489382 26107 ts_tablet_manager.cc:1434] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:21:51.489682 25951 leader_election.cc:304] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:51.490530 26107 tablet_bootstrap.cc:492] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:51.490577 26115 raft_consensus.cc:2804] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.491179 26115 raft_consensus.cc:493] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.491508 26115 raft_consensus.cc:3060] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.491936 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b69a58c24c44d16b7aeed68a23964a5" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:51.492610 26058 raft_consensus.cc:2468] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:51.485385 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec9041a9b841bb91cd06da0192130e" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:51.494225 26169 raft_consensus.cc:493] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.494467 25985 raft_consensus.cc:3060] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.494740 26169 raft_consensus.cc:515] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.497051 26169 leader_election.cc:290] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:51.498353 26107 tablet_bootstrap.cc:654] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.499187 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56d8e51e0714bcfac360118807d6e0f" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:51.500031 25834 raft_consensus.cc:2393] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cb7aae2a23a47c180432cb646577fd6 in current term 1: Already voted for candidate d01fccfd609b4182a5d43a7f6b4ae503 in this term.
I20260709 13:21:51.488445 25731 catalog_manager.cc:5697] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:51.502462 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56d8e51e0714bcfac360118807d6e0f" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:51.503189 26115 raft_consensus.cc:515] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.504590 26022 leader_election.cc:304] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:51.508636 26169 raft_consensus.cc:3060] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.505077 26142 leader_election.cc:290] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:51.521453 26105 tablet_bootstrap.cc:492] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:51.519232 26169 raft_consensus.cc:2749] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:51.527693 26105 ts_tablet_manager.cc:1403] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.013s
I20260709 13:21:51.539793 26115 leader_election.cc:290] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:51.537688 26057 raft_consensus.cc:2468] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:51.540794 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b69a58c24c44d16b7aeed68a23964a5" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:51.542297 26107 tablet_bootstrap.cc:492] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:51.543159 26107 ts_tablet_manager.cc:1403] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.016s
I20260709 13:21:51.543484 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b69a58c24c44d16b7aeed68a23964a5" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:51.543959 25876 leader_election.cc:304] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:51.544206 26058 raft_consensus.cc:3060] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.545053 26227 raft_consensus.cc:2804] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.545644 26231 raft_consensus.cc:493] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.546062 26231 raft_consensus.cc:515] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.546106 26107 raft_consensus.cc:359] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.546998 26107 raft_consensus.cc:385] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.547279 26107 raft_consensus.cc:740] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.548429 26231 leader_election.cc:290] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:51.549055 25909 raft_consensus.cc:3060] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.549678 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757888a24b0145f2b16b34ac466a31d1" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:51.550069 26227 raft_consensus.cc:697] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
W20260709 13:21:51.551177 25875 leader_election.cc:343] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.551096 26227 consensus_queue.cc:237] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.548071 26107 consensus_queue.cc:260] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.553279 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757888a24b0145f2b16b34ac466a31d1" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:51.554004 26107 ts_tablet_manager.cc:1434] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:21:51.553949 26059 raft_consensus.cc:2468] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:51.555466 26107 tablet_bootstrap.cc:492] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:51.561295 25876 leader_election.cc:304] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:51.561888 26169 raft_consensus.cc:493] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.562564 26169 raft_consensus.cc:515] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.567965 26107 tablet_bootstrap.cc:654] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.569120 26231 raft_consensus.cc:2804] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.569640 26231 raft_consensus.cc:493] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.570039 26231 raft_consensus.cc:3060] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.571199 25985 raft_consensus.cc:2468] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:51.574980 26169 leader_election.cc:290] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:51.575307 26106 tablet_bootstrap.cc:492] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:51.585053 26106 ts_tablet_manager.cc:1403] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.180s	user 0.020s	sys 0.033s
I20260709 13:21:51.584537 25730 catalog_manager.cc:5697] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:51.589269 26106 raft_consensus.cc:359] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.590276 26106 raft_consensus.cc:385] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.590652 26106 raft_consensus.cc:740] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.577776 26105 raft_consensus.cc:359] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.567816 25909 raft_consensus.cc:2468] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:51.579432 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244656e8e9b646c48e9b5b92ed53ba51" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:51.593777 25951 leader_election.cc:304] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:51.595170 26115 raft_consensus.cc:2804] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.595861 26115 raft_consensus.cc:697] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:21:51.580606 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244656e8e9b646c48e9b5b92ed53ba51" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:51.599071 25910 raft_consensus.cc:2468] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:51.580953 26231 raft_consensus.cc:515] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.598243 26105 raft_consensus.cc:385] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.592561 25834 raft_consensus.cc:2468] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:51.597160 26115 consensus_queue.cc:237] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.601101 26105 raft_consensus.cc:740] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.600526 26025 leader_election.cc:304] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:51.602478 26169 raft_consensus.cc:2804] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.602421 26105 consensus_queue.cc:260] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.602993 26169 raft_consensus.cc:493] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.603572 26169 raft_consensus.cc:3060] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.605211 26058 raft_consensus.cc:2468] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:51.605212 26105 ts_tablet_manager.cc:1434] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.001s
I20260709 13:21:51.598995 26106 consensus_queue.cc:260] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.610064 26106 ts_tablet_manager.cc:1434] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.005s
I20260709 13:21:51.611279 26106 tablet_bootstrap.cc:492] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:51.612923 26169 raft_consensus.cc:515] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.616645 26231 leader_election.cc:290] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:51.616828 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757888a24b0145f2b16b34ac466a31d1" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:51.617702 26105 tablet_bootstrap.cc:492] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:51.618819 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757888a24b0145f2b16b34ac466a31d1" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:51.619511 26058 raft_consensus.cc:3060] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.619501 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244656e8e9b646c48e9b5b92ed53ba51" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
W20260709 13:21:51.621150 25875 leader_election.cc:343] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.623040 25836 raft_consensus.cc:3060] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.635090 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244656e8e9b646c48e9b5b92ed53ba51" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:51.646806 26105 tablet_bootstrap.cc:654] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.646813 25909 raft_consensus.cc:3060] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.636719 25730 catalog_manager.cc:5697] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:51.655059 25909 raft_consensus.cc:2468] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:51.656340 26025 leader_election.cc:304] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:51.657470 26183 raft_consensus.cc:2804] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.632927 26169 leader_election.cc:290] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:51.646193 25836 raft_consensus.cc:2468] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:51.670424 26183 raft_consensus.cc:697] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:51.673431 26183 consensus_queue.cc:237] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.678061 26104 tablet_bootstrap.cc:492] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:51.678782 26104 ts_tablet_manager.cc:1403] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.236s	user 0.013s	sys 0.011s
I20260709 13:21:51.682029 25731 catalog_manager.cc:5697] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:51.684091 26106 tablet_bootstrap.cc:654] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.684222 26107 tablet_bootstrap.cc:492] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:51.684922 26107 ts_tablet_manager.cc:1403] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.130s	user 0.009s	sys 0.048s
I20260709 13:21:51.687712 26107 raft_consensus.cc:359] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.688391 26107 raft_consensus.cc:385] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.688651 26107 raft_consensus.cc:740] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.689370 26107 consensus_queue.cc:260] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.691143 26058 raft_consensus.cc:2468] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:51.690990 26104 raft_consensus.cc:359] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.692404 26104 raft_consensus.cc:385] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.692802 26104 raft_consensus.cc:740] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.692701 25876 leader_election.cc:304] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:51.695111 26107 ts_tablet_manager.cc:1434] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:21:51.695506 26231 raft_consensus.cc:2804] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.696229 26107 tablet_bootstrap.cc:492] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:51.696269 26231 raft_consensus.cc:697] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:51.703136 26107 tablet_bootstrap.cc:654] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.702734 26231 consensus_queue.cc:237] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.706036 26227 consensus_queue.cc:1048] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:51.714931 26104 consensus_queue.cc:260] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.718001 26104 ts_tablet_manager.cc:1434] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:21:51.727983 26104 tablet_bootstrap.cc:492] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:51.746621 26106 tablet_bootstrap.cc:492] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:51.747108 26106 ts_tablet_manager.cc:1403] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.136s	user 0.018s	sys 0.008s
I20260709 13:21:51.759080 26104 tablet_bootstrap.cc:654] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.763661 26107 tablet_bootstrap.cc:492] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:51.764207 26107 ts_tablet_manager.cc:1403] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.008s
I20260709 13:21:51.767109 26107 raft_consensus.cc:359] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.767894 26107 raft_consensus.cc:385] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.768189 26107 raft_consensus.cc:740] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.767012 25730 catalog_manager.cc:5697] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:51.768953 26107 consensus_queue.cc:260] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.777446 25733 catalog_manager.cc:5697] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:51.785475 26105 tablet_bootstrap.cc:492] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:51.786051 26105 ts_tablet_manager.cc:1403] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.169s	user 0.011s	sys 0.017s
I20260709 13:21:51.789163 26231 raft_consensus.cc:493] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.790740 26183 raft_consensus.cc:493] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.791365 26183 raft_consensus.cc:515] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
W20260709 13:21:51.793679 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:51.795643 26107 ts_tablet_manager.cc:1434] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:21:51.795536 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df402c226a164b7b945723f607f9aa75" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:51.797214 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df402c226a164b7b945723f607f9aa75" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:51.791138 26231 raft_consensus.cc:515] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.793728 26183 leader_election.cc:290] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:51.806996 26231 leader_election.cc:290] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:51.807687 25909 raft_consensus.cc:2468] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:51.808009 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df402c226a164b7b945723f607f9aa75" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:51.809674 25874 leader_election.cc:343] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:51.809952 26022 leader_election.cc:343] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.810340 26107 tablet_bootstrap.cc:492] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:51.810608 26025 leader_election.cc:304] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:51.811498 26183 raft_consensus.cc:2804] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.811902 26183 raft_consensus.cc:493] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.822674 26112 raft_consensus.cc:493] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.822717 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df402c226a164b7b945723f607f9aa75" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:51.823288 26112 raft_consensus.cc:515] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.823899 26183 raft_consensus.cc:3060] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.823999 26115 raft_consensus.cc:493] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.824656 26115 raft_consensus.cc:515] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.830744 26231 consensus_queue.cc:1048] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:51.844398 26105 raft_consensus.cc:359] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.846964 26105 raft_consensus.cc:385] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.847332 26105 raft_consensus.cc:740] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.854910 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:51.856081 26057 raft_consensus.cc:2468] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:51.857738 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:51.857903 25950 leader_election.cc:304] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:51.858596 25836 raft_consensus.cc:2468] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:51.859169 26222 raft_consensus.cc:2804] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.859728 26222 raft_consensus.cc:493] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.860164 26222 raft_consensus.cc:3060] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.863591 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:51.862987 26112 leader_election.cc:290] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:51.870301 26106 raft_consensus.cc:359] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.870858 26106 raft_consensus.cc:385] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.871053 26106 raft_consensus.cc:740] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.873299 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:51.874059 26105 consensus_queue.cc:260] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.863204 26115 leader_election.cc:290] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:51.875195 26057 raft_consensus.cc:2468] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:51.876662 25801 leader_election.cc:304] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:51.877600 26112 raft_consensus.cc:2804] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:51.877978 26112 raft_consensus.cc:493] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:51.878342 26112 raft_consensus.cc:3060] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.881039 26115 consensus_queue.cc:1048] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:51.894030 26106 consensus_queue.cc:260] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.905184 26105 ts_tablet_manager.cc:1434] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.003s
I20260709 13:21:51.907001 26183 raft_consensus.cc:515] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:51.907398 26112 raft_consensus.cc:515] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.910581 26058 raft_consensus.cc:2393] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dbc14fa82f4a22b1cab8f3691196de in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:51.913458 26222 raft_consensus.cc:515] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.932468 25983 raft_consensus.cc:2393] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate d01fccfd609b4182a5d43a7f6b4ae503 in this term.
W20260709 13:21:51.935850 25874 consensus_peers.cc:597] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.939481 26112 leader_election.cc:290] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:51.939992 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:51.941124 25983 raft_consensus.cc:2393] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate d01fccfd609b4182a5d43a7f6b4ae503 in this term.
W20260709 13:21:51.927969 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 51407.8us
I20260709 13:21:51.946419 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:51.947265 26059 raft_consensus.cc:3060] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.914708 26107 tablet_bootstrap.cc:654] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.913815 25876 leader_election.cc:304] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:51.919529 26183 leader_election.cc:290] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:51.920789 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df402c226a164b7b945723f607f9aa75" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:51.954465 26227 raft_consensus.cc:3060] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:51.921303 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df402c226a164b7b945723f607f9aa75" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:51.927174 26104 tablet_bootstrap.cc:492] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:51.928617 26105 tablet_bootstrap.cc:492] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:51.959127 26104 ts_tablet_manager.cc:1403] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.231s	user 0.029s	sys 0.016s
I20260709 13:21:51.961297 26059 raft_consensus.cc:2468] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:51.983934 25801 leader_election.cc:304] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:51.985688 26260 raft_consensus.cc:2804] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:51.986214 26260 raft_consensus.cc:697] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:51.987519 26115 consensus_queue.cc:1048] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:51.987658 26260 consensus_queue.cc:237] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:51.963306 26104 raft_consensus.cc:359] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.964558 26105 tablet_bootstrap.cc:654] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:51.989910 26104 raft_consensus.cc:385] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:51.990317 26104 raft_consensus.cc:740] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:51.991444 26104 consensus_queue.cc:260] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:51.992300 26107 tablet_bootstrap.cc:492] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:51.931327 26258 raft_consensus.cc:493] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:51.992807 26107 ts_tablet_manager.cc:1403] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.183s	user 0.011s	sys 0.002s
W20260709 13:21:51.964743 26022 leader_election.cc:343] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:51.993130 26258 raft_consensus.cc:515] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:51.997696 26258 leader_election.cc:290] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:51.969007 26222 leader_election.cc:290] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:51.969234 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:51.971215 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:51.974196 26227 raft_consensus.cc:2749] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:51.996812 26107 raft_consensus.cc:359] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.006011 26107 raft_consensus.cc:385] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.006827 26107 raft_consensus.cc:740] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.008315 26231 consensus_queue.cc:1048] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.008374 26058 raft_consensus.cc:2393] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d01fccfd609b4182a5d43a7f6b4ae503 in current term 1: Already voted for candidate 8e453645ce774c99b4b4aafb4362719b in this term.
I20260709 13:21:52.009506 26106 ts_tablet_manager.cc:1434] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.262s	user 0.017s	sys 0.021s
I20260709 13:21:52.010929 26106 tablet_bootstrap.cc:492] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:52.011353 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757888a24b0145f2b16b34ac466a31d1" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:52.013470 26104 ts_tablet_manager.cc:1434] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.001s
I20260709 13:21:52.013725 26105 tablet_bootstrap.cc:492] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.014153 26105 ts_tablet_manager.cc:1403] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.000s
I20260709 13:21:52.014552 26104 tablet_bootstrap.cc:492] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:52.020695 26107 consensus_queue.cc:260] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.019285 26105 raft_consensus.cc:359] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.016767 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "757888a24b0145f2b16b34ac466a31d1" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:52.022142 26105 raft_consensus.cc:385] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.025388 25950 leader_election.cc:304] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:52.026335 26115 raft_consensus.cc:2749] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.028790 26106 tablet_bootstrap.cc:654] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.022622 26105 raft_consensus.cc:740] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.022677 26058 raft_consensus.cc:2393] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate 00dbc14fa82f4a22b1cab8f3691196de in this term.
I20260709 13:21:52.030689 26105 consensus_queue.cc:260] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.029733 26227 raft_consensus.cc:493] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.038257 26107 ts_tablet_manager.cc:1434] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:21:52.040584 26105 ts_tablet_manager.cc:1434] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 13:21:52.043805 25801 leader_election.cc:304] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:52.044193 26105 tablet_bootstrap.cc:492] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:52.054055 26107 tablet_bootstrap.cc:492] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:52.049810 26261 raft_consensus.cc:3060] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.040377 26227 raft_consensus.cc:515] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.060015 26227 leader_election.cc:290] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:52.066349 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:52.066845 25909 raft_consensus.cc:2468] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:52.067059 26105 tablet_bootstrap.cc:654] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.067183 26104 tablet_bootstrap.cc:654] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.071972 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:52.072146 26025 leader_election.cc:304] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:52.060700 26107 tablet_bootstrap.cc:654] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:52.073601 25876 leader_election.cc:343] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:52.074184 25874 leader_election.cc:343] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.074823 25874 leader_election.cc:304] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:52.073659 26183 raft_consensus.cc:2804] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.075969 26183 raft_consensus.cc:697] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:52.078276 26231 consensus_queue.cc:1048] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.085489 26261 raft_consensus.cc:2749] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.079798 26227 raft_consensus.cc:2749] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.090754 26115 consensus_queue.cc:1048] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.087992 26183 consensus_queue.cc:237] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.109579 26106 tablet_bootstrap.cc:492] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:52.110234 26106 ts_tablet_manager.cc:1403] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.009s
I20260709 13:21:52.110785 26107 tablet_bootstrap.cc:492] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:52.111300 26107 ts_tablet_manager.cc:1403] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.002s
I20260709 13:21:52.113338 26106 raft_consensus.cc:359] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.115880 26106 raft_consensus.cc:385] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.116240 26106 raft_consensus.cc:740] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.118932 26222 consensus_queue.cc:1048] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.124289 26169 consensus_queue.cc:1048] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.125969 26107 raft_consensus.cc:359] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.126956 26107 raft_consensus.cc:385] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.127308 26107 raft_consensus.cc:740] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.128159 26107 consensus_queue.cc:260] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.130882 26106 consensus_queue.cc:260] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.152093 26107 ts_tablet_manager.cc:1434] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 13:21:52.162559 26106 ts_tablet_manager.cc:1434] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.002s
I20260709 13:21:52.164307 26107 tablet_bootstrap.cc:492] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:52.163808 26106 tablet_bootstrap.cc:492] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:52.169094 25733 catalog_manager.cc:5697] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:52.176285 26160 consensus_queue.cc:1048] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.188498 26107 tablet_bootstrap.cc:654] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.197562 26160 consensus_queue.cc:1048] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.207069 26105 tablet_bootstrap.cc:492] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.207574 26105 ts_tablet_manager.cc:1403] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.017s
I20260709 13:21:52.209410 26104 tablet_bootstrap.cc:492] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:52.209983 26104 ts_tablet_manager.cc:1403] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.196s	user 0.018s	sys 0.006s
I20260709 13:21:52.222209 26106 tablet_bootstrap.cc:654] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.223840 26104 raft_consensus.cc:359] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.224109 26246 consensus_queue.cc:1048] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.221328 25731 catalog_manager.cc:5697] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:52.225271 26104 raft_consensus.cc:385] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.229372 26104 raft_consensus.cc:740] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.249063 26222 raft_consensus.cc:493] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.250789 26222 raft_consensus.cc:515] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.253863 26107 tablet_bootstrap.cc:492] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:52.254419 26107 ts_tablet_manager.cc:1403] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.090s	user 0.006s	sys 0.008s
I20260709 13:21:52.256363 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:52.252815 26222 leader_election.cc:290] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:52.259438 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:52.259739 26142 consensus_queue.cc:1048] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.260591 26107 raft_consensus.cc:359] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.254509 26104 consensus_queue.cc:260] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.262111 26107 raft_consensus.cc:385] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.262598 26107 raft_consensus.cc:740] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.263520 26107 consensus_queue.cc:260] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.266892 26104 ts_tablet_manager.cc:1434] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.005s
I20260709 13:21:52.260962 25951 leader_election.cc:304] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:52.270862 26106 tablet_bootstrap.cc:492] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:52.272243 26222 raft_consensus.cc:2749] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.272722 26104 tablet_bootstrap.cc:492] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:52.273030 26106 ts_tablet_manager.cc:1403] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.011s
I20260709 13:21:52.278935 26260 raft_consensus.cc:493] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.279404 26260 raft_consensus.cc:515] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.281607 26260 leader_election.cc:290] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:21:52.282703 26278 log.cc:927] Time spent T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:21:52.283380 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166158c4e1034da1a83f153661381868" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:52.283787 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166158c4e1034da1a83f153661381868" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:52.284099 25985 raft_consensus.cc:2468] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:52.284463 25911 raft_consensus.cc:2468] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:52.285382 25799 leader_election.cc:304] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:52.289237 26260 raft_consensus.cc:2804] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.289593 26260 raft_consensus.cc:493] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.289939 26260 raft_consensus.cc:3060] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.290117 26105 raft_consensus.cc:359] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.290854 26105 raft_consensus.cc:385] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.291108 26105 raft_consensus.cc:740] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.293149 26107 ts_tablet_manager.cc:1434] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:21:52.294276 26107 tablet_bootstrap.cc:492] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:52.298203 26260 raft_consensus.cc:515] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.303745 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166158c4e1034da1a83f153661381868" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:52.304134 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166158c4e1034da1a83f153661381868" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:52.304329 25911 raft_consensus.cc:3060] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.304808 25985 raft_consensus.cc:3060] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.305015 26105 consensus_queue.cc:260] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.313243 26105 ts_tablet_manager.cc:1434] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.105s	user 0.000s	sys 0.008s
I20260709 13:21:52.314430 26105 tablet_bootstrap.cc:492] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:52.314253 25985 raft_consensus.cc:2468] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:52.300683 26106 raft_consensus.cc:359] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.315621 26106 raft_consensus.cc:385] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.315963 26106 raft_consensus.cc:740] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.317636 26106 consensus_queue.cc:260] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.320816 25799 leader_election.cc:304] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:52.322084 26261 raft_consensus.cc:2804] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.322721 26261 raft_consensus.cc:697] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:52.323705 26261 consensus_queue.cc:237] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.326284 26107 tablet_bootstrap.cc:654] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.328235 26260 leader_election.cc:290] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:52.330503 26106 ts_tablet_manager.cc:1434] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 13:21:52.332777 26106 tablet_bootstrap.cc:492] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:52.334429 26105 tablet_bootstrap.cc:654] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.331272 25911 raft_consensus.cc:2468] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:52.359639 26106 tablet_bootstrap.cc:654] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.362277 26104 tablet_bootstrap.cc:654] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.390511 26107 tablet_bootstrap.cc:492] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:52.391193 26107 ts_tablet_manager.cc:1403] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.038s
I20260709 13:21:52.390511 26105 tablet_bootstrap.cc:492] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.395895 26105 ts_tablet_manager.cc:1403] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.002s
I20260709 13:21:52.399289 26105 raft_consensus.cc:359] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.400079 26105 raft_consensus.cc:385] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.400426 26105 raft_consensus.cc:740] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.401160 26105 consensus_queue.cc:260] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.388170 25731 catalog_manager.cc:5697] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.403865 26105 ts_tablet_manager.cc:1434] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:52.394693 26107 raft_consensus.cc:359] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.406085 26107 raft_consensus.cc:385] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.406412 26107 raft_consensus.cc:740] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.407246 26107 consensus_queue.cc:260] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.409740 26107 ts_tablet_manager.cc:1434] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:21:52.411572 26105 tablet_bootstrap.cc:492] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:52.412151 26106 tablet_bootstrap.cc:492] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:52.413285 26106 ts_tablet_manager.cc:1403] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.005s
I20260709 13:21:52.415194 26261 consensus_queue.cc:1048] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.417094 26246 raft_consensus.cc:493] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.417847 26183 raft_consensus.cc:493] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.417665 26246 raft_consensus.cc:515] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.418408 26183 raft_consensus.cc:515] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.421242 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:52.421765 26246 leader_election.cc:290] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:52.421986 25911 raft_consensus.cc:2468] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:52.423293 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:52.423521 26025 leader_election.cc:304] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:52.424597 26169 raft_consensus.cc:2804] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.425056 26169 raft_consensus.cc:493] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:52.425344 26022 leader_election.cc:343] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.426195 26183 leader_election.cc:290] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:52.426834 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c34519b693147019b76e75d995c4975" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:52.412710 26104 tablet_bootstrap.cc:492] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
W20260709 13:21:52.428514 26023 leader_election.cc:343] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.425429 26169 raft_consensus.cc:3060] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.429349 26107 tablet_bootstrap.cc:492] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:52.433333 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c34519b693147019b76e75d995c4975" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:52.434038 25911 raft_consensus.cc:2468] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:52.435956 26025 leader_election.cc:304] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:52.436437 26107 tablet_bootstrap.cc:654] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.428670 26104 ts_tablet_manager.cc:1403] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.156s	user 0.017s	sys 0.000s
I20260709 13:21:52.442196 26105 tablet_bootstrap.cc:654] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.443534 26104 raft_consensus.cc:359] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.444362 26104 raft_consensus.cc:385] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.444666 26104 raft_consensus.cc:740] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.445281 26183 raft_consensus.cc:2804] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.445518 26104 consensus_queue.cc:260] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.432675 26106 raft_consensus.cc:359] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.450413 26183 raft_consensus.cc:493] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.451604 26105 tablet_bootstrap.cc:492] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.451990 26183 raft_consensus.cc:3060] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.450589 26106 raft_consensus.cc:385] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.452183 26105 ts_tablet_manager.cc:1403] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.000s
I20260709 13:21:52.461052 26106 raft_consensus.cc:740] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.461908 26106 consensus_queue.cc:260] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.464044 26105 raft_consensus.cc:359] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.464893 26105 raft_consensus.cc:385] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.465204 26105 raft_consensus.cc:740] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.465966 26105 consensus_queue.cc:260] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.448300 26107 tablet_bootstrap.cc:492] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:52.467944 26106 ts_tablet_manager.cc:1434] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.038s	user 0.001s	sys 0.005s
I20260709 13:21:52.468451 26107 ts_tablet_manager.cc:1403] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.001s
I20260709 13:21:52.452905 26104 ts_tablet_manager.cc:1434] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:21:52.470710 26104 tablet_bootstrap.cc:492] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:52.471709 26107 raft_consensus.cc:359] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.472214 25985 raft_consensus.cc:3060] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.472499 26107 raft_consensus.cc:385] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.472954 26106 tablet_bootstrap.cc:492] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:52.473551 26105 ts_tablet_manager.cc:1434] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:21:52.472940 26107 raft_consensus.cc:740] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.474439 26107 consensus_queue.cc:260] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.481325 26107 ts_tablet_manager.cc:1434] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:21:52.483542 26105 tablet_bootstrap.cc:492] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:52.484757 26107 tablet_bootstrap.cc:492] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:52.485203 26246 raft_consensus.cc:493] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.486986 26106 tablet_bootstrap.cc:654] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.486934 26246 raft_consensus.cc:515] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.490458 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dbb2ef09cdc4bf08cda0e5159a5bab0" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:52.491220 25983 raft_consensus.cc:2468] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:52.491437 26105 tablet_bootstrap.cc:654] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.491535 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dbb2ef09cdc4bf08cda0e5159a5bab0" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:52.492444 25836 raft_consensus.cc:2468] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:52.492882 26022 leader_election.cc:304] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:52.494155 26104 tablet_bootstrap.cc:654] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.497272 26261 raft_consensus.cc:493] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.497975 26261 raft_consensus.cc:515] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.502966 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c34519b693147019b76e75d995c4975" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:52.503806 25911 raft_consensus.cc:2468] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:52.505165 25802 leader_election.cc:304] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:52.506207 26260 raft_consensus.cc:2804] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.506650 26260 raft_consensus.cc:493] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.507118 26260 raft_consensus.cc:3060] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.509994 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c34519b693147019b76e75d995c4975" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:52.508905 26261 leader_election.cc:290] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:52.494050 26246 leader_election.cc:290] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:52.512367 26246 raft_consensus.cc:2804] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.512804 26246 raft_consensus.cc:493] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.513118 26105 tablet_bootstrap.cc:492] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.513221 26246 raft_consensus.cc:3060] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.513823 26105 ts_tablet_manager.cc:1403] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.004s
I20260709 13:21:52.516913 26260 raft_consensus.cc:515] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.517181 26105 raft_consensus.cc:359] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.517911 26105 raft_consensus.cc:385] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.518245 26105 raft_consensus.cc:740] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.519573 26107 tablet_bootstrap.cc:654] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.522879 26169 raft_consensus.cc:515] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.523047 26183 raft_consensus.cc:515] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.525342 26059 raft_consensus.cc:2393] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:52.529158 26105 consensus_queue.cc:260] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.531392 26105 ts_tablet_manager.cc:1434] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:21:52.532577 26105 tablet_bootstrap.cc:492] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:52.534848 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c34519b693147019b76e75d995c4975" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:52.535144 26183 leader_election.cc:290] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:52.536969 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c34519b693147019b76e75d995c4975" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:52.537652 25911 raft_consensus.cc:3060] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.539330 26105 tablet_bootstrap.cc:654] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.545040 26261 consensus_queue.cc:1048] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.547228 26246 raft_consensus.cc:515] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:21:52.552083 26022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 55599.7us
I20260709 13:21:52.561450 26169 leader_election.cc:290] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:52.564208 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c34519b693147019b76e75d995c4975" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:52.565236 26059 raft_consensus.cc:2393] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:52.565671 26227 raft_consensus.cc:493] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.566416 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:52.566273 26227 raft_consensus.cc:515] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.567142 25910 raft_consensus.cc:3060] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.569175 26227 leader_election.cc:290] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:52.570902 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c34519b693147019b76e75d995c4975" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:52.568570 26260 leader_election.cc:290] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:52.572026 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b625185a5664b86ad39dc782dfb71c1" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:52.572444 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dbb2ef09cdc4bf08cda0e5159a5bab0" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:52.573195 25835 raft_consensus.cc:3060] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:52.574062 25874 leader_election.cc:343] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.577600 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:52.578068 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b625185a5664b86ad39dc782dfb71c1" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:52.579701 25802 leader_election.cc:304] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:52.581205 26294 raft_consensus.cc:493] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.581876 26294 raft_consensus.cc:515] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.582150 26258 raft_consensus.cc:2749] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:21:52.582782 25875 leader_election.cc:343] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.583931 25836 raft_consensus.cc:2393] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3cb7aae2a23a47c180432cb646577fd6 in current term 1: Already voted for candidate 8e453645ce774c99b4b4aafb4362719b in this term.
I20260709 13:21:52.583630 25875 leader_election.cc:304] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:52.585228 26227 raft_consensus.cc:2749] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.569271 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dbb2ef09cdc4bf08cda0e5159a5bab0" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:52.589526 25984 raft_consensus.cc:3060] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:52.594492 26022 leader_election.cc:343] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:52.595598 26022 consensus_peers.cc:597] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.599442 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e224ef22951c499c9fceb8ce339a349a" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:52.601136 26023 leader_election.cc:343] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.601814 26294 leader_election.cc:290] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:52.607184 25984 raft_consensus.cc:2468] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:52.570894 26246 leader_election.cc:290] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:52.614779 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e224ef22951c499c9fceb8ce339a349a" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:52.615865 25910 raft_consensus.cc:2468] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:52.616783 25911 raft_consensus.cc:2468] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:52.616926 26022 leader_election.cc:304] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:52.618811 26104 tablet_bootstrap.cc:492] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:52.614981 25835 raft_consensus.cc:2468] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:52.619455 26104 ts_tablet_manager.cc:1403] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.149s	user 0.020s	sys 0.014s
I20260709 13:21:52.619758 26169 raft_consensus.cc:2804] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.620422 26169 raft_consensus.cc:697] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:52.621655 26169 consensus_queue.cc:237] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.622241 26025 leader_election.cc:304] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:52.623031 26105 tablet_bootstrap.cc:492] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.623585 26105 ts_tablet_manager.cc:1403] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.091s	user 0.026s	sys 0.005s
I20260709 13:21:52.624087 26025 leader_election.cc:304] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
W20260709 13:21:52.624755 26022 leader_election.cc:343] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.625248 26183 raft_consensus.cc:2804] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.627615 26183 raft_consensus.cc:697] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:52.627900 26106 tablet_bootstrap.cc:492] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:52.628528 26106 ts_tablet_manager.cc:1403] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.159s	user 0.014s	sys 0.020s
I20260709 13:21:52.628618 26183 consensus_queue.cc:237] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.630688 26294 raft_consensus.cc:2804] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:52.627254 26105 raft_consensus.cc:359] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.623626 26107 tablet_bootstrap.cc:492] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:52.632692 26105 raft_consensus.cc:385] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.633023 26107 ts_tablet_manager.cc:1403] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.148s	user 0.015s	sys 0.010s
I20260709 13:21:52.633170 26105 raft_consensus.cc:740] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.634337 26105 consensus_queue.cc:260] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.634640 26104 raft_consensus.cc:359] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.635478 26104 raft_consensus.cc:385] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.635798 26104 raft_consensus.cc:740] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.636464 26107 raft_consensus.cc:359] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.637262 26107 raft_consensus.cc:385] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.637569 26107 raft_consensus.cc:740] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.637872 26106 raft_consensus.cc:359] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.638664 26106 raft_consensus.cc:385] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.638303 26107 consensus_queue.cc:260] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.640924 26107 ts_tablet_manager.cc:1434] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:52.638967 26106 raft_consensus.cc:740] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.644752 26106 consensus_queue.cc:260] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.645183 26104 consensus_queue.cc:260] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.648386 26105 ts_tablet_manager.cc:1434] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:21:52.651901 26104 ts_tablet_manager.cc:1434] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.002s
I20260709 13:21:52.652429 26106 ts_tablet_manager.cc:1434] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:21:52.653189 26104 tablet_bootstrap.cc:492] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:52.653767 26106 tablet_bootstrap.cc:492] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:52.660490 26183 consensus_queue.cc:1048] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.661703 26104 tablet_bootstrap.cc:654] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.663379 26106 tablet_bootstrap.cc:654] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.666402 26107 tablet_bootstrap.cc:492] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:52.670349 25733 catalog_manager.cc:5697] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.646562 26022 leader_election.cc:304] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
W20260709 13:21:52.675894 26022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 52010.9us
I20260709 13:21:52.677135 26105 tablet_bootstrap.cc:492] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:52.685389 26105 tablet_bootstrap.cc:654] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.686806 26183 raft_consensus.cc:2749] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.689148 26294 raft_consensus.cc:697] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:52.692643 26294 consensus_queue.cc:237] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.719892 26104 tablet_bootstrap.cc:492] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:52.720674 26104 ts_tablet_manager.cc:1403] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.000s
I20260709 13:21:52.724700 26104 raft_consensus.cc:359] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.725811 26104 raft_consensus.cc:385] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.726238 26104 raft_consensus.cc:740] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.731438 26227 raft_consensus.cc:493] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.732105 26227 raft_consensus.cc:515] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.735530 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:52.737282 25875 leader_election.cc:343] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.739396 26105 tablet_bootstrap.cc:492] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.740056 26105 ts_tablet_manager.cc:1403] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.006s
I20260709 13:21:52.741052 26227 leader_election.cc:290] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:52.739542 26104 consensus_queue.cc:260] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.743327 26105 raft_consensus.cc:359] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.750332 26105 raft_consensus.cc:385] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.750694 26105 raft_consensus.cc:740] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.752831 26104 ts_tablet_manager.cc:1434] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:21:52.753989 26104 tablet_bootstrap.cc:492] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:52.751482 26105 consensus_queue.cc:260] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.756134 26105 ts_tablet_manager.cc:1434] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 13:21:52.757297 26105 tablet_bootstrap.cc:492] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:52.760272 26104 tablet_bootstrap.cc:654] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.740703 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:52.761448 26107 tablet_bootstrap.cc:654] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:52.762387 25874 leader_election.cc:343] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.762971 25874 leader_election.cc:304] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:52.763832 26106 tablet_bootstrap.cc:492] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:52.764249 26160 raft_consensus.cc:493] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.765288 26106 ts_tablet_manager.cc:1403] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.008s
I20260709 13:21:52.765225 26160 raft_consensus.cc:515] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.769703 26160 leader_election.cc:290] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:52.764873 26227 raft_consensus.cc:2749] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.770443 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f82b9479b4249b9b78a11bf5c355ddf" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:52.771380 26106 raft_consensus.cc:359] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.772204 26106 raft_consensus.cc:385] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.772316 26107 tablet_bootstrap.cc:492] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:52.772605 26106 raft_consensus.cc:740] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.773847 26107 ts_tablet_manager.cc:1403] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.002s
I20260709 13:21:52.774398 26246 raft_consensus.cc:493] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.774010 26106 consensus_queue.cc:260] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.774895 26105 tablet_bootstrap.cc:654] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.776714 26106 ts_tablet_manager.cc:1434] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:21:52.778338 26106 tablet_bootstrap.cc:492] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:52.782246 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f82b9479b4249b9b78a11bf5c355ddf" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:52.782369 25876 leader_election.cc:343] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:52.784323 25875 leader_election.cc:343] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.784863 25875 leader_election.cc:304] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:52.784471 25730 catalog_manager.cc:5697] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:52.786260 26306 consensus_queue.cc:1048] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:52.786877 25730 catalog_manager.cc:5697] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.787971 26227 raft_consensus.cc:2749] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.774956 26246 raft_consensus.cc:515] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:52.791988 26105 tablet_bootstrap.cc:492] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.792443 26106 tablet_bootstrap.cc:654] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.792578 26105 ts_tablet_manager.cc:1403] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.011s
I20260709 13:21:52.792783 26107 raft_consensus.cc:359] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.793530 26107 raft_consensus.cc:385] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.793828 26107 raft_consensus.cc:740] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.793967 26246 leader_election.cc:290] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:52.795751 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e56b5dacf8443239fe2cd7fcc3286bb" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:52.797334 26023 leader_election.cc:343] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.798722 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e56b5dacf8443239fe2cd7fcc3286bb" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:52.804374 26105 raft_consensus.cc:359] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.805202 26105 raft_consensus.cc:385] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.805483 26105 raft_consensus.cc:740] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.806206 26105 consensus_queue.cc:260] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.806206 26104 tablet_bootstrap.cc:492] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:52.807763 26104 ts_tablet_manager.cc:1403] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 13:21:52.808856 26107 consensus_queue.cc:260] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
W20260709 13:21:52.811281 26022 leader_election.cc:343] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.811589 26227 raft_consensus.cc:493] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.811843 26022 leader_election.cc:304] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:52.812163 26227 raft_consensus.cc:515] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.814014 26246 raft_consensus.cc:2749] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.814606 26227 leader_election.cc:290] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:52.815649 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4521a8865b384a5f8afb98fb858cc318" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:52.816629 26105 ts_tablet_manager.cc:1434] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
W20260709 13:21:52.817400 25876 leader_election.cc:343] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.817754 26105 tablet_bootstrap.cc:492] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:52.818128 26107 ts_tablet_manager.cc:1434] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:21:52.818429 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4521a8865b384a5f8afb98fb858cc318" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:52.819164 26107 tablet_bootstrap.cc:492] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:52.819371 26104 raft_consensus.cc:359] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
W20260709 13:21:52.820011 25875 leader_election.cc:343] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.820640 25875 leader_election.cc:304] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:52.822441 26227 raft_consensus.cc:2749] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.820076 26104 raft_consensus.cc:385] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.824689 26104 raft_consensus.cc:740] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.825559 26104 consensus_queue.cc:260] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.827735 26104 ts_tablet_manager.cc:1434] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:21:52.828809 26104 tablet_bootstrap.cc:492] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:52.834818 26261 consensus_queue.cc:1048] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:52.835556 26105 tablet_bootstrap.cc:654] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.842711 26107 tablet_bootstrap.cc:654] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.849540 26104 tablet_bootstrap.cc:654] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.851430 26106 tablet_bootstrap.cc:492] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:52.864419 26106 ts_tablet_manager.cc:1403] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.001s
I20260709 13:21:52.866370 26105 tablet_bootstrap.cc:492] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.866930 26105 ts_tablet_manager.cc:1403] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.000s
W20260709 13:21:52.867429 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:52.868723 26106 raft_consensus.cc:359] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.869578 26106 raft_consensus.cc:385] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.869887 26106 raft_consensus.cc:740] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.869916 26105 raft_consensus.cc:359] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.870806 26105 raft_consensus.cc:385] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.871152 26105 raft_consensus.cc:740] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.871953 26105 consensus_queue.cc:260] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.875821 26104 tablet_bootstrap.cc:492] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:52.876148 26105 ts_tablet_manager.cc:1434] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:21:52.876345 26104 ts_tablet_manager.cc:1403] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.003s
I20260709 13:21:52.877277 26105 tablet_bootstrap.cc:492] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:52.870869 26106 consensus_queue.cc:260] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.883780 26105 tablet_bootstrap.cc:654] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.887770 26104 raft_consensus.cc:359] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.888597 26104 raft_consensus.cc:385] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.893858 26107 tablet_bootstrap.cc:492] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:52.894840 26107 ts_tablet_manager.cc:1403] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.003s
I20260709 13:21:52.895792 26105 tablet_bootstrap.cc:492] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.896377 26105 ts_tablet_manager.cc:1403] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.003s
I20260709 13:21:52.896950 26106 ts_tablet_manager.cc:1434] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:21:52.897571 26246 raft_consensus.cc:493] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.898113 26246 raft_consensus.cc:515] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:52.899401 26105 raft_consensus.cc:359] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.901388 26246 leader_election.cc:290] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:52.901593 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f82b9479b4249b9b78a11bf5c355ddf" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:52.909337 26105 raft_consensus.cc:385] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.902426 26107 raft_consensus.cc:359] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.909969 26106 tablet_bootstrap.cc:492] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:52.909973 26105 raft_consensus.cc:740] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.910611 26227 raft_consensus.cc:493] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.910210 26107 raft_consensus.cc:385] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.911332 26107 raft_consensus.cc:740] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.911204 26227 raft_consensus.cc:515] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.911490 26105 consensus_queue.cc:260] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.888906 26104 raft_consensus.cc:740] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.912297 26107 consensus_queue.cc:260] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.915290 26105 ts_tablet_manager.cc:1434] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:21:52.913205 26104 consensus_queue.cc:260] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.918254 26106 tablet_bootstrap.cc:654] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.918903 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:52.918911 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:52.921679 25875 leader_election.cc:343] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.922777 26105 tablet_bootstrap.cc:492] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:52.921887 26104 ts_tablet_manager.cc:1434] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.001s
I20260709 13:21:52.925441 26104 tablet_bootstrap.cc:492] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:52.925570 26107 ts_tablet_manager.cc:1434] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:21:52.926789 26115 raft_consensus.cc:493] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.928918 26115 raft_consensus.cc:515] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.929900 26107 tablet_bootstrap.cc:492] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:52.931208 26115 leader_election.cc:290] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:52.932894 26246 raft_consensus.cc:493] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:52.933856 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b625185a5664b86ad39dc782dfb71c1" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:52.933643 26246 raft_consensus.cc:515] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
W20260709 13:21:52.934422 25874 leader_election.cc:343] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.934559 25836 raft_consensus.cc:2468] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:52.934952 25874 leader_election.cc:304] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:52.936720 26142 raft_consensus.cc:2749] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:52.937861 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b625185a5664b86ad39dc782dfb71c1" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:52.938868 25910 raft_consensus.cc:2468] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:52.939271 25949 leader_election.cc:304] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:52.942704 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b1da671c9454f06b4568be0a7d96ba6" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:52.943161 26105 tablet_bootstrap.cc:654] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:52.944263 26022 leader_election.cc:343] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:52.946935 26104 tablet_bootstrap.cc:654] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.952453 26246 leader_election.cc:290] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:52.913774 26227 leader_election.cc:290] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:52.955515 26115 raft_consensus.cc:2804] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.956077 26115 raft_consensus.cc:493] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.956528 26115 raft_consensus.cc:3060] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.956749 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b1da671c9454f06b4568be0a7d96ba6" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:52.957629 25910 raft_consensus.cc:2468] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:52.910276 25911 raft_consensus.cc:2468] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:52.959311 26025 leader_election.cc:304] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:52.902422 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f82b9479b4249b9b78a11bf5c355ddf" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:52.960124 25835 raft_consensus.cc:2468] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:52.961216 26023 leader_election.cc:304] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:52.962121 26294 raft_consensus.cc:2804] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.962634 26294 raft_consensus.cc:493] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.963125 26294 raft_consensus.cc:3060] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.967674 26104 tablet_bootstrap.cc:492] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:52.968231 26104 ts_tablet_manager.cc:1403] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.007s
I20260709 13:21:52.971036 26104 raft_consensus.cc:359] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.971498 26246 raft_consensus.cc:2804] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:52.971817 26115 raft_consensus.cc:515] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:52.973556 26246 raft_consensus.cc:493] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:52.973767 26105 tablet_bootstrap.cc:492] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:52.974328 26105 ts_tablet_manager.cc:1403] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.014s
I20260709 13:21:52.976128 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b625185a5664b86ad39dc782dfb71c1" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:52.976277 26246 raft_consensus.cc:3060] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.976744 25835 raft_consensus.cc:3060] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:52.977118 26105 raft_consensus.cc:359] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.977803 26105 raft_consensus.cc:385] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.978057 26105 raft_consensus.cc:740] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.978758 26105 consensus_queue.cc:260] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.981021 26104 raft_consensus.cc:385] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:52.981315 26104 raft_consensus.cc:740] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:52.981913 26104 consensus_queue.cc:260] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:52.989920 26104 ts_tablet_manager.cc:1434] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:21:52.993216 25835 raft_consensus.cc:2468] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:53.002142 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b625185a5664b86ad39dc782dfb71c1" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:53.003657 25911 raft_consensus.cc:3060] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.008527 26104 tablet_bootstrap.cc:492] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:53.009105 26107 tablet_bootstrap.cc:654] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:52.987672 26294 raft_consensus.cc:515] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.014518 26105 ts_tablet_manager.cc:1434] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 13:21:53.017892 26105 tablet_bootstrap.cc:492] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:53.018613 25911 raft_consensus.cc:2468] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:53.019907 25951 leader_election.cc:304] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:53.002641 26115 leader_election.cc:290] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:53.020678 26257 raft_consensus.cc:2804] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.020994 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b1da671c9454f06b4568be0a7d96ba6" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:53.021332 26257 raft_consensus.cc:697] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:21:53.021842 25910 raft_consensus.cc:3060] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.022239 26257 consensus_queue.cc:237] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.021044 26142 raft_consensus.cc:493] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.026281 26142 raft_consensus.cc:515] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.028303 26142 leader_election.cc:290] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:53.033241 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:53.034747 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b1da671c9454f06b4568be0a7d96ba6" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
W20260709 13:21:53.035255 25876 leader_election.cc:343] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.035598 25984 raft_consensus.cc:3060] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.038007 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:53.039669 25874 leader_election.cc:343] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.040527 26104 tablet_bootstrap.cc:654] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.043665 26306 raft_consensus.cc:493] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.040345 25874 leader_election.cc:304] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:53.044333 26105 tablet_bootstrap.cc:654] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.044232 26306 raft_consensus.cc:515] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.045393 26142 raft_consensus.cc:2749] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.048167 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:53.048347 25983 raft_consensus.cc:3060] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.049062 25909 raft_consensus.cc:2468] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:53.051975 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:53.052296 25802 leader_election.cc:304] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
W20260709 13:21:53.053483 25799 leader_election.cc:343] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.053777 26306 leader_election.cc:290] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:53.054737 26306 raft_consensus.cc:2804] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.055167 26306 raft_consensus.cc:493] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.055580 26306 raft_consensus.cc:3060] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.060041 25733 catalog_manager.cc:5697] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:53.061888 26105 tablet_bootstrap.cc:492] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:53.062489 26105 ts_tablet_manager.cc:1403] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.001s
I20260709 13:21:53.066839 26105 raft_consensus.cc:359] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.067515 26105 raft_consensus.cc:385] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.067790 26105 raft_consensus.cc:740] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.070735 26105 consensus_queue.cc:260] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.071967 26306 raft_consensus.cc:515] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.073078 26105 ts_tablet_manager.cc:1434] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:53.074070 26105 tablet_bootstrap.cc:492] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:53.075939 26104 tablet_bootstrap.cc:492] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:53.075968 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:53.076623 26104 ts_tablet_manager.cc:1403] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.010s
I20260709 13:21:53.076929 25911 raft_consensus.cc:3060] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.080410 26115 raft_consensus.cc:493] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.080982 26115 raft_consensus.cc:515] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.083161 26115 leader_election.cc:290] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:53.084280 26104 raft_consensus.cc:359] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.085049 26104 raft_consensus.cc:385] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.085114 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e224ef22951c499c9fceb8ce339a349a" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:53.085461 26104 raft_consensus.cc:740] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.086161 26104 consensus_queue.cc:260] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.085809 26058 raft_consensus.cc:2468] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:53.084318 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e224ef22951c499c9fceb8ce339a349a" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:53.096877 26306 leader_election.cc:290] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:53.097185 25950 leader_election.cc:304] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
W20260709 13:21:53.098429 25949 leader_election.cc:343] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.099570 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:53.096184 26294 leader_election.cc:290] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:53.100872 25911 raft_consensus.cc:2468] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
W20260709 13:21:53.101145 25799 leader_election.cc:343] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.101342 25984 raft_consensus.cc:2468] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:53.102123 25802 leader_election.cc:304] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:53.102808 26022 leader_election.cc:304] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:53.103297 26306 raft_consensus.cc:2804] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.103715 26115 raft_consensus.cc:2804] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.104102 26115 raft_consensus.cc:493] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.104429 26115 raft_consensus.cc:3060] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.104661 26306 raft_consensus.cc:697] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:53.105620 26169 raft_consensus.cc:2804] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.105576 26306 consensus_queue.cc:237] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.106465 26169 raft_consensus.cc:697] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:53.107760 26169 consensus_queue.cc:237] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.112798 26115 raft_consensus.cc:515] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.116519 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e224ef22951c499c9fceb8ce339a349a" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:53.117132 26104 ts_tablet_manager.cc:1434] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:21:53.117177 26058 raft_consensus.cc:3060] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.117797 25910 raft_consensus.cc:2468] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:53.120604 26105 tablet_bootstrap.cc:654] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.121619 26115 leader_election.cc:290] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:53.118458 26104 tablet_bootstrap.cc:492] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:53.123593 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e224ef22951c499c9fceb8ce339a349a" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
W20260709 13:21:53.125087 25949 leader_election.cc:343] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.130643 26142 raft_consensus.cc:493] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.131466 26106 tablet_bootstrap.cc:492] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:53.132264 26106 ts_tablet_manager.cc:1403] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.223s	user 0.072s	sys 0.076s
I20260709 13:21:53.135375 26142 raft_consensus.cc:515] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.138294 26142 leader_election.cc:290] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:53.142345 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8ea7f0acae4a2fb1fac24abac35b6f" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:53.142827 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8ea7f0acae4a2fb1fac24abac35b6f" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
W20260709 13:21:53.143903 25875 leader_election.cc:343] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:53.144498 25876 leader_election.cc:343] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.145020 25876 leader_election.cc:304] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:53.146186 26142 raft_consensus.cc:2749] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.154170 26104 tablet_bootstrap.cc:654] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.131238 26246 raft_consensus.cc:515] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.166572 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f82b9479b4249b9b78a11bf5c355ddf" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:53.167232 25835 raft_consensus.cc:3060] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.168128 26246 leader_election.cc:290] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:53.172999 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f82b9479b4249b9b78a11bf5c355ddf" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:53.173606 25911 raft_consensus.cc:3060] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.174069 26105 tablet_bootstrap.cc:492] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:53.175695 26105 ts_tablet_manager.cc:1403] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.004s
I20260709 13:21:53.153083 26058 raft_consensus.cc:2468] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:53.179442 25950 leader_election.cc:304] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:53.179975 26105 raft_consensus.cc:359] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.180363 26115 raft_consensus.cc:2804] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.185738 26105 raft_consensus.cc:385] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.186081 26105 raft_consensus.cc:740] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.186116 26294 consensus_queue.cc:1048] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.187819 26107 tablet_bootstrap.cc:492] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:53.168488 25731 catalog_manager.cc:5697] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:53.189018 26105 consensus_queue.cc:260] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.190460 26107 ts_tablet_manager.cc:1403] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.261s	user 0.012s	sys 0.014s
I20260709 13:21:53.179468 26106 raft_consensus.cc:359] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.194555 26106 raft_consensus.cc:385] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.195066 26106 raft_consensus.cc:740] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.192112 25733 catalog_manager.cc:5697] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.200146 26105 ts_tablet_manager.cc:1434] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:21:53.201222 26105 tablet_bootstrap.cc:492] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:53.209000 26106 consensus_queue.cc:260] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.209959 26333 raft_consensus.cc:493] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.206264 25835 raft_consensus.cc:2468] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:53.214046 26023 leader_election.cc:304] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:53.214748 26306 raft_consensus.cc:493] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.221824 26106 ts_tablet_manager.cc:1434] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.001s
I20260709 13:21:53.215255 26306 raft_consensus.cc:515] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.225504 26104 tablet_bootstrap.cc:492] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:53.226171 26104 ts_tablet_manager.cc:1403] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.001s
I20260709 13:21:53.215459 26294 raft_consensus.cc:2804] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.230275 26107 raft_consensus.cc:359] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.232491 26107 raft_consensus.cc:385] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.232888 26107 raft_consensus.cc:740] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.211879 26115 raft_consensus.cc:697] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
W20260709 13:21:53.235231 25950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 55888.9us
I20260709 13:21:53.235606 26332 raft_consensus.cc:493] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.236095 26332 raft_consensus.cc:515] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.238516 26332 leader_election.cc:290] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:53.240502 26107 consensus_queue.cc:260] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.242715 26106 tablet_bootstrap.cc:492] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:53.248296 26107 ts_tablet_manager.cc:1434] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260709 13:21:53.249658 26107 tablet_bootstrap.cc:492] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:53.220429 26333 raft_consensus.cc:515] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.242797 26294 raft_consensus.cc:697] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:53.264484 26294 consensus_queue.cc:237] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.269655 25984 raft_consensus.cc:3060] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.269842 26306 leader_election.cc:290] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:53.270677 26107 tablet_bootstrap.cc:654] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.270498 26115 consensus_queue.cc:237] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.273819 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e224ef22951c499c9fceb8ce339a349a" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:53.278373 26333 leader_election.cc:290] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:53.250691 26105 tablet_bootstrap.cc:654] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.300479 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:53.287886 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:53.287755 26183 consensus_queue.cc:1048] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:21:53.295603 26142 raft_consensus.cc:493] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.296505 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e56b5dacf8443239fe2cd7fcc3286bb" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:53.316361 26257 raft_consensus.cc:493] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cb7aae2a23a47c180432cb646577fd6)
I20260709 13:21:53.323566 26257 raft_consensus.cc:515] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.328504 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e56b5dacf8443239fe2cd7fcc3286bb" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:53.329352 26059 raft_consensus.cc:2468] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:53.332561 26169 consensus_queue.cc:1048] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.333945 26106 tablet_bootstrap.cc:654] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.335122 26227 raft_consensus.cc:493] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.335664 26227 raft_consensus.cc:515] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.318740 25911 raft_consensus.cc:2468] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:53.343778 25910 raft_consensus.cc:2393] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d01fccfd609b4182a5d43a7f6b4ae503 in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:53.348968 25950 leader_election.cc:304] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:53.359189 26227 leader_election.cc:290] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:53.360666 26336 raft_consensus.cc:2804] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.361125 26336 raft_consensus.cc:493] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.361465 26336 raft_consensus.cc:3060] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.321624 26142 raft_consensus.cc:515] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.351119 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e224ef22951c499c9fceb8ce339a349a" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:53.371513 26104 raft_consensus.cc:359] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.376019 26104 raft_consensus.cc:385] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.376231 26104 raft_consensus.cc:740] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
W20260709 13:21:53.363721 25949 leader_election.cc:343] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.378185 26104 consensus_queue.cc:260] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.384171 26104 ts_tablet_manager.cc:1434] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.158s	user 0.008s	sys 0.000s
I20260709 13:21:53.387562 26107 tablet_bootstrap.cc:492] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:53.388720 26107 ts_tablet_manager.cc:1403] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.139s	user 0.015s	sys 0.016s
I20260709 13:21:53.381798 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015dfd3d2a2e4732876fa91c804d5f58" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:53.389276 26057 raft_consensus.cc:2393] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate d01fccfd609b4182a5d43a7f6b4ae503 in this term.
I20260709 13:21:53.369875 26303 consensus_queue.cc:1048] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:21:53.402662 26142 leader_election.cc:290] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:53.396147 26257 leader_election.cc:290] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:53.396661 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df402c226a164b7b945723f607f9aa75" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:53.404824 25801 leader_election.cc:304] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:53.405654 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:53.406320 26337 raft_consensus.cc:3060] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.388296 26246 raft_consensus.cc:493] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.408972 26246 raft_consensus.cc:515] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.412693 26246 leader_election.cc:290] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:21:53.397516 25949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 46198.5us
I20260709 13:21:53.397892 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df402c226a164b7b945723f607f9aa75" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
W20260709 13:21:53.400241 25874 leader_election.cc:343] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.400542 25951 leader_election.cc:304] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:53.421223 26104 tablet_bootstrap.cc:492] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
W20260709 13:21:53.415443 25875 leader_election.cc:343] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.434515 26335 raft_consensus.cc:2749] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.445466 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015dfd3d2a2e4732876fa91c804d5f58" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:53.446561 26056 raft_consensus.cc:2468] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:53.449177 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:53.450721 25876 leader_election.cc:304] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:53.452307 26160 raft_consensus.cc:2804] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.449307 25908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015dfd3d2a2e4732876fa91c804d5f58" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:53.458197 26105 tablet_bootstrap.cc:492] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:53.458822 26105 ts_tablet_manager.cc:1403] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.258s	user 0.027s	sys 0.006s
W20260709 13:21:53.460320 25951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:46717, user_credentials={real_user=slave}} blocked reactor thread for 59921.6us
W20260709 13:21:53.462182 25874 leader_election.cc:343] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.462745 25874 leader_election.cc:304] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:53.462301 26105 raft_consensus.cc:359] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.452805 26160 raft_consensus.cc:493] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.463595 26105 raft_consensus.cc:385] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.463778 26160 raft_consensus.cc:3060] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.464160 26105 raft_consensus.cc:740] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.465232 26105 consensus_queue.cc:260] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.471809 26105 ts_tablet_manager.cc:1434] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:21:53.444132 25733 catalog_manager.cc:5697] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.475835 26105 tablet_bootstrap.cc:492] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:53.468516 26227 raft_consensus.cc:2749] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.462246 25951 leader_election.cc:304] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:53.481133 26227 raft_consensus.cc:493] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.501533 26227 raft_consensus.cc:515] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.504043 26227 leader_election.cc:290] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:53.485424 26104 tablet_bootstrap.cc:654] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.476217 26246 consensus_queue.cc:1048] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:21:53.491549 26106 tablet_bootstrap.cc:492] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:53.508136 26106 ts_tablet_manager.cc:1403] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.276s	user 0.012s	sys 0.025s
I20260709 13:21:53.508548 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1deaadec34478f9d16b69e2cd0742a" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:53.488196 26107 raft_consensus.cc:359] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
W20260709 13:21:53.510654 25876 leader_election.cc:343] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:53.511873 25951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:46717, user_credentials={real_user=slave}} blocked reactor thread for 49727us
I20260709 13:21:53.511973 26337 raft_consensus.cc:2749] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.512666 26335 raft_consensus.cc:2749] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:53.497761 26160 raft_consensus.cc:515] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.519590 25908 raft_consensus.cc:2393] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cb7aae2a23a47c180432cb646577fd6 in current term 1: Already voted for candidate 00dbc14fa82f4a22b1cab8f3691196de in this term.
I20260709 13:21:53.510689 26107 raft_consensus.cc:385] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.522395 26107 raft_consensus.cc:740] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.523202 26107 consensus_queue.cc:260] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.523270 26106 raft_consensus.cc:359] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.524112 26106 raft_consensus.cc:385] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.524269 26160 leader_election.cc:290] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:53.483897 26336 raft_consensus.cc:515] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.526556 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015dfd3d2a2e4732876fa91c804d5f58" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:53.526863 26336 leader_election.cc:290] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:53.527945 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015dfd3d2a2e4732876fa91c804d5f58" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:53.528614 26058 raft_consensus.cc:3060] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.529253 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e56b5dacf8443239fe2cd7fcc3286bb" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:53.529629 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e56b5dacf8443239fe2cd7fcc3286bb" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:53.530033 26105 tablet_bootstrap.cc:654] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.530364 26059 raft_consensus.cc:3060] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.515811 26246 consensus_queue.cc:1048] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:53.533341 25874 leader_election.cc:343] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.537045 25984 raft_consensus.cc:3060] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.524423 26106 raft_consensus.cc:740] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.541667 26106 consensus_queue.cc:260] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.542697 25836 raft_consensus.cc:3060] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.544271 26107 ts_tablet_manager.cc:1434] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.155s	user 0.008s	sys 0.000s
I20260709 13:21:53.549566 26107 tablet_bootstrap.cc:492] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:53.557955 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015dfd3d2a2e4732876fa91c804d5f58" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:53.561537 26059 raft_consensus.cc:2468] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:53.563077 25836 raft_consensus.cc:2468] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:53.565714 26335 consensus_queue.cc:1048] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.566558 26106 ts_tablet_manager.cc:1434] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.005s
I20260709 13:21:53.567680 26058 raft_consensus.cc:2468] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:53.569130 25950 leader_election.cc:304] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:53.570118 26257 raft_consensus.cc:2804] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.570659 26257 raft_consensus.cc:697] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:21:53.567703 26106 tablet_bootstrap.cc:492] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:53.574637 25876 leader_election.cc:304] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:53.578260 26227 raft_consensus.cc:2804] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.578836 26227 raft_consensus.cc:697] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:53.579756 26227 consensus_queue.cc:237] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.582449 26257 consensus_queue.cc:237] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.585439 26246 raft_consensus.cc:493] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.586249 26246 raft_consensus.cc:515] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.590637 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4521a8865b384a5f8afb98fb858cc318" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:53.592875 26023 leader_election.cc:343] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.562861 25729 catalog_manager.cc:5697] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.615028 26340 consensus_queue.cc:1048] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.615651 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1deaadec34478f9d16b69e2cd0742a" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:53.632083 26335 consensus_queue.cc:1048] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:53.634959 25875 leader_election.cc:343] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.635483 25875 leader_election.cc:304] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:53.636883 26246 leader_election.cc:290] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:53.639819 26353 raft_consensus.cc:2749] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:53.643047 26022 leader_election.cc:343] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.643625 26022 leader_election.cc:304] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:53.647135 26246 raft_consensus.cc:2749] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.646871 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4521a8865b384a5f8afb98fb858cc318" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:53.652143 25910 raft_consensus.cc:2468] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:53.653290 26335 consensus_queue.cc:1048] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.653789 26025 leader_election.cc:304] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:53.654896 26106 tablet_bootstrap.cc:654] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.655773 26246 raft_consensus.cc:2804] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.656222 26246 raft_consensus.cc:493] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.656598 26246 raft_consensus.cc:3060] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.660773 26104 tablet_bootstrap.cc:492] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:53.666767 26104 ts_tablet_manager.cc:1403] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.250s	user 0.013s	sys 0.014s
I20260709 13:21:53.690297 26107 tablet_bootstrap.cc:654] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.730324 26303 consensus_queue.cc:1048] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.734817 26183 consensus_queue.cc:1048] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.736259 25731 catalog_manager.cc:5697] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.754947 26105 tablet_bootstrap.cc:492] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:53.755445 26105 ts_tablet_manager.cc:1403] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.280s	user 0.033s	sys 0.022s
I20260709 13:21:53.747323 26336 raft_consensus.cc:493] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.761207 26336 raft_consensus.cc:515] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.761363 26340 consensus_queue.cc:1048] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.766603 26183 consensus_queue.cc:1048] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:53.775748 26104 raft_consensus.cc:359] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.778600 26104 raft_consensus.cc:385] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.782266 26336 leader_election.cc:290] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:53.783358 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:53.778975 26104 raft_consensus.cc:740] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.790343 26104 consensus_queue.cc:260] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.793345 26105 raft_consensus.cc:359] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.794252 26105 raft_consensus.cc:385] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.794623 26105 raft_consensus.cc:740] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.794868 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:53.795495 26105 consensus_queue.cc:260] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:53.797094 26105 ts_tablet_manager.cc:1434] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:21:53.797897 26105 tablet_bootstrap.cc:492] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:53.801970 26104 ts_tablet_manager.cc:1434] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.135s	user 0.006s	sys 0.003s
I20260709 13:21:53.808379 26107 tablet_bootstrap.cc:492] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:53.809263 26107 ts_tablet_manager.cc:1403] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.260s	user 0.012s	sys 0.009s
I20260709 13:21:53.821278 26104 tablet_bootstrap.cc:492] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:53.823575 26107 raft_consensus.cc:359] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.824208 26107 raft_consensus.cc:385] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.824404 26107 raft_consensus.cc:740] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.826102 25730 catalog_manager.cc:5697] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.829011 26294 raft_consensus.cc:493] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.829512 26294 raft_consensus.cc:515] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.833461 26107 consensus_queue.cc:260] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:53.837450 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8ea7f0acae4a2fb1fac24abac35b6f" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:53.838160 25910 raft_consensus.cc:2468] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:53.831758 26294 leader_election.cc:290] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:53.814667 26303 consensus_queue.cc:1048] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:21:53.848145 26107 ts_tablet_manager.cc:1434] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.002s
I20260709 13:21:53.855785 26025 leader_election.cc:304] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:53.825405 25949 leader_election.cc:304] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:53.857689 26115 raft_consensus.cc:2749] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:53.865410 26294 raft_consensus.cc:2804] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:53.866011 26294 raft_consensus.cc:493] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:53.866401 26294 raft_consensus.cc:3060] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.869352 26115 consensus_queue.cc:1048] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:53.871328 26107 tablet_bootstrap.cc:492] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:53.874133 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8ea7f0acae4a2fb1fac24abac35b6f" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:53.878564 26023 leader_election.cc:343] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.887020 26106 tablet_bootstrap.cc:492] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:53.887619 26106 ts_tablet_manager.cc:1403] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.320s	user 0.015s	sys 0.007s
I20260709 13:21:53.890543 26106 raft_consensus.cc:359] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.891235 26106 raft_consensus.cc:385] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:53.891496 26106 raft_consensus.cc:740] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.892185 26106 consensus_queue.cc:260] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.895507 26142 raft_consensus.cc:493] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:53.898609 26142 raft_consensus.cc:515] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:53.901222 26142 leader_election.cc:290] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:53.895358 26246 raft_consensus.cc:515] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.902505 26106 ts_tablet_manager.cc:1434] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:21:53.904117 26106 tablet_bootstrap.cc:492] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:53.897203 26105 tablet_bootstrap.cc:654] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.906831 26246 leader_election.cc:290] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:53.907191 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4521a8865b384a5f8afb98fb858cc318" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:53.908002 25832 raft_consensus.cc:3060] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:53.912340 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:53.917971 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4521a8865b384a5f8afb98fb858cc318" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:53.918613 25909 raft_consensus.cc:3060] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:53.920272 25876 leader_election.cc:343] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.924768 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:53.926368 25909 raft_consensus.cc:2468] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:53.927641 26025 leader_election.cc:304] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:53.928830 26343 raft_consensus.cc:2804] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:53.929510 26343 raft_consensus.cc:697] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:53.930639 26343 consensus_queue.cc:237] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
W20260709 13:21:53.938689 25874 leader_election.cc:343] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.939234 25874 leader_election.cc:304] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:53.940024 26142 raft_consensus.cc:2749] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:53.916445 25832 raft_consensus.cc:2468] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:53.917620 26106 tablet_bootstrap.cc:654] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.967712 26104 tablet_bootstrap.cc:654] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.970266 26294 raft_consensus.cc:515] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:53.988083 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8ea7f0acae4a2fb1fac24abac35b6f" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
W20260709 13:21:53.990203 26023 leader_election.cc:343] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:53.994341 26107 tablet_bootstrap.cc:654] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:53.996649 26294 leader_election.cc:290] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:53.998063 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8ea7f0acae4a2fb1fac24abac35b6f" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:53.998780 25911 raft_consensus.cc:3060] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.007411 26106 tablet_bootstrap.cc:492] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:54.008208 26106 ts_tablet_manager.cc:1403] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.005s
I20260709 13:21:54.014999 25911 raft_consensus.cc:2468] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:54.016327 26025 leader_election.cc:304] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:54.017580 26294 raft_consensus.cc:2804] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.018085 26294 raft_consensus.cc:697] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:54.018898 26294 consensus_queue.cc:237] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.024551 25731 catalog_manager.cc:5697] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.045009 26142 consensus_queue.cc:1048] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:54.068010 25985 raft_consensus.cc:3060] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.077510 26105 tablet_bootstrap.cc:492] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:54.078105 26105 ts_tablet_manager.cc:1403] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.280s	user 0.057s	sys 0.063s
I20260709 13:21:54.039160 26106 raft_consensus.cc:359] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.079162 26106 raft_consensus.cc:385] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.079548 26106 raft_consensus.cc:740] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.081313 26106 consensus_queue.cc:260] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.083205 26105 raft_consensus.cc:359] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.084029 26105 raft_consensus.cc:385] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.084364 26105 raft_consensus.cc:740] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.085079 26105 consensus_queue.cc:260] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.086054 26106 ts_tablet_manager.cc:1434] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.001s
I20260709 13:21:54.087658 26106 tablet_bootstrap.cc:492] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:54.089763 26105 ts_tablet_manager.cc:1434] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:21:54.091948 26107 tablet_bootstrap.cc:492] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:54.095548 26107 ts_tablet_manager.cc:1403] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.224s	user 0.013s	sys 0.000s
I20260709 13:21:54.098486 26227 consensus_queue.cc:1048] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:54.099843 26104 tablet_bootstrap.cc:492] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:54.100250 26106 tablet_bootstrap.cc:654] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.098265 26107 raft_consensus.cc:359] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.101188 26107 raft_consensus.cc:385] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.101433 26107 raft_consensus.cc:740] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.102451 26107 consensus_queue.cc:260] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.104764 25731 catalog_manager.cc:5697] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.104745 26107 ts_tablet_manager.cc:1434] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:54.108786 26107 tablet_bootstrap.cc:492] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:54.100342 26104 ts_tablet_manager.cc:1403] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.285s	user 0.019s	sys 0.031s
W20260709 13:21:54.113016 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:54.112681 26104 raft_consensus.cc:359] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.122028 26104 raft_consensus.cc:385] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.122287 26104 raft_consensus.cc:740] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.122948 26104 consensus_queue.cc:260] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.124615 26104 ts_tablet_manager.cc:1434] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.001s
I20260709 13:21:54.163727 26104 tablet_bootstrap.cc:492] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:54.131598 26107 tablet_bootstrap.cc:654] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.145900 26115 consensus_queue.cc:1048] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:21:54.170658 26337 raft_consensus.cc:493] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.171237 26337 raft_consensus.cc:515] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.174404 26337 leader_election.cc:290] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:54.174948 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:54.175765 25910 raft_consensus.cc:2468] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:54.176082 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:54.176751 25984 raft_consensus.cc:2468] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:54.177300 25802 leader_election.cc:304] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:54.181471 26337 raft_consensus.cc:2804] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.182152 26337 raft_consensus.cc:493] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.182564 26337 raft_consensus.cc:3060] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.184022 26104 tablet_bootstrap.cc:654] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.134402 26106 tablet_bootstrap.cc:492] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:54.185303 26106 ts_tablet_manager.cc:1403] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.006s
I20260709 13:21:54.187827 26333 consensus_queue.cc:1048] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:54.188153 26106 raft_consensus.cc:359] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.188824 26106 raft_consensus.cc:385] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.189138 26106 raft_consensus.cc:740] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.189803 26106 consensus_queue.cc:260] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.127343 26105 tablet_bootstrap.cc:492] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:54.192816 26106 ts_tablet_manager.cc:1434] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:21:54.196799 26106 tablet_bootstrap.cc:492] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:54.199299 26337 raft_consensus.cc:515] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.204939 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:54.205370 26107 tablet_bootstrap.cc:492] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:54.205516 25910 raft_consensus.cc:3060] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.205900 26107 ts_tablet_manager.cc:1403] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.097s	user 0.026s	sys 0.012s
I20260709 13:21:54.208639 26107 raft_consensus.cc:359] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.209268 26107 raft_consensus.cc:385] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.209506 26107 raft_consensus.cc:740] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.210283 26107 consensus_queue.cc:260] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.217270 26343 raft_consensus.cc:493] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.217846 26343 raft_consensus.cc:515] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.222471 26105 tablet_bootstrap.cc:654] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.222536 26107 ts_tablet_manager.cc:1434] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:21:54.225988 26107 tablet_bootstrap.cc:492] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:54.227645 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dbdaf9ef5f4640b9150440ef18c88c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:54.227948 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dbdaf9ef5f4640b9150440ef18c88c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:54.229888 26022 leader_election.cc:343] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.225800 26343 leader_election.cc:290] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
W20260709 13:21:54.232074 26023 leader_election.cc:343] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.232986 26023 leader_election.cc:304] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:54.234054 26343 raft_consensus.cc:2749] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.234405 26105 tablet_bootstrap.cc:492] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:54.234699 25910 raft_consensus.cc:2468] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:54.235342 26337 leader_election.cc:290] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:54.234908 26105 ts_tablet_manager.cc:1403] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.108s	user 0.023s	sys 0.004s
I20260709 13:21:54.235948 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:54.237206 25802 leader_election.cc:304] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:54.237613 25985 raft_consensus.cc:3060] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.241465 26107 tablet_bootstrap.cc:654] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.243736 26337 raft_consensus.cc:2804] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.245570 26337 raft_consensus.cc:697] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:54.246517 26337 consensus_queue.cc:237] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.250711 26106 tablet_bootstrap.cc:654] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.252563 25985 raft_consensus.cc:2468] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:54.263650 26104 tablet_bootstrap.cc:492] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:54.264143 26104 ts_tablet_manager.cc:1403] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.005s
I20260709 13:21:54.254426 26105 raft_consensus.cc:359] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.267086 26105 raft_consensus.cc:385] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.267365 26105 raft_consensus.cc:740] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.273080 26227 raft_consensus.cc:493] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.273813 26227 raft_consensus.cc:515] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.274559 26343 raft_consensus.cc:493] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.275072 26343 raft_consensus.cc:515] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.277827 26343 leader_election.cc:290] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:54.279562 26104 raft_consensus.cc:359] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.280555 26104 raft_consensus.cc:385] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.279562 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:54.281558 26105 consensus_queue.cc:260] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.282780 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:54.283385 25910 raft_consensus.cc:2468] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:54.283743 26105 ts_tablet_manager.cc:1434] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.000s
W20260709 13:21:54.284674 26022 leader_election.cc:343] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.285974 26105 tablet_bootstrap.cc:492] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:54.280879 26104 raft_consensus.cc:740] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.286968 26104 consensus_queue.cc:260] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.287761 26333 raft_consensus.cc:493] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.288192 26333 raft_consensus.cc:515] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.289132 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:54.290843 26333 leader_election.cc:290] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:54.291049 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:54.291872 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dbdaf9ef5f4640b9150440ef18c88c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:54.292449 25875 leader_election.cc:343] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:54.293521 25949 leader_election.cc:343] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.294433 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dbdaf9ef5f4640b9150440ef18c88c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:54.295033 26058 raft_consensus.cc:2468] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:54.295732 26104 ts_tablet_manager.cc:1434] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:21:54.297056 26104 tablet_bootstrap.cc:492] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
W20260709 13:21:54.300505 25874 leader_election.cc:343] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.301028 25874 leader_election.cc:304] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:54.302091 26025 leader_election.cc:304] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:54.303313 26142 raft_consensus.cc:2749] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.303800 26294 raft_consensus.cc:2804] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.304203 26294 raft_consensus.cc:493] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.304538 26294 raft_consensus.cc:3060] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.305234 25950 leader_election.cc:304] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:54.308200 26333 raft_consensus.cc:2804] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.308607 26333 raft_consensus.cc:493] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.308983 26333 raft_consensus.cc:3060] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.316509 26294 raft_consensus.cc:515] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.318092 26104 tablet_bootstrap.cc:654] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.320006 26294 leader_election.cc:290] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:54.320024 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:54.320853 25910 raft_consensus.cc:3060] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.322695 26105 tablet_bootstrap.cc:654] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.326663 26106 tablet_bootstrap.cc:492] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:54.327113 26106 ts_tablet_manager.cc:1403] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.131s	user 0.004s	sys 0.022s
I20260709 13:21:54.327587 26227 leader_election.cc:290] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:54.328820 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:54.328467 25729 catalog_manager.cc:5697] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.330125 26106 raft_consensus.cc:359] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.331022 26106 raft_consensus.cc:385] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.331278 26106 raft_consensus.cc:740] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.332008 26106 consensus_queue.cc:260] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.334069 26106 ts_tablet_manager.cc:1434] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
W20260709 13:21:54.334882 26022 leader_election.cc:343] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.335225 26106 tablet_bootstrap.cc:492] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:54.339519 25910 raft_consensus.cc:2468] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:54.341261 26104 tablet_bootstrap.cc:492] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:54.344527 26104 ts_tablet_manager.cc:1403] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.001s
I20260709 13:21:54.344573 26333 raft_consensus.cc:515] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.345448 26025 leader_election.cc:304] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:54.347389 26104 raft_consensus.cc:359] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.348039 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dbdaf9ef5f4640b9150440ef18c88c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:54.348649 26058 raft_consensus.cc:3060] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.350055 26343 raft_consensus.cc:2804] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.350203 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dbdaf9ef5f4640b9150440ef18c88c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:54.350638 26343 raft_consensus.cc:697] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
W20260709 13:21:54.351644 25949 leader_election.cc:343] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.351487 26343 consensus_queue.cc:237] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.352265 26333 leader_election.cc:290] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:54.355708 26058 raft_consensus.cc:2468] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:54.356521 26107 tablet_bootstrap.cc:492] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:54.357719 26107 ts_tablet_manager.cc:1403] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.003s
I20260709 13:21:54.358084 25950 leader_election.cc:304] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:54.358479 26105 tablet_bootstrap.cc:492] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:54.358970 26105 ts_tablet_manager.cc:1403] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.074s	user 0.003s	sys 0.007s
I20260709 13:21:54.359314 26333 raft_consensus.cc:2804] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.343065 26106 tablet_bootstrap.cc:654] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.360252 26333 raft_consensus.cc:697] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:21:54.360941 26107 raft_consensus.cc:359] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.361629 26107 raft_consensus.cc:385] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.361210 26333 consensus_queue.cc:237] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.361572 26105 raft_consensus.cc:359] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.362062 26107 raft_consensus.cc:740] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.362433 26105 raft_consensus.cc:385] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.362743 26105 raft_consensus.cc:740] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.362923 26107 consensus_queue.cc:260] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.363734 26105 consensus_queue.cc:260] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.365295 26107 ts_tablet_manager.cc:1434] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:21:54.366202 26107 tablet_bootstrap.cc:492] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:54.376737 26105 ts_tablet_manager.cc:1434] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:21:54.378981 25729 catalog_manager.cc:5697] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:54.387217 26107 tablet_bootstrap.cc:654] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.400071 26337 raft_consensus.cc:493] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.400700 26337 raft_consensus.cc:515] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.397310 26106 tablet_bootstrap.cc:492] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:54.405043 26337 leader_election.cc:290] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:54.405761 26106 ts_tablet_manager.cc:1403] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.071s	user 0.004s	sys 0.019s
I20260709 13:21:54.406387 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:54.409835 26105 tablet_bootstrap.cc:492] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:54.408025 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
W20260709 13:21:54.410589 25799 leader_election.cc:343] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.410670 25910 raft_consensus.cc:2468] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:54.412230 25802 leader_election.cc:304] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:54.348037 26104 raft_consensus.cc:385] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.413328 26104 raft_consensus.cc:740] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.412793 26106 raft_consensus.cc:359] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.428598 26105 tablet_bootstrap.cc:654] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.428712 26106 raft_consensus.cc:385] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.413460 26337 raft_consensus.cc:2804] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.429224 26106 raft_consensus.cc:740] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.429447 26337 raft_consensus.cc:493] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.429862 26337 raft_consensus.cc:3060] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.430115 26106 consensus_queue.cc:260] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.432371 26106 ts_tablet_manager.cc:1434] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:21:54.428790 26104 consensus_queue.cc:260] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.435413 26104 ts_tablet_manager.cc:1434] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.000s
I20260709 13:21:54.436285 26104 tablet_bootstrap.cc:492] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:54.437951 26106 tablet_bootstrap.cc:492] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:54.443361 26343 raft_consensus.cc:493] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.425395 26107 tablet_bootstrap.cc:492] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:54.444634 26107 ts_tablet_manager.cc:1403] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.007s
I20260709 13:21:54.444934 26105 tablet_bootstrap.cc:492] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:54.445461 26105 ts_tablet_manager.cc:1403] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.010s
I20260709 13:21:54.414695 25731 catalog_manager.cc:5697] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.447705 26107 raft_consensus.cc:359] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.448444 26107 raft_consensus.cc:385] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.415731 26306 raft_consensus.cc:493] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.448220 26105 raft_consensus.cc:359] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.449122 26105 raft_consensus.cc:385] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.449630 26105 raft_consensus.cc:740] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.449100 26306 raft_consensus.cc:515] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.443959 26343 raft_consensus.cc:515] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.452224 26343 leader_election.cc:290] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:54.453752 26104 tablet_bootstrap.cc:654] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.453951 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8ea7f0acae4a2fb1fac24abac35b6f" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:54.448796 26107 raft_consensus.cc:740] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.457679 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1deaadec34478f9d16b69e2cd0742a" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:54.458595 25909 raft_consensus.cc:2468] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:54.457384 26107 consensus_queue.cc:260] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.466491 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1deaadec34478f9d16b69e2cd0742a" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:54.466816 26107 ts_tablet_manager.cc:1434] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 13:21:54.467804 26107 tablet_bootstrap.cc:492] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:54.468537 26025 leader_election.cc:304] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:54.469452 26343 raft_consensus.cc:2804] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.469897 26343 raft_consensus.cc:493] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.470278 26343 raft_consensus.cc:3060] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.474078 26107 tablet_bootstrap.cc:654] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:54.475567 26023 leader_election.cc:343] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.455478 26106 tablet_bootstrap.cc:654] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.452436 26337 raft_consensus.cc:515] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.478968 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8ea7f0acae4a2fb1fac24abac35b6f" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:54.479974 25909 raft_consensus.cc:2393] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:54.481179 26306 leader_election.cc:290] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:54.481580 26337 leader_election.cc:290] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:54.482225 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:54.485433 25802 leader_election.cc:304] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:54.486476 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:54.492877 25909 raft_consensus.cc:3060] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.493068 26337 raft_consensus.cc:3060] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.494377 26106 tablet_bootstrap.cc:492] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:54.495100 26104 tablet_bootstrap.cc:492] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
W20260709 13:21:54.495200 25799 leader_election.cc:343] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.495662 26104 ts_tablet_manager.cc:1403] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.000s
I20260709 13:21:54.496243 26227 raft_consensus.cc:493] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.496795 26227 raft_consensus.cc:515] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.498589 26104 raft_consensus.cc:359] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.499140 26227 leader_election.cc:290] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:54.499827 26106 ts_tablet_manager.cc:1403] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.005s
I20260709 13:21:54.499984 25909 raft_consensus.cc:2468] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:54.500880 26294 consensus_queue.cc:1048] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:54.501252 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb6cace1a274a589bb22b03411c0afe" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:54.501899 26058 raft_consensus.cc:2468] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:54.502835 25802 leader_election.cc:304] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:54.503361 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb6cace1a274a589bb22b03411c0afe" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:54.504575 26306 raft_consensus.cc:2804] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.504408 25876 leader_election.cc:304] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:54.505326 26306 raft_consensus.cc:697] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:54.504370 26303 consensus_queue.cc:1048] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:54.505811 25874 leader_election.cc:343] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.506551 26227 raft_consensus.cc:2804] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.506269 26306 consensus_queue.cc:237] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.507019 26227 raft_consensus.cc:493] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.507527 26227 raft_consensus.cc:3060] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.504833 26106 raft_consensus.cc:359] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.508432 26106 raft_consensus.cc:385] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.508730 26106 raft_consensus.cc:740] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.488718 26343 raft_consensus.cc:515] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.509621 26106 consensus_queue.cc:260] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.512215 26106 ts_tablet_manager.cc:1434] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:21:54.512523 26343 leader_election.cc:290] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:54.513085 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1deaadec34478f9d16b69e2cd0742a" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:54.513255 26106 tablet_bootstrap.cc:492] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:21:54.514736 26023 leader_election.cc:343] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.514967 26107 tablet_bootstrap.cc:492] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:54.515466 26107 ts_tablet_manager.cc:1403] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.006s
I20260709 13:21:54.516170 26337 raft_consensus.cc:2749] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.516463 26105 consensus_queue.cc:260] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.518321 26107 raft_consensus.cc:359] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.519269 26107 raft_consensus.cc:385] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.519630 26107 raft_consensus.cc:740] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.499317 26104 raft_consensus.cc:385] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.523226 26104 raft_consensus.cc:740] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.523101 26107 consensus_queue.cc:260] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.525200 26353 raft_consensus.cc:493] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.525781 26353 raft_consensus.cc:515] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.527179 26107 ts_tablet_manager.cc:1434] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:21:54.528250 26107 tablet_bootstrap.cc:492] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:54.529232 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f46a3b3a20d4dcbb895c0b6bba0a6c6" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:54.560266 26058 raft_consensus.cc:2468] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:54.530272 26353 leader_election.cc:290] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:54.562963 25733 catalog_manager.cc:5697] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.531375 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f46a3b3a20d4dcbb895c0b6bba0a6c6" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:54.534915 26227 raft_consensus.cc:515] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.518869 26105 ts_tablet_manager.cc:1434] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
I20260709 13:21:54.566046 26105 tablet_bootstrap.cc:492] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
W20260709 13:21:54.567024 25875 leader_election.cc:343] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.567754 26107 tablet_bootstrap.cc:654] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.525249 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1deaadec34478f9d16b69e2cd0742a" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:54.568076 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb6cace1a274a589bb22b03411c0afe" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:54.539937 26142 raft_consensus.cc:493] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.532310 26104 consensus_queue.cc:260] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.568938 26142 raft_consensus.cc:515] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.570668 26104 ts_tablet_manager.cc:1434] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260709 13:21:54.571100 26142 leader_election.cc:290] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:54.571038 25876 leader_election.cc:304] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:54.571694 26104 tablet_bootstrap.cc:492] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:54.573298 26333 raft_consensus.cc:493] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.573817 26333 raft_consensus.cc:515] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.575230 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:54.553684 26294 consensus_queue.cc:1048] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:54.568264 25909 raft_consensus.cc:3060] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.580036 26333 leader_election.cc:290] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:54.567624 26227 leader_election.cc:290] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:54.583873 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb6cace1a274a589bb22b03411c0afe" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:54.587594 26056 raft_consensus.cc:3060] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.593948 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04360fb80eea42d7960ef5c2e4858275" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:54.594705 26058 raft_consensus.cc:2468] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:54.585753 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04360fb80eea42d7960ef5c2e4858275" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:54.585127 26160 raft_consensus.cc:2804] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.599707 26160 raft_consensus.cc:493] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.601071 26160 raft_consensus.cc:3060] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.590408 26104 tablet_bootstrap.cc:654] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:54.591564 25874 leader_election.cc:343] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.537555 26106 tablet_bootstrap.cc:654] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:54.592221 25875 leader_election.cc:343] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.607851 26105 tablet_bootstrap.cc:654] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.609325 25950 leader_election.cc:304] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:54.610334 26333 raft_consensus.cc:2804] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.610836 26333 raft_consensus.cc:493] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.611233 26333 raft_consensus.cc:3060] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.591898 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:54.616353 25949 leader_election.cc:343] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.621307 26404 consensus_queue.cc:1048] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:54.631783 25909 raft_consensus.cc:2468] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:54.628422 26160 raft_consensus.cc:515] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.640451 26333 raft_consensus.cc:515] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.643528 26105 tablet_bootstrap.cc:492] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:54.647020 26105 ts_tablet_manager.cc:1403] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.006s
W20260709 13:21:54.647516 25874 leader_election.cc:343] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.648178 25874 leader_election.cc:304] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:54.649925 26105 raft_consensus.cc:359] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.650734 26160 leader_election.cc:290] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:54.651413 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f46a3b3a20d4dcbb895c0b6bba0a6c6" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:54.661689 26058 raft_consensus.cc:3060] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.666322 26337 raft_consensus.cc:493] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.666885 26337 raft_consensus.cc:515] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.668706 26025 leader_election.cc:304] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:54.651701 26105 raft_consensus.cc:385] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.670029 26105 raft_consensus.cc:740] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.670622 26105 consensus_queue.cc:260] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.677245 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7fe3b03581401f935bfe2a3c432484" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:54.656963 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04360fb80eea42d7960ef5c2e4858275" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:54.677991 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04360fb80eea42d7960ef5c2e4858275" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:54.651535 26227 raft_consensus.cc:2749] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.678328 26059 raft_consensus.cc:3060] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:54.679520 25799 leader_election.cc:343] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.680619 26337 leader_election.cc:290] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:54.653033 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f46a3b3a20d4dcbb895c0b6bba0a6c6" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
W20260709 13:21:54.681516 25949 leader_election.cc:343] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.681783 26105 ts_tablet_manager.cc:1434] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:21:54.684437 26303 raft_consensus.cc:2804] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.686905 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7fe3b03581401f935bfe2a3c432484" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:54.688580 26336 raft_consensus.cc:493] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.693041 26303 raft_consensus.cc:697] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:54.693567 26336 raft_consensus.cc:515] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.693974 26303 consensus_queue.cc:237] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.697952 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:54.699136 25909 raft_consensus.cc:2393] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d01fccfd609b4182a5d43a7f6b4ae503 in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:54.675918 26333 leader_election.cc:290] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:54.689005 26056 raft_consensus.cc:2468] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
W20260709 13:21:54.689357 25875 leader_election.cc:343] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.690315 26107 tablet_bootstrap.cc:492] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:54.703006 26107 ts_tablet_manager.cc:1403] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.175s	user 0.015s	sys 0.035s
I20260709 13:21:54.704005 26340 consensus_queue.cc:1048] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:54.708997 25801 leader_election.cc:343] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.709522 25801 leader_election.cc:304] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:54.711676 26105 tablet_bootstrap.cc:492] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:54.688164 26058 raft_consensus.cc:2468] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:54.712679 26306 raft_consensus.cc:2749] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.712555 25876 leader_election.cc:304] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:54.715677 26142 raft_consensus.cc:2804] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.716233 26142 raft_consensus.cc:697] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:54.717682 26142 consensus_queue.cc:237] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.722226 25876 leader_election.cc:304] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:54.723613 26160 raft_consensus.cc:2804] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.723920 26336 leader_election.cc:290] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:54.724138 26160 raft_consensus.cc:697] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:54.730369 26106 tablet_bootstrap.cc:492] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:54.731046 26106 ts_tablet_manager.cc:1403] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.218s	user 0.024s	sys 0.027s
I20260709 13:21:54.740509 26160 consensus_queue.cc:237] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.742700 26306 raft_consensus.cc:493] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.743317 26306 raft_consensus.cc:515] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.745325 26337 consensus_queue.cc:1048] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:54.751924 26059 raft_consensus.cc:2468] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:54.753135 25950 leader_election.cc:304] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:54.738276 26107 raft_consensus.cc:359] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.754076 26107 raft_consensus.cc:385] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.754555 26336 raft_consensus.cc:2804] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.755442 26336 raft_consensus.cc:697] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:21:54.755955 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dbdaf9ef5f4640b9150440ef18c88c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:54.756106 26306 leader_election.cc:290] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:54.756421 26336 consensus_queue.cc:237] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.757409 26105 tablet_bootstrap.cc:654] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.754631 26107 raft_consensus.cc:740] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.762195 26107 consensus_queue.cc:260] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:54.765429 26107 ts_tablet_manager.cc:1434] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:21:54.786998 26107 tablet_bootstrap.cc:492] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:54.793546 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dbdaf9ef5f4640b9150440ef18c88c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:54.794611 26056 raft_consensus.cc:2393] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate d01fccfd609b4182a5d43a7f6b4ae503 in this term.
I20260709 13:21:54.797477 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:54.798465 25731 catalog_manager.cc:5697] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.807011 26104 tablet_bootstrap.cc:492] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:54.807657 26104 ts_tablet_manager.cc:1403] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.236s	user 0.026s	sys 0.021s
I20260709 13:21:54.814879 25950 leader_election.cc:304] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:54.817478 25730 catalog_manager.cc:5697] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.827395 26104 raft_consensus.cc:359] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.828473 26104 raft_consensus.cc:385] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.823477 26333 raft_consensus.cc:3060] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.828725 26104 raft_consensus.cc:740] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.832950 25730 catalog_manager.cc:5697] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:54.840415 26104 consensus_queue.cc:260] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.842640 26107 tablet_bootstrap.cc:654] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.848704 25801 leader_election.cc:304] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:54.851446 26337 raft_consensus.cc:3060] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.869659 26227 raft_consensus.cc:493] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.870323 26227 raft_consensus.cc:515] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:54.867806 26106 raft_consensus.cc:359] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.874152 26106 raft_consensus.cc:385] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.874574 26106 raft_consensus.cc:740] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.874702 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:54.875480 26106 consensus_queue.cc:260] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:54.876223 26404 raft_consensus.cc:493] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.876408 26227 leader_election.cc:290] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:54.876798 26404 raft_consensus.cc:515] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:21:54.877569 25876 leader_election.cc:343] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.879030 26104 ts_tablet_manager.cc:1434] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:21:54.880270 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb960d6f3ef4634a29335330aa1c58c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:54.882020 26022 leader_election.cc:343] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:54.903690 25799 consensus_peers.cc:597] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:54.914981 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb960d6f3ef4634a29335330aa1c58c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:54.917202 26106 ts_tablet_manager.cc:1434] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.186s	user 0.010s	sys 0.000s
I20260709 13:21:54.918618 26106 tablet_bootstrap.cc:492] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:54.920316 26404 leader_election.cc:290] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:54.880450 26104 tablet_bootstrap.cc:492] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:54.936492 26333 raft_consensus.cc:2749] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:54.930280 26023 leader_election.cc:343] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.946322 26023 leader_election.cc:304] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
W20260709 13:21:54.961722 25950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 106475us
W20260709 13:21:54.962129 25949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 61965.5us
I20260709 13:21:54.970674 26404 raft_consensus.cc:2749] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.974468 26404 consensus_queue.cc:1048] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:54.977952 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:54.979569 26023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 49956.8us
I20260709 13:21:54.983613 26105 tablet_bootstrap.cc:492] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:54.984133 26105 ts_tablet_manager.cc:1403] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.273s	user 0.047s	sys 0.058s
I20260709 13:21:54.983420 25733 catalog_manager.cc:5697] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:54.986882 26105 raft_consensus.cc:359] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.987509 26105 raft_consensus.cc:385] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.987236 26294 consensus_queue.cc:1048] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:54.987821 26105 raft_consensus.cc:740] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.968780 26337 raft_consensus.cc:2749] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:54.988584 26105 consensus_queue.cc:260] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:54.993702 26337 consensus_queue.cc:1048] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:21:54.995716 26160 raft_consensus.cc:493] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.001389 26160 raft_consensus.cc:515] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.002724 26106 tablet_bootstrap.cc:654] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.004310 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed0345d6849a4fcd8a00fa6dd75bad07" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:55.005195 25832 raft_consensus.cc:2468] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:55.006120 26105 ts_tablet_manager.cc:1434] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:21:55.006662 25875 leader_election.cc:304] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:55.007241 26105 tablet_bootstrap.cc:492] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:55.007730 26227 raft_consensus.cc:2804] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.008148 26227 raft_consensus.cc:493] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.008509 26227 raft_consensus.cc:3060] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.008749 26104 tablet_bootstrap.cc:654] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:54.997020 25874 leader_election.cc:343] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.017726 25874 leader_election.cc:304] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:55.019230 26142 raft_consensus.cc:2749] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.021718 26420 consensus_queue.cc:1048] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.024787 26257 consensus_queue.cc:1048] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.025244 26160 leader_election.cc:290] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:55.045234 26107 tablet_bootstrap.cc:492] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:55.045751 26107 ts_tablet_manager.cc:1403] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.259s	user 0.011s	sys 0.009s
I20260709 13:21:55.064141 26227 raft_consensus.cc:515] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.073258 26105 tablet_bootstrap.cc:654] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.095544 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed0345d6849a4fcd8a00fa6dd75bad07" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:55.100991 26023 consensus_peers.cc:597] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:55.102875 26107 raft_consensus.cc:359] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.103792 26107 raft_consensus.cc:385] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.104158 26107 raft_consensus.cc:740] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.105623 26107 consensus_queue.cc:260] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
W20260709 13:21:55.108057 25874 leader_election.cc:343] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.136541 26107 ts_tablet_manager.cc:1434] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.002s
I20260709 13:21:55.137943 26107 tablet_bootstrap.cc:492] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:55.138929 26106 tablet_bootstrap.cc:492] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:55.139503 26106 ts_tablet_manager.cc:1403] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.221s	user 0.014s	sys 0.007s
I20260709 13:21:55.145713 26353 consensus_queue.cc:1048] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.149152 26106 raft_consensus.cc:359] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.149998 26106 raft_consensus.cc:385] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.155495 26107 tablet_bootstrap.cc:654] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.150300 26106 raft_consensus.cc:740] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.159205 26106 consensus_queue.cc:260] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.162762 26106 ts_tablet_manager.cc:1434] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:21:55.164129 26106 tablet_bootstrap.cc:492] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:55.170192 26227 leader_election.cc:290] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:55.185258 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed0345d6849a4fcd8a00fa6dd75bad07" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:55.186036 25835 raft_consensus.cc:3060] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.188325 26105 tablet_bootstrap.cc:492] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:55.189332 26105 ts_tablet_manager.cc:1403] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.182s	user 0.016s	sys 0.006s
I20260709 13:21:55.190130 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed0345d6849a4fcd8a00fa6dd75bad07" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
W20260709 13:21:55.196938 25874 leader_election.cc:343] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:55.209698 25875 consensus_peers.cc:597] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:55.213251 26105 raft_consensus.cc:359] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.214151 26105 raft_consensus.cc:385] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:55.225208 25874 consensus_peers.cc:597] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:55.230249 26404 consensus_queue.cc:1048] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.214452 26105 raft_consensus.cc:740] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.232129 25835 raft_consensus.cc:2468] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:55.233465 26105 consensus_queue.cc:260] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.234074 25875 leader_election.cc:304] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:55.235716 26142 raft_consensus.cc:2804] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.235991 26105 ts_tablet_manager.cc:1434] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:21:55.236181 26142 raft_consensus.cc:697] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:55.237118 26105 tablet_bootstrap.cc:492] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:55.238449 26142 consensus_queue.cc:237] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.240386 26107 tablet_bootstrap.cc:492] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:55.240902 26107 ts_tablet_manager.cc:1403] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.103s	user 0.025s	sys 0.025s
I20260709 13:21:55.244823 26105 tablet_bootstrap.cc:654] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.245574 26104 tablet_bootstrap.cc:492] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:55.246073 26104 ts_tablet_manager.cc:1403] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.366s	user 0.031s	sys 0.014s
I20260709 13:21:55.252712 26106 tablet_bootstrap.cc:654] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.255913 26107 raft_consensus.cc:359] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.256628 26107 raft_consensus.cc:385] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.256904 26107 raft_consensus.cc:740] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.257400 26105 tablet_bootstrap.cc:492] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:55.257906 26105 ts_tablet_manager.cc:1403] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:21:55.259986 26257 consensus_queue.cc:1048] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.257681 26107 consensus_queue.cc:260] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.260799 26105 raft_consensus.cc:359] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.261508 26105 raft_consensus.cc:385] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.261802 26105 raft_consensus.cc:740] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.262609 26105 consensus_queue.cc:260] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.263072 26107 ts_tablet_manager.cc:1434] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.004s
I20260709 13:21:55.264029 26107 tablet_bootstrap.cc:492] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:55.264678 26105 ts_tablet_manager.cc:1434] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:21:55.267405 26105 tablet_bootstrap.cc:492] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
W20260709 13:21:55.273083 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:55.279171 26105 tablet_bootstrap.cc:654] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.284463 26106 tablet_bootstrap.cc:492] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
W20260709 13:21:55.288007 25949 consensus_peers.cc:597] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:55.289646 26106 ts_tablet_manager.cc:1403] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.000s
I20260709 13:21:55.291729 26105 tablet_bootstrap.cc:492] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:55.292234 26105 ts_tablet_manager.cc:1403] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.007s
I20260709 13:21:55.294942 26105 raft_consensus.cc:359] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.295590 26105 raft_consensus.cc:385] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.295835 26105 raft_consensus.cc:740] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.296627 26105 consensus_queue.cc:260] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.298135 26105 ts_tablet_manager.cc:1434] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:21:55.299005 26105 tablet_bootstrap.cc:492] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:55.302604 26294 raft_consensus.cc:493] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.303150 26294 raft_consensus.cc:515] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.304711 26105 tablet_bootstrap.cc:654] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.305891 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:55.306605 25907 raft_consensus.cc:2468] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:55.307757 26025 leader_election.cc:304] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:55.308460 26404 raft_consensus.cc:2804] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.308804 26404 raft_consensus.cc:493] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.309160 26404 raft_consensus.cc:3060] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.309237 26142 raft_consensus.cc:493] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.309830 26142 raft_consensus.cc:515] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.311954 26142 leader_election.cc:290] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:55.314586 26107 tablet_bootstrap.cc:654] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.315897 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162133acfbc941968cb2dd81ad3d7f46" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:55.318641 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:55.319864 25876 leader_election.cc:343] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:55.320050 26022 leader_election.cc:343] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.320894 26294 leader_election.cc:290] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:55.321820 26404 raft_consensus.cc:515] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.305635 26106 raft_consensus.cc:359] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.324734 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:55.325531 25907 raft_consensus.cc:3060] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.329856 26142 raft_consensus.cc:493] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.330410 26142 raft_consensus.cc:515] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.325042 26106 raft_consensus.cc:385] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.332592 26142 leader_election.cc:290] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:55.332587 26106 raft_consensus.cc:740] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.334422 26106 consensus_queue.cc:260] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.336822 26106 ts_tablet_manager.cc:1434] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:21:55.338299 26106 tablet_bootstrap.cc:492] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:55.248760 26104 raft_consensus.cc:359] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.339157 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a6ea62d4ba491aaf3c705964525771" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:55.332720 26257 raft_consensus.cc:493] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.341315 26257 raft_consensus.cc:515] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.344756 26257 leader_election.cc:290] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:55.345007 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:55.345664 25911 raft_consensus.cc:2468] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
W20260709 13:21:55.345703 25876 leader_election.cc:343] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.347023 25951 leader_election.cc:304] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:55.344295 25907 raft_consensus.cc:2468] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:55.348604 26025 leader_election.cc:304] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:55.349411 26246 raft_consensus.cc:2804] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.339205 26104 raft_consensus.cc:385] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.349960 26246 raft_consensus.cc:697] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:55.350013 26104 raft_consensus.cc:740] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.350878 26246 consensus_queue.cc:237] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.352756 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
W20260709 13:21:55.354290 26022 leader_election.cc:343] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.354921 26404 leader_election.cc:290] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:55.348699 26257 raft_consensus.cc:2804] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.357538 26160 raft_consensus.cc:493] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.357784 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:55.358153 26160 raft_consensus.cc:515] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.361714 26160 leader_election.cc:290] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:55.360114 26257 raft_consensus.cc:493] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.363006 26257 raft_consensus.cc:3060] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.358449 25835 raft_consensus.cc:2468] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:55.362957 26106 tablet_bootstrap.cc:654] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.350884 26104 consensus_queue.cc:260] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.374902 26107 tablet_bootstrap.cc:492] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:55.386361 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ef1a919b9a4fd5b21ef202381e6f54" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:55.385586 26107 ts_tablet_manager.cc:1403] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.122s	user 0.013s	sys 0.009s
W20260709 13:21:55.388939 25876 leader_election.cc:343] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.390082 25729 catalog_manager.cc:5697] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.393380 26104 ts_tablet_manager.cc:1434] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.147s	user 0.008s	sys 0.000s
I20260709 13:21:55.394913 26104 tablet_bootstrap.cc:492] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:55.420097 26257 raft_consensus.cc:515] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.430136 26107 raft_consensus.cc:359] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.430910 26107 raft_consensus.cc:385] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.431213 26107 raft_consensus.cc:740] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.433290 26105 tablet_bootstrap.cc:492] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:55.433863 26105 ts_tablet_manager.cc:1403] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.135s	user 0.036s	sys 0.048s
I20260709 13:21:55.436450 26104 tablet_bootstrap.cc:654] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.436714 26105 raft_consensus.cc:359] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.437543 26105 raft_consensus.cc:385] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.437850 26105 raft_consensus.cc:740] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.438298 26303 raft_consensus.cc:493] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.439004 26303 raft_consensus.cc:515] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.441277 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:55.441969 25835 raft_consensus.cc:3060] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.442222 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7fe3b03581401f935bfe2a3c432484" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:55.442885 25832 raft_consensus.cc:2468] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:55.443293 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7fe3b03581401f935bfe2a3c432484" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:55.438592 26105 consensus_queue.cc:260] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.444113 26023 leader_election.cc:304] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:55.445155 26404 raft_consensus.cc:2804] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:55.445276 26022 leader_election.cc:343] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.445549 26404 raft_consensus.cc:493] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.445904 26404 raft_consensus.cc:3060] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.446977 26303 leader_election.cc:290] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:55.438791 26107 consensus_queue.cc:260] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.453760 26257 leader_election.cc:290] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:55.454947 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:55.466270 25907 raft_consensus.cc:3060] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.458451 26106 tablet_bootstrap.cc:492] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:55.469318 26106 ts_tablet_manager.cc:1403] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.131s	user 0.019s	sys 0.021s
W20260709 13:21:55.465507 25875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 231536us
I20260709 13:21:55.456818 25730 catalog_manager.cc:5697] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:55.472290 26404 raft_consensus.cc:515] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.475274 26404 leader_election.cc:290] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:55.475907 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7fe3b03581401f935bfe2a3c432484" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:55.472370 26106 raft_consensus.cc:359] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.477042 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7fe3b03581401f935bfe2a3c432484" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:55.479637 25907 raft_consensus.cc:2468] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:55.452718 26105 ts_tablet_manager.cc:1434] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:21:55.482610 26106 raft_consensus.cc:385] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.455013 26107 ts_tablet_manager.cc:1434] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.002s
I20260709 13:21:55.484822 26106 raft_consensus.cc:740] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.485353 26105 tablet_bootstrap.cc:492] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:55.485594 26107 tablet_bootstrap.cc:492] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:55.485975 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162133acfbc941968cb2dd81ad3d7f46" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:55.486310 25832 raft_consensus.cc:3060] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.485673 26106 consensus_queue.cc:260] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.464564 25835 raft_consensus.cc:2468] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:55.497834 25836 raft_consensus.cc:2468] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:55.499444 26142 consensus_queue.cc:1048] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:55.486114 26022 leader_election.cc:343] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.502729 26107 tablet_bootstrap.cc:654] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.503736 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a6ea62d4ba491aaf3c705964525771" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:55.505046 26105 tablet_bootstrap.cc:654] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.505291 25949 leader_election.cc:304] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:55.506132 26257 raft_consensus.cc:2804] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.493995 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ef1a919b9a4fd5b21ef202381e6f54" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:55.506894 26257 raft_consensus.cc:697] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:21:55.507769 26257 consensus_queue.cc:237] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.508611 26306 raft_consensus.cc:493] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.509204 26306 raft_consensus.cc:515] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.509858 25875 leader_election.cc:304] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:55.513832 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04360fb80eea42d7960ef5c2e4858275" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:55.518638 26106 ts_tablet_manager.cc:1434] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:21:55.511035 25832 raft_consensus.cc:2468] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:55.521186 26106 tablet_bootstrap.cc:492] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:55.519636 26160 raft_consensus.cc:2804] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.527724 26306 leader_election.cc:290] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:55.544106 26160 raft_consensus.cc:493] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.544515 26160 raft_consensus.cc:3060] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.528671 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04360fb80eea42d7960ef5c2e4858275" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:55.545912 26023 leader_election.cc:304] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:55.547127 26303 raft_consensus.cc:2804] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.547622 26303 raft_consensus.cc:697] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
W20260709 13:21:55.523142 25875 leader_election.cc:343] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.549360 25801 leader_election.cc:304] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:55.549690 26303 consensus_queue.cc:237] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.550523 26306 raft_consensus.cc:2749] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.549918 25875 leader_election.cc:304] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:55.554128 26433 raft_consensus.cc:2749] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:55.554509 25875 leader_election.cc:343] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.555038 25875 leader_election.cc:304] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:55.555799 26433 raft_consensus.cc:2749] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.568507 26105 tablet_bootstrap.cc:492] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:55.569504 26105 ts_tablet_manager.cc:1403] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.000s
I20260709 13:21:55.571961 26433 raft_consensus.cc:493] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.572448 26433 raft_consensus.cc:515] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.575081 26433 leader_election.cc:290] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:55.576713 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981001373c784e27a4ec5bef4b640b77" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
W20260709 13:21:55.578497 25876 leader_election.cc:343] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.579519 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981001373c784e27a4ec5bef4b640b77" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:55.582015 25874 leader_election.cc:343] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.582458 25874 leader_election.cc:304] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:55.583084 26104 tablet_bootstrap.cc:492] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:55.583611 26104 ts_tablet_manager.cc:1403] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.190s	user 0.010s	sys 0.002s
I20260709 13:21:55.586323 26104 raft_consensus.cc:359] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.586951 26104 raft_consensus.cc:385] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.587208 26104 raft_consensus.cc:740] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.587783 26104 consensus_queue.cc:260] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.589391 26227 raft_consensus.cc:2749] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.595451 26104 ts_tablet_manager.cc:1434] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:21:55.607858 26105 raft_consensus.cc:359] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.608744 26105 raft_consensus.cc:385] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.609045 26105 raft_consensus.cc:740] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.609915 26105 consensus_queue.cc:260] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.610399 26104 tablet_bootstrap.cc:492] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:55.617398 26105 ts_tablet_manager.cc:1434] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:21:55.618391 26105 tablet_bootstrap.cc:492] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:55.627409 25729 catalog_manager.cc:5697] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:55.639256 25733 catalog_manager.cc:5697] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.644879 26106 tablet_bootstrap.cc:654] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.654745 26160 raft_consensus.cc:515] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.660257 26142 raft_consensus.cc:493] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.661559 26142 raft_consensus.cc:515] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.665338 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162133acfbc941968cb2dd81ad3d7f46" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:55.665546 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea59a8a0048199f9090a390dd25f7" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:55.667874 25875 leader_election.cc:343] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:55.669499 25876 leader_election.cc:343] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.669646 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea59a8a0048199f9090a390dd25f7" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:55.670135 26142 leader_election.cc:290] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:21:55.671221 25874 leader_election.cc:343] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.650717 26104 tablet_bootstrap.cc:654] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.672427 25874 leader_election.cc:304] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:55.628582 26105 tablet_bootstrap.cc:654] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.677232 26433 raft_consensus.cc:2749] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.705566 26433 raft_consensus.cc:493] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.706176 26433 raft_consensus.cc:515] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.708477 26433 leader_election.cc:290] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:55.710106 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf0142f8c8d4e7e9a4edc4e88bb184c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:55.710137 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf0142f8c8d4e7e9a4edc4e88bb184c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:55.712062 25876 leader_election.cc:343] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:55.714237 25874 leader_election.cc:343] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.714612 25874 leader_election.cc:304] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:55.715345 26107 tablet_bootstrap.cc:492] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:55.715782 26107 ts_tablet_manager.cc:1403] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.230s	user 0.032s	sys 0.063s
I20260709 13:21:55.717666 26160 leader_election.cc:290] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:55.718307 26160 raft_consensus.cc:2749] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.720952 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162133acfbc941968cb2dd81ad3d7f46" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:55.721590 25834 raft_consensus.cc:3060] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.722333 26107 raft_consensus.cc:359] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.723240 26107 raft_consensus.cc:385] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.723613 26107 raft_consensus.cc:740] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.724342 26107 consensus_queue.cc:260] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.726114 26107 ts_tablet_manager.cc:1434] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:21:55.734062 26107 tablet_bootstrap.cc:492] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:55.741995 26105 tablet_bootstrap.cc:492] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:55.742606 26105 ts_tablet_manager.cc:1403] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.000s
I20260709 13:21:55.744820 26107 tablet_bootstrap.cc:654] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:55.744899 25874 consensus_peers.cc:597] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:55.746361 26106 tablet_bootstrap.cc:492] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:55.746939 26106 ts_tablet_manager.cc:1403] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.226s	user 0.017s	sys 0.026s
I20260709 13:21:55.751502 26336 raft_consensus.cc:493] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.752211 26336 raft_consensus.cc:515] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.753041 26257 raft_consensus.cc:493] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.753541 26257 raft_consensus.cc:515] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.755703 26257 leader_election.cc:290] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:55.760179 26105 raft_consensus.cc:359] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.760778 26105 raft_consensus.cc:385] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.761190 26105 raft_consensus.cc:740] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.759161 26336 leader_election.cc:290] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:55.761929 26105 consensus_queue.cc:260] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.764400 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:55.770807 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:55.766158 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb960d6f3ef4634a29335330aa1c58c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:55.771567 26058 raft_consensus.cc:2468] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
I20260709 13:21:55.768826 26104 tablet_bootstrap.cc:492] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:55.772944 26104 ts_tablet_manager.cc:1403] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.168s	user 0.008s	sys 0.005s
I20260709 13:21:55.773079 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb960d6f3ef4634a29335330aa1c58c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:55.772570 25951 leader_election.cc:304] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
W20260709 13:21:55.774493 25949 leader_election.cc:343] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.775432 26336 raft_consensus.cc:2749] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.776190 26104 raft_consensus.cc:359] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.776923 26104 raft_consensus.cc:385] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.777194 26104 raft_consensus.cc:740] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.779743 25950 leader_election.cc:304] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:55.781514 25834 raft_consensus.cc:2468] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:55.781629 26104 consensus_queue.cc:260] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.781515 26336 raft_consensus.cc:2804] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.791404 26336 raft_consensus.cc:493] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.791855 26336 raft_consensus.cc:3060] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.791999 25875 leader_election.cc:304] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:55.794903 26433 raft_consensus.cc:2804] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.795549 26433 raft_consensus.cc:697] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:55.765376 26105 ts_tablet_manager.cc:1434] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:21:55.797763 26105 tablet_bootstrap.cc:492] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:55.783962 26160 consensus_queue.cc:1048] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.802268 25983 raft_consensus.cc:3060] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.807462 26104 ts_tablet_manager.cc:1434] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:21:55.796595 26433 consensus_queue.cc:237] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.808492 26104 tablet_bootstrap.cc:492] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:55.811635 26106 raft_consensus.cc:359] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.812479 26106 raft_consensus.cc:385] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.812798 26106 raft_consensus.cc:740] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.813561 26106 consensus_queue.cc:260] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.822149 26106 ts_tablet_manager.cc:1434] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 13:21:55.823385 26106 tablet_bootstrap.cc:492] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:55.829068 26160 raft_consensus.cc:493] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.833570 26160 raft_consensus.cc:515] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:55.835256 26105 tablet_bootstrap.cc:654] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.837764 26246 raft_consensus.cc:493] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.838333 26160 leader_election.cc:290] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:55.839423 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:55.840962 25831 raft_consensus.cc:3060] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.843456 26106 tablet_bootstrap.cc:654] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.843564 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:55.850539 25874 leader_election.cc:343] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:55.852896 25875 leader_election.cc:343] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.853775 25875 leader_election.cc:304] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:55.838358 26246 raft_consensus.cc:515] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:55.854852 26160 raft_consensus.cc:2749] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.855975 26336 raft_consensus.cc:515] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.857767 26107 tablet_bootstrap.cc:492] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:55.858214 26336 leader_election.cc:290] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:55.859728 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:55.856765 26246 leader_election.cc:290] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:55.865249 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:55.866089 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb960d6f3ef4634a29335330aa1c58c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:55.866709 26058 raft_consensus.cc:3060] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.858299 26107 ts_tablet_manager.cc:1403] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.125s	user 0.044s	sys 0.027s
W20260709 13:21:55.869095 26022 consensus_peers.cc:597] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:55.874481 26104 tablet_bootstrap.cc:654] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:55.878511 26022 leader_election.cc:343] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.885668 26107 raft_consensus.cc:359] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.886363 26107 raft_consensus.cc:385] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.886637 26107 raft_consensus.cc:740] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.866110 25911 raft_consensus.cc:2468] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:55.887305 26107 consensus_queue.cc:260] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:55.891724 26107 ts_tablet_manager.cc:1434] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:21:55.894519 26058 raft_consensus.cc:2468] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:55.883879 25730 catalog_manager.cc:5697] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:55.895196 26025 leader_election.cc:304] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:55.899142 25950 leader_election.cc:304] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:55.899335 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb960d6f3ef4634a29335330aa1c58c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:55.900254 26418 raft_consensus.cc:2804] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.900791 26418 raft_consensus.cc:697] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:21:55.904729 26107 tablet_bootstrap.cc:492] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:55.905403 26418 consensus_queue.cc:237] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.920977 26107 tablet_bootstrap.cc:654] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.924757 26246 consensus_queue.cc:1048] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:55.913236 26303 raft_consensus.cc:2804] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.939705 26106 tablet_bootstrap.cc:492] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:55.940418 26106 ts_tablet_manager.cc:1403] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.009s
I20260709 13:21:55.938037 26303 raft_consensus.cc:493] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.948763 26106 raft_consensus.cc:359] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:55.950212 26106 raft_consensus.cc:385] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.950574 26106 raft_consensus.cc:740] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.952332 26106 consensus_queue.cc:260] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:21:55.942651 25949 leader_election.cc:343] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.950821 26303 raft_consensus.cc:3060] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.962534 26106 ts_tablet_manager.cc:1434] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:21:55.981760 26105 tablet_bootstrap.cc:492] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:55.982718 26105 ts_tablet_manager.cc:1403] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.185s	user 0.011s	sys 0.019s
I20260709 13:21:55.982858 26106 tablet_bootstrap.cc:492] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:55.996985 26246 raft_consensus.cc:493] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.997596 26246 raft_consensus.cc:515] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.000430 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7cba52ce9343d1bee167ea3364a7f9" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:56.001971 26022 leader_election.cc:343] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.006479 26107 tablet_bootstrap.cc:492] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:56.007058 26107 ts_tablet_manager.cc:1403] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.003s
I20260709 13:21:56.007769 26246 leader_election.cc:290] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:56.009624 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7cba52ce9343d1bee167ea3364a7f9" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:56.009732 26257 raft_consensus.cc:493] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.010452 26257 raft_consensus.cc:515] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:56.011459 26303 raft_consensus.cc:515] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
W20260709 13:21:56.011081 26023 leader_election.cc:343] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.014350 26023 leader_election.cc:304] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:56.015466 26246 raft_consensus.cc:2749] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.017513 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb6cace1a274a589bb22b03411c0afe" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:56.015321 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb6cace1a274a589bb22b03411c0afe" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:56.020643 25951 leader_election.cc:304] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:56.022106 26336 raft_consensus.cc:2749] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.004850 25733 catalog_manager.cc:5697] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.023672 26105 raft_consensus.cc:359] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
W20260709 13:21:56.024971 26022 consensus_peers.cc:597] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:56.026084 26104 tablet_bootstrap.cc:492] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:56.027451 26105 raft_consensus.cc:385] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.027660 26104 ts_tablet_manager.cc:1403] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.219s	user 0.017s	sys 0.005s
I20260709 13:21:56.026518 26257 leader_election.cc:290] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:56.025991 26107 raft_consensus.cc:359] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.023211 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:56.027873 26105 raft_consensus.cc:740] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.029315 26107 raft_consensus.cc:385] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.029663 26107 raft_consensus.cc:740] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.030687 25907 raft_consensus.cc:3060] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.029872 26105 consensus_queue.cc:260] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:56.032258 26107 consensus_queue.cc:260] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.034400 26107 ts_tablet_manager.cc:1434] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:21:56.036211 26107 tablet_bootstrap.cc:492] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:56.042140 26404 raft_consensus.cc:493] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.042676 26404 raft_consensus.cc:515] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.043515 26107 tablet_bootstrap.cc:654] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.044229 26104 raft_consensus.cc:359] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:56.052552 26104 raft_consensus.cc:385] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.052697 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:56.053174 26104 raft_consensus.cc:740] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.054077 26104 consensus_queue.cc:260] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:56.048144 26106 tablet_bootstrap.cc:654] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.050567 26303 leader_election.cc:290] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:56.056167 25907 raft_consensus.cc:2468] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:56.057502 26105 ts_tablet_manager.cc:1434] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.002s
I20260709 13:21:56.058097 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162133acfbc941968cb2dd81ad3d7f46" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
W20260709 13:21:56.066242 26022 leader_election.cc:343] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.045861 26404 leader_election.cc:290] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:56.068995 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162133acfbc941968cb2dd81ad3d7f46" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:56.069872 25831 raft_consensus.cc:2393] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cb7aae2a23a47c180432cb646577fd6 in current term 1: Already voted for candidate 00dbc14fa82f4a22b1cab8f3691196de in this term.
I20260709 13:21:56.073585 26105 tablet_bootstrap.cc:492] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:56.075917 26025 leader_election.cc:304] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:56.077003 26404 raft_consensus.cc:2804] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.077488 26404 raft_consensus.cc:697] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:56.078456 26404 consensus_queue.cc:237] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:56.082790 26104 ts_tablet_manager.cc:1434] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 13:21:56.095402 26104 tablet_bootstrap.cc:492] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:56.103029 26105 tablet_bootstrap.cc:654] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.105880 26418 consensus_queue.cc:1048] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.116930 25985 raft_consensus.cc:3060] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.125313 26160 raft_consensus.cc:493] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.125897 26160 raft_consensus.cc:515] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:56.128568 26160 leader_election.cc:290] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:56.129345 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:56.130967 25874 leader_election.cc:343] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.135334 26104 tablet_bootstrap.cc:654] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.122191 26023 leader_election.cc:304] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:56.139432 26246 raft_consensus.cc:3060] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.141976 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:56.146463 26246 raft_consensus.cc:2749] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.146981 26418 consensus_queue.cc:1048] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:56.149001 25876 leader_election.cc:343] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.149214 26343 consensus_queue.cc:1048] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.182181 26106 tablet_bootstrap.cc:492] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:56.182749 26106 ts_tablet_manager.cc:1403] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.213s	user 0.018s	sys 0.018s
I20260709 13:21:56.185182 26469 raft_consensus.cc:493] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.185828 26469 raft_consensus.cc:515] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.188372 26469 leader_election.cc:290] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:56.190616 25983 raft_consensus.cc:3060] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.160276 25876 leader_election.cc:304] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:56.193010 26160 raft_consensus.cc:2749] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.200968 26107 tablet_bootstrap.cc:492] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:56.201581 26107 ts_tablet_manager.cc:1403] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.166s	user 0.023s	sys 0.039s
I20260709 13:21:56.206795 26107 raft_consensus.cc:359] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.213588 26107 raft_consensus.cc:385] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.214387 26107 raft_consensus.cc:740] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.215349 26105 tablet_bootstrap.cc:492] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:56.216104 26105 ts_tablet_manager.cc:1403] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.143s	user 0.019s	sys 0.014s
I20260709 13:21:56.215113 26107 consensus_queue.cc:260] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.219476 26107 ts_tablet_manager.cc:1434] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:21:56.220499 26106 raft_consensus.cc:359] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.221107 26107 tablet_bootstrap.cc:492] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:56.221426 26106 raft_consensus.cc:385] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.221951 26106 raft_consensus.cc:740] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.222837 26106 consensus_queue.cc:260] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.237494 26106 ts_tablet_manager.cc:1434] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 13:21:56.248418 26105 raft_consensus.cc:359] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:56.249312 26105 raft_consensus.cc:385] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.252923 26105 raft_consensus.cc:740] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.254341 26105 consensus_queue.cc:260] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:56.256249 26106 tablet_bootstrap.cc:492] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:21:56.233419 26023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 73137.6us
I20260709 13:21:56.264174 26104 tablet_bootstrap.cc:492] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:56.264741 26104 ts_tablet_manager.cc:1403] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.181s	user 0.021s	sys 0.011s
I20260709 13:21:56.265257 25733 catalog_manager.cc:5697] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:56.275785 26160 raft_consensus.cc:493] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.276361 26160 raft_consensus.cc:515] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:56.279044 26160 leader_election.cc:290] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:56.267500 26104 raft_consensus.cc:359] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:56.281008 26433 consensus_queue.cc:1048] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.283574 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:56.284230 25834 raft_consensus.cc:2468] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 0.
I20260709 13:21:56.285408 25875 leader_election.cc:304] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:56.286391 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:56.287773 25874 leader_election.cc:343] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.288094 26105 ts_tablet_manager.cc:1434] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.001s
I20260709 13:21:56.281239 26104 raft_consensus.cc:385] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.289263 26104 raft_consensus.cc:740] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.278129 26107 tablet_bootstrap.cc:654] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.293286 26105 tablet_bootstrap.cc:492] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:56.290052 26104 consensus_queue.cc:260] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:56.303059 26104 ts_tablet_manager.cc:1434] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 13:21:56.303990 26104 tablet_bootstrap.cc:492] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:56.294683 26227 raft_consensus.cc:2804] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:56.307930 26227 raft_consensus.cc:493] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:56.308290 26227 raft_consensus.cc:3060] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.321632 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ef1a919b9a4fd5b21ef202381e6f54" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:56.322389 25907 raft_consensus.cc:2468] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:56.323527 26025 leader_election.cc:304] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:56.324462 26474 raft_consensus.cc:2804] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:56.324855 26474 raft_consensus.cc:493] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:56.325165 26474 raft_consensus.cc:3060] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:56.327056 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:56.336078 25831 raft_consensus.cc:3060] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.327668 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ef1a919b9a4fd5b21ef202381e6f54" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:56.342334 26160 consensus_queue.cc:1048] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.357427 26459 raft_consensus.cc:493] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.362457 26459 raft_consensus.cc:515] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:21:56.369401 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 46651.6us
I20260709 13:21:56.370036 26227 raft_consensus.cc:515] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:56.376039 26418 raft_consensus.cc:493] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dbc14fa82f4a22b1cab8f3691196de)
I20260709 13:21:56.394109 26227 leader_election.cc:290] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:56.389125 26418 raft_consensus.cc:515] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
W20260709 13:21:56.397447 26023 leader_election.cc:343] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.402935 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed0345d6849a4fcd8a00fa6dd75bad07" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:56.403235 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed0345d6849a4fcd8a00fa6dd75bad07" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:56.400559 26418 leader_election.cc:290] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:56.440941 26105 tablet_bootstrap.cc:654] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.447911 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
W20260709 13:21:56.450773 25874 leader_election.cc:343] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.462199 26459 leader_election.cc:290] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:56.473353 26106 tablet_bootstrap.cc:654] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.453249 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:56.484899 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb960d6f3ef4634a29335330aa1c58c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:56.493760 26056 raft_consensus.cc:2393] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate d01fccfd609b4182a5d43a7f6b4ae503 in this term.
W20260709 13:21:56.480912 25949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 59480.8us
I20260709 13:21:56.513448 25949 leader_election.cc:304] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:56.492923 26474 raft_consensus.cc:515] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.490916 25835 raft_consensus.cc:3060] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.542335 26104 tablet_bootstrap.cc:654] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.543589 26485 raft_consensus.cc:2749] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:56.559080 26474 leader_election.cc:290] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
W20260709 13:21:56.561553 25949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 48271.2us
I20260709 13:21:56.565176 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb960d6f3ef4634a29335330aa1c58c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:56.576803 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ef1a919b9a4fd5b21ef202381e6f54" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:56.578527 26488 raft_consensus.cc:493] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.559158 25835 raft_consensus.cc:2468] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:21:56.577759 25909 raft_consensus.cc:3060] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.604281 26107 tablet_bootstrap.cc:492] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:56.605118 26107 ts_tablet_manager.cc:1403] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.384s	user 0.020s	sys 0.009s
I20260709 13:21:56.594414 26488 raft_consensus.cc:515] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:56.621454 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ef1a919b9a4fd5b21ef202381e6f54" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:56.629092 25875 leader_election.cc:304] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:56.630817 26160 raft_consensus.cc:2804] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.631299 26160 raft_consensus.cc:697] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:56.631603 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:56.632014 26160 consensus_queue.cc:237] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:56.639839 25982 raft_consensus.cc:3060] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:56.643270 25874 leader_election.cc:343] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.654371 26105 tablet_bootstrap.cc:492] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:56.655162 26105 ts_tablet_manager.cc:1403] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.366s	user 0.011s	sys 0.010s
I20260709 13:21:56.656374 26106 tablet_bootstrap.cc:492] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:56.657068 26106 ts_tablet_manager.cc:1403] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.401s	user 0.017s	sys 0.000s
I20260709 13:21:56.661849 25799 leader_election.cc:304] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:56.663157 26493 raft_consensus.cc:3060] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.669579 26493 raft_consensus.cc:2749] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.645290 26488 leader_election.cc:290] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:56.649259 25909 raft_consensus.cc:2468] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:56.677922 26104 tablet_bootstrap.cc:492] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:56.678457 26104 ts_tablet_manager.cc:1403] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.375s	user 0.022s	sys 0.032s
I20260709 13:21:56.681439 26025 leader_election.cc:304] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:56.691416 26107 raft_consensus.cc:359] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.692257 26107 raft_consensus.cc:385] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.692149 26336 raft_consensus.cc:493] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.679558 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:56.693704 26107 raft_consensus.cc:740] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.695210 26107 consensus_queue.cc:260] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.673030 26485 consensus_queue.cc:1048] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:21:56.699740 26107 ts_tablet_manager.cc:1434] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.094s	user 0.004s	sys 0.003s
W20260709 13:21:56.705348 25875 leader_election.cc:343] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.705879 25875 leader_election.cc:304] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:56.706979 26142 raft_consensus.cc:2749] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.696542 26336 raft_consensus.cc:515] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:56.712080 26343 raft_consensus.cc:493] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:56.712459 26023 leader_election.cc:343] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.712625 26343 raft_consensus.cc:515] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.713874 26336 leader_election.cc:290] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:56.708469 26106 raft_consensus.cc:359] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.715890 26106 raft_consensus.cc:385] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.716181 26106 raft_consensus.cc:740] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.718032 26107 tablet_bootstrap.cc:492] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:56.717767 26106 consensus_queue.cc:260] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.721112 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a6ea62d4ba491aaf3c705964525771" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:56.721241 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:56.721813 25910 raft_consensus.cc:2468] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:56.723767 26104 raft_consensus.cc:359] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.724442 26104 raft_consensus.cc:385] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.727105 26025 leader_election.cc:304] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:56.727994 26246 raft_consensus.cc:2804] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:56.728348 26246 raft_consensus.cc:493] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:56.728682 26246 raft_consensus.cc:3060] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.729192 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:56.729887 25910 raft_consensus.cc:2468] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:56.714749 26343 leader_election.cc:290] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:56.736198 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a6ea62d4ba491aaf3c705964525771" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:56.737695 25951 leader_election.cc:304] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:56.739300 26485 raft_consensus.cc:2804] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:56.739696 26485 raft_consensus.cc:493] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:56.740031 26485 raft_consensus.cc:3060] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.741945 26106 ts_tablet_manager.cc:1434] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
W20260709 13:21:56.743620 26023 leader_election.cc:343] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.749081 26495 raft_consensus.cc:2804] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.749642 26495 raft_consensus.cc:697] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:56.750512 26495 consensus_queue.cc:237] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
W20260709 13:21:56.751307 26494 log.cc:927] Time spent T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:21:56.752732 26479 consensus_queue.cc:1048] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.753409 26336 consensus_queue.cc:1048] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.754065 26477 consensus_queue.cc:1048] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:56.724706 26104 raft_consensus.cc:740] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.756929 26104 consensus_queue.cc:260] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.759440 26104 ts_tablet_manager.cc:1434] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:21:56.760987 26105 raft_consensus.cc:359] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.766993 26104 tablet_bootstrap.cc:492] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:56.765729 26105 raft_consensus.cc:385] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.767493 26105 raft_consensus.cc:740] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.768198 26105 consensus_queue.cc:260] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.769115 26106 tablet_bootstrap.cc:492] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:56.736495 26246 raft_consensus.cc:515] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.776873 26246 leader_election.cc:290] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:56.777446 26106 tablet_bootstrap.cc:654] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.781219 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a6ea62d4ba491aaf3c705964525771" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:56.748015 26485 raft_consensus.cc:515] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
W20260709 13:21:56.786048 26023 leader_election.cc:343] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.786605 25982 raft_consensus.cc:1240] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Rejecting Update request from peer 3cb7aae2a23a47c180432cb646577fd6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:21:56.790258 26479 consensus_queue.cc:1059] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.791168 26479 raft_consensus.cc:3055] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:56.791559 26479 raft_consensus.cc:740] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:56.793774 26485 leader_election.cc:290] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:56.795105 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:56.799052 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a6ea62d4ba491aaf3c705964525771" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:56.799743 25911 raft_consensus.cc:3060] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.792532 26479 consensus_queue.cc:260] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:56.800858 26479 raft_consensus.cc:3060] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.808482 26105 ts_tablet_manager.cc:1434] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.153s	user 0.006s	sys 0.000s
I20260709 13:21:56.809692 26105 tablet_bootstrap.cc:492] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de: Bootstrap starting.
I20260709 13:21:56.814601 25911 raft_consensus.cc:2468] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:56.816265 26107 tablet_bootstrap.cc:654] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.816115 26025 leader_election.cc:304] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:56.817085 26404 raft_consensus.cc:2804] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.817517 26105 tablet_bootstrap.cc:654] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.817587 26404 raft_consensus.cc:697] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:56.818603 26404 consensus_queue.cc:237] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.821190 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:56.824463 26104 tablet_bootstrap.cc:654] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.830843 25831 raft_consensus.cc:3060] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.834574 26059 raft_consensus.cc:2410] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d01fccfd609b4182a5d43a7f6b4ae503 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:21:56.841665 25950 leader_election.cc:304] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:56.843014 26491 raft_consensus.cc:2749] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:56.847506 25729 catalog_manager.cc:5697] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 1 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.851267 26105 tablet_bootstrap.cc:492] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de: No bootstrap required, opened a new log
I20260709 13:21:56.851795 26105 ts_tablet_manager.cc:1403] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 13:21:56.859318 26106 tablet_bootstrap.cc:492] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:56.863783 26106 ts_tablet_manager.cc:1403] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.000s
I20260709 13:21:56.866632 26106 raft_consensus.cc:359] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.867343 26106 raft_consensus.cc:385] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.867611 26106 raft_consensus.cc:740] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.869213 26105 raft_consensus.cc:359] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.869946 26105 raft_consensus.cc:385] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.870225 26105 raft_consensus.cc:740] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.870783 26106 consensus_queue.cc:260] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.863826 26107 tablet_bootstrap.cc:492] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:56.875192 26107 ts_tablet_manager.cc:1403] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.157s	user 0.012s	sys 0.000s
I20260709 13:21:56.878010 26107 raft_consensus.cc:359] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.878679 26107 raft_consensus.cc:385] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.871833 26105 consensus_queue.cc:260] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.886504 26104 tablet_bootstrap.cc:492] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:56.878327 26106 ts_tablet_manager.cc:1434] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:21:56.887050 26104 ts_tablet_manager.cc:1403] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.120s	user 0.006s	sys 0.005s
I20260709 13:21:56.887748 26106 tablet_bootstrap.cc:492] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:56.888912 26105 ts_tablet_manager.cc:1434] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:21:56.889726 26484 raft_consensus.cc:493] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.890255 26484 raft_consensus.cc:515] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.894649 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2bafd1f44402cbf2f7d5ca62a7508" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:56.895355 26059 raft_consensus.cc:2468] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:56.896471 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2bafd1f44402cbf2f7d5ca62a7508" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:56.897197 25982 raft_consensus.cc:2468] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:56.898066 26106 tablet_bootstrap.cc:654] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.898468 25799 leader_election.cc:304] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:56.899374 26493 raft_consensus.cc:2804] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:56.899744 26493 raft_consensus.cc:493] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:56.900061 26493 raft_consensus.cc:3060] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.900560 26484 leader_election.cc:290] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:56.904202 25731 catalog_manager.cc:5697] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.907835 26493 raft_consensus.cc:515] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.907660 25731 catalog_manager.cc:5697] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.912436 26106 tablet_bootstrap.cc:492] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:56.913020 26106 ts_tablet_manager.cc:1403] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.002s
I20260709 13:21:56.878957 26107 raft_consensus.cc:740] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.916824 26107 consensus_queue.cc:260] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.916567 26106 raft_consensus.cc:359] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.916568 26104 raft_consensus.cc:359] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.920184 26104 raft_consensus.cc:385] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.918701 26106 raft_consensus.cc:385] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.923259 26106 raft_consensus.cc:740] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.924002 26106 consensus_queue.cc:260] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.926162 26106 ts_tablet_manager.cc:1434] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 13:21:56.927129 26106 tablet_bootstrap.cc:492] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:56.945082 26106 tablet_bootstrap.cc:654] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.949364 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2bafd1f44402cbf2f7d5ca62a7508" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:56.950016 25982 raft_consensus.cc:3060] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.920486 26104 raft_consensus.cc:740] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.952901 26104 consensus_queue.cc:260] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.954756 26107 ts_tablet_manager.cc:1434] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260709 13:21:56.955989 26107 tablet_bootstrap.cc:492] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:56.958381 26106 tablet_bootstrap.cc:492] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:56.958895 26106 ts_tablet_manager.cc:1403] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.006s
I20260709 13:21:56.961493 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2bafd1f44402cbf2f7d5ca62a7508" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:56.962116 26058 raft_consensus.cc:3060] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.963500 25982 raft_consensus.cc:2468] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:56.964396 26493 leader_election.cc:290] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:56.965626 25799 leader_election.cc:304] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:56.966403 26493 raft_consensus.cc:2804] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.969606 26493 raft_consensus.cc:697] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:56.969457 26106 raft_consensus.cc:359] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.970252 26106 raft_consensus.cc:385] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.970534 26106 raft_consensus.cc:740] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.971371 26484 raft_consensus.cc:493] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.971233 26106 consensus_queue.cc:260] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.971997 26484 raft_consensus.cc:515] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:56.973344 26106 ts_tablet_manager.cc:1434] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:21:56.974272 26106 tablet_bootstrap.cc:492] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:56.976153 26484 leader_election.cc:290] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:56.976368 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ef1a919b9a4fd5b21ef202381e6f54" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:56.970667 26493 consensus_queue.cc:237] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:56.977226 25911 raft_consensus.cc:2393] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:56.978351 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ef1a919b9a4fd5b21ef202381e6f54" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:56.979687 25801 leader_election.cc:304] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:56.980914 26337 raft_consensus.cc:3060] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.988981 25983 raft_consensus.cc:3060] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.988780 26337 raft_consensus.cc:2749] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.989744 26107 tablet_bootstrap.cc:654] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.996332 26106 tablet_bootstrap.cc:654] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.999603 26142 raft_consensus.cc:493] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.000125 26142 raft_consensus.cc:515] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.002303 26142 leader_election.cc:290] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:57.009614 26106 tablet_bootstrap.cc:492] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:57.010177 26106 ts_tablet_manager.cc:1403] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.004s
I20260709 13:21:57.010003 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
W20260709 13:21:57.011583 25876 leader_election.cc:343] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.010649 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
W20260709 13:21:57.013334 25875 leader_election.cc:343] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.013796 25875 leader_election.cc:304] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:57.014998 26142 raft_consensus.cc:2749] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.020797 26106 raft_consensus.cc:359] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.021690 26106 raft_consensus.cc:385] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.022007 26106 raft_consensus.cc:740] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.023895 26104 ts_tablet_manager.cc:1434] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.137s	user 0.005s	sys 0.002s
I20260709 13:21:57.039840 26104 tablet_bootstrap.cc:492] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:57.029726 26106 consensus_queue.cc:260] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.050097 26106 ts_tablet_manager.cc:1434] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:21:57.051036 26106 tablet_bootstrap.cc:492] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:57.038813 26058 raft_consensus.cc:2468] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:57.075547 26104 tablet_bootstrap.cc:654] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.075362 26493 raft_consensus.cc:493] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.076131 26493 raft_consensus.cc:515] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.078382 26493 leader_election.cc:290] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:57.080685 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a6ea62d4ba491aaf3c705964525771" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:57.081488 25909 raft_consensus.cc:2393] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e453645ce774c99b4b4aafb4362719b in current term 1: Already voted for candidate 3cb7aae2a23a47c180432cb646577fd6 in this term.
I20260709 13:21:57.082206 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a6ea62d4ba491aaf3c705964525771" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:57.094046 26106 tablet_bootstrap.cc:654] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.111394 26107 tablet_bootstrap.cc:492] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:57.111923 26107 ts_tablet_manager.cc:1403] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.013s
I20260709 13:21:57.113525 25802 leader_election.cc:304] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:57.115607 26104 tablet_bootstrap.cc:492] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:57.116338 26104 ts_tablet_manager.cc:1403] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.077s	user 0.005s	sys 0.008s
I20260709 13:21:57.116796 26484 raft_consensus.cc:3060] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.130474 26107 raft_consensus.cc:359] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.131276 26107 raft_consensus.cc:385] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.131557 26107 raft_consensus.cc:740] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.132231 26107 consensus_queue.cc:260] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.133051 26484 raft_consensus.cc:2749] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.144882 26107 ts_tablet_manager.cc:1434] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.003s
I20260709 13:21:57.145833 26107 tablet_bootstrap.cc:492] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:57.145738 25733 catalog_manager.cc:5697] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:57.150259 26104 raft_consensus.cc:359] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.151036 26104 raft_consensus.cc:385] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.151300 26104 raft_consensus.cc:740] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.152479 26104 consensus_queue.cc:260] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.165767 26104 ts_tablet_manager.cc:1434] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.003s
I20260709 13:21:57.166503 26107 tablet_bootstrap.cc:654] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.169770 26104 tablet_bootstrap.cc:492] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:57.177289 26488 consensus_queue.cc:1048] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:57.183774 26104 tablet_bootstrap.cc:654] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.196645 26107 tablet_bootstrap.cc:492] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:57.197418 26107 ts_tablet_manager.cc:1403] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.004s
I20260709 13:21:57.198526 26106 tablet_bootstrap.cc:492] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:57.200735 26107 raft_consensus.cc:359] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.206247 26107 raft_consensus.cc:385] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.206534 26107 raft_consensus.cc:740] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.199546 26106 ts_tablet_manager.cc:1403] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.013s
I20260709 13:21:57.209873 26107 consensus_queue.cc:260] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.214895 26104 tablet_bootstrap.cc:492] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:57.215458 26104 ts_tablet_manager.cc:1403] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.006s
I20260709 13:21:57.232371 26106 raft_consensus.cc:359] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.233150 26106 raft_consensus.cc:385] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.233428 26106 raft_consensus.cc:740] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
W20260709 13:21:57.233760 25874 consensus_peers.cc:597] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.234102 26106 consensus_queue.cc:260] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.233798 26104 raft_consensus.cc:359] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.236720 26104 raft_consensus.cc:385] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.236977 26404 raft_consensus.cc:493] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.237479 26404 raft_consensus.cc:515] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.239488 26404 leader_election.cc:290] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:57.240073 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf0142f8c8d4e7e9a4edc4e88bb184c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:57.240689 25911 raft_consensus.cc:2468] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:57.240996 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf0142f8c8d4e7e9a4edc4e88bb184c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:57.241814 26025 leader_election.cc:304] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
W20260709 13:21:57.242509 26022 leader_election.cc:343] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.237026 26104 raft_consensus.cc:740] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.243575 26479 raft_consensus.cc:2804] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.244270 26106 ts_tablet_manager.cc:1434] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:21:57.245267 26106 tablet_bootstrap.cc:492] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:57.243947 26246 consensus_queue.cc:1048] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.243580 26104 consensus_queue.cc:260] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.243952 26479 raft_consensus.cc:493] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.253983 26479 raft_consensus.cc:3060] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.256187 26106 tablet_bootstrap.cc:654] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.262398 26104 ts_tablet_manager.cc:1434] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:21:57.263723 26104 tablet_bootstrap.cc:492] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:57.292271 26477 raft_consensus.cc:493] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.292800 26477 raft_consensus.cc:515] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.293540 26106 tablet_bootstrap.cc:492] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:57.294124 26106 ts_tablet_manager.cc:1403] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.016s
I20260709 13:21:57.294852 26477 leader_election.cc:290] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:57.299115 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42cec7e321749d39d2184b40221df6c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:57.300990 26022 leader_election.cc:343] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.325554 26107 ts_tablet_manager.cc:1434] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.001s
I20260709 13:21:57.327446 26107 tablet_bootstrap.cc:492] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:57.334093 26404 consensus_queue.cc:1048] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:57.337281 26106 raft_consensus.cc:359] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.338457 26106 raft_consensus.cc:385] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.338733 26106 raft_consensus.cc:740] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.339609 26106 consensus_queue.cc:260] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.338104 26142 raft_consensus.cc:493] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.340817 26142 raft_consensus.cc:515] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.329804 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42cec7e321749d39d2184b40221df6c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:57.345237 26107 tablet_bootstrap.cc:654] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.345894 26104 tablet_bootstrap.cc:654] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.343046 26142 leader_election.cc:290] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:57.347484 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:57.358664 26479 raft_consensus.cc:515] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.361326 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:57.364552 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf0142f8c8d4e7e9a4edc4e88bb184c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:57.365077 25911 raft_consensus.cc:3060] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.372558 26479 leader_election.cc:290] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:21:57.372871 25875 leader_election.cc:343] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.380118 25911 raft_consensus.cc:2468] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:57.387187 26025 leader_election.cc:304] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:57.392867 26106 ts_tablet_manager.cc:1434] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.096s	user 0.004s	sys 0.007s
I20260709 13:21:57.398370 26107 tablet_bootstrap.cc:492] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:57.398909 26107 ts_tablet_manager.cc:1403] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.006s
I20260709 13:21:57.395915 26495 raft_consensus.cc:2804] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:57.404991 26023 leader_election.cc:343] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.404624 26532 consensus_queue.cc:1048] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:21:57.425633 26534 raft_consensus.cc:493] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.432171 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf0142f8c8d4e7e9a4edc4e88bb184c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:57.428007 26483 raft_consensus.cc:493] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.437608 26106 tablet_bootstrap.cc:492] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:57.424697 26495 raft_consensus.cc:697] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:57.450434 26104 tablet_bootstrap.cc:492] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:57.451823 26104 ts_tablet_manager.cc:1403] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.188s	user 0.013s	sys 0.007s
W20260709 13:21:57.458372 25876 leader_election.cc:343] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.466722 25876 leader_election.cc:304] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:57.466444 26495 consensus_queue.cc:237] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.427614 26023 leader_election.cc:304] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
W20260709 13:21:57.469686 26023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 72114.1us
I20260709 13:21:57.471027 26246 raft_consensus.cc:2749] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.472705 26246 raft_consensus.cc:493] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:57.473316 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:57.473104 26246 raft_consensus.cc:515] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.448091 26534 raft_consensus.cc:515] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.473727 26539 raft_consensus.cc:2749] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.478616 26534 leader_election.cc:290] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:57.480825 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:57.480995 26484 raft_consensus.cc:493] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.481608 26484 raft_consensus.cc:515] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.483927 26484 leader_election.cc:290] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
W20260709 13:21:57.485095 25799 leader_election.cc:343] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.486685 26104 raft_consensus.cc:359] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.487429 26104 raft_consensus.cc:385] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.487690 26104 raft_consensus.cc:740] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.488732 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:57.489461 25911 raft_consensus.cc:2468] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:57.489717 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7cba52ce9343d1bee167ea3364a7f9" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:57.490667 25982 raft_consensus.cc:2468] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:57.492936 26107 raft_consensus.cc:359] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.493690 26107 raft_consensus.cc:385] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.493970 26107 raft_consensus.cc:740] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.494625 26107 consensus_queue.cc:260] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.488372 26104 consensus_queue.cc:260] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.501227 26106 tablet_bootstrap.cc:654] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.447777 26483 raft_consensus.cc:515] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.503926 25802 leader_election.cc:304] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:57.502135 25799 leader_election.cc:304] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:57.506790 26337 raft_consensus.cc:493] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.509335 26107 ts_tablet_manager.cc:1434] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 13:21:57.509642 26104 ts_tablet_manager.cc:1434] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:21:57.526096 26107 tablet_bootstrap.cc:492] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:57.519142 26246 leader_election.cc:290] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:57.526890 26104 tablet_bootstrap.cc:492] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:57.530328 26534 raft_consensus.cc:2804] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.535851 26484 raft_consensus.cc:2804] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.536059 26483 leader_election.cc:290] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:57.536384 26484 raft_consensus.cc:493] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.536809 26484 raft_consensus.cc:3060] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.534019 26337 raft_consensus.cc:515] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.541819 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:57.542479 25911 raft_consensus.cc:2468] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:57.544282 25802 leader_election.cc:304] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:57.546033 26493 raft_consensus.cc:2804] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.546397 26493 raft_consensus.cc:493] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.546731 26493 raft_consensus.cc:3060] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.530838 26534 raft_consensus.cc:493] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.549168 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981001373c784e27a4ec5bef4b640b77" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:57.540721 26337 leader_election.cc:290] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:57.549615 26534 raft_consensus.cc:3060] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.549849 25907 raft_consensus.cc:2468] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:57.551343 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:57.554399 26107 tablet_bootstrap.cc:654] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.557382 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:57.560209 25950 leader_election.cc:304] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
W20260709 13:21:57.558799 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 56665.9us
I20260709 13:21:57.563426 26485 raft_consensus.cc:2749] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:57.533480 26022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 142713us
I20260709 13:21:57.583818 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7cba52ce9343d1bee167ea3364a7f9" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:57.590626 26025 leader_election.cc:304] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:57.593436 26056 raft_consensus.cc:2468] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:57.599978 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
W20260709 13:21:57.589533 25802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:46717, user_credentials={real_user=slave}} blocked reactor thread for 45335.7us
I20260709 13:21:57.602252 26495 raft_consensus.cc:2804] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.607137 26493 raft_consensus.cc:515] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.609190 26493 leader_election.cc:290] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:57.609068 26532 consensus_queue.cc:1048] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:57.612130 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981001373c784e27a4ec5bef4b640b77" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:57.644572 25983 raft_consensus.cc:2468] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:57.613495 25981 raft_consensus.cc:3060] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.603335 26337 consensus_queue.cc:1048] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:21:57.615115 26534 raft_consensus.cc:515] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.616817 26484 raft_consensus.cc:515] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.602929 26495 raft_consensus.cc:493] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:57.612702 26022 leader_election.cc:343] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.669179 26495 raft_consensus.cc:3060] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:57.669569 26022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 56906.3us
I20260709 13:21:57.624874 26104 tablet_bootstrap.cc:654] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:57.667210 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 62166.1us
I20260709 13:21:57.645485 26539 raft_consensus.cc:493] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:57.675825 25801 leader_election.cc:343] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.678921 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
W20260709 13:21:57.680060 25801 leader_election.cc:343] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.684304 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:57.684787 26106 tablet_bootstrap.cc:492] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:57.685142 25911 raft_consensus.cc:3060] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.685381 26106 ts_tablet_manager.cc:1403] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.248s	user 0.020s	sys 0.000s
I20260709 13:21:57.692710 26534 leader_election.cc:290] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:57.697446 26107 tablet_bootstrap.cc:492] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:57.698143 26107 ts_tablet_manager.cc:1403] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.172s	user 0.019s	sys 0.002s
I20260709 13:21:57.676396 26539 raft_consensus.cc:515] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.704512 25911 raft_consensus.cc:2468] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
W20260709 13:21:57.676512 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 58135.8us
I20260709 13:21:57.698138 26541 raft_consensus.cc:493] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.726315 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7cba52ce9343d1bee167ea3364a7f9" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:57.727041 26057 raft_consensus.cc:3060] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.717582 26484 leader_election.cc:290] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:57.738279 26106 raft_consensus.cc:359] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.738945 26106 raft_consensus.cc:385] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.726979 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7cba52ce9343d1bee167ea3364a7f9" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:57.741956 25982 raft_consensus.cc:3060] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.746229 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:57.746807 26057 raft_consensus.cc:2468] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:57.714578 26541 raft_consensus.cc:515] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.750197 26539 leader_election.cc:290] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:57.750661 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:57.750826 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea59a8a0048199f9090a390dd25f7" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:57.746846 25911 raft_consensus.cc:3060] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:57.752336 25875 leader_election.cc:343] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.739205 26106 raft_consensus.cc:740] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.753623 26106 consensus_queue.cc:260] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.754300 26541 leader_election.cc:290] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:21:57.756179 26548 consensus_queue.cc:1048] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.757964 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1821e793dcc0499d9d8a707ea4f8d0d2" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:57.758585 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea59a8a0048199f9090a390dd25f7" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:57.759348 25799 leader_election.cc:343] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:57.761610 26022 leader_election.cc:343] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:57.762755 25874 leader_election.cc:343] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.763176 25874 leader_election.cc:304] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:57.764232 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1821e793dcc0499d9d8a707ea4f8d0d2" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:57.764564 26142 raft_consensus.cc:2749] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.768075 26106 ts_tablet_manager.cc:1434] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:21:57.769088 26106 tablet_bootstrap.cc:492] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:57.771551 25982 raft_consensus.cc:2468] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:57.776458 25911 raft_consensus.cc:2468] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:57.785831 25801 leader_election.cc:304] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:57.791023 25802 leader_election.cc:304] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:57.794811 26546 raft_consensus.cc:2804] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:57.797228 26023 leader_election.cc:343] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.797770 26023 leader_election.cc:304] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:57.798758 26542 raft_consensus.cc:2749] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:57.796504 26546 raft_consensus.cc:697] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:57.801366 26546 consensus_queue.cc:237] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.790311 26548 raft_consensus.cc:2804] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.806628 26548 raft_consensus.cc:697] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:57.807726 26548 consensus_queue.cc:237] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:57.822127 26104 tablet_bootstrap.cc:492] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:57.822736 26104 ts_tablet_manager.cc:1403] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.296s	user 0.014s	sys 0.019s
I20260709 13:21:57.823164 26106 tablet_bootstrap.cc:654] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.816485 26107 raft_consensus.cc:359] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.824704 26107 raft_consensus.cc:385] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.825071 26107 raft_consensus.cc:740] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.828423 26104 raft_consensus.cc:359] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.829250 26104 raft_consensus.cc:385] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.829594 26104 raft_consensus.cc:740] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.829666 26107 consensus_queue.cc:260] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.830600 26104 consensus_queue.cc:260] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.833345 26104 ts_tablet_manager.cc:1434] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:21:57.834358 26104 tablet_bootstrap.cc:492] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:57.834462 26107 ts_tablet_manager.cc:1434] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.001s
I20260709 13:21:57.837527 26107 tablet_bootstrap.cc:492] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:57.844108 26104 tablet_bootstrap.cc:654] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.859457 26107 tablet_bootstrap.cc:654] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.870366 26485 raft_consensus.cc:493] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.871166 26485 raft_consensus.cc:515] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.874995 26485 leader_election.cc:290] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:57.876744 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea59a8a0048199f9090a390dd25f7" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:57.878088 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea59a8a0048199f9090a390dd25f7" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:57.878917 25910 raft_consensus.cc:2468] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 0.
W20260709 13:21:57.878206 25949 leader_election.cc:343] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:57.880973 25951 leader_election.cc:304] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:57.882838 26491 raft_consensus.cc:2804] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.883210 26491 raft_consensus.cc:493] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.883558 26491 raft_consensus.cc:3060] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.860265 25802 leader_election.cc:304] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:57.885166 26484 raft_consensus.cc:2804] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:57.861835 26495 raft_consensus.cc:515] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.889357 26484 raft_consensus.cc:697] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:57.898195 26484 consensus_queue.cc:237] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:57.909245 26106 tablet_bootstrap.cc:492] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:57.910460 26106 ts_tablet_manager.cc:1403] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.142s	user 0.018s	sys 0.017s
I20260709 13:21:57.923708 26543 raft_consensus.cc:493] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.923827 25733 catalog_manager.cc:5697] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.929387 25730 catalog_manager.cc:5697] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:57.924386 26543 raft_consensus.cc:515] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:57.941578 26106 raft_consensus.cc:359] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.942711 26106 raft_consensus.cc:385] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:57.943068 26106 raft_consensus.cc:740] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:57.944100 26106 consensus_queue.cc:260] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.947542 26106 ts_tablet_manager.cc:1434] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 13:21:57.948774 26106 tablet_bootstrap.cc:492] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:57.954226 26543 leader_election.cc:290] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:57.955051 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:57.955760 25907 raft_consensus.cc:2468] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 0.
I20260709 13:21:57.957870 26025 leader_election.cc:304] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:57.958767 26106 tablet_bootstrap.cc:654] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:57.960721 26404 raft_consensus.cc:2804] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:57.961160 26404 raft_consensus.cc:493] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.961512 26404 raft_consensus.cc:3060] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.973929 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:57.986763 26548 raft_consensus.cc:493] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.988919 26548 raft_consensus.cc:515] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:57.989890 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981001373c784e27a4ec5bef4b640b77" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:57.990505 25907 raft_consensus.cc:3060] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:57.991747 26548 leader_election.cc:290] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:57.993947 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:57.994678 25911 raft_consensus.cc:2468] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:58.003196 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:58.003822 25802 leader_election.cc:304] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:58.004823 26404 raft_consensus.cc:515] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.006690 26104 tablet_bootstrap.cc:492] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:58.007170 26104 ts_tablet_manager.cc:1403] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.173s	user 0.016s	sys 0.001s
I20260709 13:21:58.007516 25907 raft_consensus.cc:2468] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:58.009405 26025 leader_election.cc:304] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:58.009709 26542 consensus_queue.cc:1048] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.011214 26542 raft_consensus.cc:2804] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.011471 26546 raft_consensus.cc:2804] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:58.012202 26546 raft_consensus.cc:493] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:58.011453 26495 leader_election.cc:290] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:58.012514 26546 raft_consensus.cc:3060] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.012614 26104 raft_consensus.cc:359] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.013353 26104 raft_consensus.cc:385] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.013619 26104 raft_consensus.cc:740] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.014366 26104 consensus_queue.cc:260] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
W20260709 13:21:58.015702 26557 log.cc:927] Time spent T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:21:58.016422 26104 ts_tablet_manager.cc:1434] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
W20260709 13:21:58.023198 25801 leader_election.cc:343] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.011703 26542 raft_consensus.cc:697] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:21:58.024940 26542 consensus_queue.cc:237] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.027858 26404 leader_election.cc:290] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:58.028532 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:58.032454 25911 raft_consensus.cc:3060] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:58.034857 26022 leader_election.cc:343] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.035668 26106 tablet_bootstrap.cc:492] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:58.036173 26106 ts_tablet_manager.cc:1403] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.008s
I20260709 13:21:58.026856 26491 raft_consensus.cc:515] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.038800 26107 tablet_bootstrap.cc:492] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:58.039319 26107 ts_tablet_manager.cc:1403] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.202s	user 0.007s	sys 0.025s
I20260709 13:21:58.042018 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea59a8a0048199f9090a390dd25f7" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
I20260709 13:21:58.043195 26106 raft_consensus.cc:359] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.043892 26106 raft_consensus.cc:385] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:58.043968 25949 leader_election.cc:343] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.044255 26106 raft_consensus.cc:740] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.044981 26106 consensus_queue.cc:260] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.047001 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981001373c784e27a4ec5bef4b640b77" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:58.047600 25985 raft_consensus.cc:3060] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.048987 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:58.055972 26106 ts_tablet_manager.cc:1434] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:21:58.057155 26106 tablet_bootstrap.cc:492] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:58.059418 26491 leader_election.cc:290] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:58.042132 26107 raft_consensus.cc:359] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
W20260709 13:21:58.062943 26022 leader_election.cc:343] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.065603 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea59a8a0048199f9090a390dd25f7" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:58.073057 25910 raft_consensus.cc:3060] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:58.073163 26022 consensus_peers.cc:597] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.073545 26104 tablet_bootstrap.cc:492] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:58.073817 26107 raft_consensus.cc:385] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.074100 26107 raft_consensus.cc:740] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.074847 26107 consensus_queue.cc:260] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:58.076982 26107 ts_tablet_manager.cc:1434] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 13:21:58.077842 26107 tablet_bootstrap.cc:492] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6: Bootstrap starting.
I20260709 13:21:58.080950 25911 raft_consensus.cc:2468] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:58.031487 26546 raft_consensus.cc:515] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:58.082623 26025 leader_election.cc:304] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:58.085218 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:58.086544 26057 raft_consensus.cc:3060] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.087664 26546 leader_election.cc:290] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:58.088470 26484 raft_consensus.cc:493] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.088944 25910 raft_consensus.cc:2468] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:21:58.092919 26104 tablet_bootstrap.cc:654] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.093245 25951 leader_election.cc:304] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:58.094660 26336 raft_consensus.cc:2804] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.094942 26107 tablet_bootstrap.cc:654] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.095136 26336 raft_consensus.cc:697] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:21:58.096009 26336 consensus_queue.cc:237] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.103353 26106 tablet_bootstrap.cc:654] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.088986 26484 raft_consensus.cc:515] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.106175 26484 leader_election.cc:290] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:58.085248 26404 raft_consensus.cc:2804] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.085517 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:58.115229 25911 raft_consensus.cc:3060] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.083369 25985 raft_consensus.cc:2468] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:21:58.134171 26546 raft_consensus.cc:493] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.134773 26546 raft_consensus.cc:515] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.141031 26106 tablet_bootstrap.cc:492] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:58.141522 26106 ts_tablet_manager.cc:1403] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.001s
I20260709 13:21:58.141959 26546 leader_election.cc:290] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:58.145301 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:58.144335 26106 raft_consensus.cc:359] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.130684 26491 raft_consensus.cc:493] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.146543 25910 raft_consensus.cc:2468] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:58.149309 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42cec7e321749d39d2184b40221df6c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:58.149366 26491 raft_consensus.cc:515] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.151801 25802 leader_election.cc:304] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:58.153764 26484 raft_consensus.cc:2804] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:58.154441 26484 raft_consensus.cc:493] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:58.154891 26484 raft_consensus.cc:3060] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.155412 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:58.144901 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42cec7e321749d39d2184b40221df6c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:58.157109 26059 raft_consensus.cc:2468] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:58.159096 26491 leader_election.cc:290] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:58.132818 26404 raft_consensus.cc:697] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
W20260709 13:21:58.153827 25799 leader_election.cc:343] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.160250 26404 consensus_queue.cc:237] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.162015 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:58.163093 25801 leader_election.cc:304] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
W20260709 13:21:58.163342 25799 leader_election.cc:343] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.166680 26546 raft_consensus.cc:2804] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:58.167191 26546 raft_consensus.cc:493] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:58.167651 26546 raft_consensus.cc:3060] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.168975 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:58.169757 26107 tablet_bootstrap.cc:492] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6: No bootstrap required, opened a new log
I20260709 13:21:58.172036 26107 ts_tablet_manager.cc:1403] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.017s
I20260709 13:21:58.172827 26106 raft_consensus.cc:385] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.173314 26106 raft_consensus.cc:740] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.178782 26106 consensus_queue.cc:260] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.183195 26106 ts_tablet_manager.cc:1434] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:21:58.186209 26106 tablet_bootstrap.cc:492] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:21:58.186534 25911 raft_consensus.cc:2468] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:58.184808 26484 raft_consensus.cc:515] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.206540 26057 raft_consensus.cc:2468] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:58.204671 26107 raft_consensus.cc:359] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
W20260709 13:21:58.207968 25801 consensus_peers.cc:597] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b -> Peer 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175): Couldn't send request to peer 3cb7aae2a23a47c180432cb646577fd6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.209301 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:58.208752 26107 raft_consensus.cc:385] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.210399 26107 raft_consensus.cc:740] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Initialized, Role: FOLLOWER
W20260709 13:21:58.212756 25799 leader_election.cc:343] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.202759 25802 leader_election.cc:304] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:21:58.209442 26484 leader_election.cc:290] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:21:58.217157 26548 raft_consensus.cc:2804] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.217512 26106 tablet_bootstrap.cc:654] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.218133 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:21:58.218449 26484 consensus_queue.cc:1048] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.218735 25909 raft_consensus.cc:3060] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.217682 26548 raft_consensus.cc:697] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:58.224354 26548 consensus_queue.cc:237] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:58.230786 25909 raft_consensus.cc:2468] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:58.211648 26107 consensus_queue.cc:260] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:21:58.234277 26107 ts_tablet_manager.cc:1434] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:21:58.229652 25951 leader_election.cc:304] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:58.237416 26483 raft_consensus.cc:2749] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:58.235584 25802 leader_election.cc:304] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:58.238850 26484 raft_consensus.cc:2804] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.239354 26484 raft_consensus.cc:697] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:58.240160 26484 consensus_queue.cc:237] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.240908 26104 tablet_bootstrap.cc:492] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:58.241668 26104 ts_tablet_manager.cc:1403] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.168s	user 0.023s	sys 0.029s
I20260709 13:21:58.244683 26546 raft_consensus.cc:515] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.245718 26104 raft_consensus.cc:359] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.247007 26104 raft_consensus.cc:385] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.247399 26104 raft_consensus.cc:740] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.247778 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42cec7e321749d39d2184b40221df6c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:58.248479 26104 consensus_queue.cc:260] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
W20260709 13:21:58.249370 25799 leader_election.cc:343] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.251704 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42cec7e321749d39d2184b40221df6c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:58.252358 26059 raft_consensus.cc:3060] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.252396 26104 ts_tablet_manager.cc:1434] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:58.253806 26104 tablet_bootstrap.cc:492] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:58.261027 26142 raft_consensus.cc:493] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cb7aae2a23a47c180432cb646577fd6)
I20260709 13:21:58.261682 26142 raft_consensus.cc:515] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.264056 26142 leader_election.cc:290] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:58.265978 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:58.266072 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:58.266844 26058 raft_consensus.cc:2468] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:21:58.267098 25985 raft_consensus.cc:2393] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dbc14fa82f4a22b1cab8f3691196de in current term 2: Already voted for candidate d01fccfd609b4182a5d43a7f6b4ae503 in this term.
I20260709 13:21:58.268685 25876 leader_election.cc:304] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:21:58.270500 26059 raft_consensus.cc:2468] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:58.272004 25801 leader_election.cc:304] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:58.273227 26553 raft_consensus.cc:2804] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.273695 26553 raft_consensus.cc:697] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:58.273895 26142 raft_consensus.cc:2804] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:58.274415 26142 raft_consensus.cc:493] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3cb7aae2a23a47c180432cb646577fd6)
I20260709 13:21:58.274813 26142 raft_consensus.cc:3060] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:58.274561 26553 consensus_queue.cc:237] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.281219 26104 tablet_bootstrap.cc:654] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.276407 26546 leader_election.cc:290] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:58.293641 26142 raft_consensus.cc:515] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.295137 25731 catalog_manager.cc:5697] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 0 to 1, leader changed from <none> to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:58.300668 26548 consensus_queue.cc:1048] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:58.304049 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:58.304754 25985 raft_consensus.cc:2393] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dbc14fa82f4a22b1cab8f3691196de in current term 2: Already voted for candidate d01fccfd609b4182a5d43a7f6b4ae503 in this term.
I20260709 13:21:58.306895 26142 leader_election.cc:290] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:58.309224 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:58.316504 26059 raft_consensus.cc:2468] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:21:58.317715 25876 leader_election.cc:304] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:58.318940 26498 raft_consensus.cc:2804] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:58.319602 26498 raft_consensus.cc:697] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:21:58.320874 26498 consensus_queue.cc:237] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.324965 26106 tablet_bootstrap.cc:492] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: No bootstrap required, opened a new log
I20260709 13:21:58.325795 26106 ts_tablet_manager.cc:1403] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.010s
I20260709 13:21:58.341259 26106 raft_consensus.cc:359] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.341674 26491 raft_consensus.cc:493] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.341979 26106 raft_consensus.cc:385] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.342330 26106 raft_consensus.cc:740] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.342234 26491 raft_consensus.cc:515] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.343060 26106 consensus_queue.cc:260] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.344414 26491 leader_election.cc:290] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:58.353626 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:58.350127 26106 ts_tablet_manager.cc:1434] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:21:58.355976 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:58.359735 25911 raft_consensus.cc:2393] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d01fccfd609b4182a5d43a7f6b4ae503 in current term 1: Already voted for candidate 8e453645ce774c99b4b4aafb4362719b in this term.
I20260709 13:21:58.362994 25985 raft_consensus.cc:3060] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.384249 25733 catalog_manager.cc:5697] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:58.404647 25733 catalog_manager.cc:5697] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.409211 25733 catalog_manager.cc:5697] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.411309 25733 catalog_manager.cc:5697] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:58.413372 25733 catalog_manager.cc:5697] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.433890 26104 tablet_bootstrap.cc:492] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:58.434461 26104 ts_tablet_manager.cc:1403] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.181s	user 0.018s	sys 0.022s
I20260709 13:21:58.436676 25951 leader_election.cc:304] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:58.437358 26104 raft_consensus.cc:359] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.438169 26104 raft_consensus.cc:385] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.438488 26104 raft_consensus.cc:740] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.439185 26104 consensus_queue.cc:260] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.439615 26483 raft_consensus.cc:3060] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.450197 26104 ts_tablet_manager.cc:1434] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:21:58.451239 26104 tablet_bootstrap.cc:492] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:58.481402 26548 consensus_queue.cc:1048] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.492177 26104 tablet_bootstrap.cc:654] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:58.497505 25875 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 99768.1us
I20260709 13:21:58.513605 25983 raft_consensus.cc:3060] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.516885 26483 raft_consensus.cc:2749] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:58.525807 26553 raft_consensus.cc:493] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.526122 26104 tablet_bootstrap.cc:492] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:58.526852 26104 ts_tablet_manager.cc:1403] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.002s
I20260709 13:21:58.526487 26553 raft_consensus.cc:515] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.531534 25985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1821e793dcc0499d9d8a707ea4f8d0d2" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:21:58.533079 25799 leader_election.cc:343] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:58.533825 26484 consensus_queue.cc:1048] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.533881 25729 catalog_manager.cc:5697] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:58.537591 26484 consensus_queue.cc:1048] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.547468 26104 raft_consensus.cc:359] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.548337 26104 raft_consensus.cc:385] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.548677 26104 raft_consensus.cc:740] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.549640 26104 consensus_queue.cc:260] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.539738 26553 leader_election.cc:290] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:58.539907 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1821e793dcc0499d9d8a707ea4f8d0d2" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:58.557547 26058 raft_consensus.cc:2468] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 0.
I20260709 13:21:58.559494 25801 leader_election.cc:304] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:58.562808 26104 ts_tablet_manager.cc:1434] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:21:58.574255 26491 consensus_queue.cc:1048] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.611615 26546 raft_consensus.cc:2804] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:58.612108 26546 raft_consensus.cc:493] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:58.612497 26546 raft_consensus.cc:3060] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.614001 26104 tablet_bootstrap.cc:492] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
W20260709 13:21:58.617084 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 57670.3us
I20260709 13:21:58.623764 26104 tablet_bootstrap.cc:654] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:58.618220 25782 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:58.628871 26541 consensus_queue.cc:1048] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.659873 26104 tablet_bootstrap.cc:492] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:58.660554 26104 ts_tablet_manager.cc:1403] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.005s
I20260709 13:21:58.664384 25833 raft_consensus.cc:3060] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:58.666801 26022 consensus_peers.cc:597] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.674723 26104 raft_consensus.cc:359] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.678786 26104 raft_consensus.cc:385] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.679232 26104 raft_consensus.cc:740] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.679572 26546 raft_consensus.cc:515] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:21:58.677210 25799 consensus_peers.cc:597] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.680024 26104 consensus_queue.cc:260] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.681939 26549 consensus_queue.cc:1048] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.682803 26104 ts_tablet_manager.cc:1434] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:21:58.685174 26058 raft_consensus.cc:3060] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.688457 26104 tablet_bootstrap.cc:492] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:58.690625 25730 catalog_manager.cc:5697] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:58.696278 26104 tablet_bootstrap.cc:654] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.697230 25730 catalog_manager.cc:5697] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 1 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:58.702453 26553 consensus_queue.cc:1048] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.712642 26058 raft_consensus.cc:1275] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.714393 26539 consensus_queue.cc:1048] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.720772 26104 tablet_bootstrap.cc:492] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:58.721796 26104 ts_tablet_manager.cc:1403] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.004s
I20260709 13:21:58.724453 25985 raft_consensus.cc:3060] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.727007 26104 raft_consensus.cc:359] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.727308 26404 consensus_queue.cc:1048] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.727926 26104 raft_consensus.cc:385] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.728286 26104 raft_consensus.cc:740] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.732640 26104 consensus_queue.cc:260] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.737109 26553 consensus_queue.cc:1048] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:58.738289 26104 ts_tablet_manager.cc:1434] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:21:58.739501 26104 tablet_bootstrap.cc:492] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503: Bootstrap starting.
I20260709 13:21:58.738724 26336 raft_consensus.cc:493] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:58.741014 26336 raft_consensus.cc:515] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:58.743171 26336 leader_election.cc:290] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:58.750911 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:58.752935 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe43c0e1b72475da18a3ce2febfa9e3" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:58.756114 25951 leader_election.cc:304] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:58.757434 26336 raft_consensus.cc:2749] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:58.767057 25982 raft_consensus.cc:1275] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.770962 26104 tablet_bootstrap.cc:654] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:58.770732 26336 consensus_queue.cc:1048] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.788002 26539 consensus_queue.cc:1048] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:58.811532 26104 tablet_bootstrap.cc:492] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503: No bootstrap required, opened a new log
I20260709 13:21:58.812297 26104 ts_tablet_manager.cc:1403] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.004s
I20260709 13:21:58.817857 26104 raft_consensus.cc:359] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.820474 26104 raft_consensus.cc:385] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:58.820789 26104 raft_consensus.cc:740] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Initialized, Role: FOLLOWER
I20260709 13:21:58.825320 26104 consensus_queue.cc:260] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.835114 26404 consensus_queue.cc:1048] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:21:58.860231 26104 ts_tablet_manager.cc:1434] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:21:58.851642 26493 consensus_queue.cc:1048] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:21:58.865163 26546 leader_election.cc:290] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:58.861552 26484 consensus_queue.cc:1048] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:21:58.904992 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1821e793dcc0499d9d8a707ea4f8d0d2" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:21:58.905817 25983 raft_consensus.cc:3060] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.920028 26553 raft_consensus.cc:493] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d01fccfd609b4182a5d43a7f6b4ae503)
I20260709 13:21:58.920722 26553 raft_consensus.cc:515] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:58.922396 25983 raft_consensus.cc:2468] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:58.925105 26553 leader_election.cc:290] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:21:58.932158 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 79815.4us
I20260709 13:21:58.939378 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea59a8a0048199f9090a390dd25f7" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:58.940867 25799 leader_election.cc:304] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:21:58.941452 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400ea59a8a0048199f9090a390dd25f7" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:21:58.939462 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1821e793dcc0499d9d8a707ea4f8d0d2" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:21:58.942631 26059 raft_consensus.cc:3060] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:58.943110 25799 leader_election.cc:304] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:21:58.944239 26549 raft_consensus.cc:2749] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:58.942734 26484 raft_consensus.cc:2804] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:58.947759 26484 raft_consensus.cc:697] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:21:58.948799 26484 consensus_queue.cc:237] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:21:58.954491 26059 raft_consensus.cc:2468] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 1.
I20260709 13:21:59.032311 25733 catalog_manager.cc:5697] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 1 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:59.048056 26611 raft_consensus.cc:493] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.048625 26611 raft_consensus.cc:515] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:21:59.051729 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:59.052565 26611 leader_election.cc:290] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:21:59.053175 26059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:21:59.056749 25950 leader_election.cc:304] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:21:59.057559 26611 raft_consensus.cc:2749] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:59.157855 26485 raft_consensus.cc:493] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.159736 26485 raft_consensus.cc:515] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:21:59.181737 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:21:59.182862 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:21:59.183375 26485 leader_election.cc:290] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:21:59.197252 25949 leader_election.cc:304] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:21:59.199384 26485 raft_consensus.cc:2749] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:59.223271 25979 raft_consensus.cc:3060] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.246968 25981 raft_consensus.cc:3060] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.544241 26549 consensus_queue.cc:1048] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:59.562595 26549 consensus_queue.cc:1048] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:00.932533 16192 tablet_server.cc:179] TabletServer@127.15.208.1:0 shutting down...
W20260709 13:22:00.960418 26023 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:22:00.979715 26023 consensus_peers.cc:597] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.007586 25875 consensus_peers.cc:597] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.008373 25875 consensus_peers.cc:597] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.012962 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:22:01.013695 25949 consensus_peers.cc:597] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.014750 25949 consensus_peers.cc:597] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.016155 16192 tablet_replica.cc:333] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.017709 16192 raft_consensus.cc:2243] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.018450 16192 raft_consensus.cc:2272] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.022615 16192 tablet_replica.cc:333] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.023841 16192 raft_consensus.cc:2243] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:22:01.024984 25949 consensus_peers.cc:597] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.025626 16192 raft_consensus.cc:2272] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.030683 16192 tablet_replica.cc:333] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.031917 16192 raft_consensus.cc:2243] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.033206 16192 raft_consensus.cc:2272] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:01.033377 26023 consensus_peers.cc:597] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.037729 16192 tablet_replica.cc:333] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.039069 16192 raft_consensus.cc:2243] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.040365 16192 raft_consensus.cc:2272] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.044423 16192 tablet_replica.cc:333] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.045603 16192 raft_consensus.cc:2243] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.046988 16192 raft_consensus.cc:2272] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.050714 16192 tablet_replica.cc:333] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.051782 16192 raft_consensus.cc:2243] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.052460 16192 raft_consensus.cc:2272] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.056354 16192 tablet_replica.cc:333] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.057638 16192 raft_consensus.cc:2243] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.058802 16192 raft_consensus.cc:2272] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.062306 16192 tablet_replica.cc:333] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.063331 16192 raft_consensus.cc:2243] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.064718 16192 raft_consensus.cc:2272] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.068495 16192 tablet_replica.cc:333] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.069568 16192 raft_consensus.cc:2243] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.070358 16192 raft_consensus.cc:2272] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:01.072613 25875 consensus_peers.cc:597] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.073649 26023 consensus_peers.cc:597] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.074077 16192 tablet_replica.cc:333] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.075138 16192 raft_consensus.cc:2243] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.075901 16192 raft_consensus.cc:2272] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.079960 16192 tablet_replica.cc:333] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.081035 16192 raft_consensus.cc:2243] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.081714 16192 raft_consensus.cc:2272] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.085786 16192 tablet_replica.cc:333] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.086712 16192 raft_consensus.cc:2243] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.087459 16192 raft_consensus.cc:2272] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:01.087502 26023 consensus_peers.cc:597] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.091202 16192 tablet_replica.cc:333] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.092433 16192 raft_consensus.cc:2243] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.093225 16192 raft_consensus.cc:2272] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.096978 16192 tablet_replica.cc:333] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.097945 16192 raft_consensus.cc:2243] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.098698 16192 raft_consensus.cc:2272] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:01.100293 25949 consensus_peers.cc:597] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.102463 16192 tablet_replica.cc:333] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.103533 16192 raft_consensus.cc:2243] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.104211 16192 raft_consensus.cc:2272] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.108067 16192 tablet_replica.cc:333] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.109076 16192 raft_consensus.cc:2243] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.110582 16192 raft_consensus.cc:2272] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.114699 16192 tablet_replica.cc:333] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.115836 16192 raft_consensus.cc:2243] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.117226 16192 raft_consensus.cc:2272] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.120428 16192 tablet_replica.cc:333] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.121276 16192 raft_consensus.cc:2243] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.121940 16192 raft_consensus.cc:2272] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.124915 16192 tablet_replica.cc:333] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.125801 16192 raft_consensus.cc:2243] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.126403 16192 raft_consensus.cc:2272] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.129755 16192 tablet_replica.cc:333] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.130582 16192 raft_consensus.cc:2243] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.131755 16192 raft_consensus.cc:2272] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.134909 16192 tablet_replica.cc:333] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.135711 16192 raft_consensus.cc:2243] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.136312 16192 raft_consensus.cc:2272] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.139209 16192 tablet_replica.cc:333] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.139982 16192 raft_consensus.cc:2243] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.140625 16192 raft_consensus.cc:2272] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.143837 16192 tablet_replica.cc:333] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.144718 16192 raft_consensus.cc:2243] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.145921 16192 raft_consensus.cc:2272] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.149040 16192 tablet_replica.cc:333] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.149938 16192 raft_consensus.cc:2243] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.150586 16192 raft_consensus.cc:2272] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.153779 16192 tablet_replica.cc:333] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.154614 16192 raft_consensus.cc:2243] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.155175 16192 raft_consensus.cc:2272] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.158031 16192 tablet_replica.cc:333] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.158916 16192 raft_consensus.cc:2243] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.159480 16192 raft_consensus.cc:2272] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.162462 16192 tablet_replica.cc:333] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.163245 16192 raft_consensus.cc:2243] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.163787 16192 raft_consensus.cc:2272] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.166791 16192 tablet_replica.cc:333] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.167627 16192 raft_consensus.cc:2243] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.174131 16192 raft_consensus.cc:2272] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.177568 16192 tablet_replica.cc:333] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.178388 16192 raft_consensus.cc:2243] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.179049 16192 raft_consensus.cc:2272] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.182646 16192 tablet_replica.cc:333] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.183509 16192 raft_consensus.cc:2243] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.184111 16192 raft_consensus.cc:2272] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:01.184546 26023 consensus_peers.cc:597] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.187467 16192 tablet_replica.cc:333] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.188349 16192 raft_consensus.cc:2243] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.188918 16192 raft_consensus.cc:2272] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.192055 16192 tablet_replica.cc:333] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.192893 16192 raft_consensus.cc:2243] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.193430 16192 raft_consensus.cc:2272] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.196580 16192 tablet_replica.cc:333] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.197458 16192 raft_consensus.cc:2243] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.198122 16192 raft_consensus.cc:2272] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.201313 16192 tablet_replica.cc:333] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.202195 16192 raft_consensus.cc:2243] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.202783 16192 raft_consensus.cc:2272] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:01.203488 25875 consensus_peers.cc:597] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.206300 16192 tablet_replica.cc:333] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.207310 16192 raft_consensus.cc:2243] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.207938 16192 raft_consensus.cc:2272] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.211330 16192 tablet_replica.cc:333] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.212144 16192 raft_consensus.cc:2243] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.212759 16192 raft_consensus.cc:2272] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:01.215339 25949 consensus_peers.cc:597] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.215906 16192 tablet_replica.cc:333] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.216943 16192 raft_consensus.cc:2243] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.217624 16192 raft_consensus.cc:2272] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.220960 16192 tablet_replica.cc:333] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.221745 16192 raft_consensus.cc:2243] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.222877 16192 raft_consensus.cc:2272] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.226034 16192 tablet_replica.cc:333] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
W20260709 13:22:01.226365 26023 consensus_peers.cc:597] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.226771 16192 raft_consensus.cc:2243] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.227937 16192 raft_consensus.cc:2272] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.231176 16192 tablet_replica.cc:333] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.231994 16192 raft_consensus.cc:2243] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.233204 16192 raft_consensus.cc:2272] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.236541 16192 tablet_replica.cc:333] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.237425 16192 raft_consensus.cc:2243] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.238632 16192 raft_consensus.cc:2272] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.241842 16192 tablet_replica.cc:333] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.242578 16192 raft_consensus.cc:2243] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:01.243660 16192 raft_consensus.cc:2272] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.246929 16192 tablet_replica.cc:333] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
W20260709 13:22:01.247059 25949 consensus_peers.cc:597] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.247701 16192 raft_consensus.cc:2243] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.248407 16192 raft_consensus.cc:2272] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.251380 16192 tablet_replica.cc:333] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.252100 16192 raft_consensus.cc:2243] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.252638 16192 raft_consensus.cc:2272] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:01.255997 16192 tablet_replica.cc:333] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: stopping tablet replica
I20260709 13:22:01.256754 16192 raft_consensus.cc:2243] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:01.257318 16192 raft_consensus.cc:2272] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:01.260731 26023 consensus_peers.cc:597] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.265702 26023 consensus_peers.cc:597] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.266775 25949 consensus_peers.cc:597] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.280076 25949 consensus_peers.cc:597] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.284896 26023 consensus_peers.cc:597] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.299702 25875 consensus_peers.cc:597] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.305795 25875 consensus_peers.cc:597] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.355816 16192 tablet_server.cc:196] TabletServer@127.15.208.1:0 shutdown complete.
W20260709 13:22:01.433624 25949 consensus_peers.cc:597] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.441819 26023 consensus_peers.cc:597] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.480614 26023 consensus_peers.cc:597] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:01.488616 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:01.505899 26631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:01.509601 25875 consensus_peers.cc:597] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.510320 25875 consensus_peers.cc:597] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.515518 26632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:01.629475 26023 consensus_peers.cc:597] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:01.634037 26635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:01.664402 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:01.669551 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:01.669965 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:01.670256 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603321670233 us; error 0 us; skew 500 ppm
I20260709 13:22:01.671092 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:01.675127 16192 webserver.cc:533] Webserver started at http://127.15.208.1:34151/ using document root <none> and password file <none>
I20260709 13:22:01.675884 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:01.676167 16192 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:22:01.681521 16192 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:01.693274 26641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.695860 16192 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:22:01.696305 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-0-root
uuid: "8e453645ce774c99b4b4aafb4362719b"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-w3b1"
I20260709 13:22:01.696924 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603004946521-16192-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:01.722612 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:01.724334 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:01.733541 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:01.740262 26648 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:22:02.048864 26611 raft_consensus.cc:493] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.049458 26611 raft_consensus.cc:515] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.051749 26611 leader_election.cc:290] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.054980 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
W20260709 13:22:02.058647 25949 leader_election.cc:336] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.059095 25949 leader_election.cc:304] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:02.060102 26611 raft_consensus.cc:2749] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.070089 26607 raft_consensus.cc:493] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.070737 26607 raft_consensus.cc:515] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.072703 26607 leader_election.cc:290] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.073477 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f87eb5e589466fa0bc8c00974bdd91" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:22:02.078080 26023 leader_election.cc:336] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.078542 26023 leader_election.cc:304] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:02.079239 26607 raft_consensus.cc:2749] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.101387 26588 raft_consensus.cc:493] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.102958 26588 raft_consensus.cc:515] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.104679 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:22:02.105732 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.367s	user 0.008s	sys 0.002s
I20260709 13:22:02.106120 16192 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:22:02.111323 26607 raft_consensus.cc:493] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.111981 26607 raft_consensus.cc:515] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
W20260709 13:22:02.112875 25875 leader_election.cc:336] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.114400 26607 leader_election.cc:290] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.116052 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:02.120982 26648 tablet_bootstrap.cc:492] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:02.123638 26607 raft_consensus.cc:493] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.125842 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.124226 26607 raft_consensus.cc:515] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.127460 25874 leader_election.cc:304] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:02.128129 26607 leader_election.cc:290] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.128383 26626 raft_consensus.cc:2749] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.130218 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42cec7e321749d39d2184b40221df6c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:22:02.132494 26023 leader_election.cc:336] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.135963 26023 leader_election.cc:304] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:02.124018 26588 leader_election.cc:290] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:02.137917 26542 raft_consensus.cc:2749] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:22:02.142149 26023 leader_election.cc:336] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.142627 26023 leader_election.cc:304] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:02.143337 26542 raft_consensus.cc:2749] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.147454 26611 raft_consensus.cc:493] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.148018 26611 raft_consensus.cc:515] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.159679 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:02.160306 25910 raft_consensus.cc:2468] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:22:02.161777 25951 leader_election.cc:304] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
W20260709 13:22:02.162292 25949 leader_election.cc:336] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.162645 26485 raft_consensus.cc:2804] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.163028 26485 raft_consensus.cc:493] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.163355 26485 raft_consensus.cc:3060] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.177805 26648 tablet_bootstrap.cc:492] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:02.178890 26648 tablet_bootstrap.cc:492] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:02.179554 26648 ts_tablet_manager.cc:1403] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.012s
I20260709 13:22:02.182691 26648 raft_consensus.cc:359] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.183812 26648 raft_consensus.cc:740] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.185791 26648 consensus_queue.cc:260] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.194226 26588 raft_consensus.cc:493] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.194998 26588 raft_consensus.cc:515] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:02.198411 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:02.198570 26652 raft_consensus.cc:493] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.199121 26057 raft_consensus.cc:2468] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:22:02.199162 26652 raft_consensus.cc:515] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:02.207315 26485 raft_consensus.cc:515] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.210320 25876 leader_election.cc:304] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:22:02.212424 26652 leader_election.cc:290] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:02.216720 26626 raft_consensus.cc:2804] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.217172 26626 raft_consensus.cc:493] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.217554 26626 raft_consensus.cc:3060] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.212985 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
W20260709 13:22:02.224442 25875 leader_election.cc:336] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.225762 26626 raft_consensus.cc:515] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:02.227696 26588 leader_election.cc:290] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.229007 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:02.229637 26057 raft_consensus.cc:3060] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.233724 26611 leader_election.cc:290] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.237506 26057 raft_consensus.cc:2468] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:02.238430 26485 leader_election.cc:290] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.238812 25876 leader_election.cc:304] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:22:02.239728 26588 raft_consensus.cc:2804] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.240777 26588 raft_consensus.cc:697] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:02.241686 26588 consensus_queue.cc:237] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
W20260709 13:22:02.260741 26023 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 44779.1us
I20260709 13:22:02.266968 26607 raft_consensus.cc:493] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.267602 26607 raft_consensus.cc:515] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:22:02.269200 25875 leader_election.cc:336] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.270187 26626 leader_election.cc:290] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.270231 26607 leader_election.cc:290] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.272733 26485 raft_consensus.cc:493] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.292049 26485 raft_consensus.cc:515] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:22:02.281236 25949 leader_election.cc:336] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.294199 25949 leader_election.cc:304] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:02.294647 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7cba52ce9343d1bee167ea3364a7f9" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
W20260709 13:22:02.295186 25949 leader_election.cc:336] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.295866 26652 raft_consensus.cc:2749] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.287885 26648 ts_tablet_manager.cc:1434] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.108s	user 0.011s	sys 0.004s
I20260709 13:22:02.295251 26058 raft_consensus.cc:2468] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:22:02.307299 26648 tablet_bootstrap.cc:492] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:02.308038 25950 leader_election.cc:304] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.310992 26652 raft_consensus.cc:2804] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.311390 26652 raft_consensus.cc:493] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.311728 26652 raft_consensus.cc:3060] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.321342 26626 raft_consensus.cc:493] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.322271 26626 raft_consensus.cc:515] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:02.331110 25733 catalog_manager.cc:5697] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:02.285204 25951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:46717, user_credentials={real_user=slave}} blocked reactor thread for 82239us
I20260709 13:22:02.337600 26653 raft_consensus.cc:493] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.338097 25910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f217c0d15b04aa38110ee2f881fc575" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:02.338303 26653 raft_consensus.cc:515] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.338857 25910 raft_consensus.cc:3060] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.341106 26650 raft_consensus.cc:493] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.341727 26650 raft_consensus.cc:515] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.344430 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42cec7e321749d39d2184b40221df6c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:02.345124 26058 raft_consensus.cc:2468] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:22:02.346275 25950 leader_election.cc:304] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.347551 26654 raft_consensus.cc:2804] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.349474 26654 raft_consensus.cc:493] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.350711 26654 raft_consensus.cc:3060] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.352154 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:02.352074 26652 raft_consensus.cc:515] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:22:02.360948 25875 leader_election.cc:336] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.361449 25875 leader_election.cc:304] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:02.362419 26539 raft_consensus.cc:2749] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.363586 25910 raft_consensus.cc:2468] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 2.
I20260709 13:22:02.364454 26653 leader_election.cc:290] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.367494 26626 leader_election.cc:290] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.368309 26485 leader_election.cc:290] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.369155 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7cba52ce9343d1bee167ea3364a7f9" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.370043 25981 raft_consensus.cc:2393] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cb7aae2a23a47c180432cb646577fd6 in current term 2: Already voted for candidate d01fccfd609b4182a5d43a7f6b4ae503 in this term.
W20260709 13:22:02.375010 26023 leader_election.cc:336] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.378480 26485 raft_consensus.cc:493] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.369561 26650 leader_election.cc:290] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.379099 26485 raft_consensus.cc:515] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.382324 26485 leader_election.cc:290] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.385016 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:02.385313 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7cba52ce9343d1bee167ea3364a7f9" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:02.385847 26058 raft_consensus.cc:3060] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.379524 26626 raft_consensus.cc:493] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.386510 26626 raft_consensus.cc:515] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.388576 26626 leader_election.cc:290] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:02.390471 26022 leader_election.cc:304] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:02.390724 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:02.393496 26058 raft_consensus.cc:2468] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 2.
I20260709 13:22:02.394181 26634 raft_consensus.cc:2749] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.397087 25950 leader_election.cc:304] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
W20260709 13:22:02.399976 25875 leader_election.cc:336] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.401762 26611 raft_consensus.cc:2804] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.402374 26654 raft_consensus.cc:515] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.406097 26653 raft_consensus.cc:493] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.406658 26653 raft_consensus.cc:515] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.408210 26607 raft_consensus.cc:493] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.408413 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42cec7e321749d39d2184b40221df6c" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:02.409235 26058 raft_consensus.cc:3060] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.409293 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:02.408747 26607 raft_consensus.cc:515] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:02.416535 26058 raft_consensus.cc:2468] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 2.
I20260709 13:22:02.417793 25950 leader_election.cc:304] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.418612 26650 raft_consensus.cc:2804] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.419628 26653 leader_election.cc:290] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.419801 16192 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:22:02.420282 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.314s	user 0.277s	sys 0.009s
I20260709 13:22:02.416253 25951 leader_election.cc:304] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:02.421393 26652 leader_election.cc:290] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.422648 26652 raft_consensus.cc:2804] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.419082 26650 raft_consensus.cc:697] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:02.423533 26652 raft_consensus.cc:697] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:02.424132 26539 raft_consensus.cc:493] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.407873 26654 leader_election.cc:290] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.424744 26539 raft_consensus.cc:515] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.426792 26539 leader_election.cc:290] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:22:02.422968 25949 leader_election.cc:336] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.430291 25949 leader_election.cc:304] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:02.431265 26654 raft_consensus.cc:2749] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:22:02.431491 25949 leader_election.cc:336] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
W20260709 13:22:02.432343 25949 leader_election.cc:336] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.434464 26539 raft_consensus.cc:493] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.435232 26539 raft_consensus.cc:515] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
W20260709 13:22:02.437290 25875 leader_election.cc:336] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.437577 26539 leader_election.cc:290] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:02.433631 26650 consensus_queue.cc:237] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.443403 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.450739 25981 raft_consensus.cc:2468] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:22:02.444476 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.444988 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166158c4e1034da1a83f153661381868" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.446099 26634 raft_consensus.cc:493] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.447837 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:02.452466 25909 raft_consensus.cc:2468] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:22:02.453488 26634 raft_consensus.cc:515] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:02.459237 26634 leader_election.cc:290] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:22:02.461577 26023 leader_election.cc:336] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.462958 26652 consensus_queue.cc:237] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.460778 26607 leader_election.cc:290] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.468938 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.469678 26650 raft_consensus.cc:493] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.469815 25979 raft_consensus.cc:2468] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:22:02.472978 26022 leader_election.cc:304] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.474779 26542 raft_consensus.cc:2804] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.475206 26542 raft_consensus.cc:493] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.475567 26542 raft_consensus.cc:3060] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.476426 26025 leader_election.cc:304] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:02.479022 26607 raft_consensus.cc:2804] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.479672 26607 raft_consensus.cc:493] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.480177 26607 raft_consensus.cc:3060] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.481173 26611 raft_consensus.cc:697] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:02.482197 26611 consensus_queue.cc:237] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:22:02.483780 25875 leader_election.cc:336] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.478353 25874 leader_election.cc:304] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:02.492197 26539 raft_consensus.cc:2804] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.492635 26539 raft_consensus.cc:493] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.493165 26539 raft_consensus.cc:3060] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.492667 26542 raft_consensus.cc:515] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:02.497763 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:02.498409 25979 raft_consensus.cc:3060] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.502074 26539 raft_consensus.cc:515] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.506208 25979 raft_consensus.cc:2468] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 2.
I20260709 13:22:02.504119 26539 leader_election.cc:290] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:02.508620 26022 leader_election.cc:304] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.508692 26634 raft_consensus.cc:493] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.509684 26637 raft_consensus.cc:2804] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.509517 26634 raft_consensus.cc:515] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.510414 26637 raft_consensus.cc:697] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:02.511449 26637 consensus_queue.cc:237] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:02.513098 26634 leader_election.cc:290] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.492791 25874 leader_election.cc:304] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:02.517099 26542 leader_election.cc:290] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:22:02.471163 25949 leader_election.cc:336] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.517793 25949 leader_election.cc:304] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
W20260709 13:22:02.518620 25949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 47492.2us
W20260709 13:22:02.519106 25949 leader_election.cc:336] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.520207 26539 raft_consensus.cc:2749] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.521037 25874 leader_election.cc:304] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:02.523568 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:02.524281 25983 raft_consensus.cc:3060] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.523372 26650 raft_consensus.cc:515] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.523671 26588 raft_consensus.cc:2749] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.533471 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2bafd1f44402cbf2f7d5ca62a7508" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:02.534031 26058 raft_consensus.cc:2468] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:22:02.535107 25950 leader_election.cc:304] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
W20260709 13:22:02.535385 26023 leader_election.cc:336] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.537067 26611 raft_consensus.cc:493] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.539608 26611 raft_consensus.cc:515] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.537804 26485 raft_consensus.cc:2804] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.541222 26485 raft_consensus.cc:493] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.541626 26485 raft_consensus.cc:3060] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.542449 26611 leader_election.cc:290] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.544262 26648 tablet_bootstrap.cc:492] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:02.545598 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:02.536350 25983 raft_consensus.cc:2468] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:02.546468 25909 raft_consensus.cc:2468] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:22:02.550377 25951 leader_election.cc:304] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.552181 26485 raft_consensus.cc:515] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.554361 26485 leader_election.cc:290] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.549516 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2bafd1f44402cbf2f7d5ca62a7508" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.557387 25979 raft_consensus.cc:2393] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3cb7aae2a23a47c180432cb646577fd6 in current term 2: Already voted for candidate d01fccfd609b4182a5d43a7f6b4ae503 in this term.
I20260709 13:22:02.557966 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad2bafd1f44402cbf2f7d5ca62a7508" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:02.558635 26058 raft_consensus.cc:3060] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.561463 25874 leader_election.cc:304] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.562371 26588 raft_consensus.cc:2804] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.562933 26588 raft_consensus.cc:697] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:02.560487 26611 raft_consensus.cc:493] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.563876 26588 consensus_queue.cc:237] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.564667 26611 raft_consensus.cc:515] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
W20260709 13:22:02.566939 26023 leader_election.cc:336] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.567024 26611 leader_election.cc:290] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.573056 26611 raft_consensus.cc:493] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.574239 26648 tablet_bootstrap.cc:492] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:02.573912 26611 raft_consensus.cc:515] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.575210 26648 ts_tablet_manager.cc:1403] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.268s	user 0.029s	sys 0.005s
I20260709 13:22:02.576277 26611 leader_election.cc:290] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.572980 26658 raft_consensus.cc:2749] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.580041 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
W20260709 13:22:02.559175 25949 leader_election.cc:336] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.580731 25911 raft_consensus.cc:2468] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:22:02.581168 25949 leader_election.cc:304] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b
W20260709 13:22:02.580092 26023 leader_election.cc:336] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.581959 25951 leader_election.cc:304] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
W20260709 13:22:02.582090 25949 leader_election.cc:336] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.582924 26658 raft_consensus.cc:2749] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.584396 26658 raft_consensus.cc:2804] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.584801 26658 raft_consensus.cc:493] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.582050 26023 leader_election.cc:304] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:02.586638 26658 raft_consensus.cc:3060] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.587299 26057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f87eb5e589466fa0bc8c00974bdd91" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:02.588804 26057 raft_consensus.cc:2468] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:22:02.590528 25950 leader_election.cc:304] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.593160 26650 leader_election.cc:290] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.593816 26650 raft_consensus.cc:2804] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.594172 26650 raft_consensus.cc:493] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.594601 26650 raft_consensus.cc:3060] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:02.600260 25949 leader_election.cc:336] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.602499 26539 raft_consensus.cc:493] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
W20260709 13:22:02.603371 25949 leader_election.cc:336] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.603121 26539 raft_consensus.cc:515] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.603780 26658 raft_consensus.cc:515] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
W20260709 13:22:02.606134 25949 leader_election.cc:336] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
W20260709 13:22:02.606861 25949 leader_election.cc:336] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.607692 26539 leader_election.cc:290] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:02.608680 26058 raft_consensus.cc:2468] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 2.
I20260709 13:22:02.610191 26648 raft_consensus.cc:359] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.610929 26648 raft_consensus.cc:740] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.611783 26648 consensus_queue.cc:260] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.612560 26533 raft_consensus.cc:2749] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.613025 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:02.613623 25909 raft_consensus.cc:3060] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.613736 26648 ts_tablet_manager.cc:1434] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.003s
I20260709 13:22:02.614655 26648 tablet_bootstrap.cc:492] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:02.616636 26662 log.cc:927] Time spent T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:22:02.618211 25949 leader_election.cc:336] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
W20260709 13:22:02.602579 25875 leader_election.cc:336] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.605717 26652 raft_consensus.cc:2804] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.627396 26652 raft_consensus.cc:493] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.627810 26652 raft_consensus.cc:3060] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.628276 26485 raft_consensus.cc:493] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.628686 26485 raft_consensus.cc:515] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.630811 26485 leader_election.cc:290] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.631264 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.631429 26650 raft_consensus.cc:515] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.632114 25979 raft_consensus.cc:2468] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:22:02.632875 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166158c4e1034da1a83f153661381868" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:02.641355 25909 raft_consensus.cc:2468] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 2.
I20260709 13:22:02.641371 25911 raft_consensus.cc:2468] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:22:02.643126 25874 leader_election.cc:304] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.643181 25951 leader_election.cc:304] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.644098 26539 raft_consensus.cc:2804] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.644476 26539 raft_consensus.cc:493] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.644619 25951 leader_election.cc:304] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.644968 26539 raft_consensus.cc:3060] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.645594 26485 raft_consensus.cc:2804] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.619180 26658 leader_election.cc:290] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.647223 26485 raft_consensus.cc:697] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:02.647255 25950 leader_election.cc:304] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:02.649314 26485 consensus_queue.cc:237] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.650319 26654 raft_consensus.cc:2804] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.650835 26654 raft_consensus.cc:697] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:02.647135 26611 raft_consensus.cc:2804] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.653259 26611 raft_consensus.cc:493] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.653645 26611 raft_consensus.cc:3060] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.641052 26607 raft_consensus.cc:515] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:02.657522 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f87eb5e589466fa0bc8c00974bdd91" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:02.658274 26058 raft_consensus.cc:3060] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.651602 26654 consensus_queue.cc:237] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.665215 26650 leader_election.cc:290] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.662972 26539 raft_consensus.cc:515] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.667915 26058 raft_consensus.cc:2468] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 2.
W20260709 13:22:02.668344 25875 leader_election.cc:336] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.669071 25950 leader_election.cc:304] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.670130 26650 raft_consensus.cc:2804] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.670678 26650 raft_consensus.cc:697] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:02.670359 26652 raft_consensus.cc:515] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.675463 26656 raft_consensus.cc:493] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
W20260709 13:22:02.680151 25949 leader_election.cc:336] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.680470 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:02.680999 26542 raft_consensus.cc:493] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.681418 25979 raft_consensus.cc:3060] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.681522 26542 raft_consensus.cc:515] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.682487 26656 raft_consensus.cc:515] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.683490 26542 leader_election.cc:290] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.688418 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.689160 25981 raft_consensus.cc:2468] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 1.
I20260709 13:22:02.689673 26607 leader_election.cc:290] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.688560 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1821e793dcc0499d9d8a707ea4f8d0d2" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.671710 26650 consensus_queue.cc:237] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:22:02.692091 26023 leader_election.cc:336] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.692528 26023 leader_election.cc:304] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:02.692706 25874 leader_election.cc:304] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
W20260709 13:22:02.693925 25875 leader_election.cc:336] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.695596 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:02.696182 25911 raft_consensus.cc:3060] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.695607 26542 raft_consensus.cc:2749] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:02.696893 26058 raft_consensus.cc:1275] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.698344 26539 leader_election.cc:290] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:02.699594 26626 raft_consensus.cc:2804] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.684561 26656 leader_election.cc:290] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:02.700012 26626 raft_consensus.cc:493] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
W20260709 13:22:02.700304 26023 leader_election.cc:336] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
W20260709 13:22:02.701225 25949 leader_election.cc:336] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.700471 26626 raft_consensus.cc:3060] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:02.711243 25875 leader_election.cc:336] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.712285 26652 leader_election.cc:290] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.713770 26658 raft_consensus.cc:493] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.714877 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50052343bec74747b699a16e53a348b6" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:02.717964 25909 raft_consensus.cc:3060] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.716478 25911 raft_consensus.cc:2468] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 2.
W20260709 13:22:02.720719 25949 leader_election.cc:336] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.721158 26656 consensus_queue.cc:1048] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:22:02.737471 26637 raft_consensus.cc:493] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.727248 26658 raft_consensus.cc:515] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.750497 25979 raft_consensus.cc:2468] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:02.751538 26025 leader_election.cc:304] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:02.758155 26607 raft_consensus.cc:2804] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.758687 26607 raft_consensus.cc:697] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:02.759567 26607 consensus_queue.cc:237] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:02.770023 25909 raft_consensus.cc:2468] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 2.
I20260709 13:22:02.776407 25951 leader_election.cc:304] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
W20260709 13:22:02.782721 25876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 75903.7us
I20260709 13:22:02.788205 26653 raft_consensus.cc:2804] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.764729 26637 raft_consensus.cc:515] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.801461 26653 raft_consensus.cc:697] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:02.802399 26653 consensus_queue.cc:237] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
W20260709 13:22:02.802762 25949 leader_election.cc:336] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.797855 26626 raft_consensus.cc:515] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.809374 26637 leader_election.cc:290] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.810076 26626 leader_election.cc:290] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:22:02.818272 25875 leader_election.cc:336] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.819774 26658 leader_election.cc:290] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.824034 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1821e793dcc0499d9d8a707ea4f8d0d2" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:02.826447 26058 raft_consensus.cc:2468] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 1.
I20260709 13:22:02.826303 26611 raft_consensus.cc:515] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:02.825698 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:02.827621 25979 raft_consensus.cc:2468] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 1.
I20260709 13:22:02.829880 26611 leader_election.cc:290] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Requested vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:02.830860 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166158c4e1034da1a83f153661381868" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:02.830996 26022 leader_election.cc:304] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.831576 25907 raft_consensus.cc:3060] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.831990 26637 raft_consensus.cc:2804] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.832535 26637 raft_consensus.cc:493] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.833056 26637 raft_consensus.cc:3060] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.829988 25950 leader_election.cc:304] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
W20260709 13:22:02.835698 25876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 44079.6us
I20260709 13:22:02.836817 26658 raft_consensus.cc:2804] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:02.838879 26658 raft_consensus.cc:493] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:02.839258 26658 raft_consensus.cc:3060] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.840916 25730 catalog_manager.cc:5697] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.841717 25731 catalog_manager.cc:5697] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.842509 25730 catalog_manager.cc:5697] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.843884 25730 catalog_manager.cc:5697] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:02.849397 26023 leader_election.cc:336] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
W20260709 13:22:02.853479 25949 leader_election.cc:336] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.857280 25730 catalog_manager.cc:5697] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.861650 25730 catalog_manager.cc:5697] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.835960 25733 catalog_manager.cc:5697] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.873255 25907 raft_consensus.cc:2468] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 2.
I20260709 13:22:02.874711 25951 leader_election.cc:304] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:02.863775 25730 catalog_manager.cc:5697] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.875849 26652 raft_consensus.cc:2804] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.878715 26652 raft_consensus.cc:697] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:02.879594 26652 consensus_queue.cc:237] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
W20260709 13:22:02.883287 25875 consensus_peers.cc:597] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:02.884196 26658 raft_consensus.cc:515] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.899685 26057 raft_consensus.cc:1275] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer d01fccfd609b4182a5d43a7f6b4ae503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.903262 26650 consensus_queue.cc:1048] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:02.889024 25949 leader_election.cc:336] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
W20260709 13:22:02.927601 26023 consensus_peers.cc:597] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:02.930150 25949 consensus_peers.cc:597] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:02.936491 26648 tablet_bootstrap.cc:492] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:22:02.949640 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 165528us
I20260709 13:22:02.949958 25730 catalog_manager.cc:5697] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.951975 25730 catalog_manager.cc:5697] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.959805 26648 tablet_bootstrap.cc:492] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:02.960703 26648 ts_tablet_manager.cc:1403] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.346s	user 0.024s	sys 0.005s
I20260709 13:22:02.964531 26637 raft_consensus.cc:515] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:02.959798 25733 catalog_manager.cc:5697] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.968688 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:02.969415 25979 raft_consensus.cc:3060] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:02.973204 26023 leader_election.cc:336] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:02.974072 26059 raft_consensus.cc:1275] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer d01fccfd609b4182a5d43a7f6b4ae503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.975152 26637 leader_election.cc:290] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.977690 25979 raft_consensus.cc:2468] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:02.981586 25983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df82fd13f8664091b9b38e193d84780b" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:02.982220 25983 raft_consensus.cc:3060] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.983608 26658 leader_election.cc:290] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:02.984094 26648 raft_consensus.cc:359] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
W20260709 13:22:02.984735 25949 consensus_peers.cc:597] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:02.984961 26648 raft_consensus.cc:740] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
W20260709 13:22:02.985451 25949 consensus_peers.cc:597] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:02.985667 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1821e793dcc0499d9d8a707ea4f8d0d2" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:02.986220 26058 raft_consensus.cc:3060] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.985796 26648 consensus_queue.cc:260] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:02.990540 26648 ts_tablet_manager.cc:1434] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:22:02.991403 26648 tablet_bootstrap.cc:492] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:02.991227 26653 consensus_queue.cc:1048] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:02.992769 25983 raft_consensus.cc:2468] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 2.
I20260709 13:22:03.002110 26058 raft_consensus.cc:2468] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01fccfd609b4182a5d43a7f6b4ae503 in term 2.
I20260709 13:22:03.002401 26022 leader_election.cc:304] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:03.005098 25874 leader_election.cc:304] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:03.006572 25950 leader_election.cc:304] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:03.007098 25874 leader_election.cc:304] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:03.008260 26626 raft_consensus.cc:2804] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:03.008790 26626 raft_consensus.cc:697] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:03.020488 26626 consensus_queue.cc:237] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:03.030488 26653 raft_consensus.cc:2804] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:03.039141 26653 raft_consensus.cc:697] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Becoming Leader. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:03.040081 26653 consensus_queue.cc:237] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:22:03.043700 25949 leader_election.cc:336] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
I20260709 13:22:03.012802 26637 raft_consensus.cc:2804] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:03.062621 26684 raft_consensus.cc:2804] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:03.082868 25983 raft_consensus.cc:1275] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 3cb7aae2a23a47c180432cb646577fd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.085168 26542 consensus_queue.cc:1048] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:03.076299 26637 raft_consensus.cc:697] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:03.087486 26684 raft_consensus.cc:697] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:03.225395 25909 raft_consensus.cc:1275] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer d01fccfd609b4182a5d43a7f6b4ae503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:22:03.222549 26688 log.cc:927] Time spent T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:22:03.252624 26658 consensus_queue.cc:1048] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:03.253212 26684 consensus_queue.cc:237] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
W20260709 13:22:03.254948 26683 log.cc:927] Time spent T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:22:03.275010 25951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:46717, user_credentials={real_user=slave}} blocked reactor thread for 47376.3us
I20260709 13:22:03.256983 26637 consensus_queue.cc:237] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
W20260709 13:22:03.291376 25874 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 226088us
I20260709 13:22:03.293445 25979 raft_consensus.cc:1275] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:22:03.311827 25875 consensus_peers.cc:597] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:03.324456 25730 catalog_manager.cc:5697] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:03.324476 25731 catalog_manager.cc:5697] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:03.360086 25909 raft_consensus.cc:1275] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer d01fccfd609b4182a5d43a7f6b4ae503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.392169 26485 consensus_queue.cc:1048] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:03.393142 25909 raft_consensus.cc:1275] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer d01fccfd609b4182a5d43a7f6b4ae503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.406528 26653 consensus_queue.cc:1048] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:03.445595 26059 raft_consensus.cc:1275] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer d01fccfd609b4182a5d43a7f6b4ae503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.451339 25911 raft_consensus.cc:1275] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer 3cb7aae2a23a47c180432cb646577fd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.456496 26654 consensus_queue.cc:1048] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:03.458807 25730 catalog_manager.cc:5697] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 2 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:03.456545 26648 tablet_bootstrap.cc:492] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:03.461206 26648 tablet_bootstrap.cc:492] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:03.462080 26648 ts_tablet_manager.cc:1403] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.471s	user 0.029s	sys 0.016s
I20260709 13:22:03.466686 26588 consensus_queue.cc:1048] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:03.469154 26023 consensus_peers.cc:597] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:03.468470 26648 raft_consensus.cc:359] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:03.475656 26648 raft_consensus.cc:740] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.476447 26648 consensus_queue.cc:260] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:03.481647 26056 raft_consensus.cc:1275] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer d01fccfd609b4182a5d43a7f6b4ae503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.482980 26648 ts_tablet_manager.cc:1434] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:22:03.487491 26648 tablet_bootstrap.cc:492] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:03.500357 26701 consensus_queue.cc:1048] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:03.506006 26023 consensus_peers.cc:597] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.521378 25875 consensus_peers.cc:597] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:03.517748 25903 raft_consensus.cc:1275] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer d01fccfd609b4182a5d43a7f6b4ae503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.539732 26717 consensus_queue.cc:1048] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:03.548167 26653 consensus_queue.cc:1048] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:22:03.584395 25730 catalog_manager.cc:5697] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 8e453645ce774c99b4b4aafb4362719b (127.15.208.1) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:03.622359 25949 consensus_peers.cc:597] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.623054 25949 consensus_peers.cc:597] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.623605 25949 consensus_peers.cc:597] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.624119 25949 consensus_peers.cc:597] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.638882 26023 consensus_peers.cc:597] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:03.642863 26058 raft_consensus.cc:1275] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer d01fccfd609b4182a5d43a7f6b4ae503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:22:03.646629 25949 consensus_peers.cc:597] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:03.651320 26654 consensus_queue.cc:1048] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:22:03.655757 25980 raft_consensus.cc:1275] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.661964 26626 consensus_queue.cc:1048] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:03.666908 26648 tablet_bootstrap.cc:492] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:03.667969 26648 tablet_bootstrap.cc:492] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:03.668594 26648 ts_tablet_manager.cc:1403] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.181s	user 0.016s	sys 0.004s
W20260709 13:22:03.676149 25875 consensus_peers.cc:597] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.720306 25949 consensus_peers.cc:597] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.720984 25949 consensus_peers.cc:597] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.734118 26023 consensus_peers.cc:597] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.737040 25875 consensus_peers.cc:597] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.746376 25875 consensus_peers.cc:597] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.754683 26023 consensus_peers.cc:597] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.755220 26023 consensus_peers.cc:597] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.780826 26023 consensus_peers.cc:597] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:03.798439 26648 raft_consensus.cc:359] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:03.802865 26648 raft_consensus.cc:740] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.800016 25982 raft_consensus.cc:1275] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 3cb7aae2a23a47c180432cb646577fd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:22:03.813562 25949 consensus_peers.cc:597] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:03.814985 26651 raft_consensus.cc:493] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:03.815587 26651 raft_consensus.cc:515] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:03.818564 26666 consensus_queue.cc:1048] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:03.822471 26651 leader_election.cc:290] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:03.823391 26651 raft_consensus.cc:493] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:03.825817 26651 raft_consensus.cc:515] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:03.831418 26648 consensus_queue.cc:260] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:03.847203 26648 ts_tablet_manager.cc:1434] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.176s	user 0.005s	sys 0.024s
I20260709 13:22:03.848313 26648 tablet_bootstrap.cc:492] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:03.871206 25875 consensus_peers.cc:597] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:03.885179 25983 raft_consensus.cc:1275] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.886925 26539 consensus_queue.cc:1048] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:03.908577 26651 leader_election.cc:290] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
W20260709 13:22:03.927621 25949 consensus_peers.cc:597] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.930874 26023 consensus_peers.cc:597] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.940081 26023 consensus_peers.cc:597] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.940627 26023 consensus_peers.cc:597] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.962522 26023 consensus_peers.cc:597] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.963056 26023 consensus_peers.cc:597] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.982712 26023 consensus_peers.cc:597] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.984100 26023 consensus_peers.cc:597] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:03.984964 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:03.986399 25982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
W20260709 13:22:03.987413 25875 consensus_peers.cc:597] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.988629 25949 consensus_peers.cc:597] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.995556 25949 consensus_peers.cc:597] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:03.999794 25875 consensus_peers.cc:597] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:04.014038 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:04.016052 25909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:04.017729 26645 leader_election.cc:304] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:04.019127 26651 raft_consensus.cc:2749] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:04.027272 26645 leader_election.cc:304] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:04.028692 26651 raft_consensus.cc:2749] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:22:04.045807 25949 consensus_peers.cc:597] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:04.073211 26648 tablet_bootstrap.cc:492] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:04.076200 26648 tablet_bootstrap.cc:492] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:04.077135 26648 ts_tablet_manager.cc:1403] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.229s	user 0.019s	sys 0.009s
I20260709 13:22:04.085080 26648 raft_consensus.cc:359] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:04.087548 26648 raft_consensus.cc:740] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
W20260709 13:22:04.087893 25875 consensus_peers.cc:597] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:04.088853 26648 consensus_queue.cc:260] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:04.095561 26648 ts_tablet_manager.cc:1434] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:22:04.097077 26648 tablet_bootstrap.cc:492] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:04.130504 26648 tablet_bootstrap.cc:492] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:04.131822 26648 tablet_bootstrap.cc:492] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:04.136377 26648 ts_tablet_manager.cc:1403] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.007s
I20260709 13:22:04.141469 26648 raft_consensus.cc:359] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:04.142452 26648 raft_consensus.cc:740] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:04.143342 26648 consensus_queue.cc:260] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:04.146183 26648 ts_tablet_manager.cc:1434] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:04.147524 26648 tablet_bootstrap.cc:492] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:04.181536 25875 consensus_peers.cc:597] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:04.181650 25949 consensus_peers.cc:597] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:04.191473 26648 tablet_bootstrap.cc:492] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:04.208372 26648 tablet_bootstrap.cc:492] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:04.209136 26648 ts_tablet_manager.cc:1403] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.010s
W20260709 13:22:04.210067 25949 consensus_peers.cc:597] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:04.213577 26648 raft_consensus.cc:359] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:04.214411 26648 raft_consensus.cc:740] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:04.215343 26648 consensus_queue.cc:260] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:04.217878 26648 ts_tablet_manager.cc:1434] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:22:04.218827 26648 tablet_bootstrap.cc:492] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:04.353998 26648 tablet_bootstrap.cc:492] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:04.355039 26648 tablet_bootstrap.cc:492] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:04.355868 26648 ts_tablet_manager.cc:1403] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.137s	user 0.017s	sys 0.015s
I20260709 13:22:04.362568 26648 raft_consensus.cc:359] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:04.363377 26648 raft_consensus.cc:740] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:04.370002 26648 consensus_queue.cc:260] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:04.384565 26648 ts_tablet_manager.cc:1434] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 13:22:04.390043 26648 tablet_bootstrap.cc:492] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:04.458106 25950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 47033.5us
W20260709 13:22:04.503532 25949 consensus_peers.cc:597] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:04.518369 25875 consensus_peers.cc:597] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:04.551760 26648 tablet_bootstrap.cc:492] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:04.554862 26648 tablet_bootstrap.cc:492] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:04.555747 26648 ts_tablet_manager.cc:1403] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.166s	user 0.017s	sys 0.009s
I20260709 13:22:04.585922 26648 raft_consensus.cc:359] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:04.590802 26648 raft_consensus.cc:740] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:04.593088 26648 consensus_queue.cc:260] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:04.595088 26648 ts_tablet_manager.cc:1434] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:22:04.595894 26648 tablet_bootstrap.cc:492] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:04.630264 26651 raft_consensus.cc:493] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:04.630944 26651 raft_consensus.cc:515] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:04.642452 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:04.638859 26651 leader_election.cc:290] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:04.654331 26648 tablet_bootstrap.cc:492] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:04.668823 26648 tablet_bootstrap.cc:492] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:04.669659 26648 ts_tablet_manager.cc:1403] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.021s
I20260709 13:22:04.693341 26648 raft_consensus.cc:359] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:04.694228 26648 raft_consensus.cc:740] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:04.698983 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:04.701844 26644 leader_election.cc:304] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:22:04.701534 26648 consensus_queue.cc:260] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:04.704993 26651 raft_consensus.cc:2749] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:04.707868 26648 ts_tablet_manager.cc:1434] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 13:22:04.710718 26648 tablet_bootstrap.cc:492] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:04.774840 26648 tablet_bootstrap.cc:492] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:04.777200 26648 tablet_bootstrap.cc:492] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:04.779986 26648 ts_tablet_manager.cc:1403] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.071s	user 0.027s	sys 0.009s
I20260709 13:22:04.784520 26648 raft_consensus.cc:359] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:04.785470 26648 raft_consensus.cc:740] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:04.790259 26648 consensus_queue.cc:260] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:04.794761 26648 ts_tablet_manager.cc:1434] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:22:04.796799 26648 tablet_bootstrap.cc:492] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:04.817342 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.1:34819
I20260709 13:22:04.817818 26800 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.1:34819 every 8 connection(s)
I20260709 13:22:04.836683 26648 tablet_bootstrap.cc:492] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:04.837800 26648 tablet_bootstrap.cc:492] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:04.838467 26648 ts_tablet_manager.cc:1403] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.021s
I20260709 13:22:04.841224 26648 raft_consensus.cc:359] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:04.841930 26648 raft_consensus.cc:740] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:04.842808 26648 consensus_queue.cc:260] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:04.845171 26648 ts_tablet_manager.cc:1434] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:22:04.846009 26648 tablet_bootstrap.cc:492] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:04.872952 26762 raft_consensus.cc:3060] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.914691 26648 tablet_bootstrap.cc:492] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:04.915822 26648 tablet_bootstrap.cc:492] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:04.916586 26648 ts_tablet_manager.cc:1403] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.010s
I20260709 13:22:04.930750 26648 raft_consensus.cc:359] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:04.937150 26648 raft_consensus.cc:740] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:04.940452 26648 consensus_queue.cc:260] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:04.954881 26648 ts_tablet_manager.cc:1434] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:22:04.963694 26759 raft_consensus.cc:3060] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.977716 26648 tablet_bootstrap.cc:492] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.041549 26648 tablet_bootstrap.cc:492] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.045408 26648 tablet_bootstrap.cc:492] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.046190 26648 ts_tablet_manager.cc:1403] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.069s	user 0.026s	sys 0.006s
I20260709 13:22:05.048398 26648 raft_consensus.cc:359] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.049203 26648 raft_consensus.cc:740] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.050755 26651 raft_consensus.cc:493] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:05.051003 26648 consensus_queue.cc:260] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.051327 26651 raft_consensus.cc:515] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:05.055400 26651 leader_election.cc:290] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:05.055588 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb960d6f3ef4634a29335330aa1c58c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:05.055663 26055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb960d6f3ef4634a29335330aa1c58c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:05.057175 26648 ts_tablet_manager.cc:1434] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:22:05.057948 26648 tablet_bootstrap.cc:492] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.060093 26644 leader_election.cc:304] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:05.061955 26651 raft_consensus.cc:2749] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:05.084694 26804 heartbeater.cc:344] Connected to a master server at 127.15.208.62:41075
I20260709 13:22:05.085220 26804 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:05.086171 26804 heartbeater.cc:507] Master 127.15.208.62:41075 requested a full tablet report, sending...
I20260709 13:22:05.110203 25733 ts_manager.cc:194] Re-registered known tserver with Master: 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:05.111800 26648 tablet_bootstrap.cc:492] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.113040 26648 tablet_bootstrap.cc:492] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.113834 26648 ts_tablet_manager.cc:1403] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.006s
I20260709 13:22:05.116722 26648 raft_consensus.cc:359] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.117587 26648 raft_consensus.cc:740] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.118377 26648 consensus_queue.cc:260] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.120910 26648 ts_tablet_manager.cc:1434] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:05.121764 26648 tablet_bootstrap.cc:492] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.163002 26648 tablet_bootstrap.cc:492] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.164069 26648 tablet_bootstrap.cc:492] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.164786 26648 ts_tablet_manager.cc:1403] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.015s
I20260709 13:22:05.167676 26648 raft_consensus.cc:359] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.168483 26648 raft_consensus.cc:740] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.169284 26648 consensus_queue.cc:260] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.171797 26648 ts_tablet_manager.cc:1434] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:05.172680 26648 tablet_bootstrap.cc:492] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.195016 26648 tablet_bootstrap.cc:492] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.196013 26648 tablet_bootstrap.cc:492] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.196822 26648 ts_tablet_manager.cc:1403] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:22:05.200186 26648 raft_consensus.cc:359] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:05.200906 26648 raft_consensus.cc:740] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.201620 26648 consensus_queue.cc:260] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:05.203310 26648 ts_tablet_manager.cc:1434] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.002s
I20260709 13:22:05.203456 25733 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36118
I20260709 13:22:05.204253 26648 tablet_bootstrap.cc:492] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.209303 26804 heartbeater.cc:499] Master 127.15.208.62:41075 was elected leader, sending a full tablet report...
I20260709 13:22:05.257094 26648 tablet_bootstrap.cc:492] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.258262 26648 tablet_bootstrap.cc:492] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.259109 26648 ts_tablet_manager.cc:1403] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.008s
I20260709 13:22:05.261945 26648 raft_consensus.cc:359] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.262740 26648 raft_consensus.cc:740] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.263662 26648 consensus_queue.cc:260] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.267506 26648 ts_tablet_manager.cc:1434] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:22:05.268476 26648 tablet_bootstrap.cc:492] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:05.293741 25876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 59980.6us
I20260709 13:22:05.295980 26648 tablet_bootstrap.cc:492] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.298108 26648 tablet_bootstrap.cc:492] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.301306 26648 ts_tablet_manager.cc:1403] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.009s
I20260709 13:22:05.304647 26648 raft_consensus.cc:359] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.305377 26648 raft_consensus.cc:740] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.306030 26648 consensus_queue.cc:260] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.308158 26648 ts_tablet_manager.cc:1434] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:22:05.309162 26648 tablet_bootstrap.cc:492] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.328358 26648 tablet_bootstrap.cc:492] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.329489 26648 tablet_bootstrap.cc:492] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.330300 26648 ts_tablet_manager.cc:1403] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:22:05.333273 26648 raft_consensus.cc:359] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.334348 26648 raft_consensus.cc:740] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.335326 26648 consensus_queue.cc:260] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.337929 26648 ts_tablet_manager.cc:1434] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:22:05.338861 26648 tablet_bootstrap.cc:492] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.357930 26648 tablet_bootstrap.cc:492] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.359030 26648 tablet_bootstrap.cc:492] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.359830 26648 ts_tablet_manager.cc:1403] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:22:05.363113 26648 raft_consensus.cc:359] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:05.363886 26648 raft_consensus.cc:740] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.364686 26648 consensus_queue.cc:260] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:05.367098 26648 ts_tablet_manager.cc:1434] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:05.367410 26762 raft_consensus.cc:3060] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.369978 26648 tablet_bootstrap.cc:492] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.376754 26759 raft_consensus.cc:3060] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:05.432408 25949 consensus_peers.cc:597] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:05.447189 26648 tablet_bootstrap.cc:492] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.448313 26648 tablet_bootstrap.cc:492] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.449131 26648 ts_tablet_manager.cc:1403] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.079s	user 0.029s	sys 0.027s
I20260709 13:22:05.452001 26648 raft_consensus.cc:359] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.452879 26648 raft_consensus.cc:740] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.454123 26648 consensus_queue.cc:260] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.456358 26648 ts_tablet_manager.cc:1434] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:22:05.465669 26648 tablet_bootstrap.cc:492] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.528431 26762 raft_consensus.cc:3060] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:05.536214 25949 consensus_peers.cc:597] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.559192 25875 consensus_peers.cc:597] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:05.623859 26648 tablet_bootstrap.cc:492] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.631532 26648 tablet_bootstrap.cc:492] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.632517 26648 ts_tablet_manager.cc:1403] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.167s	user 0.048s	sys 0.061s
I20260709 13:22:05.671569 26648 raft_consensus.cc:359] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.674728 26648 raft_consensus.cc:740] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.675760 26648 consensus_queue.cc:260] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.681689 26648 ts_tablet_manager.cc:1434] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:22:05.682600 26648 tablet_bootstrap.cc:492] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:05.712510 25949 consensus_peers.cc:597] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.719040 25949 consensus_peers.cc:597] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.740356 25875 consensus_peers.cc:597] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.746591 26023 consensus_peers.cc:597] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:05.754194 26648 tablet_bootstrap.cc:492] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.755101 26648 tablet_bootstrap.cc:492] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.755685 26648 ts_tablet_manager.cc:1403] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.015s
I20260709 13:22:05.757869 26648 raft_consensus.cc:359] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:05.758538 26648 raft_consensus.cc:740] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.759245 26648 consensus_queue.cc:260] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:05.761515 26648 ts_tablet_manager.cc:1434] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:22:05.762789 26648 tablet_bootstrap.cc:492] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:05.776325 25949 consensus_peers.cc:597] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:05.799161 26648 tablet_bootstrap.cc:492] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.800343 26648 tablet_bootstrap.cc:492] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.801127 26648 ts_tablet_manager.cc:1403] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.008s
I20260709 13:22:05.803074 26648 raft_consensus.cc:359] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.803655 26648 raft_consensus.cc:740] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.804311 26648 consensus_queue.cc:260] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.806406 26648 ts_tablet_manager.cc:1434] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:05.807700 26648 tablet_bootstrap.cc:492] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.823889 26758 raft_consensus.cc:3060] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.830760 26648 tablet_bootstrap.cc:492] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.831900 26648 tablet_bootstrap.cc:492] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.832592 26648 ts_tablet_manager.cc:1403] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:22:05.835382 26648 raft_consensus.cc:359] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:05.836113 26648 raft_consensus.cc:740] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.836836 26648 consensus_queue.cc:260] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:05.839049 26648 ts_tablet_manager.cc:1434] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:05.839921 26648 tablet_bootstrap.cc:492] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.874785 26648 tablet_bootstrap.cc:492] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.875777 26648 tablet_bootstrap.cc:492] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.876439 26648 ts_tablet_manager.cc:1403] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.005s
I20260709 13:22:05.878840 26648 raft_consensus.cc:359] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.879514 26648 raft_consensus.cc:740] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.880147 26648 consensus_queue.cc:260] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:05.883478 26648 ts_tablet_manager.cc:1434] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:05.884903 26648 tablet_bootstrap.cc:492] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.905855 26648 tablet_bootstrap.cc:492] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.906842 26648 tablet_bootstrap.cc:492] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.907519 26648 ts_tablet_manager.cc:1403] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:22:05.910081 26648 raft_consensus.cc:359] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.910730 26648 raft_consensus.cc:740] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.912312 26648 consensus_queue.cc:260] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.915442 26648 ts_tablet_manager.cc:1434] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:05.916261 26648 tablet_bootstrap.cc:492] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:05.925827 26023 consensus_peers.cc:597] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:05.933620 26648 tablet_bootstrap.cc:492] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.934618 26648 tablet_bootstrap.cc:492] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.935268 26648 ts_tablet_manager.cc:1403] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:22:05.938019 26648 raft_consensus.cc:359] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.938688 26648 raft_consensus.cc:740] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.939358 26648 consensus_queue.cc:260] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.941668 26648 ts_tablet_manager.cc:1434] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:22:05.942673 26648 tablet_bootstrap.cc:492] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:05.968502 26648 tablet_bootstrap.cc:492] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:05.969388 26648 tablet_bootstrap.cc:492] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:05.970031 26648 ts_tablet_manager.cc:1403] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.008s
I20260709 13:22:05.972354 26648 raft_consensus.cc:359] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.973047 26648 raft_consensus.cc:740] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:05.973786 26648 consensus_queue.cc:260] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:05.974272 26758 raft_consensus.cc:3060] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.976176 26648 ts_tablet_manager.cc:1434] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:05.977260 26648 tablet_bootstrap.cc:492] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:06.010389 26648 tablet_bootstrap.cc:492] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.011409 26648 tablet_bootstrap.cc:492] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.012171 26648 ts_tablet_manager.cc:1403] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.011s
I20260709 13:22:06.014853 26648 raft_consensus.cc:359] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.015548 26648 raft_consensus.cc:740] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.016215 26648 consensus_queue.cc:260] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.017836 26648 ts_tablet_manager.cc:1434] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:06.019279 26648 tablet_bootstrap.cc:492] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:06.040979 26648 tablet_bootstrap.cc:492] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.042013 26648 tablet_bootstrap.cc:492] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.042621 26648 ts_tablet_manager.cc:1403] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:22:06.044680 26648 raft_consensus.cc:359] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:06.045337 26648 raft_consensus.cc:740] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.046103 26648 consensus_queue.cc:260] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:06.048146 26648 ts_tablet_manager.cc:1434] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:22:06.053617 26648 tablet_bootstrap.cc:492] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:06.080490 25875 consensus_peers.cc:597] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:06.085829 26648 tablet_bootstrap.cc:492] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.087024 26648 tablet_bootstrap.cc:492] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.087779 26648 ts_tablet_manager.cc:1403] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.019s
I20260709 13:22:06.090647 26648 raft_consensus.cc:359] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:06.091403 26648 raft_consensus.cc:740] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.092132 26648 consensus_queue.cc:260] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:06.094278 26648 ts_tablet_manager.cc:1434] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:06.104434 26648 tablet_bootstrap.cc:492] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:06.134443 26648 tablet_bootstrap.cc:492] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.136046 26648 tablet_bootstrap.cc:492] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.136826 26648 ts_tablet_manager.cc:1403] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.012s
I20260709 13:22:06.142187 26648 raft_consensus.cc:359] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:06.143030 26648 raft_consensus.cc:740] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.143870 26648 consensus_queue.cc:260] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:06.146588 26648 ts_tablet_manager.cc:1434] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:22:06.152516 26648 tablet_bootstrap.cc:492] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:06.155048 26758 raft_consensus.cc:3060] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.178290 26762 raft_consensus.cc:3060] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.219404 26648 tablet_bootstrap.cc:492] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.220824 26648 tablet_bootstrap.cc:492] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.221616 26648 ts_tablet_manager.cc:1403] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.020s
I20260709 13:22:06.224516 26648 raft_consensus.cc:359] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:06.225333 26648 raft_consensus.cc:740] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.226100 26648 consensus_queue.cc:260] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:06.239396 26648 ts_tablet_manager.cc:1434] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:22:06.240379 26648 tablet_bootstrap.cc:492] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:06.257892 26648 tablet_bootstrap.cc:492] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.258973 26648 tablet_bootstrap.cc:492] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.259756 26648 ts_tablet_manager.cc:1403] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:22:06.261478 26758 raft_consensus.cc:3060] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.262786 26648 raft_consensus.cc:359] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:06.263546 26648 raft_consensus.cc:740] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.264498 26648 consensus_queue.cc:260] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:06.266866 26648 ts_tablet_manager.cc:1434] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:06.267709 26648 tablet_bootstrap.cc:492] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:06.290197 26648 tablet_bootstrap.cc:492] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.291472 26648 tablet_bootstrap.cc:492] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.292156 26648 ts_tablet_manager.cc:1403] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 13:22:06.295434 26763 raft_consensus.cc:3060] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.297372 26648 raft_consensus.cc:359] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.298106 26648 raft_consensus.cc:740] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.298942 26648 consensus_queue.cc:260] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.300499 26648 ts_tablet_manager.cc:1434] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:22:06.301328 26648 tablet_bootstrap.cc:492] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:06.321668 26648 tablet_bootstrap.cc:492] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.322700 26648 tablet_bootstrap.cc:492] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.323776 26648 ts_tablet_manager.cc:1403] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.001s
I20260709 13:22:06.327275 26648 raft_consensus.cc:359] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:06.328035 26648 raft_consensus.cc:740] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.328663 26648 consensus_queue.cc:260] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:06.334877 26648 ts_tablet_manager.cc:1434] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:06.335949 26648 tablet_bootstrap.cc:492] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:06.334733 26023 consensus_peers.cc:597] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:06.374821 26648 tablet_bootstrap.cc:492] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.375989 26648 tablet_bootstrap.cc:492] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.376711 26648 ts_tablet_manager.cc:1403] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.000s
I20260709 13:22:06.379722 26648 raft_consensus.cc:359] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.380448 26648 raft_consensus.cc:740] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.381173 26648 consensus_queue.cc:260] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.383735 26648 ts_tablet_manager.cc:1434] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:06.384830 26648 tablet_bootstrap.cc:492] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:06.407625 26648 tablet_bootstrap.cc:492] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.408692 26648 tablet_bootstrap.cc:492] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.409544 26648 ts_tablet_manager.cc:1403] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 13:22:06.412290 26648 raft_consensus.cc:359] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:06.412985 26648 raft_consensus.cc:740] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.413676 26648 consensus_queue.cc:260] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:06.415768 26648 ts_tablet_manager.cc:1434] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:22:06.416641 26648 tablet_bootstrap.cc:492] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:06.454238 26648 tablet_bootstrap.cc:492] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.455265 26648 tablet_bootstrap.cc:492] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.455989 26648 ts_tablet_manager.cc:1403] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.000s
I20260709 13:22:06.458824 26648 raft_consensus.cc:359] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.459573 26648 raft_consensus.cc:740] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.460294 26648 consensus_queue.cc:260] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.462565 26648 ts_tablet_manager.cc:1434] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:06.463436 26648 tablet_bootstrap.cc:492] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
I20260709 13:22:06.479053 26648 tablet_bootstrap.cc:492] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.479990 26648 tablet_bootstrap.cc:492] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.480701 26648 ts_tablet_manager.cc:1403] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:22:06.483358 26648 raft_consensus.cc:359] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.484035 26648 raft_consensus.cc:740] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.484787 26648 consensus_queue.cc:260] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.487087 26648 ts_tablet_manager.cc:1434] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:06.488279 26648 tablet_bootstrap.cc:492] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:06.491000 25875 consensus_peers.cc:597] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:06.511353 26763 raft_consensus.cc:3060] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.546249 26648 tablet_bootstrap.cc:492] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.547021 26762 raft_consensus.cc:3060] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.547856 26648 tablet_bootstrap.cc:492] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.549196 26648 ts_tablet_manager.cc:1403] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.017s
I20260709 13:22:06.553964 26648 raft_consensus.cc:359] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.555191 26648 raft_consensus.cc:740] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.556066 26648 consensus_queue.cc:260] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:06.559094 26648 ts_tablet_manager.cc:1434] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:22:06.560534 26648 tablet_bootstrap.cc:492] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: Bootstrap starting.
W20260709 13:22:06.582975 26023 consensus_peers.cc:597] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:06.614686 25950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 100927us
I20260709 13:22:06.647972 26758 raft_consensus.cc:3060] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.662400 26648 tablet_bootstrap.cc:492] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:06.663609 26648 tablet_bootstrap.cc:492] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: Bootstrap complete.
I20260709 13:22:06.664382 26648 ts_tablet_manager.cc:1403] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.034s
I20260709 13:22:06.665416 26762 raft_consensus.cc:3060] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.667428 26648 raft_consensus.cc:359] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:06.668216 26648 raft_consensus.cc:740] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.669070 26648 consensus_queue.cc:260] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:06.671485 26648 ts_tablet_manager.cc:1434] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:07.187713 26758 raft_consensus.cc:3060] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:10.192939 25949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 61479.6us
W20260709 13:22:10.192790 25950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 63212.9us
W20260709 13:22:10.856055 25765 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1460 after lost signal to thread 16195
W20260709 13:22:10.857218 25765 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2ec0 after lost signal to thread 25768
W20260709 13:22:10.858346 25765 debug-util.cc:398] Leaking SignalData structure 0x7b08000467a0 after lost signal to thread 25935
W20260709 13:22:10.859274 25765 debug-util.cc:398] Leaking SignalData structure 0x7b080004bf40 after lost signal to thread 26009
W20260709 13:22:10.860253 25765 debug-util.cc:398] Leaking SignalData structure 0x7b080032b1a0 after lost signal to thread 26083
W20260709 13:22:10.861413 25765 debug-util.cc:398] Leaking SignalData structure 0x7b0800104e40 after lost signal to thread 26800
I20260709 13:22:12.426959 26900 raft_consensus.cc:493] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cb7aae2a23a47c180432cb646577fd6)
I20260709 13:22:12.428083 26900 raft_consensus.cc:515] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:12.497972 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
W20260709 13:22:12.520689 26022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:43721, user_credentials={real_user=slave}} blocked reactor thread for 79124.5us
I20260709 13:22:12.524264 26058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:12.483163 26900 leader_election.cc:290] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:12.547058 26912 raft_consensus.cc:493] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dbc14fa82f4a22b1cab8f3691196de)
I20260709 13:22:12.548028 26912 raft_consensus.cc:515] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:12.550930 26912 leader_election.cc:290] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:12.559643 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:12.581347 26916 raft_consensus.cc:493] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dbc14fa82f4a22b1cab8f3691196de)
I20260709 13:22:12.581323 26915 raft_consensus.cc:493] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dbc14fa82f4a22b1cab8f3691196de)
I20260709 13:22:12.582186 26916 raft_consensus.cc:515] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:12.583304 26915 raft_consensus.cc:515] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:12.586185 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f46a3b3a20d4dcbb895c0b6bba0a6c6" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:12.608665 25950 leader_election.cc:304] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:22:12.610097 26911 raft_consensus.cc:2749] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:22:12.628562 25876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 49003.4us
W20260709 13:22:12.629731 26025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:46717, user_credentials={real_user=slave}} blocked reactor thread for 107750us
I20260709 13:22:12.642373 26919 raft_consensus.cc:493] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dbc14fa82f4a22b1cab8f3691196de)
I20260709 13:22:12.646230 26895 raft_consensus.cc:493] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dbc14fa82f4a22b1cab8f3691196de)
I20260709 13:22:12.653342 26919 raft_consensus.cc:515] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:12.653427 26895 raft_consensus.cc:515] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:12.656268 26895 leader_election.cc:290] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:12.657289 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:12.645669 26761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e40f11ff0b4d47bda6cd2c01a752e8" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e453645ce774c99b4b4aafb4362719b" is_pre_election: true
I20260709 13:22:12.658100 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec9041a9b841bb91cd06da0192130e" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:12.664098 26918 raft_consensus.cc:493] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d01fccfd609b4182a5d43a7f6b4ae503)
I20260709 13:22:12.664387 26915 leader_election.cc:290] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:12.664984 26918 raft_consensus.cc:515] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:12.665977 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:12.666879 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ec9041a9b841bb91cd06da0192130e" candidate_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:12.656600 26919 leader_election.cc:290] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:12.669796 26918 leader_election.cc:290] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:12.669672 26915 raft_consensus.cc:493] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dbc14fa82f4a22b1cab8f3691196de)
I20260709 13:22:12.670172 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04360fb80eea42d7960ef5c2e4858275" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cb7aae2a23a47c180432cb646577fd6" is_pre_election: true
I20260709 13:22:12.666816 26916 leader_election.cc:290] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:12.670172 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04360fb80eea42d7960ef5c2e4858275" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:12.671514 25950 leader_election.cc:304] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:22:12.670903 26915 raft_consensus.cc:515] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:12.672576 26895 raft_consensus.cc:2749] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:12.674015 26642 leader_election.cc:304] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:12.674192 26915 leader_election.cc:290] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:12.674894 26915 raft_consensus.cc:2749] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:12.676612 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" is_pre_election: true
I20260709 13:22:12.688654 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f46a3b3a20d4dcbb895c0b6bba0a6c6" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:12.688717 25949 leader_election.cc:304] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d01fccfd609b4182a5d43a7f6b4ae503; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:12.689162 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:12.690130 26911 raft_consensus.cc:2749] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:12.693645 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011e0b4473294a54a4e5b968a1bee812" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:12.694032 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de" is_pre_election: true
I20260709 13:22:12.694912 26645 leader_election.cc:304] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:22:12.696211 26645 leader_election.cc:304] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:12.697032 26916 raft_consensus.cc:2749] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:12.696398 26920 raft_consensus.cc:2749] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:12.697992 26645 leader_election.cc:304] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:22:12.698868 26920 raft_consensus.cc:2749] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:12.701339 26645 leader_election.cc:304] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b; no voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:12.702139 26920 raft_consensus.cc:2749] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:22:13.052999 25765 debug-util.cc:398] Leaking SignalData structure 0x7b0800315540 after lost signal to thread 16195
W20260709 13:22:13.054059 25765 debug-util.cc:398] Leaking SignalData structure 0x7b08001bc200 after lost signal to thread 25768
W20260709 13:22:13.055119 25765 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7d40 after lost signal to thread 25935
W20260709 13:22:13.056046 25765 debug-util.cc:398] Leaking SignalData structure 0x7b080007f920 after lost signal to thread 26009
W20260709 13:22:13.057025 25765 debug-util.cc:398] Leaking SignalData structure 0x7b0800121b80 after lost signal to thread 26083
W20260709 13:22:13.057960 25765 debug-util.cc:398] Leaking SignalData structure 0x7b0800316180 after lost signal to thread 26800
W20260709 13:22:13.058306 25765 debug-util.cc:398] Leaking SignalData structure 0x7b080018d740 after lost signal to thread 26893
I20260709 13:22:14.964139 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:15.019002 26054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "244656e8e9b646c48e9b5b92ed53ba51"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:15.019690 26054 raft_consensus.cc:606] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:15.022214 26054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71b7bc1778ac476b9576cf48b4353789"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:15.022734 26054 raft_consensus.cc:606] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Received request to transfer leadership to TS 00dbc14fa82f4a22b1cab8f3691196de
I20260709 13:22:15.035218 26917 raft_consensus.cc:993] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:15.035773 26906 raft_consensus.cc:1081] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Signalling peer 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:15.037464 25906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71b7bc1778ac476b9576cf48b4353789"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:51544
I20260709 13:22:15.038264 25906 raft_consensus.cc:493] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.038697 25906 raft_consensus.cc:3060] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.039330 25911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:45380
I20260709 13:22:15.039983 25911 raft_consensus.cc:606] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:15.047801 25906 raft_consensus.cc:515] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:15.050879 25906 leader_election.cc:290] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:15.051088 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b7bc1778ac476b9576cf48b4353789" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:15.051824 25984 raft_consensus.cc:3060] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.053994 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b7bc1778ac476b9576cf48b4353789" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:15.054628 26054 raft_consensus.cc:3055] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:15.054962 26054 raft_consensus.cc:740] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:15.055900 26054 consensus_queue.cc:260] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:15.057336 26054 raft_consensus.cc:3060] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.059198 25984 raft_consensus.cc:2468] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:15.060941 25874 leader_election.cc:304] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:15.061959 26880 raft_consensus.cc:2804] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:15.062456 26880 raft_consensus.cc:697] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:15.063460 26880 consensus_queue.cc:237] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:15.068922 25985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e56b5dacf8443239fe2cd7fcc3286bb"
dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:42416
I20260709 13:22:15.069569 25985 raft_consensus.cc:606] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:15.069891 26054 raft_consensus.cc:2468] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:15.079623 26056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f82b9479b4249b9b78a11bf5c355ddf"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:15.080252 26056 raft_consensus.cc:606] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:15.085891 25731 catalog_manager.cc:5697] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:15.101891 26054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:15.102531 26054 raft_consensus.cc:606] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:15.103735 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:22:15.105849 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:15.307940 26917 raft_consensus.cc:993] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:15.308630 26906 raft_consensus.cc:1081] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:15.310382 26761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f82b9479b4249b9b78a11bf5c355ddf"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60910
I20260709 13:22:15.311050 26761 raft_consensus.cc:493] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.311410 26761 raft_consensus.cc:3060] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.317917 26761 raft_consensus.cc:515] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:15.320075 26761 leader_election.cc:290] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:15.320761 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f82b9479b4249b9b78a11bf5c355ddf" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:15.321239 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f82b9479b4249b9b78a11bf5c355ddf" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:15.321473 26054 raft_consensus.cc:3055] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:15.321848 25906 raft_consensus.cc:3060] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.321976 26054 raft_consensus.cc:740] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:15.322850 26054 consensus_queue.cc:260] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:15.323943 26054 raft_consensus.cc:3060] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.328353 25906 raft_consensus.cc:2468] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:15.329962 26054 raft_consensus.cc:2468] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:15.330668 26645 leader_election.cc:304] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:22:15.333230 26935 raft_consensus.cc:2804] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:15.333662 26930 raft_consensus.cc:993] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:15.334178 26930 raft_consensus.cc:1081] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:15.335109 26935 raft_consensus.cc:697] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:15.336140 26761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60898
I20260709 13:22:15.336850 26761 raft_consensus.cc:493] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.336395 26935 consensus_queue.cc:237] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:15.337301 26761 raft_consensus.cc:3060] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:15.345268 26761 raft_consensus.cc:515] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:15.350093 26761 leader_election.cc:290] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:15.350591 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:15.351219 25984 raft_consensus.cc:3060] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:15.351670 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fcb34b2da1456c9b298616cda786a4" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:15.352308 25911 raft_consensus.cc:3055] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:15.352592 25911 raft_consensus.cc:740] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:15.353353 25911 consensus_queue.cc:260] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:15.354606 25911 raft_consensus.cc:3060] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:15.365959 25911 raft_consensus.cc:2468] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 3.
I20260709 13:22:15.366297 25731 catalog_manager.cc:5697] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 1 to 2, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 2 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:15.367559 26645 leader_election.cc:304] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:22:15.368311 25984 raft_consensus.cc:2468] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 3.
I20260709 13:22:15.368568 26935 raft_consensus.cc:2804] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:15.369307 26935 raft_consensus.cc:697] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 3 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:15.370350 26935 consensus_queue.cc:237] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:15.392107 25731 catalog_manager.cc:5697] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 2 to 3, leader changed from 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 3 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:15.416424 26926 raft_consensus.cc:993] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:15.417094 26917 raft_consensus.cc:1081] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:15.418740 26761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60910
I20260709 13:22:15.420032 26761 raft_consensus.cc:493] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.420467 26761 raft_consensus.cc:3060] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:15.426502 26761 raft_consensus.cc:515] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:15.428268 26761 leader_election.cc:290] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:15.429193 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:15.429361 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b633a2406cc3422abe7f6adda14a8386" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:15.429814 25984 raft_consensus.cc:3060] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:15.429979 26054 raft_consensus.cc:3055] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:15.430478 26054 raft_consensus.cc:740] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:15.431321 26054 consensus_queue.cc:260] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:15.432482 26054 raft_consensus.cc:3060] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:15.435811 25984 raft_consensus.cc:2468] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 3.
I20260709 13:22:15.436993 26642 leader_election.cc:304] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:15.437796 26935 raft_consensus.cc:2804] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:15.438357 26935 raft_consensus.cc:697] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 3 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:15.439268 26935 consensus_queue.cc:237] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:15.439673 26054 raft_consensus.cc:2468] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 3.
I20260709 13:22:15.448197 26906 raft_consensus.cc:993] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:15.448953 26926 raft_consensus.cc:1081] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:15.450659 26755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "244656e8e9b646c48e9b5b92ed53ba51"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60910
I20260709 13:22:15.451192 26755 raft_consensus.cc:493] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.451575 26755 raft_consensus.cc:3060] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.458343 25731 catalog_manager.cc:5697] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 2 to 3, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 3 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:15.462556 26755 raft_consensus.cc:515] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:15.464790 26755 leader_election.cc:290] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:15.465389 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244656e8e9b646c48e9b5b92ed53ba51" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:15.466049 26054 raft_consensus.cc:3055] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:15.466358 26054 raft_consensus.cc:740] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:15.466264 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244656e8e9b646c48e9b5b92ed53ba51" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:15.467656 26054 consensus_queue.cc:260] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:15.468442 25906 raft_consensus.cc:3060] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.469055 26054 raft_consensus.cc:3060] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.474905 26056 raft_consensus.cc:1275] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.480937 25906 raft_consensus.cc:2468] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:15.481523 26930 consensus_queue.cc:1048] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.482954 26645 leader_election.cc:304] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:22:15.486490 26054 raft_consensus.cc:2468] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:15.491535 26935 raft_consensus.cc:2804] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:15.492187 26935 raft_consensus.cc:697] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:15.495055 26911 raft_consensus.cc:993] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:15.495829 26935 consensus_queue.cc:237] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:15.496680 26940 raft_consensus.cc:1081] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:15.498862 26755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e56b5dacf8443239fe2cd7fcc3286bb"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60924
I20260709 13:22:15.499461 26755 raft_consensus.cc:493] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.499972 26755 raft_consensus.cc:3060] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.508739 26755 raft_consensus.cc:515] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:15.513516 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e56b5dacf8443239fe2cd7fcc3286bb" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:15.514219 26054 raft_consensus.cc:3060] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.516047 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e56b5dacf8443239fe2cd7fcc3286bb" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:15.516219 26755 leader_election.cc:290] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:15.516757 25977 raft_consensus.cc:3055] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:15.519937 25977 raft_consensus.cc:740] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:15.520860 25977 consensus_queue.cc:260] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:15.522481 25977 raft_consensus.cc:3060] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.535912 26054 raft_consensus.cc:2468] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:15.537343 26644 leader_election.cc:304] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:22:15.538380 26936 raft_consensus.cc:2804] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:15.538522 25730 catalog_manager.cc:5697] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 1 to 2, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 2 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:15.551297 26936 raft_consensus.cc:697] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:15.552481 26936 consensus_queue.cc:237] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:15.559705 25984 raft_consensus.cc:1275] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.568286 26930 consensus_queue.cc:1048] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:15.569923 25730 catalog_manager.cc:5697] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 1 to 2, leader changed from d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 2 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:15.571432 25977 raft_consensus.cc:2468] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:15.788918 26056 raft_consensus.cc:1275] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.789640 25906 raft_consensus.cc:1275] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.790311 26935 consensus_queue.cc:1048] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.791790 26935 consensus_queue.cc:1048] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.845306 25984 raft_consensus.cc:1275] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:15.846585 26935 consensus_queue.cc:1048] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:15.857805 25911 raft_consensus.cc:1275] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:15.859898 26949 consensus_queue.cc:1048] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:15.862651 26056 raft_consensus.cc:1275] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:15.863961 26949 consensus_queue.cc:1048] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:15.878890 25984 raft_consensus.cc:1275] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:15.881642 26935 consensus_queue.cc:1048] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:16.031436 26054 raft_consensus.cc:1275] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.032857 26949 consensus_queue.cc:1048] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:16.045209 25911 raft_consensus.cc:1275] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.047348 26936 consensus_queue.cc:1048] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:16.107038 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:16.118155 26054 raft_consensus.cc:1275] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.120093 26936 consensus_queue.cc:1048] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:16.130821 25977 raft_consensus.cc:1275] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.132632 26935 consensus_queue.cc:1048] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:16.166813 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:16.204509 26054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:16.205152 26054 raft_consensus.cc:606] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Received request to transfer leadership to TS 00dbc14fa82f4a22b1cab8f3691196de
I20260709 13:22:16.207463 26054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf0142f8c8d4e7e9a4edc4e88bb184c"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:16.207916 26054 raft_consensus.cc:606] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Received request to transfer leadership to TS 00dbc14fa82f4a22b1cab8f3691196de
I20260709 13:22:16.209980 26054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:16.210409 26054 raft_consensus.cc:606] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:16.212597 25911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:45380
I20260709 13:22:16.213173 25911 raft_consensus.cc:606] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:16.215694 26054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:16.216250 26054 raft_consensus.cc:606] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Received request to transfer leadership to TS 00dbc14fa82f4a22b1cab8f3691196de
I20260709 13:22:16.218644 25977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343"
dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:42416
I20260709 13:22:16.219260 25977 raft_consensus.cc:606] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:16.220587 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:22:16.222518 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:16.227416 26962 raft_consensus.cc:993] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:16.228089 26941 raft_consensus.cc:1081] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Signalling peer 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:16.229692 25911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:51544
I20260709 13:22:16.230469 25911 raft_consensus.cc:493] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.230840 25911 raft_consensus.cc:3060] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.235808 25911 raft_consensus.cc:515] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:16.237403 25911 leader_election.cc:290] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:16.238178 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:16.238415 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:16.238843 25977 raft_consensus.cc:3060] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.239027 26054 raft_consensus.cc:3055] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.239444 26054 raft_consensus.cc:740] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:16.240163 26054 consensus_queue.cc:260] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:16.241487 26054 raft_consensus.cc:3060] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.245338 25977 raft_consensus.cc:2468] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:16.249794 25874 leader_election.cc:304] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:16.250077 26054 raft_consensus.cc:2468] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:16.250707 26951 raft_consensus.cc:2804] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.251191 26951 raft_consensus.cc:697] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:16.252022 26951 consensus_queue.cc:237] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:16.265839 25733 catalog_manager.cc:5697] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.530598 26951 raft_consensus.cc:993] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:16.531030 26930 raft_consensus.cc:1081] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:16.532449 26763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60898
I20260709 13:22:16.532931 26763 raft_consensus.cc:493] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.533197 26763 raft_consensus.cc:3060] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.538156 26763 raft_consensus.cc:515] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:16.539601 26763 leader_election.cc:290] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:16.540688 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:16.540827 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5cee043c4a449188a031808c1da79e" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:16.541426 25984 raft_consensus.cc:3060] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.541505 25906 raft_consensus.cc:3055] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:16.541908 25906 raft_consensus.cc:740] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:16.542750 25906 consensus_queue.cc:260] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:16.544052 25906 raft_consensus.cc:3060] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.548529 25984 raft_consensus.cc:2468] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 3.
I20260709 13:22:16.549751 26642 leader_election.cc:304] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:16.550635 26949 raft_consensus.cc:2804] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:16.551090 26949 raft_consensus.cc:697] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 3 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:16.551961 26949 consensus_queue.cc:237] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:16.552493 25906 raft_consensus.cc:2468] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 3.
I20260709 13:22:16.563584 25733 catalog_manager.cc:5697] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 2 to 3, leader changed from 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 3 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.571770 26940 raft_consensus.cc:993] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:16.572263 26911 raft_consensus.cc:1081] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:16.573709 26763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60924
I20260709 13:22:16.574252 26763 raft_consensus.cc:493] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.574373 26941 raft_consensus.cc:993] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:16.574589 26763 raft_consensus.cc:3060] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.575347 26962 raft_consensus.cc:1081] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Signalling peer 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:16.576963 25911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bf0142f8c8d4e7e9a4edc4e88bb184c"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:51544
I20260709 13:22:16.577445 25911 raft_consensus.cc:493] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.577805 25911 raft_consensus.cc:3060] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.582511 26763 raft_consensus.cc:515] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:16.584614 26763 leader_election.cc:290] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:16.584367 25911 raft_consensus.cc:515] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:16.585492 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:16.585543 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fd2c216d4f4c11b81198c731099343" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:16.586213 25906 raft_consensus.cc:3060] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.587185 25911 leader_election.cc:290] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:16.587373 25984 raft_consensus.cc:3055] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:16.588194 25984 raft_consensus.cc:740] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:16.587205 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf0142f8c8d4e7e9a4edc4e88bb184c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:16.588631 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf0142f8c8d4e7e9a4edc4e88bb184c" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:16.588852 25977 raft_consensus.cc:3060] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.589248 26056 raft_consensus.cc:3055] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.589129 25984 consensus_queue.cc:260] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:16.589612 26056 raft_consensus.cc:740] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:16.590457 26056 consensus_queue.cc:260] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:16.591704 26056 raft_consensus.cc:3060] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.599144 26962 raft_consensus.cc:993] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:16.599716 26962 raft_consensus.cc:1081] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:16.600889 25984 raft_consensus.cc:3060] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:16.601275 25977 raft_consensus.cc:2468] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:16.601336 26763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60910
I20260709 13:22:16.603165 26763 raft_consensus.cc:493] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.603516 26763 raft_consensus.cc:3060] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.606621 26056 raft_consensus.cc:2468] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:16.606925 25906 raft_consensus.cc:2468] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 3.
I20260709 13:22:16.607904 25876 leader_election.cc:304] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:22:16.608256 26645 leader_election.cc:304] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:22:16.608779 26951 raft_consensus.cc:2804] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.609229 26949 raft_consensus.cc:2804] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:16.609306 26951 raft_consensus.cc:697] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:16.609791 26949 raft_consensus.cc:697] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 3 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:16.611007 26949 consensus_queue.cc:237] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:16.610944 26951 consensus_queue.cc:237] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:16.613400 26763 raft_consensus.cc:515] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:16.617686 26763 leader_election.cc:290] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:16.618016 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:16.618682 26056 raft_consensus.cc:3055] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.618995 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5422aebfcb69407490575715e7e6cd18" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:16.619205 26056 raft_consensus.cc:740] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:16.619637 25906 raft_consensus.cc:3060] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.620580 26056 consensus_queue.cc:260] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:16.628551 25906 raft_consensus.cc:2468] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:16.631294 26056 raft_consensus.cc:3060] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.631736 26645 leader_election.cc:304] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:22:16.633885 25733 catalog_manager.cc:5697] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 2 to 3, leader changed from d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 3 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.629940 25984 raft_consensus.cc:2468] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 3.
I20260709 13:22:16.638476 26949 raft_consensus.cc:2804] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.639047 26949 raft_consensus.cc:697] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:16.638406 25730 catalog_manager.cc:5697] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.639829 26949 consensus_queue.cc:237] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:16.640657 26056 raft_consensus.cc:2468] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:16.654857 26972 raft_consensus.cc:993] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:16.655332 26972 raft_consensus.cc:1081] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Signalling peer 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:16.656755 25911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:51544
I20260709 13:22:16.657330 25911 raft_consensus.cc:493] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.657672 25911 raft_consensus.cc:3060] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.662202 25730 catalog_manager.cc:5697] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 1 to 2, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 2 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.662878 25911 raft_consensus.cc:515] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:16.665460 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:16.666018 25984 raft_consensus.cc:3060] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.667798 25911 leader_election.cc:290] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:16.668366 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000a2e7a3f5d41cfa0490dc7b23be634" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:16.669006 26056 raft_consensus.cc:3055] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.669329 26056 raft_consensus.cc:740] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:16.670050 26056 consensus_queue.cc:260] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:16.671307 26056 raft_consensus.cc:3060] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.672502 25984 raft_consensus.cc:2468] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:16.674167 25874 leader_election.cc:304] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:16.674865 26951 raft_consensus.cc:2804] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.675298 26951 raft_consensus.cc:697] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:16.676112 26951 consensus_queue.cc:237] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:16.676548 26056 raft_consensus.cc:2468] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:16.686815 25730 catalog_manager.cc:5697] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.797212 26056 raft_consensus.cc:1275] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.798418 26951 consensus_queue.cc:1048] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:16.808271 25984 raft_consensus.cc:1275] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.810039 26979 consensus_queue.cc:1048] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.001168 25984 raft_consensus.cc:1275] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:17.002534 26936 consensus_queue.cc:1048] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:17.007292 25977 raft_consensus.cc:1275] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.010226 26951 consensus_queue.cc:1048] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.049978 26056 raft_consensus.cc:1275] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.052721 26951 consensus_queue.cc:1048] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.107118 25906 raft_consensus.cc:1275] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:17.115530 25980 raft_consensus.cc:1275] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:17.127070 26949 consensus_queue.cc:1048] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:17.130213 26949 consensus_queue.cc:1048] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:22:17.140612 25876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.4:35175, user_credentials={real_user=slave}} blocked reactor thread for 78524.4us
I20260709 13:22:17.157030 25906 raft_consensus.cc:1275] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:17.158357 26949 consensus_queue.cc:1048] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:17.166631 25911 raft_consensus.cc:1275] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.169415 26935 consensus_queue.cc:1048] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.182557 26056 raft_consensus.cc:1275] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.183857 26936 consensus_queue.cc:1048] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.216645 25980 raft_consensus.cc:1275] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.218047 26930 consensus_queue.cc:1048] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.223574 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:17.231464 26056 raft_consensus.cc:1275] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.237104 26930 consensus_queue.cc:1048] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.279633 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:17.321801 25906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0262be24b803413883f14155c6e4c640"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:45380
I20260709 13:22:17.322474 25906 raft_consensus.cc:606] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:17.325115 25906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:45380
I20260709 13:22:17.325735 25906 raft_consensus.cc:606] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:17.328037 26056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:17.328583 26056 raft_consensus.cc:606] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Received request to transfer leadership to TS 00dbc14fa82f4a22b1cab8f3691196de
I20260709 13:22:17.331453 25906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
mode: GRACEFUL
new_leader_uuid: "3cb7aae2a23a47c180432cb646577fd6"
 from {username='slave'} at 127.0.0.1:45380
I20260709 13:22:17.331955 25906 raft_consensus.cc:606] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Received request to transfer leadership to TS 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:22:17.334561 25980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e56d8e51e0714bcfac360118807d6e0f"
dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:42416
I20260709 13:22:17.335114 25980 raft_consensus.cc:606] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:17.336660 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:22:17.338212 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:17.468928 26988 raft_consensus.cc:993] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:17.469563 26930 raft_consensus.cc:1081] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:17.473450 26759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60898
I20260709 13:22:17.473999 26759 raft_consensus.cc:493] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.474324 26759 raft_consensus.cc:3060] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.479624 26759 raft_consensus.cc:515] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:17.481498 26759 leader_election.cc:290] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:17.482496 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:17.482506 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9336cac5990e43cbab1b688c336b02bd" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:17.483151 25980 raft_consensus.cc:3060] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.483268 25906 raft_consensus.cc:3055] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.483654 25906 raft_consensus.cc:740] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:17.484477 25906 consensus_queue.cc:260] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:17.485420 25906 raft_consensus.cc:3060] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.489470 25980 raft_consensus.cc:2468] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:17.490887 26642 leader_election.cc:304] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:17.491349 25906 raft_consensus.cc:2468] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:17.492801 26936 raft_consensus.cc:2804] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.493359 26936 raft_consensus.cc:697] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:17.494127 26936 consensus_queue.cc:237] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:17.507874 25733 catalog_manager.cc:5697] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 1 to 2, leader changed from 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 2 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.576277 26930 raft_consensus.cc:993] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:17.576762 26988 raft_consensus.cc:1081] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:17.578244 26759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0262be24b803413883f14155c6e4c640"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60898
I20260709 13:22:17.578703 26759 raft_consensus.cc:493] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.579036 26759 raft_consensus.cc:3060] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.584528 26759 raft_consensus.cc:515] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:17.586540 26759 leader_election.cc:290] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:17.587009 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:17.587038 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0262be24b803413883f14155c6e4c640" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:17.587698 25911 raft_consensus.cc:3055] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.587869 25977 raft_consensus.cc:3060] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.588074 25911 raft_consensus.cc:740] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:17.589125 25911 consensus_queue.cc:260] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:17.590512 25911 raft_consensus.cc:3060] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.594687 25977 raft_consensus.cc:2468] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:17.596570 26642 leader_election.cc:304] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:17.597450 26936 raft_consensus.cc:2804] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.598001 26936 raft_consensus.cc:697] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:17.599040 26936 consensus_queue.cc:237] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:17.599563 25911 raft_consensus.cc:2468] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:17.608418 26940 raft_consensus.cc:993] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:17.609064 26940 raft_consensus.cc:1081] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:17.615110 26763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e56d8e51e0714bcfac360118807d6e0f"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60924
I20260709 13:22:17.615960 26763 raft_consensus.cc:493] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.616593 26763 raft_consensus.cc:3060] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.621470 25733 catalog_manager.cc:5697] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 1 to 2, leader changed from 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 2 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.629853 26763 raft_consensus.cc:515] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:17.633653 26763 leader_election.cc:290] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:17.634433 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56d8e51e0714bcfac360118807d6e0f" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:17.635066 25980 raft_consensus.cc:3055] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.635375 25980 raft_consensus.cc:740] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:17.636117 25980 consensus_queue.cc:260] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:17.637243 25980 raft_consensus.cc:3060] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.639652 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56d8e51e0714bcfac360118807d6e0f" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:17.640276 26054 raft_consensus.cc:3060] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.646382 26987 raft_consensus.cc:993] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de: : Instructing follower 3cb7aae2a23a47c180432cb646577fd6 to start an election
I20260709 13:22:17.646935 26987 raft_consensus.cc:1081] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Signalling peer 3cb7aae2a23a47c180432cb646577fd6 to start an election
I20260709 13:22:17.648236 26972 raft_consensus.cc:993] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:17.650490 26941 raft_consensus.cc:1081] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Signalling peer 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:17.658773 26056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
 from {username='slave'} at 127.0.0.1:44550
I20260709 13:22:17.659580 26056 raft_consensus.cc:493] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.659960 26056 raft_consensus.cc:3060] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.672281 26056 raft_consensus.cc:515] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:17.673719 25904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:51544
I20260709 13:22:17.675642 25904 raft_consensus.cc:493] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.676126 25904 raft_consensus.cc:3060] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.677452 26056 leader_election.cc:290] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:17.678058 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:17.678345 25980 raft_consensus.cc:2468] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:17.678668 25984 raft_consensus.cc:3060] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.680792 26642 leader_election.cc:304] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:17.681721 26936 raft_consensus.cc:2804] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.682253 26936 raft_consensus.cc:697] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:17.682467 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d150b2f01c6a49f284817b4f031c89de" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:17.683115 25911 raft_consensus.cc:3055] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:17.683682 25911 raft_consensus.cc:740] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:17.684564 25911 consensus_queue.cc:260] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:17.683203 26936 consensus_queue.cc:237] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:17.685896 25911 raft_consensus.cc:3060] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:17.687122 25984 raft_consensus.cc:2468] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 3.
I20260709 13:22:17.688393 26022 leader_election.cc:304] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:17.690145 27001 raft_consensus.cc:2804] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:17.691154 27001 raft_consensus.cc:697] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 3 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:17.692077 27001 consensus_queue.cc:237] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:17.695056 25904 raft_consensus.cc:515] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:17.697796 25904 leader_election.cc:290] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:17.698173 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:17.698778 26056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:17.699375 26056 raft_consensus.cc:3055] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.699692 26056 raft_consensus.cc:740] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:17.698778 25980 raft_consensus.cc:3060] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.700563 26056 consensus_queue.cc:260] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:17.701628 26056 raft_consensus.cc:3060] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.705571 26054 raft_consensus.cc:2468] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:17.707773 25980 raft_consensus.cc:2468] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:17.710282 26056 raft_consensus.cc:2468] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:17.714519 25984 raft_consensus.cc:1240] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Rejecting Update request from peer 3cb7aae2a23a47c180432cb646577fd6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:17.715579 25876 leader_election.cc:304] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 3cb7aae2a23a47c180432cb646577fd6; no voters: 
I20260709 13:22:17.716741 26930 raft_consensus.cc:2804] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.713847 25911 raft_consensus.cc:2468] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 3.
I20260709 13:22:17.717372 26930 raft_consensus.cc:697] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:17.718457 26930 consensus_queue.cc:237] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:17.720705 25730 catalog_manager.cc:5697] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 1 to 2, leader changed from d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 2 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:17.722805 25733 catalog_manager.cc:5697] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 2 to 3, leader changed from 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2) to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 3 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:17.741056 25733 catalog_manager.cc:5697] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.977988 25911 raft_consensus.cc:1275] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.979206 26936 consensus_queue.cc:1048] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.988736 25984 raft_consensus.cc:1275] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.990208 26935 consensus_queue.cc:1048] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.013648 25911 raft_consensus.cc:1275] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.015177 26949 consensus_queue.cc:1048] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.015599 25980 raft_consensus.cc:1275] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.016981 26949 consensus_queue.cc:1048] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.083581 26054 raft_consensus.cc:1275] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.084828 26935 consensus_queue.cc:1048] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.091708 25911 raft_consensus.cc:1275] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Refusing update from remote peer 3cb7aae2a23a47c180432cb646577fd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:18.093055 27001 consensus_queue.cc:1048] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:18.095304 25984 raft_consensus.cc:1275] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.096750 26935 consensus_queue.cc:1048] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.114004 26054 raft_consensus.cc:1275] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.115728 26930 consensus_queue.cc:1048] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.157567 25984 raft_consensus.cc:1275] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Refusing update from remote peer 3cb7aae2a23a47c180432cb646577fd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:18.159137 26972 consensus_queue.cc:1048] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:18.171990 25980 raft_consensus.cc:1275] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.177938 26988 consensus_queue.cc:1048] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.339143 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:18.378485 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:18.418483 25911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:45380
I20260709 13:22:18.419138 25911 raft_consensus.cc:606] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:18.421634 25984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23"
dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:42416
I20260709 13:22:18.422101 25984 raft_consensus.cc:606] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:18.424500 26054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:18.425050 26054 raft_consensus.cc:606] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Received request to transfer leadership to TS 00dbc14fa82f4a22b1cab8f3691196de
I20260709 13:22:18.426378 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:18.428085 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:18.434995 26940 raft_consensus.cc:993] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:18.436079 26940 raft_consensus.cc:1081] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:18.437551 26759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60924
I20260709 13:22:18.438122 26759 raft_consensus.cc:493] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.438405 26759 raft_consensus.cc:3060] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.444074 26759 raft_consensus.cc:515] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:18.445785 26759 leader_election.cc:290] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:18.446267 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:18.446887 25911 raft_consensus.cc:3060] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.447011 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f86ad3167cc43d48b4c3c06d197cd23" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:18.447599 25980 raft_consensus.cc:3055] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:18.447871 25980 raft_consensus.cc:740] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d01fccfd609b4182a5d43a7f6b4ae503, State: Running, Role: LEADER
I20260709 13:22:18.448648 25980 consensus_queue.cc:260] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:18.449826 25980 raft_consensus.cc:3060] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.453511 25911 raft_consensus.cc:2468] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:18.454687 26645 leader_election.cc:304] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:22:18.455395 26936 raft_consensus.cc:2804] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:18.455859 26936 raft_consensus.cc:697] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:18.456728 26936 consensus_queue.cc:237] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:18.458113 25980 raft_consensus.cc:2468] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:18.466430 25733 catalog_manager.cc:5697] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 1 to 2, leader changed from d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 2 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.491245 26930 raft_consensus.cc:993] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:18.491714 26930 raft_consensus.cc:1081] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:18.493254 26763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60898
I20260709 13:22:18.493783 26763 raft_consensus.cc:493] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.494076 26763 raft_consensus.cc:3060] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.499194 26763 raft_consensus.cc:515] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:18.500959 26763 leader_election.cc:290] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:18.501729 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:18.501864 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5469483e48bf4675b18b42b3279e8f4c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:18.502352 25911 raft_consensus.cc:3055] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:18.502398 25980 raft_consensus.cc:3060] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.502739 25911 raft_consensus.cc:740] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:18.503429 25911 consensus_queue.cc:260] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:18.504495 25911 raft_consensus.cc:3060] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.507110 25980 raft_consensus.cc:2468] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:18.508280 26642 leader_election.cc:304] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:18.509073 25911 raft_consensus.cc:2468] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 2.
I20260709 13:22:18.509160 26936 raft_consensus.cc:2804] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:18.509744 26936 raft_consensus.cc:697] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:18.510864 26936 consensus_queue.cc:237] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } }
I20260709 13:22:18.520294 25733 catalog_manager.cc:5697] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 1 to 2, leader changed from 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 2 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.561404 26972 raft_consensus.cc:993] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:18.561940 27002 raft_consensus.cc:1081] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Signalling peer 00dbc14fa82f4a22b1cab8f3691196de to start an election
I20260709 13:22:18.563397 25911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
 from {username='slave'} at 127.0.0.1:51544
I20260709 13:22:18.563817 25911 raft_consensus.cc:493] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.564045 25911 raft_consensus.cc:3060] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.570436 25911 raft_consensus.cc:515] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:18.573312 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:18.573876 25984 raft_consensus.cc:3060] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.573879 25911 leader_election.cc:290] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Requested vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175)
I20260709 13:22:18.574882 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a91a957dc23746599c956ea9b45f3fba" candidate_uuid: "00dbc14fa82f4a22b1cab8f3691196de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:18.575479 26054 raft_consensus.cc:3055] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:18.575736 26054 raft_consensus.cc:740] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:18.576393 26054 consensus_queue.cc:260] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:18.577319 26054 raft_consensus.cc:3060] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.579423 25984 raft_consensus.cc:2468] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:18.580535 25874 leader_election.cc:304] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:18.581262 26930 raft_consensus.cc:2804] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:18.581724 26930 raft_consensus.cc:697] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Leader. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:18.582533 26930 consensus_queue.cc:237] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:18.583084 26054 raft_consensus.cc:2468] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dbc14fa82f4a22b1cab8f3691196de in term 2.
I20260709 13:22:18.595659 25730 catalog_manager.cc:5697] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de reported cstate change: term changed from 1 to 2, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2). New cstate: current_term: 2 leader_uuid: "00dbc14fa82f4a22b1cab8f3691196de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.905048 25984 raft_consensus.cc:1275] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.906477 26935 consensus_queue.cc:1048] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.918566 25911 raft_consensus.cc:1275] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.920179 27012 consensus_queue.cc:1048] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:18.941555 25984 raft_consensus.cc:1275] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.943213 27012 consensus_queue.cc:1048] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.969079 25911 raft_consensus.cc:1275] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.971155 27012 consensus_queue.cc:1048] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:19.057624 26056 raft_consensus.cc:1275] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:19.059185 26987 consensus_queue.cc:1048] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:19.077215 25984 raft_consensus.cc:1275] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Refusing update from remote peer 00dbc14fa82f4a22b1cab8f3691196de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:19.078616 27028 consensus_queue.cc:1048] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:19.429404 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:19.502295 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:19.546378 25906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4"
dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
mode: GRACEFUL
new_leader_uuid: "3cb7aae2a23a47c180432cb646577fd6"
 from {username='slave'} at 127.0.0.1:45380
I20260709 13:22:19.547026 25906 raft_consensus.cc:606] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Received request to transfer leadership to TS 3cb7aae2a23a47c180432cb646577fd6
I20260709 13:22:19.548422 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:22:19.549964 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:20.134095 26930 raft_consensus.cc:993] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de: : Instructing follower 3cb7aae2a23a47c180432cb646577fd6 to start an election
I20260709 13:22:20.134764 26988 raft_consensus.cc:1081] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Signalling peer 3cb7aae2a23a47c180432cb646577fd6 to start an election
I20260709 13:22:20.136353 26054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
 from {username='slave'} at 127.0.0.1:44550
I20260709 13:22:20.136786 26054 raft_consensus.cc:493] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:20.137073 26054 raft_consensus.cc:3060] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:20.144450 26054 raft_consensus.cc:515] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:20.147692 25984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d01fccfd609b4182a5d43a7f6b4ae503"
I20260709 13:22:20.148473 25984 raft_consensus.cc:3060] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:20.147635 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c42a92a5a0247a499aa3493980d57f4" candidate_uuid: "3cb7aae2a23a47c180432cb646577fd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:20.149184 25911 raft_consensus.cc:3055] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:20.149533 25911 raft_consensus.cc:740] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dbc14fa82f4a22b1cab8f3691196de, State: Running, Role: LEADER
I20260709 13:22:20.150426 25911 consensus_queue.cc:260] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:20.151686 25911 raft_consensus.cc:3060] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:20.156397 25984 raft_consensus.cc:2468] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 3.
I20260709 13:22:20.157382 26054 leader_election.cc:290] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 election: Requested vote from peers 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717), d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721)
I20260709 13:22:20.157888 26022 leader_election.cc:304] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6, d01fccfd609b4182a5d43a7f6b4ae503; no voters: 
I20260709 13:22:20.159003 27043 raft_consensus.cc:2804] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:20.159464 27043 raft_consensus.cc:697] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 3 LEADER]: Becoming Leader. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:20.160509 27043 consensus_queue.cc:237] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } }
I20260709 13:22:20.159652 25911 raft_consensus.cc:2468] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cb7aae2a23a47c180432cb646577fd6 in term 3.
I20260709 13:22:20.171521 25729 catalog_manager.cc:5697] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 reported cstate change: term changed from 2 to 3, leader changed from 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2) to 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4). New cstate: current_term: 3 leader_uuid: "3cb7aae2a23a47c180432cb646577fd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:20.550887 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:20.607971 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:20.643971 26054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c"
dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
mode: GRACEFUL
new_leader_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:46926
I20260709 13:22:20.644542 26054 raft_consensus.cc:606] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Received request to transfer leadership to TS 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:20.645913 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:22:20.647564 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:20.725529 25980 raft_consensus.cc:1275] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Refusing update from remote peer 3cb7aae2a23a47c180432cb646577fd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:20.726892 27043 consensus_queue.cc:1048] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:20.739985 25906 raft_consensus.cc:1275] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Refusing update from remote peer 3cb7aae2a23a47c180432cb646577fd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:20.741429 27051 consensus_queue.cc:1048] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:20.809473 27051 raft_consensus.cc:993] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6: : Instructing follower 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:20.810040 27051 raft_consensus.cc:1081] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Signalling peer 8e453645ce774c99b4b4aafb4362719b to start an election
I20260709 13:22:20.812318 26763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c"
dest_uuid: "8e453645ce774c99b4b4aafb4362719b"
 from {username='slave'} at 127.0.0.1:60910
I20260709 13:22:20.812908 26763 raft_consensus.cc:493] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:20.813261 26763 raft_consensus.cc:3060] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:20.819991 26763 raft_consensus.cc:515] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:20.821924 26763 leader_election.cc:290] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 election: Requested vote from peers 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4:35175), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
I20260709 13:22:20.822806 26054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3cb7aae2a23a47c180432cb646577fd6"
I20260709 13:22:20.822952 25911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b576e68fb75f4973a322f1566d0fd69c" candidate_uuid: "8e453645ce774c99b4b4aafb4362719b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dbc14fa82f4a22b1cab8f3691196de"
I20260709 13:22:20.823518 26054 raft_consensus.cc:3055] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:20.823637 25911 raft_consensus.cc:3060] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:20.823899 26054 raft_consensus.cc:740] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cb7aae2a23a47c180432cb646577fd6, State: Running, Role: LEADER
I20260709 13:22:20.824759 26054 consensus_queue.cc:260] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:20.826045 26054 raft_consensus.cc:3060] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:20.829089 25911 raft_consensus.cc:2468] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 3.
I20260709 13:22:20.830564 26645 leader_election.cc:304] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b; no voters: 
I20260709 13:22:20.831493 26935 raft_consensus.cc:2804] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:20.833375 26935 raft_consensus.cc:697] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 3 LEADER]: Becoming Leader. State: Replica: 8e453645ce774c99b4b4aafb4362719b, State: Running, Role: LEADER
I20260709 13:22:20.834816 26935 consensus_queue.cc:237] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:20.838269 26054 raft_consensus.cc:2468] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e453645ce774c99b4b4aafb4362719b in term 3.
I20260709 13:22:20.845866 25730 catalog_manager.cc:5697] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b reported cstate change: term changed from 2 to 3, leader changed from 3cb7aae2a23a47c180432cb646577fd6 (127.15.208.4) to 8e453645ce774c99b4b4aafb4362719b (127.15.208.1). New cstate: current_term: 3 leader_uuid: "8e453645ce774c99b4b4aafb4362719b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.317610 26056 raft_consensus.cc:1275] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:21.318823 26935 consensus_queue.cc:1048] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:21.347004 25911 raft_consensus.cc:1275] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Refusing update from remote peer 8e453645ce774c99b4b4aafb4362719b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:21.349246 27055 consensus_queue.cc:1048] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:21.648464 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:21.683022 16192 tablet_server.cc:179] TabletServer@127.15.208.1:34819 shutting down...
W20260709 13:22:21.708680 25949 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 314 similar messages]
W20260709 13:22:21.713101 25949 consensus_peers.cc:597] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.721107 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:21.721982 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.722815 16192 raft_consensus.cc:2243] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.723340 16192 raft_consensus.cc:2272] T df82fd13f8664091b9b38e193d84780b P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.726733 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.727828 16192 raft_consensus.cc:2243] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.728503 16192 raft_consensus.cc:2272] T 50052343bec74747b699a16e53a348b6 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.731904 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.732762 16192 raft_consensus.cc:2243] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.733840 16192 raft_consensus.cc:2272] T 9f82b9479b4249b9b78a11bf5c355ddf P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.737048 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.737969 16192 raft_consensus.cc:2243] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.738524 16192 raft_consensus.cc:2272] T 04360fb80eea42d7960ef5c2e4858275 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.741885 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.742736 16192 raft_consensus.cc:2243] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.743321 16192 raft_consensus.cc:2272] T 400ea59a8a0048199f9090a390dd25f7 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.745608 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.746179 16192 raft_consensus.cc:2243] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.746513 16192 raft_consensus.cc:2272] T 61dbdaf9ef5f4640b9150440ef18c88c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.749163 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.749890 16192 raft_consensus.cc:2243] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.750360 16192 raft_consensus.cc:2272] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.752043 25875 consensus_peers.cc:597] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.753517 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.754483 16192 raft_consensus.cc:2243] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.755137 16192 raft_consensus.cc:2272] T 40f87eb5e589466fa0bc8c00974bdd91 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.758649 16192 tablet_replica.cc:333] stopping tablet replica
W20260709 13:22:21.758742 25875 consensus_peers.cc:597] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.759550 16192 raft_consensus.cc:2243] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.760260 16192 raft_consensus.cc:2272] T e42cec7e321749d39d2184b40221df6c P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.762627 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.763299 16192 raft_consensus.cc:2243] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.764137 16192 raft_consensus.cc:2272] T 8d5cee043c4a449188a031808c1da79e P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.766496 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.767102 16192 raft_consensus.cc:2243] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.767892 16192 raft_consensus.cc:2272] T 5469483e48bf4675b18b42b3279e8f4c P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.770167 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.770821 16192 raft_consensus.cc:2243] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.771847 16192 raft_consensus.cc:2272] T 83fcb34b2da1456c9b298616cda786a4 P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.774466 16192 tablet_replica.cc:333] stopping tablet replica
W20260709 13:22:21.774523 25949 consensus_peers.cc:597] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.775269 16192 raft_consensus.cc:2243] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.775729 16192 raft_consensus.cc:2272] T d1f90d8c21b9479cab6a633e8615dfef P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.778156 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.779027 16192 raft_consensus.cc:2243] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.779546 16192 raft_consensus.cc:2272] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.782677 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.783533 16192 raft_consensus.cc:2243] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.784122 16192 raft_consensus.cc:2272] T 4f217c0d15b04aa38110ee2f881fc575 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.784302 25875 consensus_peers.cc:597] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.787271 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.788082 16192 raft_consensus.cc:2243] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.788681 16192 raft_consensus.cc:2272] T fd7cba52ce9343d1bee167ea3364a7f9 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.791378 26023 consensus_peers.cc:597] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.791972 16192 tablet_replica.cc:333] stopping tablet replica
W20260709 13:22:21.792389 26023 consensus_peers.cc:597] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.793001 16192 raft_consensus.cc:2243] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.793605 16192 raft_consensus.cc:2272] T 4521a8865b384a5f8afb98fb858cc318 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.797008 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.797855 16192 raft_consensus.cc:2243] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.798406 16192 raft_consensus.cc:2272] T 969350a564f340bc8bd087df45015f7d P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.799393 26023 consensus_peers.cc:597] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.801229 16192 tablet_replica.cc:333] stopping tablet replica
W20260709 13:22:21.801573 25949 consensus_peers.cc:597] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.802158 16192 raft_consensus.cc:2243] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.802664 16192 raft_consensus.cc:2272] T 9c34519b693147019b76e75d995c4975 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.805100 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.805806 16192 raft_consensus.cc:2243] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.806802 16192 raft_consensus.cc:2272] T 9336cac5990e43cbab1b688c336b02bd P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.809615 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.810392 16192 raft_consensus.cc:2243] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.810887 16192 raft_consensus.cc:2272] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.811969 25949 consensus_peers.cc:597] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.813544 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.814258 16192 raft_consensus.cc:2243] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.814692 16192 raft_consensus.cc:2272] T 166158c4e1034da1a83f153661381868 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.816648 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.817425 16192 raft_consensus.cc:2243] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.817787 16192 raft_consensus.cc:2272] T fe1deaadec34478f9d16b69e2cd0742a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.820055 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.820740 16192 raft_consensus.cc:2243] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.821642 16192 raft_consensus.cc:2272] T b576e68fb75f4973a322f1566d0fd69c P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.823210 25949 consensus_peers.cc:597] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.824594 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.825268 16192 raft_consensus.cc:2243] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.825645 16192 raft_consensus.cc:2272] T ed0345d6849a4fcd8a00fa6dd75bad07 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.827822 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.828315 16192 raft_consensus.cc:2243] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.828675 16192 raft_consensus.cc:2272] T b4ef1a919b9a4fd5b21ef202381e6f54 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.830797 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.831292 16192 raft_consensus.cc:2243] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.831666 16192 raft_consensus.cc:2272] T 011e0b4473294a54a4e5b968a1bee812 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.833868 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.834563 16192 raft_consensus.cc:2243] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.835132 16192 raft_consensus.cc:2272] T bad2bafd1f44402cbf2f7d5ca62a7508 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.837860 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.838341 16192 raft_consensus.cc:2243] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.838721 16192 raft_consensus.cc:2272] T 757888a24b0145f2b16b34ac466a31d1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.841216 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.841796 16192 raft_consensus.cc:2243] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.842648 16192 raft_consensus.cc:2272] T 7f86ad3167cc43d48b4c3c06d197cd23 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.845451 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.846107 16192 raft_consensus.cc:2243] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.846571 16192 raft_consensus.cc:2272] T 162133acfbc941968cb2dd81ad3d7f46 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.849097 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.849865 16192 raft_consensus.cc:2243] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.850394 16192 raft_consensus.cc:2272] T e224ef22951c499c9fceb8ce339a349a P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.851958 25875 consensus_peers.cc:597] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.853579 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.854362 16192 raft_consensus.cc:2243] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.855839 16192 raft_consensus.cc:2272] T e56d8e51e0714bcfac360118807d6e0f P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.859217 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.859951 16192 raft_consensus.cc:2243] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.861142 16192 raft_consensus.cc:2272] T 0262be24b803413883f14155c6e4c640 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.864248 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.865092 16192 raft_consensus.cc:2243] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.866428 16192 raft_consensus.cc:2272] T 5422aebfcb69407490575715e7e6cd18 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.869596 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.870424 16192 raft_consensus.cc:2243] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.871585 16192 raft_consensus.cc:2272] T 8e56b5dacf8443239fe2cd7fcc3286bb P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.873744 26023 consensus_peers.cc:597] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.874495 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.875412 16192 raft_consensus.cc:2243] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.875949 16192 raft_consensus.cc:2272] T 84a6ea62d4ba491aaf3c705964525771 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.879326 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.880162 16192 raft_consensus.cc:2243] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:22:21.880771 25949 consensus_peers.cc:597] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.881232 16192 raft_consensus.cc:2272] T b633a2406cc3422abe7f6adda14a8386 P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.881650 25949 consensus_peers.cc:597] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.884552 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.885473 16192 raft_consensus.cc:2243] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.886018 16192 raft_consensus.cc:2272] T 3b7fe3b03581401f935bfe2a3c432484 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.888732 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.889299 16192 raft_consensus.cc:2243] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.890101 16192 raft_consensus.cc:2272] T f2fd2c216d4f4c11b81198c731099343 P 8e453645ce774c99b4b4aafb4362719b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.892416 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.893000 16192 raft_consensus.cc:2243] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.893400 16192 raft_consensus.cc:2272] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.895577 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.896121 16192 raft_consensus.cc:2243] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.896526 16192 raft_consensus.cc:2272] T 6cb960d6f3ef4634a29335330aa1c58c P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.899124 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.899777 16192 raft_consensus.cc:2243] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.900288 16192 raft_consensus.cc:2272] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.902768 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.903333 16192 raft_consensus.cc:2243] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.903827 16192 raft_consensus.cc:2272] T 2b625185a5664b86ad39dc782dfb71c1 P 8e453645ce774c99b4b4aafb4362719b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.906714 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:21.907301 16192 raft_consensus.cc:2243] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.908382 16192 raft_consensus.cc:2272] T 244656e8e9b646c48e9b5b92ed53ba51 P 8e453645ce774c99b4b4aafb4362719b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.912358 25875 consensus_peers.cc:597] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:21.930588 26023 consensus_peers.cc:597] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:21.941051 26023 consensus_peers.cc:597] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:21.945231 25875 consensus_peers.cc:597] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:21.972882 26645 connection.cc:466] server connection from 127.0.0.1:60924 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60924 (request call id 564) could send its response
W20260709 13:22:21.973917 25949 consensus_peers.cc:597] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: recv got EOF from 127.15.208.1:34819 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.991279 16192 tablet_server.cc:196] TabletServer@127.15.208.1:34819 shutdown complete.
W20260709 13:22:22.007653 26023 consensus_peers.cc:597] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.057631 25949 consensus_peers.cc:597] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.065258 25949 consensus_peers.cc:597] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.097651 16192 tablet_server.cc:179] TabletServer@127.15.208.2:0 shutting down...
W20260709 13:22:22.111903 26023 consensus_peers.cc:597] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.114637 26023 consensus_peers.cc:597] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.114933 25949 consensus_peers.cc:597] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.126412 25875 consensus_peers.cc:597] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.138559 25949 consensus_peers.cc:597] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.142884 25951 consensus_peers.cc:597] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.162815 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:22.163700 16192 tablet_replica.cc:333] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.164438 16192 raft_consensus.cc:2243] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.165539 16192 raft_consensus.cc:2272] T 011e0b4473294a54a4e5b968a1bee812 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.168766 16192 tablet_replica.cc:333] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.169700 16192 raft_consensus.cc:2243] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:22.169696 26025 consensus_peers.cc:597] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.170367 16192 raft_consensus.cc:2272] T b576e68fb75f4973a322f1566d0fd69c P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.171535 26023 consensus_peers.cc:597] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.173681 16192 tablet_replica.cc:333] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.174474 16192 raft_consensus.cc:2243] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.174980 16192 raft_consensus.cc:2272] T 50052343bec74747b699a16e53a348b6 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.177336 16192 tablet_replica.cc:333] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.177964 16192 raft_consensus.cc:2243] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.178843 16192 raft_consensus.cc:2272] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.181190 16192 tablet_replica.cc:333] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.181794 16192 raft_consensus.cc:2243] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.182237 16192 raft_consensus.cc:2272] T b4ef1a919b9a4fd5b21ef202381e6f54 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.184518 16192 tablet_replica.cc:333] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.185425 16192 raft_consensus.cc:2243] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.185902 16192 raft_consensus.cc:2272] T 400ea59a8a0048199f9090a390dd25f7 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.190009 16192 tablet_replica.cc:333] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.190851 16192 raft_consensus.cc:2243] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.191869 16192 raft_consensus.cc:2272] T ed0345d6849a4fcd8a00fa6dd75bad07 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.192101 25949 consensus_peers.cc:597] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.194638 16192 tablet_replica.cc:333] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.195363 16192 raft_consensus.cc:2243] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.195889 16192 raft_consensus.cc:2272] T 84a6ea62d4ba491aaf3c705964525771 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.198225 16192 tablet_replica.cc:333] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.198853 16192 raft_consensus.cc:2243] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.199730 16192 raft_consensus.cc:2272] T cbb6cace1a274a589bb22b03411c0afe P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.202147 16192 tablet_replica.cc:333] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.202737 16192 raft_consensus.cc:2243] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.203572 16192 raft_consensus.cc:2272] T a91a957dc23746599c956ea9b45f3fba P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.205933 16192 tablet_replica.cc:333] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.206557 16192 raft_consensus.cc:2243] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.207041 16192 raft_consensus.cc:2272] T fe1deaadec34478f9d16b69e2cd0742a P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.209967 16192 tablet_replica.cc:333] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.210777 16192 raft_consensus.cc:2243] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.211917 16192 raft_consensus.cc:2272] T 46e40f11ff0b4d47bda6cd2c01a752e8 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.214828 16192 tablet_replica.cc:333] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.215440 16192 raft_consensus.cc:2243] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.216328 16192 raft_consensus.cc:2272] T 000a2e7a3f5d41cfa0490dc7b23be634 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.218540 16192 tablet_replica.cc:333] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.219112 16192 raft_consensus.cc:2243] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.219594 16192 raft_consensus.cc:2272] T d150b2f01c6a49f284817b4f031c89de P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.222477 16192 tablet_replica.cc:333] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.223356 16192 raft_consensus.cc:2243] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.223857 16192 raft_consensus.cc:2272] T 9f82b9479b4249b9b78a11bf5c355ddf P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.226542 16192 tablet_replica.cc:333] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.227377 16192 raft_consensus.cc:2243] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.228323 16192 raft_consensus.cc:2272] T 015dfd3d2a2e4732876fa91c804d5f58 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.230873 16192 tablet_replica.cc:333] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.231493 16192 raft_consensus.cc:2243] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.231984 16192 raft_consensus.cc:2272] T 4f217c0d15b04aa38110ee2f881fc575 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.234273 16192 tablet_replica.cc:333] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.234850 16192 raft_consensus.cc:2243] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.235293 16192 raft_consensus.cc:2272] T 3b1da671c9454f06b4568be0a7d96ba6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.237411 16192 tablet_replica.cc:333] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.238013 16192 raft_consensus.cc:2243] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.238886 16192 raft_consensus.cc:2272] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.241212 16192 tablet_replica.cc:333] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.241768 16192 raft_consensus.cc:2243] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.242213 16192 raft_consensus.cc:2272] T 2b625185a5664b86ad39dc782dfb71c1 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.244256 16192 tablet_replica.cc:333] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.244926 16192 raft_consensus.cc:2243] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.245503 16192 raft_consensus.cc:2272] T 166158c4e1034da1a83f153661381868 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.248492 16192 tablet_replica.cc:333] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.249341 16192 raft_consensus.cc:2243] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.249842 16192 raft_consensus.cc:2272] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.252991 16192 tablet_replica.cc:333] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.253826 16192 raft_consensus.cc:2243] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.254309 16192 raft_consensus.cc:2272] T 9c42a92a5a0247a499aa3493980d57f4 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.255165 26025 consensus_peers.cc:597] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.257297 16192 tablet_replica.cc:333] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.258283 16192 raft_consensus.cc:2243] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.258890 16192 raft_consensus.cc:2272] T 5469483e48bf4675b18b42b3279e8f4c P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.258955 25949 consensus_peers.cc:597] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Couldn't send request to peer 8e453645ce774c99b4b4aafb4362719b. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.261565 16192 tablet_replica.cc:333] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.262213 16192 raft_consensus.cc:2243] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.262699 16192 raft_consensus.cc:2272] T 0262be24b803413883f14155c6e4c640 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.265579 16192 tablet_replica.cc:333] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.266294 16192 raft_consensus.cc:2243] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.267414 16192 raft_consensus.cc:2272] T 50ec9041a9b841bb91cd06da0192130e P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.270490 16192 tablet_replica.cc:333] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.271060 16192 raft_consensus.cc:2243] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.271529 16192 raft_consensus.cc:2272] T 4521a8865b384a5f8afb98fb858cc318 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.273797 16192 tablet_replica.cc:333] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.274478 16192 raft_consensus.cc:2243] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.275615 16192 raft_consensus.cc:2272] T 969350a564f340bc8bd087df45015f7d P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.278499 16192 tablet_replica.cc:333] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.279269 16192 raft_consensus.cc:2243] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.280431 16192 raft_consensus.cc:2272] T 162133acfbc941968cb2dd81ad3d7f46 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.283562 16192 tablet_replica.cc:333] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.284390 16192 raft_consensus.cc:2243] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.285040 16192 raft_consensus.cc:2272] T 7f86ad3167cc43d48b4c3c06d197cd23 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.287926 16192 tablet_replica.cc:333] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.288695 16192 raft_consensus.cc:2243] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:22:22.288998 26025 consensus_peers.cc:597] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.289903 16192 raft_consensus.cc:2272] T 757888a24b0145f2b16b34ac466a31d1 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.291580 26025 consensus_peers.cc:597] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.293085 16192 tablet_replica.cc:333] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.293973 16192 raft_consensus.cc:2243] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.294621 16192 raft_consensus.cc:2272] T 981001373c784e27a4ec5bef4b640b77 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.297854 16192 tablet_replica.cc:333] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.298640 16192 raft_consensus.cc:2243] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.299201 16192 raft_consensus.cc:2272] T d1f90d8c21b9479cab6a633e8615dfef P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.300652 25951 consensus_peers.cc:597] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.301743 26025 consensus_peers.cc:597] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.302124 16192 tablet_replica.cc:333] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.302944 16192 raft_consensus.cc:2243] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.303495 16192 raft_consensus.cc:2272] T 83fcb34b2da1456c9b298616cda786a4 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.306474 16192 tablet_replica.cc:333] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.307080 16192 raft_consensus.cc:2243] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.307700 16192 raft_consensus.cc:2272] T 244656e8e9b646c48e9b5b92ed53ba51 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.310505 16192 tablet_replica.cc:333] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.311102 16192 raft_consensus.cc:2243] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.311578 16192 raft_consensus.cc:2272] T 9b69a58c24c44d16b7aeed68a23964a5 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.314388 16192 tablet_replica.cc:333] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.315228 16192 raft_consensus.cc:2243] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.316375 16192 raft_consensus.cc:2272] T bbe43c0e1b72475da18a3ce2febfa9e3 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.319084 16192 tablet_replica.cc:333] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.319784 16192 raft_consensus.cc:2243] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.320348 16192 raft_consensus.cc:2272] T f2fd2c216d4f4c11b81198c731099343 P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.322759 16192 tablet_replica.cc:333] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.323307 16192 raft_consensus.cc:2243] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.323755 16192 raft_consensus.cc:2272] T 9336cac5990e43cbab1b688c336b02bd P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.326224 16192 tablet_replica.cc:333] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.326804 16192 raft_consensus.cc:2243] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.327342 16192 raft_consensus.cc:2272] T 9c34519b693147019b76e75d995c4975 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.327659 25951 consensus_peers.cc:597] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.329712 16192 tablet_replica.cc:333] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.330307 16192 raft_consensus.cc:2243] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.330674 16192 raft_consensus.cc:2272] T df402c226a164b7b945723f607f9aa75 P 00dbc14fa82f4a22b1cab8f3691196de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.332619 16192 tablet_replica.cc:333] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.333145 16192 raft_consensus.cc:2243] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.333575 16192 raft_consensus.cc:2272] T 5422aebfcb69407490575715e7e6cd18 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.336222 16192 tablet_replica.cc:333] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.336937 16192 raft_consensus.cc:2243] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.337486 16192 raft_consensus.cc:2272] T 8d5cee043c4a449188a031808c1da79e P 00dbc14fa82f4a22b1cab8f3691196de [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.338004 25951 consensus_peers.cc:597] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.339973 16192 tablet_replica.cc:333] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de: stopping tablet replica
I20260709 13:22:22.340600 16192 raft_consensus.cc:2243] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.341439 16192 raft_consensus.cc:2272] T 71b7bc1778ac476b9576cf48b4353789 P 00dbc14fa82f4a22b1cab8f3691196de [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.345965 26025 consensus_peers.cc:597] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.352339 26025 consensus_peers.cc:597] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.420646 26025 consensus_peers.cc:597] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:46717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.433738 16192 tablet_server.cc:196] TabletServer@127.15.208.2:0 shutdown complete.
W20260709 13:22:22.492364 25951 consensus_peers.cc:597] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:46717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.517937 26025 consensus_peers.cc:597] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:46717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.523322 16192 tablet_server.cc:179] TabletServer@127.15.208.3:0 shutting down...
W20260709 13:22:22.537915 26025 consensus_peers.cc:597] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:46717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.564553 26022 consensus_peers.cc:597] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.572645 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:22.573772 16192 tablet_replica.cc:333] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.574795 16192 raft_consensus.cc:2243] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.575433 16192 raft_consensus.cc:2272] T a91a957dc23746599c956ea9b45f3fba P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.577804 16192 tablet_replica.cc:333] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.578387 16192 raft_consensus.cc:2243] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.579181 16192 raft_consensus.cc:2272] T e42cec7e321749d39d2184b40221df6c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.581790 16192 tablet_replica.cc:333] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.582409 16192 raft_consensus.cc:2243] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.582883 16192 raft_consensus.cc:2272] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.585273 16192 tablet_replica.cc:333] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.585963 16192 raft_consensus.cc:2243] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.586959 16192 raft_consensus.cc:2272] T 400ea59a8a0048199f9090a390dd25f7 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.589685 16192 tablet_replica.cc:333] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.590363 16192 raft_consensus.cc:2243] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.591440 16192 raft_consensus.cc:2272] T fd7cba52ce9343d1bee167ea3364a7f9 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.594165 16192 tablet_replica.cc:333] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.594955 16192 raft_consensus.cc:2243] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.595878 16192 raft_consensus.cc:2272] T bad2bafd1f44402cbf2f7d5ca62a7508 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.598110 16192 tablet_replica.cc:333] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.598630 16192 raft_consensus.cc:2243] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.599010 16192 raft_consensus.cc:2272] T ed0345d6849a4fcd8a00fa6dd75bad07 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.600965 16192 tablet_replica.cc:333] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.601495 16192 raft_consensus.cc:2243] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.602224 16192 raft_consensus.cc:2272] T 6cb960d6f3ef4634a29335330aa1c58c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.604259 16192 tablet_replica.cc:333] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.604820 16192 raft_consensus.cc:2243] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.605283 16192 raft_consensus.cc:2272] T 7f86ad3167cc43d48b4c3c06d197cd23 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.607283 16192 tablet_replica.cc:333] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.607889 16192 raft_consensus.cc:2243] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.608587 16192 raft_consensus.cc:2272] T 04360fb80eea42d7960ef5c2e4858275 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.610704 16192 tablet_replica.cc:333] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.611272 16192 raft_consensus.cc:2243] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.611698 16192 raft_consensus.cc:2272] T 000a2e7a3f5d41cfa0490dc7b23be634 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.613816 16192 tablet_replica.cc:333] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.614356 16192 raft_consensus.cc:2243] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.614734 16192 raft_consensus.cc:2272] T d150b2f01c6a49f284817b4f031c89de P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.616748 16192 tablet_replica.cc:333] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.617404 16192 raft_consensus.cc:2243] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.617830 16192 raft_consensus.cc:2272] T 981001373c784e27a4ec5bef4b640b77 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.619854 16192 tablet_replica.cc:333] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.620438 16192 raft_consensus.cc:2243] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.620955 16192 raft_consensus.cc:2272] T 83fcb34b2da1456c9b298616cda786a4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.622905 16192 tablet_replica.cc:333] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.623479 16192 raft_consensus.cc:2243] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.623914 16192 raft_consensus.cc:2272] T 015dfd3d2a2e4732876fa91c804d5f58 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.626003 16192 tablet_replica.cc:333] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.626564 16192 raft_consensus.cc:2243] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.627355 16192 raft_consensus.cc:2272] T 4f217c0d15b04aa38110ee2f881fc575 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.629359 16192 tablet_replica.cc:333] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.629951 16192 raft_consensus.cc:2243] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.630366 16192 raft_consensus.cc:2272] T 3b1da671c9454f06b4568be0a7d96ba6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.632230 16192 tablet_replica.cc:333] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.632804 16192 raft_consensus.cc:2243] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.633596 16192 raft_consensus.cc:2272] T 2b625185a5664b86ad39dc782dfb71c1 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.635550 16192 tablet_replica.cc:333] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.636116 16192 raft_consensus.cc:2243] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.636538 16192 raft_consensus.cc:2272] T 9c42a92a5a0247a499aa3493980d57f4 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.638578 16192 tablet_replica.cc:333] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.639459 16192 raft_consensus.cc:2243] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.640389 16192 raft_consensus.cc:2272] T e224ef22951c499c9fceb8ce339a349a P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.642388 16192 tablet_replica.cc:333] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.642944 16192 raft_consensus.cc:2243] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.643378 16192 raft_consensus.cc:2272] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.646124 16192 tablet_replica.cc:333] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.646785 16192 raft_consensus.cc:2243] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.647727 16192 raft_consensus.cc:2272] T 61dbdaf9ef5f4640b9150440ef18c88c P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.650449 16192 tablet_replica.cc:333] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.651196 16192 raft_consensus.cc:2243] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.652624 16192 raft_consensus.cc:2272] T 5469483e48bf4675b18b42b3279e8f4c P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.655707 16192 tablet_replica.cc:333] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.656587 16192 raft_consensus.cc:2243] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.657652 16192 raft_consensus.cc:2272] T 9b69a58c24c44d16b7aeed68a23964a5 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.660764 16192 tablet_replica.cc:333] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.661628 16192 raft_consensus.cc:2243] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.662176 16192 raft_consensus.cc:2272] T cbb6cace1a274a589bb22b03411c0afe P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.665305 16192 tablet_replica.cc:333] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.666090 16192 raft_consensus.cc:2243] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.666638 16192 raft_consensus.cc:2272] T b633a2406cc3422abe7f6adda14a8386 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.666926 26022 consensus_peers.cc:597] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.669662 16192 tablet_replica.cc:333] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.670614 16192 raft_consensus.cc:2243] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.671248 16192 raft_consensus.cc:2272] T 8e56b5dacf8443239fe2cd7fcc3286bb P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.674218 16192 tablet_replica.cc:333] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.675036 16192 raft_consensus.cc:2243] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.675551 16192 raft_consensus.cc:2272] T 0262be24b803413883f14155c6e4c640 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.677789 16192 tablet_replica.cc:333] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.678416 16192 raft_consensus.cc:2243] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.678908 16192 raft_consensus.cc:2272] T 50ec9041a9b841bb91cd06da0192130e P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.681795 26025 consensus_peers.cc:597] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:46717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.682267 16192 tablet_replica.cc:333] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.683075 16192 raft_consensus.cc:2243] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.683595 16192 raft_consensus.cc:2272] T 969350a564f340bc8bd087df45015f7d P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.686794 16192 tablet_replica.cc:333] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
W20260709 13:22:22.687026 26022 consensus_peers.cc:597] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.687680 16192 raft_consensus.cc:2243] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.688941 16192 raft_consensus.cc:2272] T 166158c4e1034da1a83f153661381868 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.692163 16192 tablet_replica.cc:333] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.692996 16192 raft_consensus.cc:2243] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.694090 16192 raft_consensus.cc:2272] T 50052343bec74747b699a16e53a348b6 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.694243 26022 consensus_peers.cc:597] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:22.696266 26025 consensus_peers.cc:597] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 -> Peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Couldn't send request to peer 00dbc14fa82f4a22b1cab8f3691196de. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:46717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.697324 16192 tablet_replica.cc:333] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.698268 16192 raft_consensus.cc:2243] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.698875 16192 raft_consensus.cc:2272] T df82fd13f8664091b9b38e193d84780b P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.702239 16192 tablet_replica.cc:333] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.703033 16192 raft_consensus.cc:2243] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.703634 16192 raft_consensus.cc:2272] T df402c226a164b7b945723f607f9aa75 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.706694 16192 tablet_replica.cc:333] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.707422 16192 raft_consensus.cc:2243] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.708429 16192 raft_consensus.cc:2272] T 1821e793dcc0499d9d8a707ea4f8d0d2 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.711053 16192 tablet_replica.cc:333] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.711799 16192 raft_consensus.cc:2243] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.712335 16192 raft_consensus.cc:2272] T 9336cac5990e43cbab1b688c336b02bd P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.715001 16192 tablet_replica.cc:333] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.715653 16192 raft_consensus.cc:2243] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.716135 16192 raft_consensus.cc:2272] T 3b7fe3b03581401f935bfe2a3c432484 P d01fccfd609b4182a5d43a7f6b4ae503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.718129 16192 tablet_replica.cc:333] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.718678 16192 raft_consensus.cc:2243] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.719127 16192 raft_consensus.cc:2272] T bbe43c0e1b72475da18a3ce2febfa9e3 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.721349 16192 tablet_replica.cc:333] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.721869 16192 raft_consensus.cc:2243] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.722352 16192 raft_consensus.cc:2272] T f2fd2c216d4f4c11b81198c731099343 P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.724329 16192 tablet_replica.cc:333] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.724831 16192 raft_consensus.cc:2243] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.725332 16192 raft_consensus.cc:2272] T 46e40f11ff0b4d47bda6cd2c01a752e8 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.727336 16192 tablet_replica.cc:333] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.727895 16192 raft_consensus.cc:2243] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.728677 16192 raft_consensus.cc:2272] T 40f87eb5e589466fa0bc8c00974bdd91 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.730906 16192 tablet_replica.cc:333] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.731439 16192 raft_consensus.cc:2243] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.731873 16192 raft_consensus.cc:2272] T e56d8e51e0714bcfac360118807d6e0f P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.734014 16192 tablet_replica.cc:333] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.734650 16192 raft_consensus.cc:2243] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.735105 16192 raft_consensus.cc:2272] T 8d5cee043c4a449188a031808c1da79e P d01fccfd609b4182a5d43a7f6b4ae503 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.737242 16192 tablet_replica.cc:333] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503: stopping tablet replica
I20260709 13:22:22.737733 16192 raft_consensus.cc:2243] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.738160 16192 raft_consensus.cc:2272] T 71b7bc1778ac476b9576cf48b4353789 P d01fccfd609b4182a5d43a7f6b4ae503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.814024 16192 tablet_server.cc:196] TabletServer@127.15.208.3:0 shutdown complete.
W20260709 13:22:22.814471 26022 consensus_peers.cc:597] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.3:43721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.816677 27041 raft_consensus.cc:493] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:22.817302 27041 raft_consensus.cc:515] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:22.819468 27041 leader_election.cc:290] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
W20260709 13:22:22.823429 26023 leader_election.cc:336] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
W20260709 13:22:22.823925 26025 leader_election.cc:336] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Network error: Client connection negotiation failed: client connection to 127.15.208.2:46717: connect: Connection refused (error 111)
I20260709 13:22:22.824345 26025 leader_election.cc:304] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:22.825104 27041 raft_consensus.cc:2749] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:22.843947 27041 raft_consensus.cc:493] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:22.844524 27041 raft_consensus.cc:515] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } } peers { permanent_uuid: "00dbc14fa82f4a22b1cab8f3691196de" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 46717 } }
I20260709 13:22:22.846943 27041 leader_election.cc:290] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819), 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717)
W20260709 13:22:22.851342 26023 leader_election.cc:336] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
W20260709 13:22:22.851851 26025 leader_election.cc:336] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 00dbc14fa82f4a22b1cab8f3691196de (127.15.208.2:46717): Network error: Client connection negotiation failed: client connection to 127.15.208.2:46717: connect: Connection refused (error 111)
I20260709 13:22:22.852217 26025 leader_election.cc:304] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 00dbc14fa82f4a22b1cab8f3691196de, 8e453645ce774c99b4b4aafb4362719b
I20260709 13:22:22.852867 27041 raft_consensus.cc:2749] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:22:22.877442 26022 consensus_peers.cc:597] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.3:43721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.891328 16192 tablet_server.cc:179] TabletServer@127.15.208.4:0 shutting down...
I20260709 13:22:22.904031 27051 raft_consensus.cc:493] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:22.906004 27051 raft_consensus.cc:515] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:22.909008 27051 leader_election.cc:290] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
W20260709 13:22:22.915912 26023 leader_election.cc:336] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
W20260709 13:22:22.925047 26022 leader_election.cc:336] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Network error: Client connection negotiation failed: client connection to 127.15.208.3:43721: connect: Connection refused (error 111)
I20260709 13:22:22.925518 26022 leader_election.cc:304] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:22.926169 27043 raft_consensus.cc:2749] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:22:22.930987 26022 consensus_peers.cc:597] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.3:43721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.950632 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:22.951490 16192 tablet_replica.cc:333] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.952140 16192 raft_consensus.cc:2243] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.952612 16192 raft_consensus.cc:2272] T b576e68fb75f4973a322f1566d0fd69c P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.954690 16192 tablet_replica.cc:333] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.955348 16192 raft_consensus.cc:2243] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.955788 16192 raft_consensus.cc:2272] T 1bf0142f8c8d4e7e9a4edc4e88bb184c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.957800 16192 tablet_replica.cc:333] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.958338 16192 raft_consensus.cc:2243] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.958753 16192 raft_consensus.cc:2272] T e42cec7e321749d39d2184b40221df6c P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.960809 16192 tablet_replica.cc:333] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.961535 16192 raft_consensus.cc:2243] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.962000 16192 raft_consensus.cc:2272] T 011e0b4473294a54a4e5b968a1bee812 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.964108 16192 tablet_replica.cc:333] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.964687 16192 raft_consensus.cc:2243] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.965224 16192 raft_consensus.cc:2272] T bad2bafd1f44402cbf2f7d5ca62a7508 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.967222 16192 tablet_replica.cc:333] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.967845 16192 raft_consensus.cc:2243] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.968681 16192 raft_consensus.cc:2272] T b4ef1a919b9a4fd5b21ef202381e6f54 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.970763 16192 tablet_replica.cc:333] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.971360 16192 raft_consensus.cc:2243] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.971803 16192 raft_consensus.cc:2272] T fd7cba52ce9343d1bee167ea3364a7f9 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.973824 16192 tablet_replica.cc:333] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.974407 16192 raft_consensus.cc:2243] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.974871 16192 raft_consensus.cc:2272] T bbe43c0e1b72475da18a3ce2febfa9e3 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.977041 16192 tablet_replica.cc:333] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.977667 16192 raft_consensus.cc:2243] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.978550 16192 raft_consensus.cc:2272] T 3b7fe3b03581401f935bfe2a3c432484 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.980610 16192 tablet_replica.cc:333] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.981549 16192 raft_consensus.cc:2243] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.982057 16192 raft_consensus.cc:2272] T 1f46a3b3a20d4dcbb895c0b6bba0a6c6 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.984490 16192 tablet_replica.cc:333] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.985320 16192 raft_consensus.cc:2243] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.985855 16192 raft_consensus.cc:2272] T 04360fb80eea42d7960ef5c2e4858275 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:22.985976 26022 consensus_peers.cc:597] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 -> Peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Couldn't send request to peer d01fccfd609b4182a5d43a7f6b4ae503. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.3:43721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:22.988250 16192 tablet_replica.cc:333] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.988976 16192 raft_consensus.cc:2243] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.989482 16192 raft_consensus.cc:2272] T a91a957dc23746599c956ea9b45f3fba P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.991652 16192 tablet_replica.cc:333] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.992255 16192 raft_consensus.cc:2243] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:22.993146 16192 raft_consensus.cc:2272] T fe1deaadec34478f9d16b69e2cd0742a P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.995692 16192 tablet_replica.cc:333] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.996305 16192 raft_consensus.cc:2243] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:22.996794 16192 raft_consensus.cc:2272] T 000a2e7a3f5d41cfa0490dc7b23be634 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:22.998982 16192 tablet_replica.cc:333] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:22.999532 16192 raft_consensus.cc:2243] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.000303 16192 raft_consensus.cc:2272] T d150b2f01c6a49f284817b4f031c89de P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.002255 16192 tablet_replica.cc:333] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.002795 16192 raft_consensus.cc:2243] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.003166 16192 raft_consensus.cc:2272] T 61dbdaf9ef5f4640b9150440ef18c88c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.005121 16192 tablet_replica.cc:333] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.005668 16192 raft_consensus.cc:2243] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.006102 16192 raft_consensus.cc:2272] T 9f82b9479b4249b9b78a11bf5c355ddf P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.008225 16192 tablet_replica.cc:333] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.008822 16192 raft_consensus.cc:2243] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.009366 27041 raft_consensus.cc:493] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e453645ce774c99b4b4aafb4362719b)
I20260709 13:22:23.009464 16192 raft_consensus.cc:2272] T 015dfd3d2a2e4732876fa91c804d5f58 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.009959 27041 raft_consensus.cc:515] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d01fccfd609b4182a5d43a7f6b4ae503" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43721 } } peers { permanent_uuid: "3cb7aae2a23a47c180432cb646577fd6" member_type: VOTER last_known_addr { host: "127.15.208.4" port: 35175 } } peers { permanent_uuid: "8e453645ce774c99b4b4aafb4362719b" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 34819 } }
I20260709 13:22:23.012508 16192 tablet_replica.cc:333] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.012496 27041 leader_election.cc:290] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721), 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819)
I20260709 13:22:23.013607 16192 raft_consensus.cc:2243] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.014670 16192 raft_consensus.cc:2272] T 3b1da671c9454f06b4568be0a7d96ba6 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:23.016898 26023 leader_election.cc:336] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8e453645ce774c99b4b4aafb4362719b (127.15.208.1:34819): Network error: Client connection negotiation failed: client connection to 127.15.208.1:34819: connect: Connection refused (error 111)
W20260709 13:22:23.017514 26022 leader_election.cc:336] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d01fccfd609b4182a5d43a7f6b4ae503 (127.15.208.3:43721): Network error: Client connection negotiation failed: client connection to 127.15.208.3:43721: connect: Connection refused (error 111)
I20260709 13:22:23.017778 16192 tablet_replica.cc:333] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.017935 26022 leader_election.cc:304] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cb7aae2a23a47c180432cb646577fd6; no voters: 8e453645ce774c99b4b4aafb4362719b, d01fccfd609b4182a5d43a7f6b4ae503
I20260709 13:22:23.018662 16192 raft_consensus.cc:2243] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.018662 27041 raft_consensus.cc:2749] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:23.019495 16192 raft_consensus.cc:2272] T e224ef22951c499c9fceb8ce339a349a P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.021624 16192 tablet_replica.cc:333] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.022311 16192 raft_consensus.cc:2243] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.023218 16192 raft_consensus.cc:2272] T 5dbb2ef09cdc4bf08cda0e5159a5bab0 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.026252 16192 tablet_replica.cc:333] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.027089 16192 raft_consensus.cc:2243] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.027701 16192 raft_consensus.cc:2272] T 6cb960d6f3ef4634a29335330aa1c58c P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.030092 16192 tablet_replica.cc:333] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.030589 16192 raft_consensus.cc:2243] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.031250 16192 raft_consensus.cc:2272] T 3d8ea7f0acae4a2fb1fac24abac35b6f P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.032999 16192 tablet_replica.cc:333] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.033459 16192 raft_consensus.cc:2243] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.034116 16192 raft_consensus.cc:2272] T 9c42a92a5a0247a499aa3493980d57f4 P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.035810 16192 tablet_replica.cc:333] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.036307 16192 raft_consensus.cc:2243] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.037089 16192 raft_consensus.cc:2272] T 4521a8865b384a5f8afb98fb858cc318 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.038940 16192 tablet_replica.cc:333] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.039436 16192 raft_consensus.cc:2243] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.039834 16192 raft_consensus.cc:2272] T 162133acfbc941968cb2dd81ad3d7f46 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.041759 16192 tablet_replica.cc:333] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.042310 16192 raft_consensus.cc:2243] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.042739 16192 raft_consensus.cc:2272] T 757888a24b0145f2b16b34ac466a31d1 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.044633 16192 tablet_replica.cc:333] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.045186 16192 raft_consensus.cc:2243] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.045600 16192 raft_consensus.cc:2272] T 244656e8e9b646c48e9b5b92ed53ba51 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.047716 16192 tablet_replica.cc:333] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.048261 16192 raft_consensus.cc:2243] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.048662 16192 raft_consensus.cc:2272] T 9b69a58c24c44d16b7aeed68a23964a5 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.050760 16192 tablet_replica.cc:333] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.051311 16192 raft_consensus.cc:2243] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.052034 16192 raft_consensus.cc:2272] T 84a6ea62d4ba491aaf3c705964525771 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.054183 16192 tablet_replica.cc:333] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.054755 16192 raft_consensus.cc:2243] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.055181 16192 raft_consensus.cc:2272] T cbb6cace1a274a589bb22b03411c0afe P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.057211 16192 tablet_replica.cc:333] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.057816 16192 raft_consensus.cc:2243] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.058254 16192 raft_consensus.cc:2272] T b633a2406cc3422abe7f6adda14a8386 P 3cb7aae2a23a47c180432cb646577fd6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.060294 16192 tablet_replica.cc:333] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.060812 16192 raft_consensus.cc:2243] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.061342 16192 raft_consensus.cc:2272] T 8e56b5dacf8443239fe2cd7fcc3286bb P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.063205 16192 tablet_replica.cc:333] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.063755 16192 raft_consensus.cc:2243] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.064219 16192 raft_consensus.cc:2272] T 50ec9041a9b841bb91cd06da0192130e P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.066676 16192 tablet_replica.cc:333] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.067201 16192 raft_consensus.cc:2243] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.068018 16192 raft_consensus.cc:2272] T df82fd13f8664091b9b38e193d84780b P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.070087 16192 tablet_replica.cc:333] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.070607 16192 raft_consensus.cc:2243] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.071049 16192 raft_consensus.cc:2272] T 1821e793dcc0499d9d8a707ea4f8d0d2 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.073112 16192 tablet_replica.cc:333] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.073617 16192 raft_consensus.cc:2243] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.074414 16192 raft_consensus.cc:2272] T 9c34519b693147019b76e75d995c4975 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.076635 16192 tablet_replica.cc:333] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.077356 16192 raft_consensus.cc:2243] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.078120 16192 raft_consensus.cc:2272] T df402c226a164b7b945723f607f9aa75 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.080572 16192 tablet_replica.cc:333] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.081219 16192 raft_consensus.cc:2243] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.081640 16192 raft_consensus.cc:2272] T 40f87eb5e589466fa0bc8c00974bdd91 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.083650 16192 tablet_replica.cc:333] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.084160 16192 raft_consensus.cc:2243] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.084575 16192 raft_consensus.cc:2272] T e56d8e51e0714bcfac360118807d6e0f P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.086709 16192 tablet_replica.cc:333] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.088346 16192 raft_consensus.cc:2243] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.089563 16192 raft_consensus.cc:2272] T 981001373c784e27a4ec5bef4b640b77 P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.092453 16192 tablet_replica.cc:333] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.093160 16192 raft_consensus.cc:2243] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.094126 16192 raft_consensus.cc:2272] T d1f90d8c21b9479cab6a633e8615dfef P 3cb7aae2a23a47c180432cb646577fd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.096761 16192 tablet_replica.cc:333] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.097295 16192 raft_consensus.cc:2243] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.097762 16192 raft_consensus.cc:2272] T 71b7bc1778ac476b9576cf48b4353789 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.099752 16192 tablet_replica.cc:333] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6: stopping tablet replica
I20260709 13:22:23.100212 16192 raft_consensus.cc:2243] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:23.100651 16192 raft_consensus.cc:2272] T 5422aebfcb69407490575715e7e6cd18 P 3cb7aae2a23a47c180432cb646577fd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.168646 16192 tablet_server.cc:196] TabletServer@127.15.208.4:0 shutdown complete.
I20260709 13:22:23.232714 16192 master.cc:562] Master@127.15.208.62:41075 shutting down...
I20260709 13:22:23.263628 16192 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:23.264282 16192 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:23.264639 16192 tablet_replica.cc:333] T 00000000000000000000000000000000 P cddca48df7264204bfd14ae81d32a6a3: stopping tablet replica
I20260709 13:22:23.336160 16192 master.cc:584] Master@127.15.208.62:41075 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36949 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:22:23.427879 16192 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.208.62:33225
I20260709 13:22:23.429090 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:23.435187 27078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:23.435935 27081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:23.436455 27079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:23.437208 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:23.438297 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:23.438472 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:23.438584 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603343438569 us; error 0 us; skew 500 ppm
I20260709 13:22:23.439033 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:23.441466 16192 webserver.cc:533] Webserver started at http://127.15.208.62:32951/ using document root <none> and password file <none>
I20260709 13:22:23.441919 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:23.442075 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:23.442299 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:23.443394 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/master-0-root/instance:
uuid: "674a4711933c423cbf0bbe024245c151"
format_stamp: "Formatted at 2026-07-09 13:22:23 on dist-test-slave-w3b1"
I20260709 13:22:23.447750 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:22:23.451203 27086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:23.451972 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:22:23.452229 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/master-0-root
uuid: "674a4711933c423cbf0bbe024245c151"
format_stamp: "Formatted at 2026-07-09 13:22:23 on dist-test-slave-w3b1"
I20260709 13:22:23.452471 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:23.467253 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:23.468492 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:23.507004 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.62:33225
I20260709 13:22:23.507097 27138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.62:33225 every 8 connection(s)
I20260709 13:22:23.510898 27139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:23.521908 27139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151: Bootstrap starting.
I20260709 13:22:23.526958 27139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:23.531440 27139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151: No bootstrap required, opened a new log
I20260709 13:22:23.533738 27139 raft_consensus.cc:359] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "674a4711933c423cbf0bbe024245c151" member_type: VOTER }
I20260709 13:22:23.534173 27139 raft_consensus.cc:385] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:23.534413 27139 raft_consensus.cc:740] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 674a4711933c423cbf0bbe024245c151, State: Initialized, Role: FOLLOWER
I20260709 13:22:23.534997 27139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "674a4711933c423cbf0bbe024245c151" member_type: VOTER }
I20260709 13:22:23.535449 27139 raft_consensus.cc:399] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:23.535688 27139 raft_consensus.cc:493] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:23.535924 27139 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:23.540786 27139 raft_consensus.cc:515] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "674a4711933c423cbf0bbe024245c151" member_type: VOTER }
I20260709 13:22:23.541356 27139 leader_election.cc:304] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 674a4711933c423cbf0bbe024245c151; no voters: 
I20260709 13:22:23.542565 27139 leader_election.cc:290] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:23.542999 27142 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:23.544442 27142 raft_consensus.cc:697] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 1 LEADER]: Becoming Leader. State: Replica: 674a4711933c423cbf0bbe024245c151, State: Running, Role: LEADER
I20260709 13:22:23.545197 27142 consensus_queue.cc:237] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "674a4711933c423cbf0bbe024245c151" member_type: VOTER }
I20260709 13:22:23.545643 27139 sys_catalog.cc:565] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:23.549791 27143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "674a4711933c423cbf0bbe024245c151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "674a4711933c423cbf0bbe024245c151" member_type: VOTER } }
I20260709 13:22:23.550524 27143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:23.550395 27144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 674a4711933c423cbf0bbe024245c151. Latest consensus state: current_term: 1 leader_uuid: "674a4711933c423cbf0bbe024245c151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "674a4711933c423cbf0bbe024245c151" member_type: VOTER } }
I20260709 13:22:23.550982 27144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:23.553915 27148 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:23.562392 27148 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:23.563911 16192 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:23.571872 27148 catalog_manager.cc:1383] Generated new cluster ID: 17d2f759e99445d9898ece732b309a16
I20260709 13:22:23.572191 27148 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:23.587428 27148 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:23.588754 27148 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:23.608276 27148 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151: Generated new TSK 0
I20260709 13:22:23.608943 27148 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:23.631194 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:23.637459 27160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:23.638736 27161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:23.640745 27163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:23.643028 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:23.644062 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:23.644332 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:23.644502 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603343644464 us; error 0 us; skew 500 ppm
I20260709 13:22:23.645093 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:23.647686 16192 webserver.cc:533] Webserver started at http://127.15.208.1:35161/ using document root <none> and password file <none>
I20260709 13:22:23.648192 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:23.648391 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:23.648666 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:23.649734 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-0-root/instance:
uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
format_stamp: "Formatted at 2026-07-09 13:22:23 on dist-test-slave-w3b1"
I20260709 13:22:23.654330 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:23.657696 27168 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:23.658664 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:23.658980 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-0-root
uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
format_stamp: "Formatted at 2026-07-09 13:22:23 on dist-test-slave-w3b1"
I20260709 13:22:23.659283 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:23.671515 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:23.672766 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:23.674417 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:23.676703 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:23.676945 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:22:23.677199 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:23.677392 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:23.718247 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.1:44757
I20260709 13:22:23.718371 27230 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.1:44757 every 8 connection(s)
I20260709 13:22:23.723371 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:23.730587 27235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:23.732589 27236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:23.735634 27238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:23.737275 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:23.738435 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:23.738619 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:23.738763 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603343738752 us; error 0 us; skew 500 ppm
I20260709 13:22:23.739187 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:23.741698 16192 webserver.cc:533] Webserver started at http://127.15.208.2:38143/ using document root <none> and password file <none>
I20260709 13:22:23.742316 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:23.742545 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:23.742878 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:23.743956 27231 heartbeater.cc:344] Connected to a master server at 127.15.208.62:33225
I20260709 13:22:23.744369 27231 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:23.744287 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-1-root/instance:
uuid: "cca6e7866b17408cae8c4f839f878ed1"
format_stamp: "Formatted at 2026-07-09 13:22:23 on dist-test-slave-w3b1"
I20260709 13:22:23.745190 27231 heartbeater.cc:507] Master 127.15.208.62:33225 requested a full tablet report, sending...
I20260709 13:22:23.747411 27103 ts_manager.cc:194] Registered new tserver with Master: 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757)
I20260709 13:22:23.749789 27103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51594
I20260709 13:22:23.749944 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:23.753705 27243 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:23.754570 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:22:23.754894 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-1-root
uuid: "cca6e7866b17408cae8c4f839f878ed1"
format_stamp: "Formatted at 2026-07-09 13:22:23 on dist-test-slave-w3b1"
I20260709 13:22:23.755189 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:23.780006 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:23.781272 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:23.782783 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:23.785116 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:23.785339 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:23.785574 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:23.785742 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:23.826308 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.2:40417
I20260709 13:22:23.826478 27305 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.2:40417 every 8 connection(s)
I20260709 13:22:23.831249 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:23.838735 27309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:23.840938 27310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:23.841730 16192 server_base.cc:1061] running on GCE node
W20260709 13:22:23.842531 27312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:23.843781 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:23.844059 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:23.844301 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603343844282 us; error 0 us; skew 500 ppm
I20260709 13:22:23.845037 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:23.845122 27306 heartbeater.cc:344] Connected to a master server at 127.15.208.62:33225
I20260709 13:22:23.845584 27306 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:23.846487 27306 heartbeater.cc:507] Master 127.15.208.62:33225 requested a full tablet report, sending...
I20260709 13:22:23.847708 16192 webserver.cc:533] Webserver started at http://127.15.208.3:39873/ using document root <none> and password file <none>
I20260709 13:22:23.848417 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:23.848657 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:23.848995 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:23.848955 27103 ts_manager.cc:194] Registered new tserver with Master: cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:23.850800 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-2-root/instance:
uuid: "40d2fecddfbf480f86321e2bd7f390b5"
format_stamp: "Formatted at 2026-07-09 13:22:23 on dist-test-slave-w3b1"
I20260709 13:22:23.851082 27103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51610
I20260709 13:22:23.855854 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:23.859449 27317 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:23.860230 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:23.860539 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-2-root
uuid: "40d2fecddfbf480f86321e2bd7f390b5"
format_stamp: "Formatted at 2026-07-09 13:22:23 on dist-test-slave-w3b1"
I20260709 13:22:23.860821 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:23.885298 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:23.886541 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:23.888019 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:23.890359 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:23.890537 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:23.890841 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:23.891012 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:23.930970 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.3:44915
I20260709 13:22:23.931077 27379 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.3:44915 every 8 connection(s)
I20260709 13:22:23.944761 27380 heartbeater.cc:344] Connected to a master server at 127.15.208.62:33225
I20260709 13:22:23.945184 27380 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:23.945878 27380 heartbeater.cc:507] Master 127.15.208.62:33225 requested a full tablet report, sending...
I20260709 13:22:23.947861 27103 ts_manager.cc:194] Registered new tserver with Master: 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:23.948856 16192 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014711811s
I20260709 13:22:23.949581 27103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51618
I20260709 13:22:23.975627 27103 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51634:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:23.978555 27103 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:24.065454 27345 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3162f2a4ec48d8ad68d03735cfe776 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:24.067195 27345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3162f2a4ec48d8ad68d03735cfe776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.067898 27341 tablet_service.cc:1511] Processing CreateTablet for tablet 9b469a7c6a4046269b279c03f61456ec (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:24.069932 27342 tablet_service.cc:1511] Processing CreateTablet for tablet 94bf6da7f6474db8a0ee9f5fc287675e (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:24.071410 27196 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3162f2a4ec48d8ad68d03735cfe776 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:24.071758 27343 tablet_service.cc:1511] Processing CreateTablet for tablet 83277692572b4bc3970b9e403aa73a18 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:24.072888 27196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3162f2a4ec48d8ad68d03735cfe776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.073534 27344 tablet_service.cc:1511] Processing CreateTablet for tablet d86840f734a04c1fa154192ea396b15c (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:24.074486 27340 tablet_service.cc:1511] Processing CreateTablet for tablet 15186667024a468eba0accca5af212b4 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:24.075033 27341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b469a7c6a4046269b279c03f61456ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.077335 27339 tablet_service.cc:1511] Processing CreateTablet for tablet 4c69fa7372904583a992a8418a9874c4 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:24.079262 27271 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3162f2a4ec48d8ad68d03735cfe776 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:24.080590 27271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3162f2a4ec48d8ad68d03735cfe776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.082036 27270 tablet_service.cc:1511] Processing CreateTablet for tablet d86840f734a04c1fa154192ea396b15c (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:24.084203 27269 tablet_service.cc:1511] Processing CreateTablet for tablet 83277692572b4bc3970b9e403aa73a18 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:24.085376 27337 tablet_service.cc:1511] Processing CreateTablet for tablet c2d28689eaca4a8fbf307725b7695ef4 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:24.086617 27268 tablet_service.cc:1511] Processing CreateTablet for tablet 94bf6da7f6474db8a0ee9f5fc287675e (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:24.087275 27263 tablet_service.cc:1511] Processing CreateTablet for tablet c2d28689eaca4a8fbf307725b7695ef4 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:24.088065 27262 tablet_service.cc:1511] Processing CreateTablet for tablet 9de70c86acde4dab9e5bc8383e8f7176 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:24.090044 27264 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa8b5ff78894a808a3810fcfbbda3f2 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:24.090440 27336 tablet_service.cc:1511] Processing CreateTablet for tablet 9de70c86acde4dab9e5bc8383e8f7176 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:24.090782 27267 tablet_service.cc:1511] Processing CreateTablet for tablet 9b469a7c6a4046269b279c03f61456ec (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:24.092481 27265 tablet_service.cc:1511] Processing CreateTablet for tablet 4c69fa7372904583a992a8418a9874c4 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:24.092923 27338 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa8b5ff78894a808a3810fcfbbda3f2 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:24.093394 27340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15186667024a468eba0accca5af212b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.092521 27266 tablet_service.cc:1511] Processing CreateTablet for tablet 15186667024a468eba0accca5af212b4 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:24.094957 27342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bf6da7f6474db8a0ee9f5fc287675e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.095245 27263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d28689eaca4a8fbf307725b7695ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.095902 27270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86840f734a04c1fa154192ea396b15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.096532 27266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15186667024a468eba0accca5af212b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.097250 27344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86840f734a04c1fa154192ea396b15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.100029 27262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de70c86acde4dab9e5bc8383e8f7176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.100768 27267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b469a7c6a4046269b279c03f61456ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.100934 27195 tablet_service.cc:1511] Processing CreateTablet for tablet d86840f734a04c1fa154192ea396b15c (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:24.100934 27189 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa8b5ff78894a808a3810fcfbbda3f2 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:24.103778 27194 tablet_service.cc:1511] Processing CreateTablet for tablet 83277692572b4bc3970b9e403aa73a18 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:24.106078 27193 tablet_service.cc:1511] Processing CreateTablet for tablet 94bf6da7f6474db8a0ee9f5fc287675e (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:24.107735 27265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c69fa7372904583a992a8418a9874c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.108448 27192 tablet_service.cc:1511] Processing CreateTablet for tablet 9b469a7c6a4046269b279c03f61456ec (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:24.110697 27191 tablet_service.cc:1511] Processing CreateTablet for tablet 15186667024a468eba0accca5af212b4 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:24.112887 27190 tablet_service.cc:1511] Processing CreateTablet for tablet 4c69fa7372904583a992a8418a9874c4 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:24.113876 27269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83277692572b4bc3970b9e403aa73a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.114449 27339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c69fa7372904583a992a8418a9874c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.115911 27338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa8b5ff78894a808a3810fcfbbda3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.117223 27268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bf6da7f6474db8a0ee9f5fc287675e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.121022 27264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa8b5ff78894a808a3810fcfbbda3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.121567 27337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d28689eaca4a8fbf307725b7695ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.122378 27343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83277692572b4bc3970b9e403aa73a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.126833 27188 tablet_service.cc:1511] Processing CreateTablet for tablet c2d28689eaca4a8fbf307725b7695ef4 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:24.102299 27195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86840f734a04c1fa154192ea396b15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.129261 27336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de70c86acde4dab9e5bc8383e8f7176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.129671 27188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d28689eaca4a8fbf307725b7695ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.133199 27192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b469a7c6a4046269b279c03f61456ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.129300 27187 tablet_service.cc:1511] Processing CreateTablet for tablet 9de70c86acde4dab9e5bc8383e8f7176 (DEFAULT_TABLE table=test-workload [id=e5b1bc60ded34e28af4c7c3793948464]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:24.134311 27187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de70c86acde4dab9e5bc8383e8f7176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.134917 27189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa8b5ff78894a808a3810fcfbbda3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.135519 27190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c69fa7372904583a992a8418a9874c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.145226 27193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94bf6da7f6474db8a0ee9f5fc287675e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.150542 27191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15186667024a468eba0accca5af212b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.153291 27194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83277692572b4bc3970b9e403aa73a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:24.227783 27395 tablet_bootstrap.cc:492] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5: Bootstrap starting.
I20260709 13:22:24.270819 27395 tablet_bootstrap.cc:654] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.279199 27397 tablet_bootstrap.cc:492] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:24.282529 27396 tablet_bootstrap.cc:492] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1: Bootstrap starting.
I20260709 13:22:24.285367 27395 tablet_bootstrap.cc:492] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5: No bootstrap required, opened a new log
I20260709 13:22:24.285986 27395 ts_tablet_manager.cc:1403] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.000s
I20260709 13:22:24.288733 27396 tablet_bootstrap.cc:654] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.289394 27397 tablet_bootstrap.cc:654] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.289073 27395 raft_consensus.cc:359] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.289888 27395 raft_consensus.cc:385] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.290220 27395 raft_consensus.cc:740] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.291047 27395 consensus_queue.cc:260] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.297742 27380 heartbeater.cc:499] Master 127.15.208.62:33225 was elected leader, sending a full tablet report...
I20260709 13:22:24.298302 27397 tablet_bootstrap.cc:492] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: No bootstrap required, opened a new log
I20260709 13:22:24.298341 27395 ts_tablet_manager.cc:1434] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.008s
I20260709 13:22:24.299017 27397 ts_tablet_manager.cc:1403] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.009s
I20260709 13:22:24.299669 27395 tablet_bootstrap.cc:492] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5: Bootstrap starting.
I20260709 13:22:24.302074 27397 raft_consensus.cc:359] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.302819 27397 raft_consensus.cc:385] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.303133 27397 raft_consensus.cc:740] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.303239 27396 tablet_bootstrap.cc:492] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1: No bootstrap required, opened a new log
I20260709 13:22:24.303931 27396 ts_tablet_manager.cc:1403] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.012s
I20260709 13:22:24.304078 27397 consensus_queue.cc:260] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.306177 27395 tablet_bootstrap.cc:654] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.307298 27396 raft_consensus.cc:359] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.308143 27396 raft_consensus.cc:385] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.308485 27396 raft_consensus.cc:740] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.309448 27396 consensus_queue.cc:260] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.314306 27397 ts_tablet_manager.cc:1434] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.012s
I20260709 13:22:24.315307 27231 heartbeater.cc:499] Master 127.15.208.62:33225 was elected leader, sending a full tablet report...
I20260709 13:22:24.330016 27397 tablet_bootstrap.cc:492] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:24.338924 27306 heartbeater.cc:499] Master 127.15.208.62:33225 was elected leader, sending a full tablet report...
I20260709 13:22:24.339498 27396 ts_tablet_manager.cc:1434] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1: Time spent starting tablet: real 0.035s	user 0.011s	sys 0.019s
I20260709 13:22:24.339541 27397 tablet_bootstrap.cc:654] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.341145 27396 tablet_bootstrap.cc:492] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1: Bootstrap starting.
I20260709 13:22:24.347703 27396 tablet_bootstrap.cc:654] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.349965 27395 tablet_bootstrap.cc:492] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5: No bootstrap required, opened a new log
I20260709 13:22:24.350575 27395 ts_tablet_manager.cc:1403] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.019s
I20260709 13:22:24.354497 27395 raft_consensus.cc:359] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.355494 27395 raft_consensus.cc:385] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.355863 27395 raft_consensus.cc:740] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.357051 27395 consensus_queue.cc:260] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.360612 27395 ts_tablet_manager.cc:1434] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:22:24.362124 27395 tablet_bootstrap.cc:492] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5: Bootstrap starting.
I20260709 13:22:24.367071 27396 tablet_bootstrap.cc:492] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1: No bootstrap required, opened a new log
I20260709 13:22:24.367710 27396 ts_tablet_manager.cc:1403] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.000s
I20260709 13:22:24.369388 27395 tablet_bootstrap.cc:654] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.369979 27397 tablet_bootstrap.cc:492] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: No bootstrap required, opened a new log
I20260709 13:22:24.370564 27397 ts_tablet_manager.cc:1403] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.008s
I20260709 13:22:24.370808 27396 raft_consensus.cc:359] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.371601 27396 raft_consensus.cc:385] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.371912 27396 raft_consensus.cc:740] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.372882 27396 consensus_queue.cc:260] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.373624 27397 raft_consensus.cc:359] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.375072 27397 raft_consensus.cc:385] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.375362 27397 raft_consensus.cc:740] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.375741 27396 ts_tablet_manager.cc:1434] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:22:24.376245 27397 consensus_queue.cc:260] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.377252 27396 tablet_bootstrap.cc:492] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1: Bootstrap starting.
I20260709 13:22:24.380714 27397 ts_tablet_manager.cc:1434] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:24.381767 27397 tablet_bootstrap.cc:492] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:24.388752 27396 tablet_bootstrap.cc:654] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.393778 27395 tablet_bootstrap.cc:492] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5: No bootstrap required, opened a new log
I20260709 13:22:24.394316 27395 ts_tablet_manager.cc:1403] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5: Time spent bootstrapping tablet: real 0.032s	user 0.030s	sys 0.000s
I20260709 13:22:24.394825 27397 tablet_bootstrap.cc:654] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.397459 27395 raft_consensus.cc:359] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.398083 27395 raft_consensus.cc:385] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.398375 27395 raft_consensus.cc:740] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.398856 27396 tablet_bootstrap.cc:492] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1: No bootstrap required, opened a new log
I20260709 13:22:24.399055 27395 consensus_queue.cc:260] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.399645 27396 ts_tablet_manager.cc:1403] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 13:22:24.401269 27395 ts_tablet_manager.cc:1434] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:22:24.402352 27395 tablet_bootstrap.cc:492] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5: Bootstrap starting.
I20260709 13:22:24.403882 27396 raft_consensus.cc:359] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.404937 27396 raft_consensus.cc:385] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.405303 27396 raft_consensus.cc:740] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.406391 27396 consensus_queue.cc:260] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.409303 27395 tablet_bootstrap.cc:654] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.409463 27396 ts_tablet_manager.cc:1434] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:22:24.410532 27396 tablet_bootstrap.cc:492] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1: Bootstrap starting.
I20260709 13:22:24.414839 27395 tablet_bootstrap.cc:492] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5: No bootstrap required, opened a new log
I20260709 13:22:24.414860 27397 tablet_bootstrap.cc:492] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: No bootstrap required, opened a new log
I20260709 13:22:24.416064 27397 ts_tablet_manager.cc:1403] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.000s
I20260709 13:22:24.415592 27395 ts_tablet_manager.cc:1403] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 13:22:24.416679 27396 tablet_bootstrap.cc:654] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.418843 27397 raft_consensus.cc:359] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.419616 27397 raft_consensus.cc:385] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.419593 27395 raft_consensus.cc:359] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.420156 27397 raft_consensus.cc:740] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.420529 27395 raft_consensus.cc:385] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.420881 27395 raft_consensus.cc:740] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.420995 27397 consensus_queue.cc:260] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.421792 27395 consensus_queue.cc:260] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.423260 27397 ts_tablet_manager.cc:1434] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:22:24.424248 27395 ts_tablet_manager.cc:1434] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:24.425307 27395 tablet_bootstrap.cc:492] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5: Bootstrap starting.
I20260709 13:22:24.431821 27395 tablet_bootstrap.cc:654] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:24.435428 27381 tablet.cc:2406] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:24.438648 27402 raft_consensus.cc:493] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.439379 27402 raft_consensus.cc:515] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.446213 27402 leader_election.cc:290] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:24.447695 27397 tablet_bootstrap.cc:492] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:24.460942 27396 tablet_bootstrap.cc:492] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1: No bootstrap required, opened a new log
I20260709 13:22:24.461651 27396 ts_tablet_manager.cc:1403] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.021s
I20260709 13:22:24.461669 27395 tablet_bootstrap.cc:492] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5: No bootstrap required, opened a new log
I20260709 13:22:24.461923 27397 tablet_bootstrap.cc:654] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.462874 27395 ts_tablet_manager.cc:1403] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.017s
I20260709 13:22:24.465806 27396 raft_consensus.cc:359] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:24.466344 27395 raft_consensus.cc:359] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.470430 27395 raft_consensus.cc:385] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.470269 27396 raft_consensus.cc:385] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.471062 27395 raft_consensus.cc:740] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.473106 27395 consensus_queue.cc:260] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.474722 27281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15186667024a468eba0accca5af212b4" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:24.475389 27281 raft_consensus.cc:2468] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1df1f2ed97b14cdb9ac7f8ac5647205d in term 0.
I20260709 13:22:24.475553 27396 raft_consensus.cc:740] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.475324 27395 ts_tablet_manager.cc:1434] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:22:24.476655 27397 tablet_bootstrap.cc:492] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: No bootstrap required, opened a new log
I20260709 13:22:24.476513 27396 consensus_queue.cc:260] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:24.477501 27397 ts_tablet_manager.cc:1403] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.002s
I20260709 13:22:24.478996 27396 ts_tablet_manager.cc:1434] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:22:24.479414 27395 tablet_bootstrap.cc:492] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5: Bootstrap starting.
I20260709 13:22:24.480201 27396 tablet_bootstrap.cc:492] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1: Bootstrap starting.
I20260709 13:22:24.480463 27397 raft_consensus.cc:359] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.481259 27397 raft_consensus.cc:385] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.481561 27397 raft_consensus.cc:740] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.482447 27397 consensus_queue.cc:260] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.486515 27395 tablet_bootstrap.cc:654] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.487521 27396 tablet_bootstrap.cc:654] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.487646 27397 ts_tablet_manager.cc:1434] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:24.488828 27397 tablet_bootstrap.cc:492] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:24.494632 27401 raft_consensus.cc:493] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.495231 27401 raft_consensus.cc:515] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.496637 27397 tablet_bootstrap.cc:654] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.499408 27396 tablet_bootstrap.cc:492] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1: No bootstrap required, opened a new log
I20260709 13:22:24.502308 27170 leader_election.cc:304] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:24.503240 27402 raft_consensus.cc:2804] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.503739 27402 raft_consensus.cc:493] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.504184 27402 raft_consensus.cc:3060] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.500013 27404 raft_consensus.cc:493] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.500013 27396 ts_tablet_manager.cc:1403] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:22:24.511395 27404 raft_consensus.cc:515] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:24.500957 27401 leader_election.cc:290] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.521425 27404 leader_election.cc:290] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915), 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757)
I20260709 13:22:24.522259 27402 raft_consensus.cc:515] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.527207 27401 raft_consensus.cc:493] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.532527 27401 raft_consensus.cc:515] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.533962 27281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15186667024a468eba0accca5af212b4" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:24.534864 27281 raft_consensus.cc:3060] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.535123 27401 leader_election.cc:290] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.538861 27396 raft_consensus.cc:359] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.540650 27396 raft_consensus.cc:385] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.541221 27396 raft_consensus.cc:740] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.542263 27396 consensus_queue.cc:260] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.551316 27395 tablet_bootstrap.cc:492] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5: No bootstrap required, opened a new log
I20260709 13:22:24.551918 27395 ts_tablet_manager.cc:1403] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.004s
I20260709 13:22:24.552732 27355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15186667024a468eba0accca5af212b4" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
I20260709 13:22:24.549976 27402 leader_election.cc:290] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 election: Requested vote from peers cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:24.553546 27355 raft_consensus.cc:2468] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1df1f2ed97b14cdb9ac7f8ac5647205d in term 0.
I20260709 13:22:24.555169 27395 raft_consensus.cc:359] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.555800 27395 raft_consensus.cc:385] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.556107 27395 raft_consensus.cc:740] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.556795 27280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15186667024a468eba0accca5af212b4" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:24.557680 27355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15186667024a468eba0accca5af212b4" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:24.558264 27355 raft_consensus.cc:3060] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.558420 27397 tablet_bootstrap.cc:492] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: No bootstrap required, opened a new log
W20260709 13:22:24.558810 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:24.558990 27397 ts_tablet_manager.cc:1403] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.000s
I20260709 13:22:24.558712 27280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:24.555464 27396 ts_tablet_manager.cc:1434] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:22:24.559613 27280 raft_consensus.cc:2468] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 0.
I20260709 13:22:24.560776 27395 consensus_queue.cc:260] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.563057 27397 raft_consensus.cc:359] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.563824 27397 raft_consensus.cc:385] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.564145 27397 raft_consensus.cc:740] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.564985 27397 consensus_queue.cc:260] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.565732 27395 ts_tablet_manager.cc:1434] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 13:22:24.565886 27281 raft_consensus.cc:2468] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1df1f2ed97b14cdb9ac7f8ac5647205d in term 1.
I20260709 13:22:24.567322 27319 leader_election.cc:304] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:24.568305 27170 leader_election.cc:304] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:24.569187 27402 raft_consensus.cc:2804] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.570175 27396 tablet_bootstrap.cc:492] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1: Bootstrap starting.
I20260709 13:22:24.572525 27397 ts_tablet_manager.cc:1434] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:22:24.572600 27421 raft_consensus.cc:2804] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.574580 27401 raft_consensus.cc:493] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.576644 27355 raft_consensus.cc:2468] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1df1f2ed97b14cdb9ac7f8ac5647205d in term 1.
I20260709 13:22:24.576963 27401 raft_consensus.cc:515] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.579187 27401 leader_election.cc:290] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.580824 27404 raft_consensus.cc:493] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.581410 27404 raft_consensus.cc:515] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.583529 27404 leader_election.cc:290] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:24.584441 27281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:24.586440 27396 tablet_bootstrap.cc:654] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:24.586627 27319 leader_election.cc:343] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.598783 27421 raft_consensus.cc:493] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.599486 27421 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.602506 27395 tablet_bootstrap.cc:492] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5: Bootstrap starting.
I20260709 13:22:24.611270 27397 tablet_bootstrap.cc:492] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:24.613526 27395 tablet_bootstrap.cc:654] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.615309 27355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
I20260709 13:22:24.615705 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d28689eaca4a8fbf307725b7695ef4" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
W20260709 13:22:24.617239 27245 leader_election.cc:343] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:24.617897 27245 leader_election.cc:343] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.624503 27395 tablet_bootstrap.cc:492] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5: No bootstrap required, opened a new log
I20260709 13:22:24.625162 27395 ts_tablet_manager.cc:1403] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.012s
I20260709 13:22:24.626004 27396 tablet_bootstrap.cc:492] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1: No bootstrap required, opened a new log
I20260709 13:22:24.626549 27396 ts_tablet_manager.cc:1403] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.016s
I20260709 13:22:24.628005 27397 tablet_bootstrap.cc:654] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.621230 27402 raft_consensus.cc:697] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 LEADER]: Becoming Leader. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Running, Role: LEADER
I20260709 13:22:24.628441 27395 raft_consensus.cc:359] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.629386 27395 raft_consensus.cc:385] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.629321 27402 consensus_queue.cc:237] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.629436 27396 raft_consensus.cc:359] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.630046 27395 raft_consensus.cc:740] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.630419 27396 raft_consensus.cc:385] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.630781 27396 raft_consensus.cc:740] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.623095 27421 raft_consensus.cc:515] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.631198 27395 consensus_queue.cc:260] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.631655 27396 consensus_queue.cc:260] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.633857 27395 ts_tablet_manager.cc:1434] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:24.634944 27395 tablet_bootstrap.cc:492] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5: Bootstrap starting.
I20260709 13:22:24.636746 27396 ts_tablet_manager.cc:1434] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:24.637877 27396 tablet_bootstrap.cc:492] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1: Bootstrap starting.
I20260709 13:22:24.638092 27205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:24.639662 27204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:24.640964 27203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d28689eaca4a8fbf307725b7695ef4" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:24.643307 27395 tablet_bootstrap.cc:654] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.641808 27206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15186667024a468eba0accca5af212b4" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:24.644800 27396 tablet_bootstrap.cc:654] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:24.642546 27320 leader_election.cc:343] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.643352 27203 raft_consensus.cc:2468] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 0.
I20260709 13:22:24.641448 27202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:24.647251 27320 leader_election.cc:304] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1
W20260709 13:22:24.648447 27246 leader_election.cc:343] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.648954 27246 leader_election.cc:304] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cca6e7866b17408cae8c4f839f878ed1; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:24.649271 27401 raft_consensus.cc:2749] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:24.647909 27202 raft_consensus.cc:2468] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 0.
I20260709 13:22:24.650215 27246 leader_election.cc:304] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:24.651427 27404 raft_consensus.cc:2749] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:24.652094 27404 raft_consensus.cc:2804] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.652405 27404 raft_consensus.cc:493] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.652729 27404 raft_consensus.cc:3060] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.651419 27320 leader_election.cc:304] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:24.657356 27401 raft_consensus.cc:2804] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.657713 27401 raft_consensus.cc:493] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.658057 27401 raft_consensus.cc:3060] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.662824 27432 raft_consensus.cc:493] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.663532 27432 raft_consensus.cc:515] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.666240 27432 leader_election.cc:290] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.667615 27281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:24.667869 27280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bf6da7f6474db8a0ee9f5fc287675e" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:24.668308 27421 leader_election.cc:290] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.668479 27281 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.668659 27280 raft_consensus.cc:2468] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 0.
I20260709 13:22:24.670539 27319 leader_election.cc:304] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:24.671527 27421 raft_consensus.cc:2804] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.671868 27421 raft_consensus.cc:493] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.672166 27421 raft_consensus.cc:3060] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.675127 27401 raft_consensus.cc:515] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.678512 27202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bf6da7f6474db8a0ee9f5fc287675e" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:24.679471 27281 raft_consensus.cc:2468] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:24.681222 27202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:24.681962 27319 leader_election.cc:304] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:24.682746 27432 raft_consensus.cc:493] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:24.682909 27320 leader_election.cc:343] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.683136 27421 raft_consensus.cc:515] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.683326 27432 raft_consensus.cc:515] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
W20260709 13:22:24.683977 27320 leader_election.cc:343] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.685719 27404 raft_consensus.cc:515] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.686152 27432 leader_election.cc:290] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.686915 27432 raft_consensus.cc:2804] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.687459 27432 raft_consensus.cc:697] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:24.688385 27397 tablet_bootstrap.cc:492] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: No bootstrap required, opened a new log
I20260709 13:22:24.688959 27397 ts_tablet_manager.cc:1403] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.008s
I20260709 13:22:24.688524 27432 consensus_queue.cc:237] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.691987 27202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d28689eaca4a8fbf307725b7695ef4" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:24.692054 27397 raft_consensus.cc:359] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.692721 27202 raft_consensus.cc:3060] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.695729 27395 tablet_bootstrap.cc:492] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5: No bootstrap required, opened a new log
I20260709 13:22:24.696225 27401 leader_election.cc:290] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.697186 27404 leader_election.cc:290] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:24.703701 27395 ts_tablet_manager.cc:1403] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.018s
I20260709 13:22:24.703895 27203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bf6da7f6474db8a0ee9f5fc287675e" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:24.705291 27206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d28689eaca4a8fbf307725b7695ef4" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:24.706662 27395 raft_consensus.cc:359] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.707432 27395 raft_consensus.cc:385] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.698549 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d28689eaca4a8fbf307725b7695ef4" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:24.708015 27354 raft_consensus.cc:3060] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.707839 27101 catalog_manager.cc:5697] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:24.698019 27397 raft_consensus.cc:385] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.702587 27281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d28689eaca4a8fbf307725b7695ef4" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:24.707105 27204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:24.710630 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94bf6da7f6474db8a0ee9f5fc287675e" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:24.711081 27281 raft_consensus.cc:2393] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40d2fecddfbf480f86321e2bd7f390b5 in current term 1: Already voted for candidate cca6e7866b17408cae8c4f839f878ed1 in this term.
I20260709 13:22:24.711305 27279 raft_consensus.cc:3060] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.712242 27319 leader_election.cc:304] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:24.701582 27280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:24.713274 27280 raft_consensus.cc:3060] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.713555 27397 raft_consensus.cc:740] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.710691 27204 raft_consensus.cc:3060] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.714377 27397 consensus_queue.cc:260] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.715378 27203 raft_consensus.cc:3060] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.722738 27203 raft_consensus.cc:2468] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:24.724954 27421 leader_election.cc:290] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.727245 27320 leader_election.cc:304] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:24.727905 27395 raft_consensus.cc:740] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.728214 27421 raft_consensus.cc:2804] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.728796 27421 raft_consensus.cc:697] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:24.729563 27354 raft_consensus.cc:2468] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 1.
I20260709 13:22:24.732304 27425 raft_consensus.cc:493] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.732447 27279 raft_consensus.cc:2468] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:24.732589 27433 raft_consensus.cc:2749] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:24.732865 27425 raft_consensus.cc:515] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.733155 27245 leader_election.cc:304] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:24.734519 27404 raft_consensus.cc:2804] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.734915 27396 tablet_bootstrap.cc:492] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1: No bootstrap required, opened a new log
I20260709 13:22:24.735033 27404 raft_consensus.cc:697] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:24.735267 27425 leader_election.cc:290] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:24.735579 27396 ts_tablet_manager.cc:1403] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.029s
I20260709 13:22:24.736106 27404 consensus_queue.cc:237] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.737324 27355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
I20260709 13:22:24.737959 27355 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1df1f2ed97b14cdb9ac7f8ac5647205d in term 0.
I20260709 13:22:24.738654 27396 raft_consensus.cc:359] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.739434 27396 raft_consensus.cc:385] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.739789 27396 raft_consensus.cc:740] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.723068 27280 raft_consensus.cc:2468] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:24.740293 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:24.740558 27397 ts_tablet_manager.cc:1434] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:22:24.741353 27319 leader_election.cc:304] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:24.742022 27397 tablet_bootstrap.cc:492] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:24.731657 27204 raft_consensus.cc:2468] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:24.742456 27433 raft_consensus.cc:2804] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.731336 27395 consensus_queue.cc:260] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.739214 27170 leader_election.cc:304] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:24.743440 27433 raft_consensus.cc:697] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:24.743589 27425 raft_consensus.cc:2804] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.744438 27433 consensus_queue.cc:237] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.744050 27425 raft_consensus.cc:493] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.729671 27421 consensus_queue.cc:237] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.745477 27425 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.747893 27395 ts_tablet_manager.cc:1434] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
W20260709 13:22:24.749198 27170 leader_election.cc:343] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.749378 27395 tablet_bootstrap.cc:492] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5: Bootstrap starting.
I20260709 13:22:24.739192 27202 raft_consensus.cc:2468] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 1.
I20260709 13:22:24.762575 27402 raft_consensus.cc:493] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.764961 27402 raft_consensus.cc:515] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.766593 27425 raft_consensus.cc:515] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.768085 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:24.768952 27425 leader_election.cc:290] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 election: Requested vote from peers cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:24.765815 27395 tablet_bootstrap.cc:654] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.770808 27280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:24.772156 27396 consensus_queue.cc:260] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.772584 27402 leader_election.cc:290] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:24.773239 27279 raft_consensus.cc:2468] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1df1f2ed97b14cdb9ac7f8ac5647205d in term 0.
I20260709 13:22:24.774039 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:24.774566 27397 tablet_bootstrap.cc:654] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.774421 27421 raft_consensus.cc:493] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:24.775424 27170 leader_election.cc:343] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.774694 27354 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.776226 27170 leader_election.cc:304] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:24.776615 27396 ts_tablet_manager.cc:1434] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:22:24.777786 27396 tablet_bootstrap.cc:492] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1: Bootstrap starting.
I20260709 13:22:24.778437 27355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
W20260709 13:22:24.780596 27170 leader_election.cc:343] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.775332 27421 raft_consensus.cc:515] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.785470 27402 raft_consensus.cc:2804] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.789914 27402 raft_consensus.cc:493] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.790352 27402 raft_consensus.cc:3060] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.790163 27202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:24.792078 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
W20260709 13:22:24.794479 27319 leader_election.cc:343] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:24.795572 27320 leader_election.cc:343] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.796155 27320 leader_election.cc:304] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:24.797230 27433 raft_consensus.cc:2749] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:24.788661 27421 leader_election.cc:290] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.801275 27396 tablet_bootstrap.cc:654] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.801723 27395 tablet_bootstrap.cc:492] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5: No bootstrap required, opened a new log
I20260709 13:22:24.805377 27354 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1df1f2ed97b14cdb9ac7f8ac5647205d in term 1.
I20260709 13:22:24.805685 27103 catalog_manager.cc:5697] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1). New cstate: current_term: 1 leader_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:24.807121 27170 leader_election.cc:304] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:24.807952 27402 raft_consensus.cc:515] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.808786 27425 raft_consensus.cc:2804] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.809522 27425 raft_consensus.cc:697] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 LEADER]: Becoming Leader. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Running, Role: LEADER
I20260709 13:22:24.810365 27402 leader_election.cc:290] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 election: Requested vote from peers cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:24.810671 27425 consensus_queue.cc:237] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.814880 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:24.815263 27395 ts_tablet_manager.cc:1403] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.014s
I20260709 13:22:24.815748 27279 raft_consensus.cc:3060] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.819067 27395 raft_consensus.cc:359] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:24.820011 27395 raft_consensus.cc:385] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.820346 27395 raft_consensus.cc:740] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.821395 27395 consensus_queue.cc:260] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:24.822137 27355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
W20260709 13:22:24.824164 27170 leader_election.cc:343] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:24.824476 27395 ts_tablet_manager.cc:1434] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:24.825932 27395 tablet_bootstrap.cc:492] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5: Bootstrap starting.
I20260709 13:22:24.810729 27102 catalog_manager.cc:5697] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 0 to 1, leader changed from <none> to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:24.837693 27395 tablet_bootstrap.cc:654] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.844220 27279 raft_consensus.cc:2468] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1df1f2ed97b14cdb9ac7f8ac5647205d in term 1.
I20260709 13:22:24.847190 27170 leader_election.cc:304] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:24.848523 27439 raft_consensus.cc:2804] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:24.849057 27439 raft_consensus.cc:697] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 LEADER]: Becoming Leader. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Running, Role: LEADER
I20260709 13:22:24.849944 27439 consensus_queue.cc:237] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.858551 27397 tablet_bootstrap.cc:492] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: No bootstrap required, opened a new log
I20260709 13:22:24.859163 27397 ts_tablet_manager.cc:1403] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.117s	user 0.054s	sys 0.025s
I20260709 13:22:24.862107 27397 raft_consensus.cc:359] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.864007 27396 tablet_bootstrap.cc:492] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1: No bootstrap required, opened a new log
I20260709 13:22:24.864735 27396 ts_tablet_manager.cc:1403] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.006s
I20260709 13:22:24.868392 27396 raft_consensus.cc:359] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.869585 27396 raft_consensus.cc:385] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.869974 27396 raft_consensus.cc:740] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.870582 27101 catalog_manager.cc:5697] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:24.870776 27396 consensus_queue.cc:260] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.872056 27101 catalog_manager.cc:5697] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:24.873461 27397 raft_consensus.cc:385] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.873898 27397 raft_consensus.cc:740] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.876699 27397 consensus_queue.cc:260] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.879045 27397 ts_tablet_manager.cc:1434] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:22:24.879240 27396 ts_tablet_manager.cc:1434] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:22:24.880223 27397 tablet_bootstrap.cc:492] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:24.880421 27396 tablet_bootstrap.cc:492] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1: Bootstrap starting.
I20260709 13:22:24.886199 27397 tablet_bootstrap.cc:654] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.885078 27102 catalog_manager.cc:5697] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1). New cstate: current_term: 1 leader_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:24.888065 27396 tablet_bootstrap.cc:654] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.888713 27102 catalog_manager.cc:5697] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1). New cstate: current_term: 1 leader_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:24.895254 27395 tablet_bootstrap.cc:492] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5: No bootstrap required, opened a new log
I20260709 13:22:24.895835 27395 ts_tablet_manager.cc:1403] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.006s
I20260709 13:22:24.898695 27395 raft_consensus.cc:359] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.899204 27395 raft_consensus.cc:385] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.899382 27395 raft_consensus.cc:740] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.900254 27395 consensus_queue.cc:260] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.907532 27395 ts_tablet_manager.cc:1434] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:22:24.914798 27397 tablet_bootstrap.cc:492] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: No bootstrap required, opened a new log
I20260709 13:22:24.915427 27397 ts_tablet_manager.cc:1403] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.025s
I20260709 13:22:24.916143 27396 tablet_bootstrap.cc:492] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1: No bootstrap required, opened a new log
I20260709 13:22:24.916671 27396 ts_tablet_manager.cc:1403] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.005s
I20260709 13:22:24.918381 27397 raft_consensus.cc:359] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.919200 27397 raft_consensus.cc:385] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.919584 27397 raft_consensus.cc:740] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.919369 27396 raft_consensus.cc:359] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.920243 27396 raft_consensus.cc:385] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.920574 27396 raft_consensus.cc:740] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.920634 27397 consensus_queue.cc:260] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.921366 27396 consensus_queue.cc:260] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.923806 27396 ts_tablet_manager.cc:1434] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:22:24.924978 27396 tablet_bootstrap.cc:492] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1: Bootstrap starting.
I20260709 13:22:24.925963 27397 ts_tablet_manager.cc:1434] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:24.931830 27396 tablet_bootstrap.cc:654] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:24.968659 27396 tablet_bootstrap.cc:492] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1: No bootstrap required, opened a new log
I20260709 13:22:24.969219 27396 ts_tablet_manager.cc:1403] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.016s
I20260709 13:22:24.972028 27396 raft_consensus.cc:359] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.972750 27396 raft_consensus.cc:385] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:24.973063 27396 raft_consensus.cc:740] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Initialized, Role: FOLLOWER
I20260709 13:22:24.973866 27396 consensus_queue.cc:260] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.976058 27396 ts_tablet_manager.cc:1434] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:24.978516 27421 raft_consensus.cc:493] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:24.979182 27421 raft_consensus.cc:515] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.982306 27421 leader_election.cc:290] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.983081 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de70c86acde4dab9e5bc8383e8f7176" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:24.983927 27279 raft_consensus.cc:2468] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 0.
I20260709 13:22:24.985929 27319 leader_election.cc:304] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:24.986795 27421 raft_consensus.cc:2804] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:24.987219 27421 raft_consensus.cc:493] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:24.987551 27421 raft_consensus.cc:3060] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:24.993094 27397 tablet_bootstrap.cc:492] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:24.995296 27421 raft_consensus.cc:515] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:24.998144 27421 leader_election.cc:290] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:24.999094 27397 tablet_bootstrap.cc:654] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.001538 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de70c86acde4dab9e5bc8383e8f7176" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:25.002331 27279 raft_consensus.cc:3060] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.005733 27397 tablet_bootstrap.cc:492] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: No bootstrap required, opened a new log
I20260709 13:22:25.006335 27397 ts_tablet_manager.cc:1403] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:22:25.011528 27397 raft_consensus.cc:359] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:25.012347 27397 raft_consensus.cc:385] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.012617 27397 raft_consensus.cc:740] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.013458 27397 consensus_queue.cc:260] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:25.019498 27397 ts_tablet_manager.cc:1434] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:22:25.020664 27397 tablet_bootstrap.cc:492] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:25.026681 27397 tablet_bootstrap.cc:654] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:25.033546 27397 tablet_bootstrap.cc:492] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: No bootstrap required, opened a new log
I20260709 13:22:25.034086 27397 ts_tablet_manager.cc:1403] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:22:25.037320 27397 raft_consensus.cc:359] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:25.038035 27397 raft_consensus.cc:385] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:25.038343 27397 raft_consensus.cc:740] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:25.038987 27397 consensus_queue.cc:260] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:25.041146 27397 ts_tablet_manager.cc:1434] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:25.081678 27204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de70c86acde4dab9e5bc8383e8f7176" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:25.081821 27202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de70c86acde4dab9e5bc8383e8f7176" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:25.082397 27204 raft_consensus.cc:3060] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.112457 27204 raft_consensus.cc:2468] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:25.130817 27404 raft_consensus.cc:493] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.131500 27404 raft_consensus.cc:515] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:25.133405 27439 raft_consensus.cc:493] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.137117 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
I20260709 13:22:25.137835 27354 raft_consensus.cc:2468] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 0.
I20260709 13:22:25.133991 27439 raft_consensus.cc:515] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:25.139252 27245 leader_election.cc:304] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:25.140497 27439 leader_election.cc:290] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:25.133971 27404 leader_election.cc:290] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:25.141362 27280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:25.141607 27404 raft_consensus.cc:2804] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:25.142189 27404 raft_consensus.cc:493] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:25.142534 27404 raft_consensus.cc:3060] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.150447 27404 raft_consensus.cc:515] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:25.151722 27280 raft_consensus.cc:2393] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1df1f2ed97b14cdb9ac7f8ac5647205d in current term 1: Already voted for candidate cca6e7866b17408cae8c4f839f878ed1 in this term.
I20260709 13:22:25.153292 27404 leader_election.cc:290] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:25.154209 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:25.154901 27354 raft_consensus.cc:3060] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.162566 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4" candidate_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
I20260709 13:22:25.163594 27354 raft_consensus.cc:2468] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 1.
I20260709 13:22:25.163784 27320 leader_election.cc:304] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:25.164685 27245 leader_election.cc:304] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:25.165056 27421 raft_consensus.cc:2804] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:25.165592 27404 raft_consensus.cc:2804] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:25.165633 27421 raft_consensus.cc:697] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:25.166409 27404 raft_consensus.cc:697] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:25.165622 27439 consensus_queue.cc:1048] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:22:25.166867 27421 consensus_queue.cc:237] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:25.167315 27404 consensus_queue.cc:237] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:25.168807 27431 raft_consensus.cc:493] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.169353 27431 raft_consensus.cc:515] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:25.171531 27431 leader_election.cc:290] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:25.175529 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
I20260709 13:22:25.176462 27353 raft_consensus.cc:2393] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cca6e7866b17408cae8c4f839f878ed1 in current term 1: Already voted for candidate 1df1f2ed97b14cdb9ac7f8ac5647205d in this term.
I20260709 13:22:25.179015 27431 consensus_queue.cc:1048] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:25.181773 27433 raft_consensus.cc:493] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.182072 27279 raft_consensus.cc:2468] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:25.182320 27433 raft_consensus.cc:515] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:25.186153 27204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:25.186803 27204 raft_consensus.cc:2468] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 0.
I20260709 13:22:25.188347 27432 consensus_queue.cc:1048] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:25.188673 27170 leader_election.cc:304] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d; no voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:25.189882 27439 raft_consensus.cc:3060] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.190546 27320 leader_election.cc:304] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:25.191978 27433 leader_election.cc:290] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:25.195788 27204 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.198632 27439 raft_consensus.cc:2749] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:25.193274 27433 raft_consensus.cc:2804] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:25.201637 27433 raft_consensus.cc:493] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:25.202050 27433 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.211527 27432 consensus_queue.cc:1048] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.217804 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:25.218820 27279 raft_consensus.cc:2468] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 0.
I20260709 13:22:25.221113 27421 consensus_queue.cc:1048] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.221318 27433 raft_consensus.cc:515] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:25.225014 27202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:25.225368 27432 consensus_queue.cc:1048] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.225804 27202 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.237035 27281 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.245359 27203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:25.246158 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:25.246490 27433 leader_election.cc:290] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:25.246826 27277 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.246392 27203 raft_consensus.cc:2468] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 1.
I20260709 13:22:25.260529 27202 raft_consensus.cc:2468] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:25.261839 27206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:25.267374 27277 raft_consensus.cc:2468] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:25.269640 27203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:25.271873 27246 leader_election.cc:304] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cca6e7866b17408cae8c4f839f878ed1; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:25.266072 27425 consensus_queue.cc:1048] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:25.274807 27431 raft_consensus.cc:2749] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:25.277765 27320 leader_election.cc:304] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:25.279496 27439 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:25.282902 27425 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.297941 27433 raft_consensus.cc:2804] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:25.298549 27433 raft_consensus.cc:697] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:25.299402 27433 consensus_queue.cc:237] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:25.314183 27457 consensus_queue.cc:1048] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.315724 27103 catalog_manager.cc:5697] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:25.326606 27206 raft_consensus.cc:2468] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 1.
I20260709 13:22:25.336201 27439 consensus_queue.cc:1048] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:25.355067 27320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:44757, user_credentials={real_user=slave}} blocked reactor thread for 77385.6us
I20260709 13:22:25.358287 27469 raft_consensus.cc:493] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:25.358815 27469 raft_consensus.cc:515] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:25.360965 27469 leader_election.cc:290] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:25.362682 27278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:25.367754 27354 raft_consensus.cc:3060] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:25.375900 27470 consensus_queue.cc:1048] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:25.376173 27469 consensus_queue.cc:1048] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:25.381233 27204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" is_pre_election: true
I20260709 13:22:25.384086 27402 consensus_queue.cc:1048] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:25.384572 27320 leader_election.cc:304] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:25.386562 27470 raft_consensus.cc:2749] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:25.396654 27102 catalog_manager.cc:5697] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 0 to 1, leader changed from <none> to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:25.413686 27103 catalog_manager.cc:5697] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:25.611652 27457 consensus_queue.cc:1048] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:25.618263 27470 consensus_queue.cc:1048] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:25.624308 27457 consensus_queue.cc:1048] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:25.639412 27433 consensus_queue.cc:1048] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:25.639662 16192 ts_manager.cc:295] Set tserver state for 1df1f2ed97b14cdb9ac7f8ac5647205d to MAINTENANCE_MODE
I20260709 13:22:25.641078 16192 tablet_server.cc:179] TabletServer@127.15.208.1:0 shutting down...
W20260709 13:22:25.650287 27320 consensus_peers.cc:597] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:25.686733 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:25.687546 16192 tablet_replica.cc:333] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: stopping tablet replica
I20260709 13:22:25.688280 16192 raft_consensus.cc:2243] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:25.688812 16192 raft_consensus.cc:2272] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:25.691473 16192 tablet_replica.cc:333] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: stopping tablet replica
I20260709 13:22:25.692099 16192 raft_consensus.cc:2243] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:25.692560 16192 raft_consensus.cc:2272] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:25.695066 16192 tablet_replica.cc:333] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: stopping tablet replica
I20260709 13:22:25.695648 16192 raft_consensus.cc:2243] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:25.696071 16192 raft_consensus.cc:2272] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:25.698493 16192 tablet_replica.cc:333] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: stopping tablet replica
I20260709 13:22:25.699054 16192 raft_consensus.cc:2243] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:25.699434 16192 raft_consensus.cc:2272] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:25.701316 16192 tablet_replica.cc:333] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: stopping tablet replica
I20260709 13:22:25.701829 16192 raft_consensus.cc:2243] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:25.702193 16192 raft_consensus.cc:2272] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:25.703819 16192 tablet_replica.cc:333] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: stopping tablet replica
I20260709 13:22:25.704372 16192 raft_consensus.cc:2243] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:25.704941 16192 raft_consensus.cc:2272] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:25.707168 16192 tablet_replica.cc:333] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: stopping tablet replica
I20260709 13:22:25.707746 16192 raft_consensus.cc:2243] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:25.708563 16192 raft_consensus.cc:2272] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:25.710707 16192 tablet_replica.cc:333] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: stopping tablet replica
I20260709 13:22:25.711241 16192 raft_consensus.cc:2243] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:25.712038 16192 raft_consensus.cc:2272] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:25.714586 16192 tablet_replica.cc:333] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: stopping tablet replica
I20260709 13:22:25.715180 16192 raft_consensus.cc:2243] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:25.715583 16192 raft_consensus.cc:2272] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:25.718497 16192 tablet_replica.cc:333] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: stopping tablet replica
I20260709 13:22:25.719141 16192 raft_consensus.cc:2243] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:25.720052 16192 raft_consensus.cc:2272] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:25.726315 27433 consensus_queue.cc:1048] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:22:25.739542 27320 consensus_peers.cc:597] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:25.767329 27320 consensus_peers.cc:597] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:25.879861 27246 consensus_peers.cc:597] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:25.952972 27320 consensus_peers.cc:597] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:25.991868 27320 consensus_peers.cc:597] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:26.038640 27246 consensus_peers.cc:597] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:26.053627 27227 debug-util.cc:398] Leaking SignalData structure 0x7b08000dbd20 after lost signal to thread 16195
W20260709 13:22:26.054821 27227 debug-util.cc:398] Leaking SignalData structure 0x7b0800262d00 after lost signal to thread 27138
W20260709 13:22:26.056728 27227 debug-util.cc:398] Leaking SignalData structure 0x7b0800251b80 after lost signal to thread 27305
W20260709 13:22:26.057775 27227 debug-util.cc:398] Leaking SignalData structure 0x7b0800261ae0 after lost signal to thread 27379
W20260709 13:22:26.575095 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:26.747360 16192 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27227)
I20260709 13:22:26.784606 27457 raft_consensus.cc:493] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1df1f2ed97b14cdb9ac7f8ac5647205d)
I20260709 13:22:26.785296 27457 raft_consensus.cc:515] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:26.787029 27457 leader_election.cc:290] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:26.788165 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15186667024a468eba0accca5af212b4" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
W20260709 13:22:26.789053 27246 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111) [suppressed 119 similar messages]
W20260709 13:22:26.791887 27246 leader_election.cc:336] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111)
I20260709 13:22:26.792351 27246 leader_election.cc:304] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cca6e7866b17408cae8c4f839f878ed1; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:26.793128 27457 raft_consensus.cc:2749] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:26.885322 27457 raft_consensus.cc:493] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1df1f2ed97b14cdb9ac7f8ac5647205d)
I20260709 13:22:26.885811 27457 raft_consensus.cc:515] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:26.887535 27457 leader_election.cc:290] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:26.888741 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
I20260709 13:22:26.891144 27457 raft_consensus.cc:493] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1df1f2ed97b14cdb9ac7f8ac5647205d)
I20260709 13:22:26.891738 27457 raft_consensus.cc:515] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
W20260709 13:22:26.891817 27246 leader_election.cc:336] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111)
I20260709 13:22:26.893090 27246 leader_election.cc:304] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cca6e7866b17408cae8c4f839f878ed1; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:26.893715 27457 leader_election.cc:290] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:26.893903 27431 raft_consensus.cc:2749] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:26.895394 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5" is_pre_election: true
W20260709 13:22:26.898239 27246 leader_election.cc:336] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111)
I20260709 13:22:26.898612 27246 leader_election.cc:304] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cca6e7866b17408cae8c4f839f878ed1; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:26.899253 27431 raft_consensus.cc:2749] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:26.904150 27432 raft_consensus.cc:493] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1df1f2ed97b14cdb9ac7f8ac5647205d)
I20260709 13:22:26.904675 27432 raft_consensus.cc:515] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:26.906483 27432 leader_election.cc:290] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:26.907681 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:26.908499 27279 raft_consensus.cc:2468] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:26.909874 27319 leader_election.cc:304] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
W20260709 13:22:26.910565 27320 leader_election.cc:336] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111)
I20260709 13:22:26.910768 27432 raft_consensus.cc:2804] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:26.911185 27432 raft_consensus.cc:493] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1df1f2ed97b14cdb9ac7f8ac5647205d)
I20260709 13:22:26.911545 27432 raft_consensus.cc:3060] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:26.913091 27470 raft_consensus.cc:493] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1df1f2ed97b14cdb9ac7f8ac5647205d)
I20260709 13:22:26.913607 27470 raft_consensus.cc:515] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:26.915802 27470 leader_election.cc:290] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:26.917022 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:26.917685 27279 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:26.918408 27432 raft_consensus.cc:515] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:26.918779 27319 leader_election.cc:304] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:26.919750 27470 raft_consensus.cc:2804] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:26.920112 27470 raft_consensus.cc:493] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1df1f2ed97b14cdb9ac7f8ac5647205d)
I20260709 13:22:26.920473 27470 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:26.921271 27432 leader_election.cc:290] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:26.922719 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
W20260709 13:22:26.922943 27320 leader_election.cc:336] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111)
I20260709 13:22:26.923413 27279 raft_consensus.cc:3060] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:26.926424 27320 leader_election.cc:336] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111)
I20260709 13:22:26.929204 27470 raft_consensus.cc:515] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:26.930850 27279 raft_consensus.cc:2468] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 2.
I20260709 13:22:26.932076 27319 leader_election.cc:304] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d
I20260709 13:22:26.932600 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:26.932895 27432 raft_consensus.cc:2804] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:26.933208 27470 leader_election.cc:290] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:26.933401 27277 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:26.935269 27432 raft_consensus.cc:697] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:26.936213 27432 consensus_queue.cc:237] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:26.942245 27277 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 2.
I20260709 13:22:26.943886 27319 leader_election.cc:304] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:26.945526 27432 raft_consensus.cc:2804] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:26.944983 27100 catalog_manager.cc:5697] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 1 to 2, leader changed from 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1) to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:26.946957 27432 raft_consensus.cc:697] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
W20260709 13:22:26.947309 27320 leader_election.cc:336] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111)
I20260709 13:22:26.948066 27432 consensus_queue.cc:237] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:26.972796 27100 catalog_manager.cc:5697] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 1 to 2, leader changed from 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1) to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:27.164557 27432 raft_consensus.cc:493] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1df1f2ed97b14cdb9ac7f8ac5647205d)
I20260709 13:22:27.165217 27432 raft_consensus.cc:515] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:27.167613 27432 leader_election.cc:290] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:27.168773 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15186667024a468eba0accca5af212b4" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1" is_pre_election: true
I20260709 13:22:27.169713 27277 raft_consensus.cc:2468] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 1.
I20260709 13:22:27.171144 27319 leader_election.cc:304] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
W20260709 13:22:27.171844 27320 leader_election.cc:336] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111)
I20260709 13:22:27.172070 27432 raft_consensus.cc:2804] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:27.172572 27432 raft_consensus.cc:493] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1df1f2ed97b14cdb9ac7f8ac5647205d)
I20260709 13:22:27.172983 27432 raft_consensus.cc:3060] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.178592 27432 raft_consensus.cc:515] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:27.181114 27432 leader_election.cc:290] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:27.181882 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15186667024a468eba0accca5af212b4" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:27.182741 27277 raft_consensus.cc:3060] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:27.185585 27320 leader_election.cc:336] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111)
I20260709 13:22:27.191766 27277 raft_consensus.cc:2468] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 2.
I20260709 13:22:27.193356 27319 leader_election.cc:304] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 1df1f2ed97b14cdb9ac7f8ac5647205d
I20260709 13:22:27.194192 27432 raft_consensus.cc:2804] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.194780 27432 raft_consensus.cc:697] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:27.195741 27432 consensus_queue.cc:237] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:27.205138 27100 catalog_manager.cc:5697] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 1 to 2, leader changed from 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1) to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:27.378310 27320 consensus_peers.cc:597] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:27.475183 27277 raft_consensus.cc:1275] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.476800 27432 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:27.503806 27320 consensus_peers.cc:597] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:27.557073 27277 raft_consensus.cc:1275] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.558404 27432 consensus_queue.cc:1048] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:27.576216 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:27.595830 27320 consensus_peers.cc:597] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:27.620569 27277 raft_consensus.cc:1275] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.622191 27501 consensus_queue.cc:1048] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:27.747957 16192 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 27227)
W20260709 13:22:28.115193 27320 consensus_peers.cc:597] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:28.164579 27320 consensus_peers.cc:597] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:28.192037 27320 consensus_peers.cc:597] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:28.436678 27320 consensus_peers.cc:597] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:28.481710 27320 consensus_peers.cc:597] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:28.505046 27246 consensus_peers.cc:597] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:28.577405 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:28.613926 27246 consensus_peers.cc:597] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:28.748533 16192 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 27227)
W20260709 13:22:29.579136 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:29.743369 27320 consensus_peers.cc:597] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:29.755517 16192 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 27227)
W20260709 13:22:29.931432 27320 consensus_peers.cc:597] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:29.947471 16192 tablet_server.cc:196] TabletServer@127.15.208.1:0 shutdown complete.
W20260709 13:22:30.158663 27320 consensus_peers.cc:597] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:30.473886 27320 consensus_peers.cc:597] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:30.580493 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:30.776754 27320 consensus_peers.cc:597] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:30.862474 27320 consensus_peers.cc:597] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:30.970754 27320 consensus_peers.cc:597] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:31.001195 27320 consensus_peers.cc:597] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:31.099956 27246 consensus_peers.cc:597] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:31.316416 27246 consensus_peers.cc:597] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:31.581640 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:31.823226 27320 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111) [suppressed 104 similar messages]
W20260709 13:22:32.359670 27320 consensus_peers.cc:597] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:32.455221 27320 consensus_peers.cc:597] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:32.582695 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:32.752430 27320 consensus_peers.cc:597] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:32.906862 27320 consensus_peers.cc:597] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:33.118958 27320 consensus_peers.cc:597] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:33.274554 27320 consensus_peers.cc:597] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:33.375473 27320 consensus_peers.cc:597] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:33.473035 27320 consensus_peers.cc:597] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:33.523681 27246 consensus_peers.cc:597] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:33.583837 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:34.004155 27246 consensus_peers.cc:597] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:34.584931 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:34.991398 27320 consensus_peers.cc:597] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:22:34.994539 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:35.002907 27509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:35.003273 27510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:35.004603 27512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:35.006971 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:35.008411 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:35.008661 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:35.008888 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603355008871 us; error 0 us; skew 500 ppm
I20260709 13:22:35.009443 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:35.012495 16192 webserver.cc:533] Webserver started at http://127.15.208.1:35161/ using document root <none> and password file <none>
I20260709 13:22:35.013149 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:35.013370 16192 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:22:35.017679 16192 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
W20260709 13:22:35.023396 27320 consensus_peers.cc:597] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:22:35.024749 27517 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:35.026865 16192 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:22:35.027249 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-0-root
uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
format_stamp: "Formatted at 2026-07-09 13:22:23 on dist-test-slave-w3b1"
I20260709 13:22:35.027765 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603004946521-16192-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:35.041162 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:35.042608 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:35.044179 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:35.048487 27524 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:22:35.058475 27320 consensus_peers.cc:597] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:22:35.105825 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:22:35.106338 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.059s	user 0.002s	sys 0.001s
I20260709 13:22:35.106721 16192 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:22:35.113638 27524 tablet_bootstrap.cc:492] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:35.127945 27524 tablet_bootstrap.cc:492] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.128758 27524 tablet_bootstrap.cc:492] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap complete.
I20260709 13:22:35.129498 27524 ts_tablet_manager.cc:1403] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 13:22:35.131913 27524 raft_consensus.cc:359] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.132772 27524 raft_consensus.cc:740] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.133582 27524 consensus_queue.cc:260] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.136087 27524 ts_tablet_manager.cc:1434] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:22:35.136799 27524 tablet_bootstrap.cc:492] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:35.149708 27524 tablet_bootstrap.cc:492] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.150532 27524 tablet_bootstrap.cc:492] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap complete.
I20260709 13:22:35.150722 16192 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:22:35.151079 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.044s	user 0.043s	sys 0.000s
I20260709 13:22:35.151157 27524 ts_tablet_manager.cc:1403] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:22:35.153633 27524 raft_consensus.cc:359] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.154184 27524 raft_consensus.cc:740] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.154882 27524 consensus_queue.cc:260] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.156437 27524 ts_tablet_manager.cc:1434] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:35.157384 27524 tablet_bootstrap.cc:492] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:35.172628 27524 tablet_bootstrap.cc:492] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.173898 27524 tablet_bootstrap.cc:492] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap complete.
I20260709 13:22:35.174810 27524 ts_tablet_manager.cc:1403] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:22:35.178462 27524 raft_consensus.cc:359] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.179404 27524 raft_consensus.cc:740] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.180263 27524 consensus_queue.cc:260] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.182688 27524 ts_tablet_manager.cc:1434] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:35.183660 27524 tablet_bootstrap.cc:492] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:35.201404 27524 tablet_bootstrap.cc:492] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.202469 27524 tablet_bootstrap.cc:492] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap complete.
I20260709 13:22:35.203348 27524 ts_tablet_manager.cc:1403] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:22:35.206632 27524 raft_consensus.cc:359] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.207408 27524 raft_consensus.cc:740] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.208245 27524 consensus_queue.cc:260] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.210749 27524 ts_tablet_manager.cc:1434] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:35.211225 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.1:44757
I20260709 13:22:35.211357 27585 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.1:44757 every 8 connection(s)
I20260709 13:22:35.211664 27524 tablet_bootstrap.cc:492] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:35.217397 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:35.234149 27524 tablet_bootstrap.cc:492] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.235337 27524 tablet_bootstrap.cc:492] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap complete.
I20260709 13:22:35.236049 27524 ts_tablet_manager.cc:1403] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.010s
I20260709 13:22:35.238826 27524 raft_consensus.cc:359] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:35.239545 27524 raft_consensus.cc:740] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.240363 27524 consensus_queue.cc:260] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:35.243074 27524 ts_tablet_manager.cc:1434] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:22:35.244015 27524 tablet_bootstrap.cc:492] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:35.250541 27586 heartbeater.cc:344] Connected to a master server at 127.15.208.62:33225
I20260709 13:22:35.251096 27586 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:35.252066 27586 heartbeater.cc:507] Master 127.15.208.62:33225 requested a full tablet report, sending...
I20260709 13:22:35.258359 27353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
mode: GRACEFUL
new_leader_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:33234
I20260709 13:22:35.259387 27353 raft_consensus.cc:606] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Received request to transfer leadership to TS cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:35.261162 27103 ts_manager.cc:194] Re-registered known tserver with Master: 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757)
I20260709 13:22:35.263208 27353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
mode: GRACEFUL
new_leader_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:33234
I20260709 13:22:35.263860 27353 raft_consensus.cc:606] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Received request to transfer leadership to TS cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:35.267216 27353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
mode: GRACEFUL
new_leader_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:33234
I20260709 13:22:35.268069 27353 raft_consensus.cc:606] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Received request to transfer leadership to TS cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:35.268512 27524 tablet_bootstrap.cc:492] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.269618 27524 tablet_bootstrap.cc:492] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap complete.
I20260709 13:22:35.270303 27524 ts_tablet_manager.cc:1403] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 13:22:35.271499 27354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9de70c86acde4dab9e5bc8383e8f7176"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
mode: GRACEFUL
new_leader_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:33234
I20260709 13:22:35.272404 27354 raft_consensus.cc:606] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Received request to transfer leadership to TS cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:35.272701 27524 raft_consensus.cc:359] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.273443 27524 raft_consensus.cc:740] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.274216 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:22:35.275141 27524 consensus_queue.cc:260] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.275511 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:35.276489 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:35.277364 27524 ts_tablet_manager.cc:1434] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:35.278242 27524 tablet_bootstrap.cc:492] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:35.279080 27103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54292
I20260709 13:22:35.284451 27586 heartbeater.cc:499] Master 127.15.208.62:33225 was elected leader, sending a full tablet report...
I20260709 13:22:35.290234 27508 raft_consensus.cc:993] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5: : Instructing follower cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:35.291007 27595 raft_consensus.cc:1081] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Signalling peer cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:35.293056 27279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:43060
I20260709 13:22:35.293629 27279 raft_consensus.cc:493] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:35.294015 27279 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:35.294672 27524 tablet_bootstrap.cc:492] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.295686 27524 tablet_bootstrap.cc:492] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap complete.
I20260709 13:22:35.296429 27524 ts_tablet_manager.cc:1403] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:22:35.299355 27524 raft_consensus.cc:359] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.300015 27524 raft_consensus.cc:740] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.300827 27524 consensus_queue.cc:260] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.302800 27524 ts_tablet_manager.cc:1434] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:22:35.303135 27279 raft_consensus.cc:515] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.303889 27524 tablet_bootstrap.cc:492] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:35.306990 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:35.307848 27354 raft_consensus.cc:3055] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:35.308221 27354 raft_consensus.cc:740] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:35.309305 27354 consensus_queue.cc:260] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.310603 27354 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:35.312345 27279 leader_election.cc:290] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 3 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:35.318044 27560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:35.318722 27560 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:22:35.322611 27524 tablet_bootstrap.cc:492] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.322933 27354 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 3.
I20260709 13:22:35.323909 27524 tablet_bootstrap.cc:492] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap complete.
I20260709 13:22:35.324733 27524 ts_tablet_manager.cc:1403] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:22:35.324538 27245 leader_election.cc:304] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d2fecddfbf480f86321e2bd7f390b5, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:35.325659 27431 raft_consensus.cc:2804] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:35.326974 27560 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 3.
I20260709 13:22:35.327021 27431 raft_consensus.cc:697] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 3 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:35.327719 27524 raft_consensus.cc:359] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.328534 27524 raft_consensus.cc:740] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.328588 27431 consensus_queue.cc:237] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.329411 27524 consensus_queue.cc:260] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.331561 27524 ts_tablet_manager.cc:1434] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:35.334131 27524 tablet_bootstrap.cc:492] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:35.338129 27100 catalog_manager.cc:5697] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 2 to 3, leader changed from 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3) to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 3 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:35.351097 27524 tablet_bootstrap.cc:492] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.352003 27524 tablet_bootstrap.cc:492] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap complete.
I20260709 13:22:35.352698 27524 ts_tablet_manager.cc:1403] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:22:35.355420 27524 raft_consensus.cc:359] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.356148 27524 raft_consensus.cc:740] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.356974 27524 consensus_queue.cc:260] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.358739 27524 ts_tablet_manager.cc:1434] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:35.359498 27524 tablet_bootstrap.cc:492] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap starting.
I20260709 13:22:35.372001 27524 tablet_bootstrap.cc:492] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:35.372781 27524 tablet_bootstrap.cc:492] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Bootstrap complete.
I20260709 13:22:35.373462 27524 ts_tablet_manager.cc:1403] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:22:35.375411 27524 raft_consensus.cc:359] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.375897 27524 raft_consensus.cc:740] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df1f2ed97b14cdb9ac7f8ac5647205d, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.376538 27524 consensus_queue.cc:260] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.378314 27524 ts_tablet_manager.cc:1434] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:35.401077 27560 raft_consensus.cc:3060] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.404987 27595 raft_consensus.cc:993] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5: : Instructing follower cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:35.405620 27508 raft_consensus.cc:1081] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Signalling peer cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:35.407286 27279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:43060
I20260709 13:22:35.407752 27279 raft_consensus.cc:493] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:35.408035 27279 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.414546 27279 raft_consensus.cc:515] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:35.416464 27279 leader_election.cc:290] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 election: Requested vote from peers 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915), 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757)
I20260709 13:22:35.417860 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:35.418642 27354 raft_consensus.cc:3055] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:35.418974 27354 raft_consensus.cc:740] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:35.419097 27560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:35.419834 27560 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.419932 27354 consensus_queue.cc:260] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:35.421537 27354 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.426683 27560 raft_consensus.cc:2468] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 2.
I20260709 13:22:35.428089 27354 raft_consensus.cc:2468] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 2.
I20260709 13:22:35.428112 27246 leader_election.cc:304] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:35.429292 27431 raft_consensus.cc:2804] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:35.429853 27431 raft_consensus.cc:697] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:35.430858 27431 consensus_queue.cc:237] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:35.438555 27100 catalog_manager.cc:5697] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 1 to 2, leader changed from 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3) to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:35.583145 27595 raft_consensus.cc:993] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5: : Instructing follower cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:35.583606 27508 raft_consensus.cc:1081] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Signalling peer cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:35.585378 27279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9de70c86acde4dab9e5bc8383e8f7176"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:43060
I20260709 13:22:35.585953 27279 raft_consensus.cc:493] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:22:35.586040 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:35.586427 27279 raft_consensus.cc:3060] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.586747 27560 raft_consensus.cc:3060] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.594202 27279 raft_consensus.cc:515] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.596647 27279 leader_election.cc:290] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:35.597610 27559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de70c86acde4dab9e5bc8383e8f7176" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:35.598309 27559 raft_consensus.cc:3060] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.598784 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de70c86acde4dab9e5bc8383e8f7176" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:35.599474 27354 raft_consensus.cc:3055] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:35.599817 27354 raft_consensus.cc:740] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:35.600953 27354 consensus_queue.cc:260] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.602509 27354 raft_consensus.cc:3060] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.605414 27559 raft_consensus.cc:2468] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 2.
I20260709 13:22:35.606498 27246 leader_election.cc:304] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:35.607254 27431 raft_consensus.cc:2804] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:35.607681 27431 raft_consensus.cc:697] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:35.608623 27431 consensus_queue.cc:237] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.609474 27354 raft_consensus.cc:2468] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 2.
I20260709 13:22:35.616457 27100 catalog_manager.cc:5697] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 1 to 2, leader changed from 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3) to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:35.700965 27595 raft_consensus.cc:993] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5: : Instructing follower cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:35.701486 27508 raft_consensus.cc:1081] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Signalling peer cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:35.702944 27279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:43060
I20260709 13:22:35.703485 27279 raft_consensus.cc:493] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:35.703796 27279 raft_consensus.cc:3060] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.709831 27279 raft_consensus.cc:515] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.711338 27279 leader_election.cc:290] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:35.712225 27559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:35.712423 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:35.712930 27559 raft_consensus.cc:3060] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.713066 27354 raft_consensus.cc:3055] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:35.713501 27354 raft_consensus.cc:740] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:35.714275 27354 consensus_queue.cc:260] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.715371 27354 raft_consensus.cc:3060] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.718330 27559 raft_consensus.cc:2468] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 2.
I20260709 13:22:35.719452 27246 leader_election.cc:304] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:35.720189 27431 raft_consensus.cc:2804] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:35.720618 27431 raft_consensus.cc:697] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:35.721233 27354 raft_consensus.cc:2468] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 2.
I20260709 13:22:35.721535 27431 consensus_queue.cc:237] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:35.729689 27100 catalog_manager.cc:5697] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 1 to 2, leader changed from 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3) to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:35.768517 27559 raft_consensus.cc:1275] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:35.769953 27431 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:35.780618 27354 raft_consensus.cc:1275] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:35.782169 27431 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:35.967362 27354 raft_consensus.cc:1275] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:35.968677 27431 consensus_queue.cc:1048] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:35.978549 27559 raft_consensus.cc:1275] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:35.980188 27431 consensus_queue.cc:1048] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:36.078477 27559 raft_consensus.cc:1275] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.079993 27615 consensus_queue.cc:1048] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:36.092579 27354 raft_consensus.cc:1275] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.094198 27431 consensus_queue.cc:1048] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.256599 27354 raft_consensus.cc:1275] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.258095 27431 consensus_queue.cc:1048] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.269042 27559 raft_consensus.cc:1275] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.271951 27623 consensus_queue.cc:1048] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:36.288213 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:36.304193 27279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
mode: GRACEFUL
new_leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:37086
I20260709 13:22:36.304723 27279 raft_consensus.cc:606] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Received request to transfer leadership to TS 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:36.307107 27279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
mode: GRACEFUL
new_leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:37086
I20260709 13:22:36.307549 27279 raft_consensus.cc:606] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 3 LEADER]: Received request to transfer leadership to TS 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:36.308579 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:36.309152 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:36.309746 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:36.340538 27615 raft_consensus.cc:993] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1: : Instructing follower 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:36.341204 27431 raft_consensus.cc:1081] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 3 LEADER]: Signalling peer 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:36.342808 27354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:22:36.343400 27354 raft_consensus.cc:493] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:36.343709 27354 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:36.349056 27354 raft_consensus.cc:515] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:36.351001 27354 leader_election.cc:290] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 4 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:36.352056 27559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:36.352315 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:36.352813 27559 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:36.352945 27279 raft_consensus.cc:3055] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:36.353389 27279 raft_consensus.cc:740] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:36.353983 27279 consensus_queue.cc:260] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:36.354957 27279 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:36.359486 27559 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 4.
I20260709 13:22:36.359735 27279 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 4.
I20260709 13:22:36.360800 27320 leader_election.cc:304] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:36.361698 27606 raft_consensus.cc:2804] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:36.362133 27606 raft_consensus.cc:697] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:36.362887 27606 consensus_queue.cc:237] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:36.368803 27103 catalog_manager.cc:5697] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 3 to 4, leader changed from cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2) to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 4 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:36.497869 27615 raft_consensus.cc:993] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1: : Instructing follower 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:36.498250 27615 raft_consensus.cc:1081] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Signalling peer 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:36.499547 27354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:22:36.500061 27354 raft_consensus.cc:493] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:36.500381 27354 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:36.505555 27354 raft_consensus.cc:515] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:36.507176 27354 leader_election.cc:290] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 3 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:36.508107 27559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:36.508213 27279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:36.508793 27559 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:36.508922 27279 raft_consensus.cc:3055] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:36.509354 27279 raft_consensus.cc:740] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:36.510077 27279 consensus_queue.cc:260] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:36.511034 27279 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:36.513921 27559 raft_consensus.cc:2468] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 3.
I20260709 13:22:36.515064 27320 leader_election.cc:304] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:36.515728 27606 raft_consensus.cc:2804] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:36.516247 27606 raft_consensus.cc:697] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:36.516481 27279 raft_consensus.cc:2468] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 3.
I20260709 13:22:36.517246 27606 consensus_queue.cc:237] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:36.523406 27103 catalog_manager.cc:5697] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 2 to 3, leader changed from cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2) to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 3 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:36.587018 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:36.865489 27559 raft_consensus.cc:1275] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:36.866974 27606 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:36.881000 27279 raft_consensus.cc:1275] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 4 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:36.882877 27508 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:36.935251 27559 raft_consensus.cc:1275] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:36.936345 27508 consensus_queue.cc:1048] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:36.943957 27279 raft_consensus.cc:1275] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:36.945534 27508 consensus_queue.cc:1048] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:37.318697 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:37.327919 27354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
mode: GRACEFUL
new_leader_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:33234
I20260709 13:22:37.328506 27354 raft_consensus.cc:606] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 LEADER]: Received request to transfer leadership to TS cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:37.330982 27279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
mode: GRACEFUL
new_leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:37086
I20260709 13:22:37.331461 27279 raft_consensus.cc:606] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Received request to transfer leadership to TS 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:37.333842 27354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
mode: GRACEFUL
new_leader_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:33234
I20260709 13:22:37.334336 27354 raft_consensus.cc:606] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Received request to transfer leadership to TS cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:37.335412 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:37.335961 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:37.336544 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:37.434829 27633 raft_consensus.cc:993] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5: : Instructing follower cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:37.435432 27633 raft_consensus.cc:1081] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 LEADER]: Signalling peer cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:37.437755 27277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:43060
I20260709 13:22:37.438386 27277 raft_consensus.cc:493] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:37.438819 27277 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:22:37.446938 27277 raft_consensus.cc:515] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:37.448669 27277 leader_election.cc:290] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 5 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:37.449272 27559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:37.449676 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:37.450033 27559 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:22:37.450387 27354 raft_consensus.cc:3055] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:22:37.450731 27354 raft_consensus.cc:740] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:37.451535 27354 consensus_queue.cc:260] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:37.452800 27354 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:22:37.457579 27559 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 5.
I20260709 13:22:37.458835 27246 leader_election.cc:304] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:37.459617 27615 raft_consensus.cc:2804] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:22:37.459721 27354 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 5.
I20260709 13:22:37.460819 27615 raft_consensus.cc:697] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 5 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:37.461786 27615 consensus_queue.cc:237] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:37.468034 27103 catalog_manager.cc:5697] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 4 to 5, leader changed from 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3) to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 5 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:37.572319 27508 raft_consensus.cc:993] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5: : Instructing follower cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:37.572829 27633 raft_consensus.cc:1081] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Signalling peer cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:37.574286 27277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:43060
I20260709 13:22:37.574769 27277 raft_consensus.cc:493] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:37.575078 27277 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:37.580278 27277 raft_consensus.cc:515] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:37.582177 27277 leader_election.cc:290] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:37.582805 27559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:37.583235 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:37.583496 27559 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:37.583827 27354 raft_consensus.cc:3055] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:37.584110 27354 raft_consensus.cc:740] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:37.584810 27354 consensus_queue.cc:260] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:37.585816 27354 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:37.587989 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:37.589082 27559 raft_consensus.cc:2468] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 2.
I20260709 13:22:37.590283 27246 leader_election.cc:304] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:37.590667 27354 raft_consensus.cc:2468] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 2.
I20260709 13:22:37.590996 27615 raft_consensus.cc:2804] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:37.591514 27615 raft_consensus.cc:697] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:37.592460 27615 consensus_queue.cc:237] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:37.599324 27103 catalog_manager.cc:5697] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 1 to 2, leader changed from 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3) to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:37.629168 27638 raft_consensus.cc:993] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1: : Instructing follower 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:37.629729 27638 raft_consensus.cc:1081] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Signalling peer 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:37.631150 27354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:22:37.631615 27354 raft_consensus.cc:493] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:37.631896 27354 raft_consensus.cc:3060] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:37.636410 27354 raft_consensus.cc:515] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:37.637985 27354 leader_election.cc:290] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 3 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:37.638857 27559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:37.639380 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b469a7c6a4046269b279c03f61456ec" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:37.639518 27559 raft_consensus.cc:3060] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:37.640250 27277 raft_consensus.cc:3055] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:37.640601 27277 raft_consensus.cc:740] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:37.641454 27277 consensus_queue.cc:260] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:37.642709 27277 raft_consensus.cc:3060] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:37.647322 27559 raft_consensus.cc:2468] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 3.
I20260709 13:22:37.648904 27320 leader_election.cc:304] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:37.649735 27633 raft_consensus.cc:2804] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:37.650055 27277 raft_consensus.cc:2468] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 3.
I20260709 13:22:37.650321 27633 raft_consensus.cc:697] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:37.651264 27633 consensus_queue.cc:237] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:37.658272 27103 catalog_manager.cc:5697] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 2 to 3, leader changed from cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2) to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 3 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:37.979732 27559 raft_consensus.cc:1275] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 5 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:22:37.980986 27638 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:22:37.991350 27354 raft_consensus.cc:1275] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 5 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:22:37.992584 27638 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:22:38.038697 27279 raft_consensus.cc:1275] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:38.039924 27633 consensus_queue.cc:1048] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:38.049350 27559 raft_consensus.cc:1275] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:38.050894 27633 consensus_queue.cc:1048] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:38.053141 27354 raft_consensus.cc:1275] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:38.055070 27638 consensus_queue.cc:1048] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:38.069725 27560 raft_consensus.cc:1275] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:38.071810 27638 consensus_queue.cc:1048] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:38.344980 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:38.353382 27354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
mode: GRACEFUL
new_leader_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:33234
I20260709 13:22:38.353924 27354 raft_consensus.cc:606] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Received request to transfer leadership to TS cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:38.356518 27279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
mode: GRACEFUL
new_leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:37086
I20260709 13:22:38.357031 27279 raft_consensus.cc:606] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 LEADER]: Received request to transfer leadership to TS 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:38.359575 27279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
mode: GRACEFUL
new_leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:37086
I20260709 13:22:38.360057 27279 raft_consensus.cc:606] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Received request to transfer leadership to TS 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:38.361229 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:38.361842 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:38.362485 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:38.585426 27615 raft_consensus.cc:993] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1: : Instructing follower 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:38.585937 27638 raft_consensus.cc:1081] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 LEADER]: Signalling peer 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:38.587495 27354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:22:38.588034 27354 raft_consensus.cc:493] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:38.588313 27651 raft_consensus.cc:993] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5: : Instructing follower cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:38.588402 27354 raft_consensus.cc:3060] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:38.588967 27633 raft_consensus.cc:1081] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Signalling peer cca6e7866b17408cae8c4f839f878ed1 to start an election
W20260709 13:22:38.589080 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:38.590595 27279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:43060
I20260709 13:22:38.591109 27279 raft_consensus.cc:493] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:38.591454 27279 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:38.594182 27354 raft_consensus.cc:515] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:38.595729 27354 leader_election.cc:290] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:38.596695 27559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:38.597401 27559 raft_consensus.cc:3060] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:38.597096 27279 raft_consensus.cc:515] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:38.597819 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69fa7372904583a992a8418a9874c4" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:38.598472 27277 raft_consensus.cc:3055] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:38.598810 27277 raft_consensus.cc:740] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:38.599687 27277 consensus_queue.cc:260] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:38.600412 27560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:38.600857 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3162f2a4ec48d8ad68d03735cfe776" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:38.601043 27560 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:38.601706 27279 leader_election.cc:290] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 4 election: Requested vote from peers 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915), 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757)
I20260709 13:22:38.602886 27638 raft_consensus.cc:993] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1: : Instructing follower 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:38.603097 27354 raft_consensus.cc:3055] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:38.601130 27277 raft_consensus.cc:3060] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:38.603463 27615 raft_consensus.cc:1081] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Signalling peer 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:38.604642 27559 raft_consensus.cc:2468] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 2.
I20260709 13:22:38.605321 27353 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:22:38.605921 27353 raft_consensus.cc:493] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:38.605932 27320 leader_election.cc:304] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:38.606447 27353 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:38.607021 27633 raft_consensus.cc:2804] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:38.607519 27633 raft_consensus.cc:697] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:38.608389 27633 consensus_queue.cc:237] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:38.609354 27560 raft_consensus.cc:2468] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 4.
I20260709 13:22:38.610800 27277 raft_consensus.cc:2468] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 2.
I20260709 13:22:38.611989 27246 leader_election.cc:304] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:38.603477 27354 raft_consensus.cc:740] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:38.613903 27638 raft_consensus.cc:2804] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:38.613785 27354 consensus_queue.cc:260] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:38.614555 27638 raft_consensus.cc:697] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 4 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:38.614203 27353 raft_consensus.cc:515] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:38.616108 27638 consensus_queue.cc:237] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } }
I20260709 13:22:38.618072 27559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:38.617295 27102 catalog_manager.cc:5697] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 1 to 2, leader changed from cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2) to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:38.618610 27559 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:38.615152 27354 raft_consensus.cc:3060] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:38.624393 27559 raft_consensus.cc:2468] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 3.
I20260709 13:22:38.625572 27320 leader_election.cc:304] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:38.625896 27353 leader_election.cc:290] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 3 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:38.626498 27633 raft_consensus.cc:2804] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:38.627310 27633 raft_consensus.cc:697] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:38.628187 27633 consensus_queue.cc:237] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:38.631757 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:38.632412 27277 raft_consensus.cc:3055] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:38.632795 27277 raft_consensus.cc:740] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:38.631310 27354 raft_consensus.cc:2468] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 4.
I20260709 13:22:38.633664 27559 raft_consensus.cc:1240] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Rejecting Update request from peer cca6e7866b17408cae8c4f839f878ed1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:22:38.633800 27277 consensus_queue.cc:260] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:38.633714 27103 catalog_manager.cc:5697] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 3 to 4, leader changed from 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3) to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 4 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:38.635248 27277 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:38.643294 27277 raft_consensus.cc:2468] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 3.
I20260709 13:22:38.648725 27103 catalog_manager.cc:5697] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 2 to 3, leader changed from cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2) to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 3 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:39.029217 27354 raft_consensus.cc:1275] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:39.030555 27638 consensus_queue.cc:1048] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:39.040233 27559 raft_consensus.cc:1275] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:39.042311 27638 consensus_queue.cc:1048] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:39.047537 27560 raft_consensus.cc:1275] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:39.049274 27633 consensus_queue.cc:1048] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:39.058818 27277 raft_consensus.cc:1275] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:39.060164 27633 consensus_queue.cc:1048] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:39.147228 27559 raft_consensus.cc:1275] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:39.148396 27670 consensus_queue.cc:1048] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:39.158511 27277 raft_consensus.cc:1275] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:39.160377 27670 consensus_queue.cc:1048] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:39.381807 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:39.395843 27354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
mode: GRACEFUL
new_leader_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:33234
I20260709 13:22:39.396677 27354 raft_consensus.cc:606] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Received request to transfer leadership to TS cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:39.400179 27277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
mode: GRACEFUL
new_leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:37086
I20260709 13:22:39.400764 27277 raft_consensus.cc:606] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 5 LEADER]: Received request to transfer leadership to TS 40d2fecddfbf480f86321e2bd7f390b5
I20260709 13:22:39.403831 27354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
mode: GRACEFUL
new_leader_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:33234
I20260709 13:22:39.404392 27354 raft_consensus.cc:606] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Received request to transfer leadership to TS cca6e7866b17408cae8c4f839f878ed1
I20260709 13:22:39.405683 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:39.406200 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:39.406910 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:22:39.590773 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:39.639029 27633 raft_consensus.cc:993] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5: : Instructing follower cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:39.639750 27673 raft_consensus.cc:1081] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Signalling peer cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:39.641486 27277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:43060
I20260709 13:22:39.642050 27277 raft_consensus.cc:493] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:39.642503 27277 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:39.651700 27277 raft_consensus.cc:515] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:39.654498 27277 leader_election.cc:290] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 4 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:39.655771 27560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:39.656934 27560 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:39.656040 27354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86840f734a04c1fa154192ea396b15c" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:39.658177 27354 raft_consensus.cc:3055] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:39.658524 27354 raft_consensus.cc:740] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:39.659560 27354 consensus_queue.cc:260] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:39.661482 27354 raft_consensus.cc:3060] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:39.668793 27560 raft_consensus.cc:2468] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 4.
I20260709 13:22:39.670748 27246 leader_election.cc:304] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:39.670691 27354 raft_consensus.cc:2468] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 4.
I20260709 13:22:39.672394 27654 raft_consensus.cc:2804] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:39.673172 27654 raft_consensus.cc:697] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 4 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:39.674685 27654 consensus_queue.cc:237] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:39.677815 27615 raft_consensus.cc:993] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1: : Instructing follower 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:39.678792 27654 raft_consensus.cc:1081] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 5 LEADER]: Signalling peer 40d2fecddfbf480f86321e2bd7f390b5 to start an election
I20260709 13:22:39.681360 27353 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18"
dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
 from {username='slave'} at 127.0.0.1:42372
I20260709 13:22:39.682044 27353 raft_consensus.cc:493] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:39.682456 27353 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:22:39.684070 27103 catalog_manager.cc:5697] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 3 to 4, leader changed from 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3) to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 4 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:39.690212 27353 raft_consensus.cc:515] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:39.693826 27353 leader_election.cc:290] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 6 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417)
I20260709 13:22:39.694432 27560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:39.695297 27560 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:22:39.694972 27277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83277692572b4bc3970b9e403aa73a18" candidate_uuid: "40d2fecddfbf480f86321e2bd7f390b5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
I20260709 13:22:39.696308 27277 raft_consensus.cc:3055] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:22:39.696676 27277 raft_consensus.cc:740] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:39.697695 27277 consensus_queue.cc:260] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:39.699717 27277 raft_consensus.cc:3060] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:22:39.704140 27560 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 6.
I20260709 13:22:39.705447 27320 leader_election.cc:304] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, 40d2fecddfbf480f86321e2bd7f390b5; no voters: 
I20260709 13:22:39.706223 27673 raft_consensus.cc:2804] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:22:39.706724 27673 raft_consensus.cc:697] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 6 LEADER]: Becoming Leader. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:39.707077 27277 raft_consensus.cc:2468] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d2fecddfbf480f86321e2bd7f390b5 in term 6.
I20260709 13:22:39.707864 27673 consensus_queue.cc:237] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:39.719084 27103 catalog_manager.cc:5697] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 reported cstate change: term changed from 5 to 6, leader changed from cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2) to 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3). New cstate: current_term: 6 leader_uuid: "40d2fecddfbf480f86321e2bd7f390b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:39.784220 27633 raft_consensus.cc:993] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5: : Instructing follower cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:39.784789 27673 raft_consensus.cc:1081] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Signalling peer cca6e7866b17408cae8c4f839f878ed1 to start an election
I20260709 13:22:39.786660 27277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2"
dest_uuid: "cca6e7866b17408cae8c4f839f878ed1"
 from {username='slave'} at 127.0.0.1:43060
I20260709 13:22:39.787156 27277 raft_consensus.cc:493] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:39.787461 27277 raft_consensus.cc:3060] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:39.792040 27277 raft_consensus.cc:515] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:39.793515 27277 leader_election.cc:290] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 3 election: Requested vote from peers 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757), 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3:44915)
I20260709 13:22:39.794514 27560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d"
I20260709 13:22:39.794695 27353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa8b5ff78894a808a3810fcfbbda3f2" candidate_uuid: "cca6e7866b17408cae8c4f839f878ed1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40d2fecddfbf480f86321e2bd7f390b5"
I20260709 13:22:39.795276 27560 raft_consensus.cc:3060] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:39.795362 27353 raft_consensus.cc:3055] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:39.795855 27353 raft_consensus.cc:740] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40d2fecddfbf480f86321e2bd7f390b5, State: Running, Role: LEADER
I20260709 13:22:39.796792 27353 consensus_queue.cc:260] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:39.798029 27353 raft_consensus.cc:3060] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:39.800827 27560 raft_consensus.cc:2468] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 3.
I20260709 13:22:39.802261 27246 leader_election.cc:304] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df1f2ed97b14cdb9ac7f8ac5647205d, cca6e7866b17408cae8c4f839f878ed1; no voters: 
I20260709 13:22:39.803174 27615 raft_consensus.cc:2804] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:39.803625 27615 raft_consensus.cc:697] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 3 LEADER]: Becoming Leader. State: Replica: cca6e7866b17408cae8c4f839f878ed1, State: Running, Role: LEADER
I20260709 13:22:39.804536 27353 raft_consensus.cc:2468] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cca6e7866b17408cae8c4f839f878ed1 in term 3.
I20260709 13:22:39.804920 27615 consensus_queue.cc:237] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } }
I20260709 13:22:39.813345 27103 catalog_manager.cc:5697] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 reported cstate change: term changed from 2 to 3, leader changed from 40d2fecddfbf480f86321e2bd7f390b5 (127.15.208.3) to cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2). New cstate: current_term: 3 leader_uuid: "cca6e7866b17408cae8c4f839f878ed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:40.164371 27560 raft_consensus.cc:1275] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:40.165654 27615 consensus_queue.cc:1048] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:40.175770 27353 raft_consensus.cc:1275] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:40.177723 27638 consensus_queue.cc:1048] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:22:40.218865 27353 raft_consensus.cc:1275] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:40.218890 27560 raft_consensus.cc:1275] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 6 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:22:40.220274 27615 consensus_queue.cc:1048] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d2fecddfbf480f86321e2bd7f390b5" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:40.220456 27673 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:22:40.232545 27277 raft_consensus.cc:1275] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 6 FOLLOWER]: Refusing update from remote peer 40d2fecddfbf480f86321e2bd7f390b5: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:22:40.234577 27633 consensus_queue.cc:1048] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cca6e7866b17408cae8c4f839f878ed1" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:22:40.243073 27559 raft_consensus.cc:1275] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Refusing update from remote peer cca6e7866b17408cae8c4f839f878ed1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:40.244508 27654 consensus_queue.cc:1048] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df1f2ed97b14cdb9ac7f8ac5647205d" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 44757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:40.417953 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:40.448400 16192 tablet_server.cc:179] TabletServer@127.15.208.1:44757 shutting down...
I20260709 13:22:40.475837 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:40.477031 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:40.478621 16192 raft_consensus.cc:2243] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.479471 16192 raft_consensus.cc:2272] T 15186667024a468eba0accca5af212b4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:40.481794 27246 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 68 similar messages]
I20260709 13:22:40.483719 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:40.484625 16192 raft_consensus.cc:2243] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:40.484952 27246 consensus_peers.cc:597] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:40.485330 16192 raft_consensus.cc:2272] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.489928 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:40.490798 16192 raft_consensus.cc:2243] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:40.491433 27320 consensus_peers.cc:597] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:40.491487 16192 raft_consensus.cc:2272] T c2d28689eaca4a8fbf307725b7695ef4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:40.492882 27320 consensus_peers.cc:597] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:40.494912 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:40.495765 16192 raft_consensus.cc:2243] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.496292 16192 raft_consensus.cc:2272] T 4c69fa7372904583a992a8418a9874c4 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.499058 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:40.499692 16192 raft_consensus.cc:2243] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.500316 16192 raft_consensus.cc:2272] T 83277692572b4bc3970b9e403aa73a18 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.504282 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:40.504946 16192 raft_consensus.cc:2243] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.505535 16192 raft_consensus.cc:2272] T 9de70c86acde4dab9e5bc8383e8f7176 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.508213 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:40.508822 16192 raft_consensus.cc:2243] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.509370 16192 raft_consensus.cc:2272] T 9b469a7c6a4046269b279c03f61456ec P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.511828 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:40.512319 16192 raft_consensus.cc:2243] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.512813 16192 raft_consensus.cc:2272] T 3b3162f2a4ec48d8ad68d03735cfe776 P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.515300 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:40.515769 16192 raft_consensus.cc:2243] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.516225 16192 raft_consensus.cc:2272] T d86840f734a04c1fa154192ea396b15c P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.519163 16192 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:40.519616 16192 raft_consensus.cc:2243] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.519995 16192 raft_consensus.cc:2272] T 94bf6da7f6474db8a0ee9f5fc287675e P 1df1f2ed97b14cdb9ac7f8ac5647205d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.553246 16192 tablet_server.cc:196] TabletServer@127.15.208.1:44757 shutdown complete.
I20260709 13:22:40.585760 16192 tablet_server.cc:179] TabletServer@127.15.208.2:0 shutting down...
W20260709 13:22:40.589073 27246 consensus_peers.cc:597] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:40.592301 27152 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:40.617358 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:40.618278 16192 tablet_replica.cc:333] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1: stopping tablet replica
I20260709 13:22:40.619215 16192 raft_consensus.cc:2243] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.619843 16192 raft_consensus.cc:2272] T 4c69fa7372904583a992a8418a9874c4 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.622483 16192 tablet_replica.cc:333] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1: stopping tablet replica
I20260709 13:22:40.623152 16192 raft_consensus.cc:2243] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.623608 16192 raft_consensus.cc:2272] T 83277692572b4bc3970b9e403aa73a18 P cca6e7866b17408cae8c4f839f878ed1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.626400 16192 tablet_replica.cc:333] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1: stopping tablet replica
I20260709 13:22:40.627024 16192 raft_consensus.cc:2243] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.627525 16192 raft_consensus.cc:2272] T 94bf6da7f6474db8a0ee9f5fc287675e P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.630280 16192 tablet_replica.cc:333] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1: stopping tablet replica
I20260709 13:22:40.630982 16192 raft_consensus.cc:2243] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.631971 16192 raft_consensus.cc:2272] T 9de70c86acde4dab9e5bc8383e8f7176 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.634579 16192 tablet_replica.cc:333] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1: stopping tablet replica
I20260709 13:22:40.635241 16192 raft_consensus.cc:2243] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.635764 16192 raft_consensus.cc:2272] T 9b469a7c6a4046269b279c03f61456ec P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.638222 16192 tablet_replica.cc:333] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1: stopping tablet replica
I20260709 13:22:40.638835 16192 raft_consensus.cc:2243] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.639740 16192 raft_consensus.cc:2272] T 3b3162f2a4ec48d8ad68d03735cfe776 P cca6e7866b17408cae8c4f839f878ed1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.642532 16192 tablet_replica.cc:333] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1: stopping tablet replica
I20260709 13:22:40.643144 16192 raft_consensus.cc:2243] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.644001 16192 raft_consensus.cc:2272] T d86840f734a04c1fa154192ea396b15c P cca6e7866b17408cae8c4f839f878ed1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.647572 16192 tablet_replica.cc:333] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1: stopping tablet replica
I20260709 13:22:40.648522 16192 raft_consensus.cc:2243] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.650450 16192 raft_consensus.cc:2272] T c2d28689eaca4a8fbf307725b7695ef4 P cca6e7866b17408cae8c4f839f878ed1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:40.652052 27319 consensus_peers.cc:597] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417): Couldn't send request to peer cca6e7866b17408cae8c4f839f878ed1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:40.653858 16192 tablet_replica.cc:333] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1: stopping tablet replica
I20260709 13:22:40.654585 16192 raft_consensus.cc:2243] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.655561 16192 raft_consensus.cc:2272] T 0aa8b5ff78894a808a3810fcfbbda3f2 P cca6e7866b17408cae8c4f839f878ed1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.658229 16192 tablet_replica.cc:333] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1: stopping tablet replica
I20260709 13:22:40.658712 16192 raft_consensus.cc:2243] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.659191 16192 raft_consensus.cc:2272] T 15186667024a468eba0accca5af212b4 P cca6e7866b17408cae8c4f839f878ed1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.686887 16192 tablet_server.cc:196] TabletServer@127.15.208.2:0 shutdown complete.
I20260709 13:22:40.716495 16192 tablet_server.cc:179] TabletServer@127.15.208.3:0 shutting down...
W20260709 13:22:40.719460 27320 consensus_peers.cc:597] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer 1df1f2ed97b14cdb9ac7f8ac5647205d (127.15.208.1:44757): Couldn't send request to peer 1df1f2ed97b14cdb9ac7f8ac5647205d. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:44757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:40.746162 27319 consensus_peers.cc:597] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 -> Peer cca6e7866b17408cae8c4f839f878ed1 (127.15.208.2:40417): Couldn't send request to peer cca6e7866b17408cae8c4f839f878ed1. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:40417: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:40.752024 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:40.753037 16192 tablet_replica.cc:333] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5: stopping tablet replica
I20260709 13:22:40.754181 16192 raft_consensus.cc:2243] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.754861 16192 raft_consensus.cc:2272] T c2d28689eaca4a8fbf307725b7695ef4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.757243 16192 tablet_replica.cc:333] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5: stopping tablet replica
I20260709 13:22:40.757839 16192 raft_consensus.cc:2243] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.758699 16192 raft_consensus.cc:2272] T 83277692572b4bc3970b9e403aa73a18 P 40d2fecddfbf480f86321e2bd7f390b5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.761853 16192 tablet_replica.cc:333] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5: stopping tablet replica
I20260709 13:22:40.762645 16192 raft_consensus.cc:2243] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.763504 16192 raft_consensus.cc:2272] T 4c69fa7372904583a992a8418a9874c4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.765691 16192 tablet_replica.cc:333] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5: stopping tablet replica
I20260709 13:22:40.766268 16192 raft_consensus.cc:2243] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.766686 16192 raft_consensus.cc:2272] T d86840f734a04c1fa154192ea396b15c P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.769263 16192 tablet_replica.cc:333] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5: stopping tablet replica
I20260709 13:22:40.769840 16192 raft_consensus.cc:2243] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.770771 16192 raft_consensus.cc:2272] T 94bf6da7f6474db8a0ee9f5fc287675e P 40d2fecddfbf480f86321e2bd7f390b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.773042 16192 tablet_replica.cc:333] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5: stopping tablet replica
I20260709 13:22:40.773620 16192 raft_consensus.cc:2243] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.774120 16192 raft_consensus.cc:2272] T 3b3162f2a4ec48d8ad68d03735cfe776 P 40d2fecddfbf480f86321e2bd7f390b5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.776618 16192 tablet_replica.cc:333] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5: stopping tablet replica
I20260709 13:22:40.777240 16192 raft_consensus.cc:2243] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.777868 16192 raft_consensus.cc:2272] T 9de70c86acde4dab9e5bc8383e8f7176 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.780414 16192 tablet_replica.cc:333] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5: stopping tablet replica
I20260709 13:22:40.781081 16192 raft_consensus.cc:2243] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.782068 16192 raft_consensus.cc:2272] T 9b469a7c6a4046269b279c03f61456ec P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.784555 16192 tablet_replica.cc:333] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5: stopping tablet replica
I20260709 13:22:40.785228 16192 raft_consensus.cc:2243] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:40.785704 16192 raft_consensus.cc:2272] T 0aa8b5ff78894a808a3810fcfbbda3f2 P 40d2fecddfbf480f86321e2bd7f390b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.788383 16192 tablet_replica.cc:333] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5: stopping tablet replica
I20260709 13:22:40.788964 16192 raft_consensus.cc:2243] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.789944 16192 raft_consensus.cc:2272] T 15186667024a468eba0accca5af212b4 P 40d2fecddfbf480f86321e2bd7f390b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.822957 16192 tablet_server.cc:196] TabletServer@127.15.208.3:0 shutdown complete.
I20260709 13:22:40.851091 16192 master.cc:562] Master@127.15.208.62:33225 shutting down...
I20260709 13:22:40.877269 16192 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:40.877887 16192 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:40.878379 16192 tablet_replica.cc:333] T 00000000000000000000000000000000 P 674a4711933c423cbf0bbe024245c151: stopping tablet replica
I20260709 13:22:40.903880 16192 master.cc:584] Master@127.15.208.62:33225 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (17524 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:22:40.952818 16192 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.208.62:36185
I20260709 13:22:40.954109 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:40.960263 27699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:40.960726 27700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:40.961338 27702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:40.962803 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:40.963760 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:40.963936 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:40.964108 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603360964094 us; error 0 us; skew 500 ppm
I20260709 13:22:40.964725 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:40.967118 16192 webserver.cc:533] Webserver started at http://127.15.208.62:35187/ using document root <none> and password file <none>
I20260709 13:22:40.967659 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:40.967856 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:40.968158 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:40.969379 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/master-0-root/instance:
uuid: "d5fd6d17de33497abe21b6295d7517ef"
format_stamp: "Formatted at 2026-07-09 13:22:40 on dist-test-slave-w3b1"
I20260709 13:22:40.974144 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:22:40.977721 27707 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:40.978490 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:40.978782 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/master-0-root
uuid: "d5fd6d17de33497abe21b6295d7517ef"
format_stamp: "Formatted at 2026-07-09 13:22:40 on dist-test-slave-w3b1"
I20260709 13:22:40.979061 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:40.990949 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:40.992323 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:41.033383 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.62:36185
I20260709 13:22:41.033483 27758 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.62:36185 every 8 connection(s)
I20260709 13:22:41.037384 27759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:41.048830 27759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef: Bootstrap starting.
I20260709 13:22:41.053681 27759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:41.057968 27759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef: No bootstrap required, opened a new log
I20260709 13:22:41.060081 27759 raft_consensus.cc:359] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5fd6d17de33497abe21b6295d7517ef" member_type: VOTER }
I20260709 13:22:41.060495 27759 raft_consensus.cc:385] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:41.060734 27759 raft_consensus.cc:740] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5fd6d17de33497abe21b6295d7517ef, State: Initialized, Role: FOLLOWER
I20260709 13:22:41.061455 27759 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5fd6d17de33497abe21b6295d7517ef" member_type: VOTER }
I20260709 13:22:41.061915 27759 raft_consensus.cc:399] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:41.062121 27759 raft_consensus.cc:493] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:41.062438 27759 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:41.067288 27759 raft_consensus.cc:515] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5fd6d17de33497abe21b6295d7517ef" member_type: VOTER }
I20260709 13:22:41.067799 27759 leader_election.cc:304] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5fd6d17de33497abe21b6295d7517ef; no voters: 
I20260709 13:22:41.068984 27759 leader_election.cc:290] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:41.069370 27762 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:41.070784 27762 raft_consensus.cc:697] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 1 LEADER]: Becoming Leader. State: Replica: d5fd6d17de33497abe21b6295d7517ef, State: Running, Role: LEADER
I20260709 13:22:41.071485 27762 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5fd6d17de33497abe21b6295d7517ef" member_type: VOTER }
I20260709 13:22:41.071987 27759 sys_catalog.cc:565] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:41.076021 27763 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5fd6d17de33497abe21b6295d7517ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5fd6d17de33497abe21b6295d7517ef" member_type: VOTER } }
I20260709 13:22:41.076579 27764 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5fd6d17de33497abe21b6295d7517ef. Latest consensus state: current_term: 1 leader_uuid: "d5fd6d17de33497abe21b6295d7517ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5fd6d17de33497abe21b6295d7517ef" member_type: VOTER } }
I20260709 13:22:41.076812 27763 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:41.077229 27764 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:41.079720 27769 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:41.087598 27769 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:41.088951 16192 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:41.098248 27769 catalog_manager.cc:1383] Generated new cluster ID: 989732d0cfaa4fec9a2859ff6dad10a6
I20260709 13:22:41.098549 27769 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:41.125826 27769 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:41.127161 27769 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:41.141274 27769 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef: Generated new TSK 0
I20260709 13:22:41.141916 27769 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:41.155614 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:41.161451 27780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.162747 27781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.164440 27783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:41.165094 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:41.166307 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:41.166499 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:41.166725 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603361166710 us; error 0 us; skew 500 ppm
I20260709 13:22:41.167315 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:41.169802 16192 webserver.cc:533] Webserver started at http://127.15.208.1:44263/ using document root <none> and password file <none>
I20260709 13:22:41.170298 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:41.170496 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:41.170785 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:41.171897 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-0-root/instance:
uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-w3b1"
I20260709 13:22:41.176604 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:41.180130 27788 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.181214 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:22:41.181591 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-0-root
uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-w3b1"
I20260709 13:22:41.181945 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:41.206257 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:41.207522 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:41.209184 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:41.211457 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:41.211633 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.211936 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:41.212121 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.253233 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.1:40675
I20260709 13:22:41.253367 27850 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.1:40675 every 8 connection(s)
I20260709 13:22:41.258363 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:41.265908 27855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.266009 27856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.271600 27858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:41.272238 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:41.272540 27851 heartbeater.cc:344] Connected to a master server at 127.15.208.62:36185
I20260709 13:22:41.273011 27851 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:41.273841 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:41.273941 27851 heartbeater.cc:507] Master 127.15.208.62:36185 requested a full tablet report, sending...
W20260709 13:22:41.274247 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:41.274477 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603361274458 us; error 0 us; skew 500 ppm
I20260709 13:22:41.275208 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:41.276648 27724 ts_manager.cc:194] Registered new tserver with Master: e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675)
I20260709 13:22:41.278101 16192 webserver.cc:533] Webserver started at http://127.15.208.2:36353/ using document root <none> and password file <none>
I20260709 13:22:41.278798 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:41.279026 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:41.279321 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:41.279383 27724 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37060
I20260709 13:22:41.280833 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-1-root/instance:
uuid: "0ddc19f033b244a58a3d678ce35c591b"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-w3b1"
I20260709 13:22:41.285720 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:22:41.289172 27863 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.289985 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:22:41.290295 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-1-root
uuid: "0ddc19f033b244a58a3d678ce35c591b"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-w3b1"
I20260709 13:22:41.290577 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:41.318317 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:41.319573 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:41.321161 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:41.323388 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:41.323559 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.323890 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:41.324028 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.368206 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.2:42179
I20260709 13:22:41.368325 27925 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.2:42179 every 8 connection(s)
I20260709 13:22:41.373297 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:41.381126 27929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.382333 27930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:41.384649 27932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:41.385314 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:41.386703 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:41.386770 27926 heartbeater.cc:344] Connected to a master server at 127.15.208.62:36185
W20260709 13:22:41.387029 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:41.387313 27926 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:41.387341 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603361387313 us; error 0 us; skew 500 ppm
I20260709 13:22:41.388300 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:41.388370 27926 heartbeater.cc:507] Master 127.15.208.62:36185 requested a full tablet report, sending...
I20260709 13:22:41.390779 27724 ts_manager.cc:194] Registered new tserver with Master: 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2:42179)
I20260709 13:22:41.391160 16192 webserver.cc:533] Webserver started at http://127.15.208.3:38537/ using document root <none> and password file <none>
I20260709 13:22:41.391764 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:41.392004 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:41.392336 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:41.392645 27724 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37072
I20260709 13:22:41.393692 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-2-root/instance:
uuid: "6f05b0d2890e4716be238dcc14c0d611"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-w3b1"
I20260709 13:22:41.398479 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:41.402050 27937 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.402940 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:41.403301 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-2-root
uuid: "6f05b0d2890e4716be238dcc14c0d611"
format_stamp: "Formatted at 2026-07-09 13:22:41 on dist-test-slave-w3b1"
I20260709 13:22:41.403577 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603004946521-16192-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:41.430859 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:41.432106 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:41.433657 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:41.435899 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:41.436131 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.436368 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:41.436539 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:41.476929 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.3:38035
I20260709 13:22:41.477088 27999 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.3:38035 every 8 connection(s)
I20260709 13:22:41.491699 28000 heartbeater.cc:344] Connected to a master server at 127.15.208.62:36185
I20260709 13:22:41.492162 28000 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:41.492995 28000 heartbeater.cc:507] Master 127.15.208.62:36185 requested a full tablet report, sending...
I20260709 13:22:41.494889 27724 ts_manager.cc:194] Registered new tserver with Master: 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3:38035)
I20260709 13:22:41.495054 16192 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014973393s
I20260709 13:22:41.496716 27724 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37082
I20260709 13:22:41.520854 27724 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37084:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:41.523029 27724 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:41.584404 27891 tablet_service.cc:1511] Processing CreateTablet for tablet a685ad84cb934c59b6d621ef43e9ec7a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb8a99e9c9af4ce4ae7c5f94aac3e842]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:41.585033 27890 tablet_service.cc:1511] Processing CreateTablet for tablet 358ee27c797f43578b50c3c3f414c46c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb8a99e9c9af4ce4ae7c5f94aac3e842]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:41.586097 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a685ad84cb934c59b6d621ef43e9ec7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:41.586769 27890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 358ee27c797f43578b50c3c3f414c46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:41.587437 27816 tablet_service.cc:1511] Processing CreateTablet for tablet a685ad84cb934c59b6d621ef43e9ec7a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb8a99e9c9af4ce4ae7c5f94aac3e842]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:41.586215 27815 tablet_service.cc:1511] Processing CreateTablet for tablet 358ee27c797f43578b50c3c3f414c46c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb8a99e9c9af4ce4ae7c5f94aac3e842]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:41.588814 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a685ad84cb934c59b6d621ef43e9ec7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:41.589979 27815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 358ee27c797f43578b50c3c3f414c46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:41.608096 27965 tablet_service.cc:1511] Processing CreateTablet for tablet a685ad84cb934c59b6d621ef43e9ec7a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb8a99e9c9af4ce4ae7c5f94aac3e842]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:41.609951 27965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a685ad84cb934c59b6d621ef43e9ec7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:41.613304 28015 tablet_bootstrap.cc:492] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b: Bootstrap starting.
I20260709 13:22:41.613842 27964 tablet_service.cc:1511] Processing CreateTablet for tablet 358ee27c797f43578b50c3c3f414c46c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb8a99e9c9af4ce4ae7c5f94aac3e842]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:41.615486 27964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 358ee27c797f43578b50c3c3f414c46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:41.621050 28016 tablet_bootstrap.cc:492] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1: Bootstrap starting.
I20260709 13:22:41.625799 28015 tablet_bootstrap.cc:654] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:41.628662 28016 tablet_bootstrap.cc:654] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:41.641126 28019 tablet_bootstrap.cc:492] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611: Bootstrap starting.
I20260709 13:22:41.641287 28015 tablet_bootstrap.cc:492] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b: No bootstrap required, opened a new log
I20260709 13:22:41.641523 28016 tablet_bootstrap.cc:492] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1: No bootstrap required, opened a new log
I20260709 13:22:41.642185 28015 ts_tablet_manager.cc:1403] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.012s
I20260709 13:22:41.643602 28016 ts_tablet_manager.cc:1403] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 13:22:41.646175 28015 raft_consensus.cc:359] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.647126 28015 raft_consensus.cc:385] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:41.647516 28015 raft_consensus.cc:740] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddc19f033b244a58a3d678ce35c591b, State: Initialized, Role: FOLLOWER
I20260709 13:22:41.647761 28019 tablet_bootstrap.cc:654] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:41.647320 28016 raft_consensus.cc:359] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.648272 28016 raft_consensus.cc:385] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:41.648636 28016 raft_consensus.cc:740] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e16b47f3b5534dfb8db1986ca8ab18c1, State: Initialized, Role: FOLLOWER
I20260709 13:22:41.648550 28015 consensus_queue.cc:260] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.649727 28016 consensus_queue.cc:260] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.654302 27851 heartbeater.cc:499] Master 127.15.208.62:36185 was elected leader, sending a full tablet report...
I20260709 13:22:41.658227 28016 ts_tablet_manager.cc:1434] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.007s
I20260709 13:22:41.661075 28016 tablet_bootstrap.cc:492] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1: Bootstrap starting.
I20260709 13:22:41.667063 27926 heartbeater.cc:499] Master 127.15.208.62:36185 was elected leader, sending a full tablet report...
I20260709 13:22:41.670164 28015 ts_tablet_manager.cc:1434] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b: Time spent starting tablet: real 0.028s	user 0.016s	sys 0.001s
I20260709 13:22:41.671427 28015 tablet_bootstrap.cc:492] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b: Bootstrap starting.
I20260709 13:22:41.671929 28019 tablet_bootstrap.cc:492] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611: No bootstrap required, opened a new log
I20260709 13:22:41.672358 28019 ts_tablet_manager.cc:1403] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.015s
I20260709 13:22:41.675486 28019 raft_consensus.cc:359] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.676139 28016 tablet_bootstrap.cc:654] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:41.676326 28019 raft_consensus.cc:385] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:41.676676 28019 raft_consensus.cc:740] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f05b0d2890e4716be238dcc14c0d611, State: Initialized, Role: FOLLOWER
I20260709 13:22:41.677544 28019 consensus_queue.cc:260] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.680344 28015 tablet_bootstrap.cc:654] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:41.704327 28019 ts_tablet_manager.cc:1434] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.017s
I20260709 13:22:41.704684 28000 heartbeater.cc:499] Master 127.15.208.62:36185 was elected leader, sending a full tablet report...
I20260709 13:22:41.705482 28019 tablet_bootstrap.cc:492] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611: Bootstrap starting.
I20260709 13:22:41.707090 28016 tablet_bootstrap.cc:492] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1: No bootstrap required, opened a new log
I20260709 13:22:41.707340 28015 tablet_bootstrap.cc:492] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b: No bootstrap required, opened a new log
I20260709 13:22:41.707891 28016 ts_tablet_manager.cc:1403] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.020s
I20260709 13:22:41.707979 28015 ts_tablet_manager.cc:1403] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.021s
I20260709 13:22:41.711758 28015 raft_consensus.cc:359] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.712569 28019 tablet_bootstrap.cc:654] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:41.712713 28015 raft_consensus.cc:385] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:41.712301 28016 raft_consensus.cc:359] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.713280 28015 raft_consensus.cc:740] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddc19f033b244a58a3d678ce35c591b, State: Initialized, Role: FOLLOWER
I20260709 13:22:41.713678 28016 raft_consensus.cc:385] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:41.714149 28016 raft_consensus.cc:740] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e16b47f3b5534dfb8db1986ca8ab18c1, State: Initialized, Role: FOLLOWER
I20260709 13:22:41.714238 28015 consensus_queue.cc:260] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.715181 28016 consensus_queue.cc:260] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.717195 28015 ts_tablet_manager.cc:1434] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:22:41.718070 28016 ts_tablet_manager.cc:1434] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:41.720990 28019 tablet_bootstrap.cc:492] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611: No bootstrap required, opened a new log
I20260709 13:22:41.721562 28019 ts_tablet_manager.cc:1403] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:22:41.724566 28019 raft_consensus.cc:359] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.725323 28019 raft_consensus.cc:385] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:41.725629 28019 raft_consensus.cc:740] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f05b0d2890e4716be238dcc14c0d611, State: Initialized, Role: FOLLOWER
I20260709 13:22:41.726420 28019 consensus_queue.cc:260] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.728554 28019 ts_tablet_manager.cc:1434] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:41.817346 28023 raft_consensus.cc:493] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:41.817927 28023 raft_consensus.cc:515] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.819984 28023 leader_election.cc:290] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675), 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2:42179)
I20260709 13:22:41.828665 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358ee27c797f43578b50c3c3f414c46c" candidate_uuid: "6f05b0d2890e4716be238dcc14c0d611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" is_pre_election: true
I20260709 13:22:41.829553 27826 raft_consensus.cc:2468] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f05b0d2890e4716be238dcc14c0d611 in term 0.
I20260709 13:22:41.830595 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358ee27c797f43578b50c3c3f414c46c" candidate_uuid: "6f05b0d2890e4716be238dcc14c0d611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddc19f033b244a58a3d678ce35c591b" is_pre_election: true
I20260709 13:22:41.830785 27938 leader_election.cc:304] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f05b0d2890e4716be238dcc14c0d611, e16b47f3b5534dfb8db1986ca8ab18c1; no voters: 
I20260709 13:22:41.831218 27901 raft_consensus.cc:2468] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f05b0d2890e4716be238dcc14c0d611 in term 0.
I20260709 13:22:41.831784 28023 raft_consensus.cc:2804] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:41.832180 28023 raft_consensus.cc:493] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:41.832505 28023 raft_consensus.cc:3060] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:41.838835 28023 raft_consensus.cc:515] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.840811 28023 leader_election.cc:290] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [CANDIDATE]: Term 1 election: Requested vote from peers e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675), 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2:42179)
I20260709 13:22:41.841671 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358ee27c797f43578b50c3c3f414c46c" candidate_uuid: "6f05b0d2890e4716be238dcc14c0d611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
I20260709 13:22:41.841917 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358ee27c797f43578b50c3c3f414c46c" candidate_uuid: "6f05b0d2890e4716be238dcc14c0d611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddc19f033b244a58a3d678ce35c591b"
I20260709 13:22:41.842375 27826 raft_consensus.cc:3060] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:41.842531 27901 raft_consensus.cc:3060] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:41.851215 27901 raft_consensus.cc:2468] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f05b0d2890e4716be238dcc14c0d611 in term 1.
I20260709 13:22:41.851218 27826 raft_consensus.cc:2468] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f05b0d2890e4716be238dcc14c0d611 in term 1.
I20260709 13:22:41.852739 27940 leader_election.cc:304] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddc19f033b244a58a3d678ce35c591b, 6f05b0d2890e4716be238dcc14c0d611; no voters: 
I20260709 13:22:41.853554 28023 raft_consensus.cc:2804] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:41.854444 28023 raft_consensus.cc:697] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 1 LEADER]: Becoming Leader. State: Replica: 6f05b0d2890e4716be238dcc14c0d611, State: Running, Role: LEADER
I20260709 13:22:41.855273 28023 consensus_queue.cc:237] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.863375 27721 catalog_manager.cc:5697] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "6f05b0d2890e4716be238dcc14c0d611" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:41.887401 28023 raft_consensus.cc:493] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:41.887905 28023 raft_consensus.cc:515] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.889794 28023 leader_election.cc:290] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2:42179), e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675)
I20260709 13:22:41.890704 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685ad84cb934c59b6d621ef43e9ec7a" candidate_uuid: "6f05b0d2890e4716be238dcc14c0d611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddc19f033b244a58a3d678ce35c591b" is_pre_election: true
I20260709 13:22:41.890828 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685ad84cb934c59b6d621ef43e9ec7a" candidate_uuid: "6f05b0d2890e4716be238dcc14c0d611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" is_pre_election: true
I20260709 13:22:41.891358 27901 raft_consensus.cc:2468] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f05b0d2890e4716be238dcc14c0d611 in term 0.
I20260709 13:22:41.891456 27826 raft_consensus.cc:2468] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f05b0d2890e4716be238dcc14c0d611 in term 0.
I20260709 13:22:41.892516 27940 leader_election.cc:304] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddc19f033b244a58a3d678ce35c591b, 6f05b0d2890e4716be238dcc14c0d611; no voters: 
I20260709 13:22:41.893322 28023 raft_consensus.cc:2804] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:41.893613 28023 raft_consensus.cc:493] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:41.893899 28023 raft_consensus.cc:3060] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:41.899420 28023 raft_consensus.cc:515] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.901086 28023 leader_election.cc:290] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [CANDIDATE]: Term 1 election: Requested vote from peers 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2:42179), e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675)
I20260709 13:22:41.901865 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685ad84cb934c59b6d621ef43e9ec7a" candidate_uuid: "6f05b0d2890e4716be238dcc14c0d611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddc19f033b244a58a3d678ce35c591b"
I20260709 13:22:41.902211 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685ad84cb934c59b6d621ef43e9ec7a" candidate_uuid: "6f05b0d2890e4716be238dcc14c0d611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
I20260709 13:22:41.902518 27901 raft_consensus.cc:3060] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:41.902832 27826 raft_consensus.cc:3060] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:41.909730 27826 raft_consensus.cc:2468] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f05b0d2890e4716be238dcc14c0d611 in term 1.
I20260709 13:22:41.909730 27901 raft_consensus.cc:2468] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f05b0d2890e4716be238dcc14c0d611 in term 1.
I20260709 13:22:41.911305 27938 leader_election.cc:304] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f05b0d2890e4716be238dcc14c0d611, e16b47f3b5534dfb8db1986ca8ab18c1; no voters: 
I20260709 13:22:41.912037 28023 raft_consensus.cc:2804] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:41.912557 28023 raft_consensus.cc:697] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 1 LEADER]: Becoming Leader. State: Replica: 6f05b0d2890e4716be238dcc14c0d611, State: Running, Role: LEADER
I20260709 13:22:41.913353 28023 consensus_queue.cc:237] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:41.921059 27721 catalog_manager.cc:5697] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "6f05b0d2890e4716be238dcc14c0d611" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:41.995217 27721 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37092:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:41.997470 27721 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:42.022183 27815 tablet_service.cc:1511] Processing CreateTablet for tablet 081b6012e9794e00ae4a2ff549fff74b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f901eab358704f968bcf9d75c961a52d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:42.023530 27815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081b6012e9794e00ae4a2ff549fff74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.023599 27890 tablet_service.cc:1511] Processing CreateTablet for tablet 081b6012e9794e00ae4a2ff549fff74b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f901eab358704f968bcf9d75c961a52d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:42.024911 27890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081b6012e9794e00ae4a2ff549fff74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.024699 27964 tablet_service.cc:1511] Processing CreateTablet for tablet 081b6012e9794e00ae4a2ff549fff74b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f901eab358704f968bcf9d75c961a52d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:42.026047 27964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081b6012e9794e00ae4a2ff549fff74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.028620 27816 tablet_service.cc:1511] Processing CreateTablet for tablet 894ccae7cf1a470589ec5d98e2bbd5f4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f901eab358704f968bcf9d75c961a52d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:42.030009 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894ccae7cf1a470589ec5d98e2bbd5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.029865 27965 tablet_service.cc:1511] Processing CreateTablet for tablet 894ccae7cf1a470589ec5d98e2bbd5f4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f901eab358704f968bcf9d75c961a52d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:42.031164 27965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894ccae7cf1a470589ec5d98e2bbd5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.037962 27891 tablet_service.cc:1511] Processing CreateTablet for tablet 894ccae7cf1a470589ec5d98e2bbd5f4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f901eab358704f968bcf9d75c961a52d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:42.039378 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 894ccae7cf1a470589ec5d98e2bbd5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:42.046298 28016 tablet_bootstrap.cc:492] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1: Bootstrap starting.
I20260709 13:22:42.048156 28019 tablet_bootstrap.cc:492] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611: Bootstrap starting.
I20260709 13:22:42.046298 28015 tablet_bootstrap.cc:492] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b: Bootstrap starting.
I20260709 13:22:42.054816 28016 tablet_bootstrap.cc:654] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.055161 28015 tablet_bootstrap.cc:654] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.054816 28019 tablet_bootstrap.cc:654] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.071687 28019 tablet_bootstrap.cc:492] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611: No bootstrap required, opened a new log
I20260709 13:22:42.071689 28015 tablet_bootstrap.cc:492] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b: No bootstrap required, opened a new log
I20260709 13:22:42.073921 28015 ts_tablet_manager.cc:1403] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.015s
I20260709 13:22:42.072268 28019 ts_tablet_manager.cc:1403] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.011s
I20260709 13:22:42.076923 28016 tablet_bootstrap.cc:492] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1: No bootstrap required, opened a new log
I20260709 13:22:42.077436 28016 ts_tablet_manager.cc:1403] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.006s
I20260709 13:22:42.077050 28015 raft_consensus.cc:359] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.077898 28015 raft_consensus.cc:385] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.078210 28015 raft_consensus.cc:740] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddc19f033b244a58a3d678ce35c591b, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.078807 28019 raft_consensus.cc:359] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.078999 28015 consensus_queue.cc:260] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.079664 28019 raft_consensus.cc:385] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.079999 28019 raft_consensus.cc:740] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f05b0d2890e4716be238dcc14c0d611, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.082317 28015 ts_tablet_manager.cc:1434] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
W20260709 13:22:42.082638 27772 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:42.080294 28016 raft_consensus.cc:359] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.083673 28016 raft_consensus.cc:385] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.083731 28015 tablet_bootstrap.cc:492] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b: Bootstrap starting.
I20260709 13:22:42.083130 28019 consensus_queue.cc:260] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.084129 28016 raft_consensus.cc:740] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e16b47f3b5534dfb8db1986ca8ab18c1, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.085081 28016 consensus_queue.cc:260] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.088003 28019 ts_tablet_manager.cc:1434] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:22:42.089134 28019 tablet_bootstrap.cc:492] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611: Bootstrap starting.
I20260709 13:22:42.090411 28016 ts_tablet_manager.cc:1434] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:22:42.091073 28015 tablet_bootstrap.cc:654] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.091671 28016 tablet_bootstrap.cc:492] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1: Bootstrap starting.
I20260709 13:22:42.095537 28019 tablet_bootstrap.cc:654] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.100739 28016 tablet_bootstrap.cc:654] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:42.104772 28015 tablet_bootstrap.cc:492] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b: No bootstrap required, opened a new log
I20260709 13:22:42.105551 28015 ts_tablet_manager.cc:1403] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:22:42.119263 28019 tablet_bootstrap.cc:492] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611: No bootstrap required, opened a new log
I20260709 13:22:42.120101 28019 ts_tablet_manager.cc:1403] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.007s
I20260709 13:22:42.122910 28015 raft_consensus.cc:359] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.123755 28015 raft_consensus.cc:385] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.124054 28015 raft_consensus.cc:740] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddc19f033b244a58a3d678ce35c591b, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.124665 28016 tablet_bootstrap.cc:492] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1: No bootstrap required, opened a new log
I20260709 13:22:42.124869 28015 consensus_queue.cc:260] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.125345 28016 ts_tablet_manager.cc:1403] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.017s
I20260709 13:22:42.125285 28019 raft_consensus.cc:359] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.126344 28019 raft_consensus.cc:385] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.126726 28019 raft_consensus.cc:740] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f05b0d2890e4716be238dcc14c0d611, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.127386 28015 ts_tablet_manager.cc:1434] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.005s
I20260709 13:22:42.127750 28019 consensus_queue.cc:260] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.129026 28016 raft_consensus.cc:359] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.129818 28016 raft_consensus.cc:385] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:42.130048 28019 ts_tablet_manager.cc:1434] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:22:42.130103 28016 raft_consensus.cc:740] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e16b47f3b5534dfb8db1986ca8ab18c1, State: Initialized, Role: FOLLOWER
I20260709 13:22:42.131134 28016 consensus_queue.cc:260] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.133343 28016 ts_tablet_manager.cc:1434] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:42.169618 28020 raft_consensus.cc:493] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:42.170360 28020 raft_consensus.cc:515] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.172641 28020 leader_election.cc:290] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675), 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3:38035)
I20260709 13:22:42.183286 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b" candidate_uuid: "0ddc19f033b244a58a3d678ce35c591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" is_pre_election: true
I20260709 13:22:42.184088 27826 raft_consensus.cc:2468] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddc19f033b244a58a3d678ce35c591b in term 0.
I20260709 13:22:42.185132 27864 leader_election.cc:304] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddc19f033b244a58a3d678ce35c591b, e16b47f3b5534dfb8db1986ca8ab18c1; no voters: 
I20260709 13:22:42.185256 27975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b" candidate_uuid: "0ddc19f033b244a58a3d678ce35c591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f05b0d2890e4716be238dcc14c0d611" is_pre_election: true
I20260709 13:22:42.185864 28020 raft_consensus.cc:2804] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:42.185995 27975 raft_consensus.cc:2468] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddc19f033b244a58a3d678ce35c591b in term 0.
I20260709 13:22:42.186225 28020 raft_consensus.cc:493] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:42.186640 28020 raft_consensus.cc:3060] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.192080 28020 raft_consensus.cc:515] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.193861 28020 leader_election.cc:290] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [CANDIDATE]: Term 1 election: Requested vote from peers e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675), 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3:38035)
I20260709 13:22:42.194572 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b" candidate_uuid: "0ddc19f033b244a58a3d678ce35c591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
I20260709 13:22:42.195035 27975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b" candidate_uuid: "0ddc19f033b244a58a3d678ce35c591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f05b0d2890e4716be238dcc14c0d611"
I20260709 13:22:42.195245 27826 raft_consensus.cc:3060] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.195647 27975 raft_consensus.cc:3060] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.202885 27826 raft_consensus.cc:2468] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddc19f033b244a58a3d678ce35c591b in term 1.
I20260709 13:22:42.203053 27975 raft_consensus.cc:2468] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddc19f033b244a58a3d678ce35c591b in term 1.
I20260709 13:22:42.204372 27864 leader_election.cc:304] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddc19f033b244a58a3d678ce35c591b, e16b47f3b5534dfb8db1986ca8ab18c1; no voters: 
I20260709 13:22:42.205226 28020 raft_consensus.cc:2804] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:42.206243 28020 raft_consensus.cc:697] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 1 LEADER]: Becoming Leader. State: Replica: 0ddc19f033b244a58a3d678ce35c591b, State: Running, Role: LEADER
I20260709 13:22:42.206939 28020 consensus_queue.cc:237] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.214519 27723 catalog_manager.cc:5697] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2). New cstate: current_term: 1 leader_uuid: "0ddc19f033b244a58a3d678ce35c591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:42.258066 28023 consensus_queue.cc:1048] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:42.269222 28020 raft_consensus.cc:493] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:42.269850 28020 raft_consensus.cc:515] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.273123 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894ccae7cf1a470589ec5d98e2bbd5f4" candidate_uuid: "0ddc19f033b244a58a3d678ce35c591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" is_pre_election: true
I20260709 13:22:42.273799 27825 raft_consensus.cc:2468] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddc19f033b244a58a3d678ce35c591b in term 0.
I20260709 13:22:42.274207 28050 consensus_queue.cc:1048] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:42.275236 27864 leader_election.cc:304] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddc19f033b244a58a3d678ce35c591b, e16b47f3b5534dfb8db1986ca8ab18c1; no voters: 
I20260709 13:22:42.275527 28020 leader_election.cc:290] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675), 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3:38035)
I20260709 13:22:42.276151 28020 raft_consensus.cc:2804] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:42.276535 28020 raft_consensus.cc:493] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:42.276893 28020 raft_consensus.cc:3060] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.277220 27975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894ccae7cf1a470589ec5d98e2bbd5f4" candidate_uuid: "0ddc19f033b244a58a3d678ce35c591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f05b0d2890e4716be238dcc14c0d611" is_pre_election: true
I20260709 13:22:42.277944 27975 raft_consensus.cc:2468] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddc19f033b244a58a3d678ce35c591b in term 0.
I20260709 13:22:42.284806 28020 raft_consensus.cc:515] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.286509 28020 leader_election.cc:290] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [CANDIDATE]: Term 1 election: Requested vote from peers e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675), 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3:38035)
I20260709 13:22:42.287400 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894ccae7cf1a470589ec5d98e2bbd5f4" candidate_uuid: "0ddc19f033b244a58a3d678ce35c591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
I20260709 13:22:42.287770 27975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894ccae7cf1a470589ec5d98e2bbd5f4" candidate_uuid: "0ddc19f033b244a58a3d678ce35c591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f05b0d2890e4716be238dcc14c0d611"
I20260709 13:22:42.288076 27825 raft_consensus.cc:3060] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.288419 27975 raft_consensus.cc:3060] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:42.294831 27825 raft_consensus.cc:2468] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddc19f033b244a58a3d678ce35c591b in term 1.
I20260709 13:22:42.295033 27975 raft_consensus.cc:2468] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddc19f033b244a58a3d678ce35c591b in term 1.
I20260709 13:22:42.296083 27864 leader_election.cc:304] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddc19f033b244a58a3d678ce35c591b, e16b47f3b5534dfb8db1986ca8ab18c1; no voters: 
I20260709 13:22:42.296890 28020 raft_consensus.cc:2804] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:42.297330 28020 raft_consensus.cc:697] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 1 LEADER]: Becoming Leader. State: Replica: 0ddc19f033b244a58a3d678ce35c591b, State: Running, Role: LEADER
I20260709 13:22:42.298046 28020 consensus_queue.cc:237] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.305104 27723 catalog_manager.cc:5697] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2). New cstate: current_term: 1 leader_uuid: "0ddc19f033b244a58a3d678ce35c591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:42.327376 27975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a685ad84cb934c59b6d621ef43e9ec7a"
dest_uuid: "6f05b0d2890e4716be238dcc14c0d611"
mode: GRACEFUL
new_leader_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
 from {username='slave'} at 127.0.0.1:33410
I20260709 13:22:42.327919 27975 raft_consensus.cc:606] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 1 LEADER]: Received request to transfer leadership to TS e16b47f3b5534dfb8db1986ca8ab18c1
I20260709 13:22:42.333428 27975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "358ee27c797f43578b50c3c3f414c46c"
dest_uuid: "6f05b0d2890e4716be238dcc14c0d611"
mode: GRACEFUL
new_leader_uuid: "0ddc19f033b244a58a3d678ce35c591b"
 from {username='slave'} at 127.0.0.1:33410
I20260709 13:22:42.333958 27975 raft_consensus.cc:606] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 1 LEADER]: Received request to transfer leadership to TS 0ddc19f033b244a58a3d678ce35c591b
I20260709 13:22:42.347723 27901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b"
dest_uuid: "0ddc19f033b244a58a3d678ce35c591b"
mode: GRACEFUL
new_leader_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
 from {username='slave'} at 127.0.0.1:43074
I20260709 13:22:42.348371 27901 raft_consensus.cc:606] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 1 LEADER]: Received request to transfer leadership to TS e16b47f3b5534dfb8db1986ca8ab18c1
I20260709 13:22:42.350499 28050 consensus_queue.cc:1048] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:42.354326 27901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "894ccae7cf1a470589ec5d98e2bbd5f4"
dest_uuid: "0ddc19f033b244a58a3d678ce35c591b"
mode: GRACEFUL
new_leader_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
 from {username='slave'} at 127.0.0.1:43074
I20260709 13:22:42.354857 27901 raft_consensus.cc:606] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 1 LEADER]: Received request to transfer leadership to TS e16b47f3b5534dfb8db1986ca8ab18c1
I20260709 13:22:42.362641 28023 consensus_queue.cc:1048] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:42.371766 28023 raft_consensus.cc:993] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611: : Instructing follower e16b47f3b5534dfb8db1986ca8ab18c1 to start an election
I20260709 13:22:42.372269 28023 raft_consensus.cc:1081] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 1 LEADER]: Signalling peer e16b47f3b5534dfb8db1986ca8ab18c1 to start an election
I20260709 13:22:42.374109 27825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a685ad84cb934c59b6d621ef43e9ec7a"
dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
 from {username='slave'} at 127.0.0.1:43824
I20260709 13:22:42.374771 27825 raft_consensus.cc:493] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:42.375202 27825 raft_consensus.cc:3060] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.381987 27825 raft_consensus.cc:515] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.384330 27825 leader_election.cc:290] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [CANDIDATE]: Term 2 election: Requested vote from peers 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2:42179), 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3:38035)
I20260709 13:22:42.397694 27975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685ad84cb934c59b6d621ef43e9ec7a" candidate_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f05b0d2890e4716be238dcc14c0d611"
I20260709 13:22:42.398250 27975 raft_consensus.cc:3055] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:42.398578 27975 raft_consensus.cc:740] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f05b0d2890e4716be238dcc14c0d611, State: Running, Role: LEADER
I20260709 13:22:42.398375 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a685ad84cb934c59b6d621ef43e9ec7a" candidate_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddc19f033b244a58a3d678ce35c591b"
I20260709 13:22:42.399286 27900 raft_consensus.cc:3060] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.399544 27975 consensus_queue.cc:260] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.400760 27975 raft_consensus.cc:3060] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.406776 27900 raft_consensus.cc:2468] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e16b47f3b5534dfb8db1986ca8ab18c1 in term 2.
I20260709 13:22:42.407400 27975 raft_consensus.cc:2468] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e16b47f3b5534dfb8db1986ca8ab18c1 in term 2.
I20260709 13:22:42.408149 27791 leader_election.cc:304] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddc19f033b244a58a3d678ce35c591b, e16b47f3b5534dfb8db1986ca8ab18c1; no voters: 
I20260709 13:22:42.409322 28022 raft_consensus.cc:2804] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:42.410739 28022 raft_consensus.cc:697] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 LEADER]: Becoming Leader. State: Replica: e16b47f3b5534dfb8db1986ca8ab18c1, State: Running, Role: LEADER
I20260709 13:22:42.411626 28022 consensus_queue.cc:237] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.418735 27723 catalog_manager.cc:5697] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 reported cstate change: term changed from 1 to 2, leader changed from 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3) to e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:42.594048 28020 consensus_queue.cc:1048] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:42.605062 28062 consensus_queue.cc:1048] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:42.613090 28045 raft_consensus.cc:993] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b: : Instructing follower e16b47f3b5534dfb8db1986ca8ab18c1 to start an election
I20260709 13:22:42.613559 28062 raft_consensus.cc:1081] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 1 LEADER]: Signalling peer e16b47f3b5534dfb8db1986ca8ab18c1 to start an election
I20260709 13:22:42.615233 27825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b"
dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
 from {username='slave'} at 127.0.0.1:43836
I20260709 13:22:42.615731 27825 raft_consensus.cc:493] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:42.616050 27825 raft_consensus.cc:3060] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.621280 27825 raft_consensus.cc:515] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.622915 27825 leader_election.cc:290] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [CANDIDATE]: Term 2 election: Requested vote from peers 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2:42179), 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3:38035)
I20260709 13:22:42.624107 27975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b" candidate_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f05b0d2890e4716be238dcc14c0d611"
I20260709 13:22:42.624209 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b" candidate_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddc19f033b244a58a3d678ce35c591b"
I20260709 13:22:42.625021 27975 raft_consensus.cc:3060] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.625102 27900 raft_consensus.cc:3055] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:42.625537 27900 raft_consensus.cc:740] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ddc19f033b244a58a3d678ce35c591b, State: Running, Role: LEADER
I20260709 13:22:42.626370 27900 consensus_queue.cc:260] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.627664 27900 raft_consensus.cc:3060] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.632627 27975 raft_consensus.cc:2468] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e16b47f3b5534dfb8db1986ca8ab18c1 in term 2.
I20260709 13:22:42.633829 27789 leader_election.cc:304] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f05b0d2890e4716be238dcc14c0d611, e16b47f3b5534dfb8db1986ca8ab18c1; no voters: 
I20260709 13:22:42.634624 28022 raft_consensus.cc:2804] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:42.634773 27900 raft_consensus.cc:2468] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e16b47f3b5534dfb8db1986ca8ab18c1 in term 2.
I20260709 13:22:42.635084 28022 raft_consensus.cc:697] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 LEADER]: Becoming Leader. State: Replica: e16b47f3b5534dfb8db1986ca8ab18c1, State: Running, Role: LEADER
I20260709 13:22:42.635994 28022 consensus_queue.cc:237] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.642151 27723 catalog_manager.cc:5697] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 reported cstate change: term changed from 1 to 2, leader changed from 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2) to e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:42.725281 28062 consensus_queue.cc:1048] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:42.732635 28023 raft_consensus.cc:993] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611: : Instructing follower 0ddc19f033b244a58a3d678ce35c591b to start an election
I20260709 13:22:42.733166 28023 raft_consensus.cc:1081] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 1 LEADER]: Signalling peer 0ddc19f033b244a58a3d678ce35c591b to start an election
I20260709 13:22:42.737645 28045 consensus_queue.cc:1048] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:42.738022 27900 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "358ee27c797f43578b50c3c3f414c46c"
dest_uuid: "0ddc19f033b244a58a3d678ce35c591b"
 from {username='slave'} at 127.0.0.1:43064
I20260709 13:22:42.738696 27900 raft_consensus.cc:493] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:42.739053 27900 raft_consensus.cc:3060] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.746719 27900 raft_consensus.cc:515] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.747536 28020 raft_consensus.cc:993] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b: : Instructing follower e16b47f3b5534dfb8db1986ca8ab18c1 to start an election
I20260709 13:22:42.748106 28062 raft_consensus.cc:1081] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 1 LEADER]: Signalling peer e16b47f3b5534dfb8db1986ca8ab18c1 to start an election
I20260709 13:22:42.748689 27900 leader_election.cc:290] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [CANDIDATE]: Term 2 election: Requested vote from peers e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675), 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3:38035)
I20260709 13:22:42.750466 27826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "894ccae7cf1a470589ec5d98e2bbd5f4"
dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
 from {username='slave'} at 127.0.0.1:43836
I20260709 13:22:42.750285 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358ee27c797f43578b50c3c3f414c46c" candidate_uuid: "0ddc19f033b244a58a3d678ce35c591b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
I20260709 13:22:42.750285 27975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358ee27c797f43578b50c3c3f414c46c" candidate_uuid: "0ddc19f033b244a58a3d678ce35c591b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f05b0d2890e4716be238dcc14c0d611"
I20260709 13:22:42.751364 27825 raft_consensus.cc:3060] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.751246 27826 raft_consensus.cc:493] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:42.752070 27975 raft_consensus.cc:3055] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:42.752193 27826 raft_consensus.cc:3060] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.752430 27975 raft_consensus.cc:740] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f05b0d2890e4716be238dcc14c0d611, State: Running, Role: LEADER
I20260709 13:22:42.753324 27975 consensus_queue.cc:260] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.754330 27975 raft_consensus.cc:3060] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.759061 27825 raft_consensus.cc:2468] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddc19f033b244a58a3d678ce35c591b in term 2.
I20260709 13:22:42.759295 27975 raft_consensus.cc:2468] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddc19f033b244a58a3d678ce35c591b in term 2.
I20260709 13:22:42.759207 27826 raft_consensus.cc:515] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.760437 27864 leader_election.cc:304] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddc19f033b244a58a3d678ce35c591b, e16b47f3b5534dfb8db1986ca8ab18c1; no voters: 
I20260709 13:22:42.761492 27826 leader_election.cc:290] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [CANDIDATE]: Term 2 election: Requested vote from peers 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2:42179), 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3:38035)
I20260709 13:22:42.761986 28062 raft_consensus.cc:2804] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:42.762260 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894ccae7cf1a470589ec5d98e2bbd5f4" candidate_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddc19f033b244a58a3d678ce35c591b"
I20260709 13:22:42.762578 28062 raft_consensus.cc:697] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 2 LEADER]: Becoming Leader. State: Replica: 0ddc19f033b244a58a3d678ce35c591b, State: Running, Role: LEADER
I20260709 13:22:42.762840 27900 raft_consensus.cc:3055] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:42.763084 27900 raft_consensus.cc:740] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ddc19f033b244a58a3d678ce35c591b, State: Running, Role: LEADER
I20260709 13:22:42.763736 27900 consensus_queue.cc:260] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.763514 28062 consensus_queue.cc:237] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.764550 27900 raft_consensus.cc:3060] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.766578 27975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "894ccae7cf1a470589ec5d98e2bbd5f4" candidate_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f05b0d2890e4716be238dcc14c0d611"
I20260709 13:22:42.767266 27975 raft_consensus.cc:3060] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:42.771185 27900 raft_consensus.cc:2468] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e16b47f3b5534dfb8db1986ca8ab18c1 in term 2.
I20260709 13:22:42.772337 27791 leader_election.cc:304] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddc19f033b244a58a3d678ce35c591b, e16b47f3b5534dfb8db1986ca8ab18c1; no voters: 
I20260709 13:22:42.773197 28022 raft_consensus.cc:2804] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:42.773728 28022 raft_consensus.cc:697] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 LEADER]: Becoming Leader. State: Replica: e16b47f3b5534dfb8db1986ca8ab18c1, State: Running, Role: LEADER
I20260709 13:22:42.773526 27722 catalog_manager.cc:5697] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b reported cstate change: term changed from 1 to 2, leader changed from 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3) to 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2). New cstate: current_term: 2 leader_uuid: "0ddc19f033b244a58a3d678ce35c591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:42.774655 28022 consensus_queue.cc:237] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:42.775936 27975 raft_consensus.cc:2468] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e16b47f3b5534dfb8db1986ca8ab18c1 in term 2.
I20260709 13:22:42.782338 27723 catalog_manager.cc:5697] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 reported cstate change: term changed from 1 to 2, leader changed from 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2) to e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:42.812352 16192 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:22:42.814028 16192 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:22:42.814448 16192 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:22:42.825809 27826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b"
dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
mode: GRACEFUL
new_leader_uuid: "6f05b0d2890e4716be238dcc14c0d611"
 from {username='slave'} at 127.0.0.1:53744
I20260709 13:22:42.826356 27826 raft_consensus.cc:606] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 LEADER]: Received request to transfer leadership to TS 6f05b0d2890e4716be238dcc14c0d611
I20260709 13:22:42.827427 16192 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:22:42.890889 27975 raft_consensus.cc:1275] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Refusing update from remote peer e16b47f3b5534dfb8db1986ca8ab18c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:42.892361 28022 consensus_queue.cc:1048] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:42.901041 27900 raft_consensus.cc:1275] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Refusing update from remote peer e16b47f3b5534dfb8db1986ca8ab18c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:42.902595 28022 consensus_queue.cc:1048] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:43.099982 27975 raft_consensus.cc:1275] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Refusing update from remote peer e16b47f3b5534dfb8db1986ca8ab18c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:43.101372 28022 consensus_queue.cc:1048] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:43.106215 28060 raft_consensus.cc:993] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1: : Instructing follower 6f05b0d2890e4716be238dcc14c0d611 to start an election
I20260709 13:22:43.107030 28022 raft_consensus.cc:1081] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 LEADER]: Signalling peer 6f05b0d2890e4716be238dcc14c0d611 to start an election
I20260709 13:22:43.110847 27975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b"
dest_uuid: "6f05b0d2890e4716be238dcc14c0d611"
 from {username='slave'} at 127.0.0.1:33422
I20260709 13:22:43.111433 27975 raft_consensus.cc:493] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:43.111830 27975 raft_consensus.cc:3060] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:43.116820 27975 raft_consensus.cc:515] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:43.119400 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b" candidate_uuid: "6f05b0d2890e4716be238dcc14c0d611" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1"
I20260709 13:22:43.119798 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081b6012e9794e00ae4a2ff549fff74b" candidate_uuid: "6f05b0d2890e4716be238dcc14c0d611" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ddc19f033b244a58a3d678ce35c591b"
I20260709 13:22:43.120265 27975 leader_election.cc:290] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [CANDIDATE]: Term 3 election: Requested vote from peers e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1:40675), 0ddc19f033b244a58a3d678ce35c591b (127.15.208.2:42179)
I20260709 13:22:43.120421 27900 raft_consensus.cc:3060] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:43.121811 27826 raft_consensus.cc:3055] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:43.122223 27826 raft_consensus.cc:740] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e16b47f3b5534dfb8db1986ca8ab18c1, State: Running, Role: LEADER
I20260709 13:22:43.123014 27826 consensus_queue.cc:260] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:43.123845 27826 raft_consensus.cc:3060] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:43.126158 27900 raft_consensus.cc:2468] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f05b0d2890e4716be238dcc14c0d611 in term 3.
I20260709 13:22:43.126881 27901 raft_consensus.cc:1240] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 3 FOLLOWER]: Rejecting Update request from peer e16b47f3b5534dfb8db1986ca8ab18c1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:22:43.127605 27940 leader_election.cc:304] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddc19f033b244a58a3d678ce35c591b, 6f05b0d2890e4716be238dcc14c0d611; no voters: 
I20260709 13:22:43.128577 28023 raft_consensus.cc:2804] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:43.129146 28023 raft_consensus.cc:697] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 3 LEADER]: Becoming Leader. State: Replica: 6f05b0d2890e4716be238dcc14c0d611, State: Running, Role: LEADER
I20260709 13:22:43.129541 27826 raft_consensus.cc:2468] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f05b0d2890e4716be238dcc14c0d611 in term 3.
I20260709 13:22:43.129995 28023 consensus_queue.cc:237] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } }
I20260709 13:22:43.137787 27723 catalog_manager.cc:5697] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 reported cstate change: term changed from 2 to 3, leader changed from e16b47f3b5534dfb8db1986ca8ab18c1 (127.15.208.1) to 6f05b0d2890e4716be238dcc14c0d611 (127.15.208.3). New cstate: current_term: 3 leader_uuid: "6f05b0d2890e4716be238dcc14c0d611" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16b47f3b5534dfb8db1986ca8ab18c1" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddc19f033b244a58a3d678ce35c591b" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:43.175462 16192 tablet_server.cc:179] TabletServer@127.15.208.1:0 shutting down...
I20260709 13:22:43.199388 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:43.200080 16192 tablet_replica.cc:333] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1: stopping tablet replica
I20260709 13:22:43.200701 16192 raft_consensus.cc:2243] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:43.200807 27901 raft_consensus.cc:1275] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Refusing update from remote peer e16b47f3b5534dfb8db1986ca8ab18c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:43.201431 16192 pending_rounds.cc:70] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1: Trying to abort 1 pending ops.
I20260709 13:22:43.201668 16192 pending_rounds.cc:77] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639373935661056 op_type: NO_OP noop_request { }
I20260709 13:22:43.202004 16192 raft_consensus.cc:2889] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:43.202399 16192 raft_consensus.cc:2272] T 894ccae7cf1a470589ec5d98e2bbd5f4 P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.205188 16192 tablet_replica.cc:333] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1: stopping tablet replica
I20260709 13:22:43.205811 16192 raft_consensus.cc:2243] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:43.206255 16192 raft_consensus.cc:2272] T 081b6012e9794e00ae4a2ff549fff74b P e16b47f3b5534dfb8db1986ca8ab18c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.208431 16192 tablet_replica.cc:333] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1: stopping tablet replica
I20260709 13:22:43.209018 16192 raft_consensus.cc:2243] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:43.209861 16192 raft_consensus.cc:2272] T a685ad84cb934c59b6d621ef43e9ec7a P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.212069 16192 tablet_replica.cc:333] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1: stopping tablet replica
I20260709 13:22:43.212570 16192 raft_consensus.cc:2243] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:43.213030 16192 raft_consensus.cc:2272] T 358ee27c797f43578b50c3c3f414c46c P e16b47f3b5534dfb8db1986ca8ab18c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.237043 16192 tablet_server.cc:196] TabletServer@127.15.208.1:0 shutdown complete.
I20260709 13:22:43.249683 16192 tablet_server.cc:179] TabletServer@127.15.208.2:0 shutting down...
I20260709 13:22:43.269853 27975 raft_consensus.cc:1275] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Refusing update from remote peer 0ddc19f033b244a58a3d678ce35c591b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:43.270625 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:43.271456 16192 tablet_replica.cc:333] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b: stopping tablet replica
I20260709 13:22:43.271641 28062 consensus_queue.cc:1048] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f05b0d2890e4716be238dcc14c0d611" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 38035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:43.272177 16192 raft_consensus.cc:2243] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:43.272893 16192 raft_consensus.cc:2272] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.275569 16192 tablet_replica.cc:333] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b: stopping tablet replica
I20260709 13:22:43.276383 16192 raft_consensus.cc:2243] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:43.277251 16192 pending_rounds.cc:70] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b: Trying to abort 1 pending ops.
I20260709 13:22:43.277515 16192 pending_rounds.cc:77] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639373892030464 op_type: NO_OP noop_request { }
I20260709 13:22:43.277880 16192 raft_consensus.cc:2889] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:43.278250 16192 raft_consensus.cc:2272] T 358ee27c797f43578b50c3c3f414c46c P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.282968 16192 tablet_replica.cc:333] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b: stopping tablet replica
I20260709 13:22:43.283517 16192 raft_consensus.cc:2243] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:43.283934 16192 raft_consensus.cc:2272] T 081b6012e9794e00ae4a2ff549fff74b P 0ddc19f033b244a58a3d678ce35c591b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.285995 16192 tablet_replica.cc:333] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b: stopping tablet replica
I20260709 13:22:43.286504 16192 raft_consensus.cc:2243] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:43.286916 16192 raft_consensus.cc:2272] T a685ad84cb934c59b6d621ef43e9ec7a P 0ddc19f033b244a58a3d678ce35c591b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.309424 16192 tablet_server.cc:196] TabletServer@127.15.208.2:0 shutdown complete.
I20260709 13:22:43.322132 16192 tablet_server.cc:179] TabletServer@127.15.208.3:0 shutting down...
I20260709 13:22:43.341037 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:43.341724 16192 tablet_replica.cc:333] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611: stopping tablet replica
I20260709 13:22:43.342351 16192 raft_consensus.cc:2243] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:43.342891 16192 raft_consensus.cc:2272] T 894ccae7cf1a470589ec5d98e2bbd5f4 P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.345749 16192 tablet_replica.cc:333] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611: stopping tablet replica
I20260709 13:22:43.346314 16192 raft_consensus.cc:2243] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:43.346966 16192 pending_rounds.cc:70] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611: Trying to abort 1 pending ops.
I20260709 13:22:43.347146 16192 pending_rounds.cc:77] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639375389147136 op_type: NO_OP noop_request { }
I20260709 13:22:43.347429 16192 raft_consensus.cc:2889] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:43.347697 16192 raft_consensus.cc:2272] T 081b6012e9794e00ae4a2ff549fff74b P 6f05b0d2890e4716be238dcc14c0d611 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.350078 16192 tablet_replica.cc:333] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611: stopping tablet replica
I20260709 13:22:43.350593 16192 raft_consensus.cc:2243] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:43.351037 16192 raft_consensus.cc:2272] T a685ad84cb934c59b6d621ef43e9ec7a P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.353289 16192 tablet_replica.cc:333] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611: stopping tablet replica
I20260709 13:22:43.353776 16192 raft_consensus.cc:2243] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:43.354146 16192 pending_rounds.cc:70] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611: Trying to abort 1 pending ops.
I20260709 13:22:43.354310 16192 pending_rounds.cc:77] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639373892030464 op_type: NO_OP noop_request { }
I20260709 13:22:43.354610 16192 raft_consensus.cc:2889] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:43.354916 16192 raft_consensus.cc:2272] T 358ee27c797f43578b50c3c3f414c46c P 6f05b0d2890e4716be238dcc14c0d611 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.378232 16192 tablet_server.cc:196] TabletServer@127.15.208.3:0 shutdown complete.
I20260709 13:22:43.391229 16192 master.cc:562] Master@127.15.208.62:36185 shutting down...
I20260709 13:22:43.407110 16192 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:43.407678 16192 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:43.408025 16192 tablet_replica.cc:333] T 00000000000000000000000000000000 P d5fd6d17de33497abe21b6295d7517ef: stopping tablet replica
I20260709 13:22:43.426628 16192 master.cc:584] Master@127.15.208.62:36185 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2501 ms)
[----------] 6 tests from LeaderRebalancerTest (358335 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:22:43.454326 16192 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.208.62:34997
I20260709 13:22:43.455575 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:43.461056 28070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:43.461529 28071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:43.462471 28073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:43.463558 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:43.464398 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:43.464608 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:43.464749 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603363464737 us; error 0 us; skew 500 ppm
I20260709 13:22:43.465355 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:43.467934 16192 webserver.cc:533] Webserver started at http://127.15.208.62:43031/ using document root <none> and password file <none>
I20260709 13:22:43.468422 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:43.468595 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:43.468816 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:43.470090 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/master-0-root/instance:
uuid: "45c76608aa374f9795b9ae0776efabe3"
format_stamp: "Formatted at 2026-07-09 13:22:43 on dist-test-slave-w3b1"
I20260709 13:22:43.474910 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:43.478368 28078 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:43.479225 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:43.479547 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/master-0-root
uuid: "45c76608aa374f9795b9ae0776efabe3"
format_stamp: "Formatted at 2026-07-09 13:22:43 on dist-test-slave-w3b1"
I20260709 13:22:43.479857 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:43.529481 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:43.530551 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:43.566452 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.62:34997
I20260709 13:22:43.566609 28129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.62:34997 every 8 connection(s)
I20260709 13:22:43.570683 28130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:43.582998 28130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3: Bootstrap starting.
I20260709 13:22:43.587822 28130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:43.592267 28130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3: No bootstrap required, opened a new log
I20260709 13:22:43.594669 28130 raft_consensus.cc:359] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45c76608aa374f9795b9ae0776efabe3" member_type: VOTER }
I20260709 13:22:43.595088 28130 raft_consensus.cc:385] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:43.595404 28130 raft_consensus.cc:740] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45c76608aa374f9795b9ae0776efabe3, State: Initialized, Role: FOLLOWER
I20260709 13:22:43.596040 28130 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45c76608aa374f9795b9ae0776efabe3" member_type: VOTER }
I20260709 13:22:43.596534 28130 raft_consensus.cc:399] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:43.596791 28130 raft_consensus.cc:493] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:43.597111 28130 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:43.602308 28130 raft_consensus.cc:515] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45c76608aa374f9795b9ae0776efabe3" member_type: VOTER }
I20260709 13:22:43.602905 28130 leader_election.cc:304] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45c76608aa374f9795b9ae0776efabe3; no voters: 
I20260709 13:22:43.604112 28130 leader_election.cc:290] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:43.604550 28133 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:43.605984 28133 raft_consensus.cc:697] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 1 LEADER]: Becoming Leader. State: Replica: 45c76608aa374f9795b9ae0776efabe3, State: Running, Role: LEADER
I20260709 13:22:43.606580 28133 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45c76608aa374f9795b9ae0776efabe3" member_type: VOTER }
I20260709 13:22:43.607234 28130 sys_catalog.cc:565] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:43.609678 28134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45c76608aa374f9795b9ae0776efabe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45c76608aa374f9795b9ae0776efabe3" member_type: VOTER } }
I20260709 13:22:43.610579 28134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:43.609728 28135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45c76608aa374f9795b9ae0776efabe3. Latest consensus state: current_term: 1 leader_uuid: "45c76608aa374f9795b9ae0776efabe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45c76608aa374f9795b9ae0776efabe3" member_type: VOTER } }
I20260709 13:22:43.611353 28135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:43.613282 28140 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:43.617964 28140 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:43.624423 16192 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:43.627225 28140 catalog_manager.cc:1383] Generated new cluster ID: 683080286f034d1b8ff02f944a0e1a85
I20260709 13:22:43.627465 28140 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:43.642220 28140 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:43.643620 28140 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:43.660246 28140 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3: Generated new TSK 0
I20260709 13:22:43.660828 28140 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:43.691763 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:43.698182 28151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:43.698998 28152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:43.700568 28154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:43.701558 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:43.702611 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:43.702804 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:43.702929 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603363702919 us; error 0 us; skew 500 ppm
I20260709 13:22:43.703387 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:43.705722 16192 webserver.cc:533] Webserver started at http://127.15.208.1:41503/ using document root <none> and password file <none>
I20260709 13:22:43.706164 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:43.706318 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:43.706532 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:43.707573 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-0-root/instance:
uuid: "670a4825d5ed45f697754318dffa6910"
format_stamp: "Formatted at 2026-07-09 13:22:43 on dist-test-slave-w3b1"
I20260709 13:22:43.712138 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:43.715569 28159 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:43.716328 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:43.716636 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-0-root
uuid: "670a4825d5ed45f697754318dffa6910"
format_stamp: "Formatted at 2026-07-09 13:22:43 on dist-test-slave-w3b1"
I20260709 13:22:43.716995 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:43.735867 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:43.737109 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:43.738499 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:43.740702 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:43.740957 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:43.741219 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:43.741384 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:43.779737 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.1:39447
I20260709 13:22:43.779842 28221 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.1:39447 every 8 connection(s)
I20260709 13:22:43.785025 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:43.792472 28226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:43.793531 28227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:43.796633 28229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:43.797834 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:43.797991 28222 heartbeater.cc:344] Connected to a master server at 127.15.208.62:34997
I20260709 13:22:43.798527 28222 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:43.798900 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:43.799207 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:43.799289 28222 heartbeater.cc:507] Master 127.15.208.62:34997 requested a full tablet report, sending...
I20260709 13:22:43.799386 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603363799351 us; error 0 us; skew 500 ppm
I20260709 13:22:43.800175 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:43.801733 28095 ts_manager.cc:194] Registered new tserver with Master: 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447)
I20260709 13:22:43.802765 16192 webserver.cc:533] Webserver started at http://127.15.208.2:40439/ using document root <none> and password file <none>
I20260709 13:22:43.803319 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:43.803530 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:43.803803 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:43.803790 28095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37720
I20260709 13:22:43.805224 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-1-root/instance:
uuid: "48bda4cab7c541bf808d72bf4d8cb906"
format_stamp: "Formatted at 2026-07-09 13:22:43 on dist-test-slave-w3b1"
I20260709 13:22:43.809918 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:43.813544 28234 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:43.814548 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:22:43.814903 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-1-root
uuid: "48bda4cab7c541bf808d72bf4d8cb906"
format_stamp: "Formatted at 2026-07-09 13:22:43 on dist-test-slave-w3b1"
I20260709 13:22:43.815308 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:43.827401 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:43.828615 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:43.830361 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:43.832929 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:43.833214 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:43.833498 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:43.833724 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:43.875201 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.2:35003
I20260709 13:22:43.875300 28296 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.2:35003 every 8 connection(s)
I20260709 13:22:43.880810 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:43.889392 28300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:43.889739 28301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:43.893419 28297 heartbeater.cc:344] Connected to a master server at 127.15.208.62:34997
I20260709 13:22:43.893985 28297 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:43.894047 16192 server_base.cc:1061] running on GCE node
W20260709 13:22:43.894857 28303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:43.895166 28297 heartbeater.cc:507] Master 127.15.208.62:34997 requested a full tablet report, sending...
I20260709 13:22:43.895898 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:43.896243 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:43.896493 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603363896476 us; error 0 us; skew 500 ppm
I20260709 13:22:43.897176 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:43.897648 28095 ts_manager.cc:194] Registered new tserver with Master: 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:43.899390 28095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37730
I20260709 13:22:43.899855 16192 webserver.cc:533] Webserver started at http://127.15.208.3:41921/ using document root <none> and password file <none>
I20260709 13:22:43.900507 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:43.900779 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:43.901098 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:43.902232 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-2-root/instance:
uuid: "68e60eb98fc641b49ff635562d526ed8"
format_stamp: "Formatted at 2026-07-09 13:22:43 on dist-test-slave-w3b1"
I20260709 13:22:43.906638 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:22:43.909965 28308 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:43.910719 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:22:43.911033 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-2-root
uuid: "68e60eb98fc641b49ff635562d526ed8"
format_stamp: "Formatted at 2026-07-09 13:22:43 on dist-test-slave-w3b1"
I20260709 13:22:43.911332 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603004946521-16192-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:43.931134 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:43.932231 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:43.933781 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:43.935971 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:43.936208 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:43.936465 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:43.936646 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:43.976248 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.3:33095
I20260709 13:22:43.976361 28370 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.3:33095 every 8 connection(s)
I20260709 13:22:43.990823 28371 heartbeater.cc:344] Connected to a master server at 127.15.208.62:34997
I20260709 13:22:43.991348 28371 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:43.992122 28371 heartbeater.cc:507] Master 127.15.208.62:34997 requested a full tablet report, sending...
I20260709 13:22:43.994460 28095 ts_manager.cc:194] Registered new tserver with Master: 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:43.995054 16192 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015325377s
I20260709 13:22:43.995903 28095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37732
I20260709 13:22:44.022787 28095 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37744:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:44.025502 28095 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:44.097957 28261 tablet_service.cc:1511] Processing CreateTablet for tablet 275c778e0fa744829c0a18cda5b09484 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:44.099478 28261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275c778e0fa744829c0a18cda5b09484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.102032 28260 tablet_service.cc:1511] Processing CreateTablet for tablet a39cf4769b79418cba18d42cf5b48f36 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:44.103523 28260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39cf4769b79418cba18d42cf5b48f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.105890 28259 tablet_service.cc:1511] Processing CreateTablet for tablet 65ce1ade2c24457e8d95ecd97739fd25 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:44.107326 28259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ce1ade2c24457e8d95ecd97739fd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.109622 28258 tablet_service.cc:1511] Processing CreateTablet for tablet 8da56053dc834fdf8469e4c8a8e7c339 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:44.110226 28257 tablet_service.cc:1511] Processing CreateTablet for tablet db9437c1592a45089625cc516da0a6a7 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:44.131230 28336 tablet_service.cc:1511] Processing CreateTablet for tablet 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:44.131322 28332 tablet_service.cc:1511] Processing CreateTablet for tablet 8da56053dc834fdf8469e4c8a8e7c339 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:44.111056 28258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da56053dc834fdf8469e4c8a8e7c339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.111385 28262 tablet_service.cc:1511] Processing CreateTablet for tablet 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:44.132925 28336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.133417 28331 tablet_service.cc:1511] Processing CreateTablet for tablet db9437c1592a45089625cc516da0a6a7 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:44.124527 28181 tablet_service.cc:1511] Processing CreateTablet for tablet 8c82376d5a634b038bcf6ad535a9338b (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:44.134743 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9437c1592a45089625cc516da0a6a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.134892 28181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c82376d5a634b038bcf6ad535a9338b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.111889 28256 tablet_service.cc:1511] Processing CreateTablet for tablet 8c82376d5a634b038bcf6ad535a9338b (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:44.113679 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:44.115361 28186 tablet_service.cc:1511] Processing CreateTablet for tablet 275c778e0fa744829c0a18cda5b09484 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:44.117928 28183 tablet_service.cc:1511] Processing CreateTablet for tablet 8da56053dc834fdf8469e4c8a8e7c339 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:44.137197 28330 tablet_service.cc:1511] Processing CreateTablet for tablet 8c82376d5a634b038bcf6ad535a9338b (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:44.119629 28255 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1760addd724c0f9fb552ee36ed6254 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:44.121347 28184 tablet_service.cc:1511] Processing CreateTablet for tablet 65ce1ade2c24457e8d95ecd97739fd25 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:44.138918 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c82376d5a634b038bcf6ad535a9338b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.122954 28182 tablet_service.cc:1511] Processing CreateTablet for tablet db9437c1592a45089625cc516da0a6a7 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:44.125878 28180 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1760addd724c0f9fb552ee36ed6254 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:44.127497 28179 tablet_service.cc:1511] Processing CreateTablet for tablet 261e51960d29420590eeeddef0a37f6c (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:44.127985 28334 tablet_service.cc:1511] Processing CreateTablet for tablet a39cf4769b79418cba18d42cf5b48f36 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:44.141456 28329 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1760addd724c0f9fb552ee36ed6254 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:44.142349 28334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39cf4769b79418cba18d42cf5b48f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.129115 28254 tablet_service.cc:1511] Processing CreateTablet for tablet 261e51960d29420590eeeddef0a37f6c (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:44.143280 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1760addd724c0f9fb552ee36ed6254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.129717 28333 tablet_service.cc:1511] Processing CreateTablet for tablet 65ce1ade2c24457e8d95ecd97739fd25 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:44.129889 28185 tablet_service.cc:1511] Processing CreateTablet for tablet a39cf4769b79418cba18d42cf5b48f36 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:44.129925 28335 tablet_service.cc:1511] Processing CreateTablet for tablet 275c778e0fa744829c0a18cda5b09484 (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:44.146432 28335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275c778e0fa744829c0a18cda5b09484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.146047 28328 tablet_service.cc:1511] Processing CreateTablet for tablet 261e51960d29420590eeeddef0a37f6c (DEFAULT_TABLE table=test-workload [id=ad4e86a3b9d9458e8409a977218d205f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:44.147873 28328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261e51960d29420590eeeddef0a37f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.150161 28333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ce1ade2c24457e8d95ecd97739fd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.152645 28332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da56053dc834fdf8469e4c8a8e7c339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.153641 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.133843 28262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.159026 28255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1760addd724c0f9fb552ee36ed6254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.163757 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 275c778e0fa744829c0a18cda5b09484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.165303 28180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1760addd724c0f9fb552ee36ed6254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.166744 28183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da56053dc834fdf8469e4c8a8e7c339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.168202 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ce1ade2c24457e8d95ecd97739fd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.169291 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39cf4769b79418cba18d42cf5b48f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.170715 28182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9437c1592a45089625cc516da0a6a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.172170 28179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261e51960d29420590eeeddef0a37f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.160637 28254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261e51960d29420590eeeddef0a37f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.177263 28256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c82376d5a634b038bcf6ad535a9338b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.181222 28257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9437c1592a45089625cc516da0a6a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:44.272114 28387 tablet_bootstrap.cc:492] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:44.319123 28386 tablet_bootstrap.cc:492] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:44.319474 28387 tablet_bootstrap.cc:654] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.401968 28389 tablet_bootstrap.cc:492] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:44.407907 28389 tablet_bootstrap.cc:654] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.414511 28387 tablet_bootstrap.cc:492] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:44.415036 28387 ts_tablet_manager.cc:1403] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.143s	user 0.037s	sys 0.047s
I20260709 13:22:44.427803 28386 tablet_bootstrap.cc:654] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.431980 28387 raft_consensus.cc:359] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.441869 28387 raft_consensus.cc:385] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.442350 28387 raft_consensus.cc:740] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.443414 28387 consensus_queue.cc:260] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.446285 28371 heartbeater.cc:499] Master 127.15.208.62:34997 was elected leader, sending a full tablet report...
I20260709 13:22:44.446666 28387 ts_tablet_manager.cc:1434] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.001s
I20260709 13:22:44.447780 28387 tablet_bootstrap.cc:492] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:44.451354 28386 tablet_bootstrap.cc:492] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:44.452059 28386 ts_tablet_manager.cc:1403] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.133s	user 0.009s	sys 0.005s
I20260709 13:22:44.453938 28387 tablet_bootstrap.cc:654] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.455168 28389 tablet_bootstrap.cc:492] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:44.455824 28389 ts_tablet_manager.cc:1403] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.054s	user 0.028s	sys 0.015s
I20260709 13:22:44.455278 28386 raft_consensus.cc:359] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.456341 28386 raft_consensus.cc:385] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.456720 28386 raft_consensus.cc:740] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.457703 28386 consensus_queue.cc:260] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.458716 28389 raft_consensus.cc:359] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.459669 28389 raft_consensus.cc:385] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.460031 28389 raft_consensus.cc:740] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.461277 28389 consensus_queue.cc:260] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.468168 28386 ts_tablet_manager.cc:1434] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:22:44.469515 28297 heartbeater.cc:499] Master 127.15.208.62:34997 was elected leader, sending a full tablet report...
I20260709 13:22:44.477566 28386 tablet_bootstrap.cc:492] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:44.483632 28389 ts_tablet_manager.cc:1434] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.021s
I20260709 13:22:44.484439 28222 heartbeater.cc:499] Master 127.15.208.62:34997 was elected leader, sending a full tablet report...
I20260709 13:22:44.485006 28389 tablet_bootstrap.cc:492] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:44.491365 28389 tablet_bootstrap.cc:654] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.491503 28386 tablet_bootstrap.cc:654] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.501010 28386 tablet_bootstrap.cc:492] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:44.501890 28386 ts_tablet_manager.cc:1403] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.005s
I20260709 13:22:44.506567 28387 tablet_bootstrap.cc:492] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:44.507200 28387 ts_tablet_manager.cc:1403] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.035s
I20260709 13:22:44.507570 28386 raft_consensus.cc:359] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.508771 28386 raft_consensus.cc:385] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.509302 28386 raft_consensus.cc:740] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.510412 28387 raft_consensus.cc:359] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.511229 28387 raft_consensus.cc:385] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.511505 28387 raft_consensus.cc:740] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.512444 28389 tablet_bootstrap.cc:492] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:44.512919 28386 consensus_queue.cc:260] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.513767 28389 ts_tablet_manager.cc:1403] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.016s
I20260709 13:22:44.512442 28387 consensus_queue.cc:260] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.520310 28394 raft_consensus.cc:493] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:44.520901 28394 raft_consensus.cc:515] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.521905 28387 ts_tablet_manager.cc:1434] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.007s
I20260709 13:22:44.523298 28387 tablet_bootstrap.cc:492] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:44.530498 28389 raft_consensus.cc:359] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.531667 28389 raft_consensus.cc:385] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.532060 28389 raft_consensus.cc:740] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.527014 28394 leader_election.cc:290] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.533282 28389 consensus_queue.cc:260] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.536099 28389 ts_tablet_manager.cc:1434] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:22:44.537557 28389 tablet_bootstrap.cc:492] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:44.546321 28387 tablet_bootstrap.cc:654] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.548831 28386 ts_tablet_manager.cc:1434] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.046s	user 0.016s	sys 0.018s
I20260709 13:22:44.551841 28389 tablet_bootstrap.cc:654] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.552421 28386 tablet_bootstrap.cc:492] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:44.562489 28386 tablet_bootstrap.cc:654] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.574040 28387 tablet_bootstrap.cc:492] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:44.574744 28387 ts_tablet_manager.cc:1403] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.007s
I20260709 13:22:44.578003 28387 raft_consensus.cc:359] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.578915 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39cf4769b79418cba18d42cf5b48f36" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:44.579802 28346 raft_consensus.cc:2468] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:44.578966 28387 raft_consensus.cc:385] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.580773 28387 raft_consensus.cc:740] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.581549 28238 leader_election.cc:304] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:44.582032 28387 consensus_queue.cc:260] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.582681 28398 raft_consensus.cc:2804] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:44.582942 28386 tablet_bootstrap.cc:492] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:44.583192 28398 raft_consensus.cc:493] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:44.583632 28398 raft_consensus.cc:3060] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.583741 28386 ts_tablet_manager.cc:1403] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.007s
I20260709 13:22:44.585651 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39cf4769b79418cba18d42cf5b48f36" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
W20260709 13:22:44.587430 28235 leader_election.cc:343] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:44.587467 28386 raft_consensus.cc:359] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.588575 28386 raft_consensus.cc:385] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.588977 28386 raft_consensus.cc:740] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.590008 28386 consensus_queue.cc:260] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.591480 28387 ts_tablet_manager.cc:1434] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.006s
I20260709 13:22:44.592198 28398 raft_consensus.cc:515] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.592800 28389 tablet_bootstrap.cc:492] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:44.593513 28389 ts_tablet_manager.cc:1403] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.056s	user 0.025s	sys 0.015s
I20260709 13:22:44.595445 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39cf4769b79418cba18d42cf5b48f36" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
W20260709 13:22:44.597096 28235 leader_election.cc:343] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:44.596901 28389 raft_consensus.cc:359] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.597815 28389 raft_consensus.cc:385] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.598003 28395 raft_consensus.cc:493] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:44.598238 28389 raft_consensus.cc:740] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.598613 28395 raft_consensus.cc:515] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.599152 28386 ts_tablet_manager.cc:1434] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:22:44.599637 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39cf4769b79418cba18d42cf5b48f36" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:44.600307 28346 raft_consensus.cc:3060] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.600723 28386 tablet_bootstrap.cc:492] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:44.604033 28395 leader_election.cc:290] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.601469 28389 consensus_queue.cc:260] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.606254 28387 tablet_bootstrap.cc:492] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:44.607136 28389 ts_tablet_manager.cc:1434] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:22:44.608307 28389 tablet_bootstrap.cc:492] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:44.610046 28346 raft_consensus.cc:2468] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:44.613588 28238 leader_election.cc:304] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 670a4825d5ed45f697754318dffa6910
I20260709 13:22:44.614178 28387 tablet_bootstrap.cc:654] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.614750 28394 raft_consensus.cc:2804] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:44.614960 28389 tablet_bootstrap.cc:654] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:44.619117 28143 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:44.625216 28386 tablet_bootstrap.cc:654] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.610623 28398 leader_election.cc:290] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.633504 28398 raft_consensus.cc:493] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:44.634251 28398 raft_consensus.cc:515] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.662356 28398 leader_election.cc:290] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.658310 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:44.663605 28346 raft_consensus.cc:2468] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:44.665334 28386 tablet_bootstrap.cc:492] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:44.665225 28238 leader_election.cc:304] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:44.666074 28386 ts_tablet_manager.cc:1403] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.023s
I20260709 13:22:44.666635 28406 raft_consensus.cc:2804] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:44.667284 28406 raft_consensus.cc:493] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:44.667630 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:44.667781 28406 raft_consensus.cc:3060] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.668403 28197 raft_consensus.cc:2468] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:44.670004 28386 raft_consensus.cc:359] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.670993 28386 raft_consensus.cc:385] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.671402 28386 raft_consensus.cc:740] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.671758 28389 tablet_bootstrap.cc:492] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:44.670478 28394 raft_consensus.cc:697] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:44.672821 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c82376d5a634b038bcf6ad535a9338b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:44.672683 28389 ts_tablet_manager.cc:1403] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.008s
I20260709 13:22:44.656548 28409 raft_consensus.cc:493] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:44.673694 28394 consensus_queue.cc:237] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.675241 28409 raft_consensus.cc:515] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.672313 28386 consensus_queue.cc:260] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.677271 28272 raft_consensus.cc:2468] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 0.
I20260709 13:22:44.679157 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275c778e0fa744829c0a18cda5b09484" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:44.680431 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275c778e0fa744829c0a18cda5b09484" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:44.682168 28386 ts_tablet_manager.cc:1434] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
W20260709 13:22:44.682570 28238 leader_election.cc:343] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:44.683420 28386 tablet_bootstrap.cc:492] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:44.684352 28163 leader_election.cc:304] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
W20260709 13:22:44.685604 28235 leader_election.cc:343] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:44.686252 28395 raft_consensus.cc:2804] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:44.686908 28395 raft_consensus.cc:493] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:44.687296 28395 raft_consensus.cc:3060] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.687456 28389 raft_consensus.cc:359] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.688635 28389 raft_consensus.cc:385] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.689137 28389 raft_consensus.cc:740] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.693809 28389 consensus_queue.cc:260] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.696604 28386 tablet_bootstrap.cc:654] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.699218 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c82376d5a634b038bcf6ad535a9338b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
W20260709 13:22:44.701256 28163 leader_election.cc:343] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:44.697044 28235 leader_election.cc:304] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906; no voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:44.703008 28405 raft_consensus.cc:2749] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:44.704519 28409 leader_election.cc:290] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.709653 28389 ts_tablet_manager.cc:1434] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.007s
I20260709 13:22:44.710647 28395 raft_consensus.cc:515] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.715124 28386 tablet_bootstrap.cc:492] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:44.715477 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c82376d5a634b038bcf6ad535a9338b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:44.716998 28395 leader_election.cc:290] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.717402 28272 raft_consensus.cc:3060] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.718355 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c82376d5a634b038bcf6ad535a9338b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
W20260709 13:22:44.720413 28163 leader_election.cc:343] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:44.721444 28386 ts_tablet_manager.cc:1403] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.001s
I20260709 13:22:44.711020 28389 tablet_bootstrap.cc:492] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:44.715171 28387 tablet_bootstrap.cc:492] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:44.726104 28272 raft_consensus.cc:2468] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 1.
I20260709 13:22:44.726600 28387 ts_tablet_manager.cc:1403] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.121s	user 0.041s	sys 0.061s
I20260709 13:22:44.726104 28406 raft_consensus.cc:515] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.727604 28163 leader_election.cc:304] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:44.728950 28395 raft_consensus.cc:2804] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:44.730098 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:44.730451 28395 raft_consensus.cc:697] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:44.730811 28197 raft_consensus.cc:3060] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.731487 28395 consensus_queue.cc:237] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.730741 28095 catalog_manager.cc:5697] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:44.730144 28387 raft_consensus.cc:359] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.724927 28386 raft_consensus.cc:359] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.735181 28387 raft_consensus.cc:385] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.735448 28386 raft_consensus.cc:385] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.735698 28387 raft_consensus.cc:740] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.735918 28386 raft_consensus.cc:740] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.736581 28387 consensus_queue.cc:260] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.737243 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:44.737949 28346 raft_consensus.cc:3060] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.738940 28387 ts_tablet_manager.cc:1434] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:44.739107 28389 tablet_bootstrap.cc:654] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.740144 28387 tablet_bootstrap.cc:492] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:44.737246 28386 consensus_queue.cc:260] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.743196 28386 ts_tablet_manager.cc:1434] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:22:44.744166 28386 tablet_bootstrap.cc:492] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:44.746040 28346 raft_consensus.cc:2468] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:44.750880 28238 leader_election.cc:304] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:44.751255 28386 tablet_bootstrap.cc:654] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.737332 28406 leader_election.cc:290] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.753064 28394 raft_consensus.cc:2804] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:44.754186 28394 raft_consensus.cc:697] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:44.755405 28394 consensus_queue.cc:237] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.758023 28387 tablet_bootstrap.cc:654] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.767096 28197 raft_consensus.cc:2468] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:44.789028 28386 tablet_bootstrap.cc:492] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:44.789703 28386 ts_tablet_manager.cc:1403] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.046s	user 0.032s	sys 0.011s
I20260709 13:22:44.790194 28387 tablet_bootstrap.cc:492] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:44.791133 28387 ts_tablet_manager.cc:1403] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.051s	user 0.030s	sys 0.011s
I20260709 13:22:44.790333 28389 tablet_bootstrap.cc:492] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:44.792052 28389 ts_tablet_manager.cc:1403] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.081s	user 0.005s	sys 0.018s
I20260709 13:22:44.792666 28386 raft_consensus.cc:359] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.793514 28386 raft_consensus.cc:385] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.793821 28386 raft_consensus.cc:740] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.794636 28386 consensus_queue.cc:260] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.794503 28094 catalog_manager.cc:5697] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 0 to 1, leader changed from <none> to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:44.796221 28395 raft_consensus.cc:493] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:44.796898 28395 raft_consensus.cc:515] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.799196 28395 leader_election.cc:290] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.797292 28386 ts_tablet_manager.cc:1434] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:44.796026 28389 raft_consensus.cc:359] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.800273 28389 raft_consensus.cc:385] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.800318 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ce1ade2c24457e8d95ecd97739fd25" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:44.800745 28386 tablet_bootstrap.cc:492] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:44.801266 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ce1ade2c24457e8d95ecd97739fd25" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:44.801422 28387 raft_consensus.cc:359] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
W20260709 13:22:44.802716 28163 leader_election.cc:343] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:44.802121 28387 raft_consensus.cc:385] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:44.803476 28163 leader_election.cc:343] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:44.800688 28389 raft_consensus.cc:740] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.803980 28163 leader_election.cc:304] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670a4825d5ed45f697754318dffa6910; no voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:44.804773 28389 consensus_queue.cc:260] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.805202 28395 raft_consensus.cc:2749] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:44.803565 28387 raft_consensus.cc:740] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.806646 28387 consensus_queue.cc:260] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.807520 28389 ts_tablet_manager.cc:1434] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:22:44.808053 28386 tablet_bootstrap.cc:654] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.812240 28387 ts_tablet_manager.cc:1434] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:22:44.813916 28387 tablet_bootstrap.cc:492] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:44.820708 28387 tablet_bootstrap.cc:654] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.823781 28386 tablet_bootstrap.cc:492] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:44.824613 28386 ts_tablet_manager.cc:1403] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.007s
I20260709 13:22:44.823897 28093 catalog_manager.cc:5697] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:44.827837 28386 raft_consensus.cc:359] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.828598 28386 raft_consensus.cc:385] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.828984 28386 raft_consensus.cc:740] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.829965 28386 consensus_queue.cc:260] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.832141 28389 tablet_bootstrap.cc:492] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:44.832510 28386 ts_tablet_manager.cc:1434] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:22:44.833663 28386 tablet_bootstrap.cc:492] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:44.835937 28387 tablet_bootstrap.cc:492] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:44.836531 28387 ts_tablet_manager.cc:1403] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:22:44.839684 28387 raft_consensus.cc:359] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.840174 28386 tablet_bootstrap.cc:654] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.840174 28389 tablet_bootstrap.cc:654] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.840397 28387 raft_consensus.cc:385] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.841125 28387 raft_consensus.cc:740] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.842082 28387 consensus_queue.cc:260] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.844651 28387 ts_tablet_manager.cc:1434] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:22:44.845788 28387 tablet_bootstrap.cc:492] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:44.850883 28389 tablet_bootstrap.cc:492] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:44.851523 28389 ts_tablet_manager.cc:1403] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:22:44.853616 28387 tablet_bootstrap.cc:654] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.855154 28389 raft_consensus.cc:359] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.857409 28389 raft_consensus.cc:385] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.857776 28389 raft_consensus.cc:740] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.858705 28389 consensus_queue.cc:260] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.860664 28387 tablet_bootstrap.cc:492] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:44.860666 28386 tablet_bootstrap.cc:492] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:44.861366 28387 ts_tablet_manager.cc:1403] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 13:22:44.861490 28386 ts_tablet_manager.cc:1403] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.012s
I20260709 13:22:44.862282 28389 ts_tablet_manager.cc:1434] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:44.863386 28389 tablet_bootstrap.cc:492] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:44.864463 28386 raft_consensus.cc:359] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.865278 28386 raft_consensus.cc:385] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.864923 28387 raft_consensus.cc:359] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.865631 28386 raft_consensus.cc:740] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.865844 28387 raft_consensus.cc:385] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.866307 28387 raft_consensus.cc:740] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.866530 28386 consensus_queue.cc:260] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.867386 28387 consensus_queue.cc:260] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.870878 28389 tablet_bootstrap.cc:654] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.872339 28394 raft_consensus.cc:493] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:44.872902 28394 raft_consensus.cc:515] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.876711 28386 ts_tablet_manager.cc:1434] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:22:44.877096 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ce1ade2c24457e8d95ecd97739fd25" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:44.877785 28346 raft_consensus.cc:2468] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:44.878060 28386 tablet_bootstrap.cc:492] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:44.876715 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ce1ade2c24457e8d95ecd97739fd25" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:44.879189 28197 raft_consensus.cc:2468] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:44.880579 28238 leader_election.cc:304] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:44.881062 28387 ts_tablet_manager.cc:1434] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:22:44.881605 28406 raft_consensus.cc:2804] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:44.882079 28406 raft_consensus.cc:493] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:44.882403 28406 raft_consensus.cc:3060] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.884909 28386 tablet_bootstrap.cc:654] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.892254 28394 leader_election.cc:290] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.892289 28387 tablet_bootstrap.cc:492] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:44.894871 28389 tablet_bootstrap.cc:492] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:44.895390 28389 ts_tablet_manager.cc:1403] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.007s
I20260709 13:22:44.895881 28395 raft_consensus.cc:493] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:44.896404 28395 raft_consensus.cc:515] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.898595 28395 leader_election.cc:290] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.899946 28386 tablet_bootstrap.cc:492] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:44.900352 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261e51960d29420590eeeddef0a37f6c" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:44.900718 28386 ts_tablet_manager.cc:1403] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260709 13:22:44.900751 28389 raft_consensus.cc:359] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.901427 28387 tablet_bootstrap.cc:654] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.901163 28346 raft_consensus.cc:2468] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 0.
I20260709 13:22:44.901645 28389 raft_consensus.cc:385] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.902088 28389 raft_consensus.cc:740] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.902743 28163 leader_election.cc:304] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:44.902832 28389 consensus_queue.cc:260] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.903927 28395 raft_consensus.cc:2804] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:44.903795 28386 raft_consensus.cc:359] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.904368 28395 raft_consensus.cc:493] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:44.904533 28386 raft_consensus.cc:385] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.904804 28395 raft_consensus.cc:3060] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.904901 28386 raft_consensus.cc:740] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.905341 28389 ts_tablet_manager.cc:1434] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:22:44.905978 28386 consensus_queue.cc:260] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.899955 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261e51960d29420590eeeddef0a37f6c" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:44.907292 28272 raft_consensus.cc:2468] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 0.
I20260709 13:22:44.906428 28389 tablet_bootstrap.cc:492] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:44.898625 28406 raft_consensus.cc:515] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.914855 28395 raft_consensus.cc:515] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.915262 28386 ts_tablet_manager.cc:1434] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:22:44.917459 28395 leader_election.cc:290] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:44.914938 28389 tablet_bootstrap.cc:654] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.919883 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261e51960d29420590eeeddef0a37f6c" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:44.920473 28272 raft_consensus.cc:3060] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.922351 28387 tablet_bootstrap.cc:492] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:44.923033 28387 ts_tablet_manager.cc:1403] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.006s
I20260709 13:22:44.923620 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261e51960d29420590eeeddef0a37f6c" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:44.924271 28346 raft_consensus.cc:3060] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.925957 28387 raft_consensus.cc:359] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.926635 28387 raft_consensus.cc:385] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:44.926910 28387 raft_consensus.cc:740] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:44.927699 28387 consensus_queue.cc:260] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.934721 28387 ts_tablet_manager.cc:1434] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:22:44.936228 28387 tablet_bootstrap.cc:492] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:44.938253 28346 raft_consensus.cc:2468] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 1.
I20260709 13:22:44.939567 28163 leader_election.cc:304] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:44.940412 28395 raft_consensus.cc:2804] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:44.940943 28395 raft_consensus.cc:697] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:44.941102 28272 raft_consensus.cc:2468] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 1.
I20260709 13:22:44.941833 28395 consensus_queue.cc:237] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.944635 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ce1ade2c24457e8d95ecd97739fd25" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:44.944926 28387 tablet_bootstrap.cc:654] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:44.945313 28197 raft_consensus.cc:3060] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.946990 28392 raft_consensus.cc:493] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:44.947490 28392 raft_consensus.cc:515] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.951989 28392 leader_election.cc:290] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:44.964704 28197 raft_consensus.cc:2468] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:44.966553 28235 leader_election.cc:304] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:44.967743 28394 raft_consensus.cc:2804] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:44.968429 28394 raft_consensus.cc:697] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:44.970319 28394 consensus_queue.cc:237] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:44.984189 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ce1ade2c24457e8d95ecd97739fd25" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:44.985155 28345 raft_consensus.cc:3060] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:44.993005 28406 leader_election.cc:290] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:45.014456 28345 raft_consensus.cc:2468] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:45.015806 28094 catalog_manager.cc:5697] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.021965 28392 raft_consensus.cc:493] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:45.022675 28392 raft_consensus.cc:515] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.024947 28392 leader_election.cc:290] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:45.025944 28392 raft_consensus.cc:493] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:45.026408 28392 raft_consensus.cc:515] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.028450 28392 leader_election.cc:290] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:45.039728 28094 catalog_manager.cc:5697] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 0 to 1, leader changed from <none> to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.049369 28389 tablet_bootstrap.cc:492] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:45.049986 28389 ts_tablet_manager.cc:1403] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.144s	user 0.043s	sys 0.092s
I20260709 13:22:45.050762 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:45.052315 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9437c1592a45089625cc516da0a6a7" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:45.053208 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275c778e0fa744829c0a18cda5b09484" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:45.053691 28195 raft_consensus.cc:2468] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
W20260709 13:22:45.054909 28309 leader_election.cc:343] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:45.053231 28389 raft_consensus.cc:359] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.055584 28389 raft_consensus.cc:385] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:45.055745 28309 leader_election.cc:343] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:45.055886 28389 raft_consensus.cc:740] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.056538 28309 leader_election.cc:304] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.056890 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275c778e0fa744829c0a18cda5b09484" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:45.057277 28387 tablet_bootstrap.cc:492] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:45.057471 28392 raft_consensus.cc:2804] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:45.057597 28272 raft_consensus.cc:2468] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
I20260709 13:22:45.057368 28270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9437c1592a45089625cc516da0a6a7" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:45.058051 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:45.058172 28392 raft_consensus.cc:493] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:45.056864 28389 consensus_queue.cc:260] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.058878 28270 raft_consensus.cc:2468] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
I20260709 13:22:45.058931 28392 raft_consensus.cc:3060] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.058938 28271 raft_consensus.cc:2468] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
I20260709 13:22:45.058043 28387 ts_tablet_manager.cc:1403] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.122s	user 0.047s	sys 0.054s
I20260709 13:22:45.061432 28312 leader_election.cc:304] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 670a4825d5ed45f697754318dffa6910
I20260709 13:22:45.063195 28389 ts_tablet_manager.cc:1434] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:22:45.063395 28387 raft_consensus.cc:359] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.064253 28389 tablet_bootstrap.cc:492] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:45.064404 28387 raft_consensus.cc:385] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.064880 28387 raft_consensus.cc:740] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.065769 28387 consensus_queue.cc:260] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.070763 28389 tablet_bootstrap.cc:654] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:45.086107 28392 raft_consensus.cc:515] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.086213 28441 raft_consensus.cc:2804] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:45.087888 28441 raft_consensus.cc:493] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:45.088318 28441 raft_consensus.cc:3060] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.090756 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9437c1592a45089625cc516da0a6a7" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:45.091634 28195 raft_consensus.cc:3060] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.101675 28392 leader_election.cc:290] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:45.103089 28392 raft_consensus.cc:493] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:45.106838 28392 raft_consensus.cc:515] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.107055 28441 raft_consensus.cc:515] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.105983 28195 raft_consensus.cc:2468] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:45.112351 28387 ts_tablet_manager.cc:1434] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.052s	user 0.015s	sys 0.026s
I20260709 13:22:45.112866 28392 leader_election.cc:290] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:45.113175 28309 leader_election.cc:304] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.114141 28392 raft_consensus.cc:2804] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:45.114225 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c82376d5a634b038bcf6ad535a9338b" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:45.114701 28392 raft_consensus.cc:697] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:45.116267 28392 consensus_queue.cc:237] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.117625 28389 tablet_bootstrap.cc:492] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:45.117738 28394 consensus_queue.cc:1048] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.118175 28389 ts_tablet_manager.cc:1403] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.027s
W20260709 13:22:45.120414 28312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.2:35003, user_credentials={real_user=slave}} blocked reactor thread for 59218.2us
I20260709 13:22:45.121695 28389 raft_consensus.cc:359] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.121970 28312 leader_election.cc:304] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 670a4825d5ed45f697754318dffa6910
I20260709 13:22:45.122426 28389 raft_consensus.cc:385] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:45.122785 28389 raft_consensus.cc:740] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:45.122991 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c82376d5a634b038bcf6ad535a9338b" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:45.123189 28439 raft_consensus.cc:2804] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:45.123829 28271 raft_consensus.cc:2393] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68e60eb98fc641b49ff635562d526ed8 in current term 1: Already voted for candidate 670a4825d5ed45f697754318dffa6910 in this term.
I20260709 13:22:45.123541 28389 consensus_queue.cc:260] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.123894 28439 raft_consensus.cc:493] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:45.124598 28439 raft_consensus.cc:3060] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.124780 28441 leader_election.cc:290] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:45.125965 28389 ts_tablet_manager.cc:1434] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:45.122514 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9437c1592a45089625cc516da0a6a7" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:45.127662 28272 raft_consensus.cc:3060] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.133615 28312 leader_election.cc:304] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68e60eb98fc641b49ff635562d526ed8; no voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910
I20260709 13:22:45.133910 28395 raft_consensus.cc:493] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:45.134022 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:45.134783 28195 raft_consensus.cc:3060] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.134483 28395 raft_consensus.cc:515] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.134953 28441 raft_consensus.cc:3060] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.136866 28395 leader_election.cc:290] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:45.137228 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:45.137907 28271 raft_consensus.cc:3060] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.138669 28270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39cf4769b79418cba18d42cf5b48f36" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:45.143079 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39cf4769b79418cba18d42cf5b48f36" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:45.144577 28272 raft_consensus.cc:2468] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:45.144670 28163 leader_election.cc:304] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670a4825d5ed45f697754318dffa6910; no voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:45.144925 28441 raft_consensus.cc:2749] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:45.146164 28395 raft_consensus.cc:2749] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:45.146989 28195 raft_consensus.cc:2468] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:45.148064 28309 leader_election.cc:304] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.149408 28438 raft_consensus.cc:2804] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:45.150522 28439 raft_consensus.cc:515] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.153632 28271 raft_consensus.cc:2468] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:45.155180 28438 raft_consensus.cc:697] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:45.156212 28438 consensus_queue.cc:237] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.160919 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275c778e0fa744829c0a18cda5b09484" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:45.161646 28409 consensus_queue.cc:1048] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:45.162575 28195 raft_consensus.cc:3060] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.166966 28439 leader_election.cc:290] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:45.168792 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275c778e0fa744829c0a18cda5b09484" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:45.169822 28271 raft_consensus.cc:3060] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.170110 28094 catalog_manager.cc:5697] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:45.185209 28392 raft_consensus.cc:493] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:45.185809 28392 raft_consensus.cc:515] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.187928 28392 leader_election.cc:290] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:45.189608 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da56053dc834fdf8469e4c8a8e7c339" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:45.190412 28197 raft_consensus.cc:2468] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
I20260709 13:22:45.191780 28309 leader_election.cc:304] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.192687 28392 raft_consensus.cc:2804] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:45.193145 28392 raft_consensus.cc:493] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:45.193725 28271 raft_consensus.cc:2468] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:45.194739 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da56053dc834fdf8469e4c8a8e7c339" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:45.195506 28272 raft_consensus.cc:2468] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
I20260709 13:22:45.195820 28392 raft_consensus.cc:3060] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.199617 28196 raft_consensus.cc:3060] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.196285 28312 leader_election.cc:304] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.200778 28439 raft_consensus.cc:2804] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:45.201310 28439 raft_consensus.cc:697] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:45.194406 28195 raft_consensus.cc:2468] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:45.202147 28439 consensus_queue.cc:237] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.207546 28394 consensus_queue.cc:1048] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.210458 28395 consensus_queue.cc:1048] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.215778 28092 catalog_manager.cc:5697] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:45.217633 28405 consensus_queue.cc:1048] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.216823 28392 raft_consensus.cc:515] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.224799 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da56053dc834fdf8469e4c8a8e7c339" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:45.225164 28392 leader_election.cc:290] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:45.225611 28271 raft_consensus.cc:3060] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.234459 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da56053dc834fdf8469e4c8a8e7c339" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:45.235208 28196 raft_consensus.cc:3060] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:45.235994 28271 raft_consensus.cc:2468] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:45.237221 28312 leader_election.cc:304] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.238410 28392 raft_consensus.cc:2804] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:45.239115 28392 raft_consensus.cc:697] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:45.239993 28392 consensus_queue.cc:237] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.255584 28094 catalog_manager.cc:5697] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:45.269381 28196 raft_consensus.cc:2468] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:45.276942 28395 consensus_queue.cc:1048] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:45.291240 28094 catalog_manager.cc:5697] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:45.388526 28409 consensus_queue.cc:1048] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.396039 28409 consensus_queue.cc:1048] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.473728 28459 consensus_queue.cc:1048] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.486742 28459 consensus_queue.cc:1048] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.511235 28392 consensus_queue.cc:1048] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.527611 28439 consensus_queue.cc:1048] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.532909 28272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
mode: GRACEFUL
new_leader_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:60486
I20260709 13:22:45.533505 28272 raft_consensus.cc:606] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Received request to transfer leadership to TS 670a4825d5ed45f697754318dffa6910
I20260709 13:22:45.552232 28345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "275c778e0fa744829c0a18cda5b09484"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
mode: GRACEFUL
new_leader_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:55534
I20260709 13:22:45.552799 28345 raft_consensus.cc:606] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Received request to transfer leadership to TS 670a4825d5ed45f697754318dffa6910
I20260709 13:22:45.558425 28272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a39cf4769b79418cba18d42cf5b48f36"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
mode: GRACEFUL
new_leader_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:60486
I20260709 13:22:45.558949 28272 raft_consensus.cc:606] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Received request to transfer leadership to TS 670a4825d5ed45f697754318dffa6910
I20260709 13:22:45.563839 28272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65ce1ade2c24457e8d95ecd97739fd25"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
mode: GRACEFUL
new_leader_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:60486
I20260709 13:22:45.564361 28272 raft_consensus.cc:606] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Received request to transfer leadership to TS 670a4825d5ed45f697754318dffa6910
I20260709 13:22:45.569422 28345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8da56053dc834fdf8469e4c8a8e7c339"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
mode: GRACEFUL
new_leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:55534
I20260709 13:22:45.570020 28345 raft_consensus.cc:606] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Received request to transfer leadership to TS 48bda4cab7c541bf808d72bf4d8cb906
I20260709 13:22:45.574790 28345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db9437c1592a45089625cc516da0a6a7"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
mode: GRACEFUL
new_leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:55534
I20260709 13:22:45.575340 28345 raft_consensus.cc:606] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Received request to transfer leadership to TS 48bda4cab7c541bf808d72bf4d8cb906
I20260709 13:22:45.588999 28195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c82376d5a634b038bcf6ad535a9338b"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
mode: GRACEFUL
new_leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:22:45.589550 28195 raft_consensus.cc:606] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Received request to transfer leadership to TS 48bda4cab7c541bf808d72bf4d8cb906
I20260709 13:22:45.595453 28345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
mode: GRACEFUL
new_leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:55534
I20260709 13:22:45.595930 28345 raft_consensus.cc:606] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Received request to transfer leadership to TS 48bda4cab7c541bf808d72bf4d8cb906
I20260709 13:22:45.600975 28195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "261e51960d29420590eeeddef0a37f6c"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
mode: GRACEFUL
new_leader_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:22:45.601523 28195 raft_consensus.cc:606] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Received request to transfer leadership to TS 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:45.692067 28439 consensus_queue.cc:1048] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.703334 28439 consensus_queue.cc:1048] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:45.711730 28438 raft_consensus.cc:993] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8: : Instructing follower 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:45.712212 28439 raft_consensus.cc:1081] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Signalling peer 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:45.713794 28272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:22:45.714356 28272 raft_consensus.cc:493] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.714710 28272 raft_consensus.cc:3060] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.721009 28272 raft_consensus.cc:515] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.723240 28272 leader_election.cc:290] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:45.724049 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:45.724733 28195 raft_consensus.cc:3060] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.724687 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:45.725513 28345 raft_consensus.cc:3055] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.725845 28345 raft_consensus.cc:740] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:45.727108 28459 raft_consensus.cc:993] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910: : Instructing follower 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:45.726815 28345 consensus_queue.cc:260] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.727649 28459 raft_consensus.cc:1081] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Signalling peer 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:45.728175 28345 raft_consensus.cc:3060] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.730212 28271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c82376d5a634b038bcf6ad535a9338b"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:22:45.730803 28271 raft_consensus.cc:493] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.731178 28271 raft_consensus.cc:3060] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.732609 28195 raft_consensus.cc:2468] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:45.734300 28235 leader_election.cc:304] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:45.735145 28450 raft_consensus.cc:2804] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.735751 28345 raft_consensus.cc:2468] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:45.736656 28450 raft_consensus.cc:697] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:45.737793 28450 consensus_queue.cc:237] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.738664 28271 raft_consensus.cc:515] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.739868 28409 raft_consensus.cc:993] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906: : Instructing follower 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:45.740346 28409 raft_consensus.cc:1081] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Signalling peer 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:45.742364 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c82376d5a634b038bcf6ad535a9338b" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:45.742933 28271 leader_election.cc:290] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:45.743045 28345 raft_consensus.cc:3060] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.743440 28196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:45134
I20260709 13:22:45.744076 28196 raft_consensus.cc:493] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.744469 28196 raft_consensus.cc:3060] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.744379 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c82376d5a634b038bcf6ad535a9338b" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:45.745442 28195 raft_consensus.cc:3055] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.745813 28195 raft_consensus.cc:740] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:45.746748 28195 consensus_queue.cc:260] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.748104 28195 raft_consensus.cc:3060] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.748512 28094 catalog_manager.cc:5697] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 1 to 2, leader changed from 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3) to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.751642 28345 raft_consensus.cc:2468] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:45.753113 28238 leader_election.cc:304] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.753170 28196 raft_consensus.cc:515] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.754232 28450 raft_consensus.cc:2804] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.754758 28450 raft_consensus.cc:697] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:45.755393 28195 raft_consensus.cc:2468] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:45.755745 28450 consensus_queue.cc:237] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.756603 28196 leader_election.cc:290] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:45.757735 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:45.758342 28271 raft_consensus.cc:3055] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.758798 28271 raft_consensus.cc:740] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:45.759611 28271 consensus_queue.cc:260] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.758203 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:45.760954 28271 raft_consensus.cc:3060] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.761240 28345 raft_consensus.cc:3060] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.762008 28439 consensus_queue.cc:1048] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:45.767369 28094 catalog_manager.cc:5697] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 1 to 2, leader changed from 670a4825d5ed45f697754318dffa6910 (127.15.208.1) to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.779121 28345 raft_consensus.cc:2468] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:45.781229 28163 leader_election.cc:304] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.781257 28392 consensus_queue.cc:1048] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:45.782269 28464 raft_consensus.cc:2804] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.782804 28464 raft_consensus.cc:697] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:45.783761 28464 consensus_queue.cc:237] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.784262 28392 consensus_queue.cc:1048] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:45.789528 28271 raft_consensus.cc:2468] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:45.795543 28441 raft_consensus.cc:993] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8: : Instructing follower 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:45.796182 28441 raft_consensus.cc:1081] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Signalling peer 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:45.795660 28092 catalog_manager.cc:5697] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 1 to 2, leader changed from 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2) to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.803678 28271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8da56053dc834fdf8469e4c8a8e7c339"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:22:45.804348 28271 raft_consensus.cc:493] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.804786 28271 raft_consensus.cc:3060] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.804502 28444 consensus_queue.cc:1048] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:45.808396 28450 raft_consensus.cc:993] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906: : Instructing follower 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:45.808982 28406 raft_consensus.cc:1081] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Signalling peer 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:45.811020 28197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a39cf4769b79418cba18d42cf5b48f36"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:45134
I20260709 13:22:45.811637 28197 raft_consensus.cc:493] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.812045 28197 raft_consensus.cc:3060] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.814108 28271 raft_consensus.cc:515] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.817867 28392 raft_consensus.cc:993] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8: : Instructing follower 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:45.817929 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da56053dc834fdf8469e4c8a8e7c339" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:45.818277 28438 raft_consensus.cc:1081] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Signalling peer 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:45.818650 28345 raft_consensus.cc:3055] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.819015 28345 raft_consensus.cc:740] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:45.819373 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da56053dc834fdf8469e4c8a8e7c339" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:45.820015 28195 raft_consensus.cc:3060] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.819890 28345 consensus_queue.cc:260] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.821203 28345 raft_consensus.cc:3060] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.820312 28196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "275c778e0fa744829c0a18cda5b09484"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:45138
I20260709 13:22:45.825451 28196 raft_consensus.cc:493] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.823069 28197 raft_consensus.cc:515] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.829941 28196 raft_consensus.cc:3060] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.831508 28197 leader_election.cc:290] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:45.832243 28270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39cf4769b79418cba18d42cf5b48f36" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:45.833056 28270 raft_consensus.cc:3055] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.833370 28270 raft_consensus.cc:740] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:45.834393 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39cf4769b79418cba18d42cf5b48f36" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:45.834210 28270 consensus_queue.cc:260] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.827046 28195 raft_consensus.cc:2468] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:45.835001 28346 raft_consensus.cc:3060] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.835599 28270 raft_consensus.cc:3060] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.829159 28345 raft_consensus.cc:2468] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:45.829253 28271 leader_election.cc:290] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:45.837350 28235 leader_election.cc:304] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:45.838594 28406 raft_consensus.cc:2804] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.838826 28196 raft_consensus.cc:515] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.839033 28406 raft_consensus.cc:697] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:45.839988 28406 consensus_queue.cc:237] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.843371 28346 raft_consensus.cc:2468] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:45.843475 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275c778e0fa744829c0a18cda5b09484" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:45.844215 28345 raft_consensus.cc:3055] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.844587 28345 raft_consensus.cc:740] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:45.845539 28345 consensus_queue.cc:260] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.846093 28163 leader_election.cc:304] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.846798 28345 raft_consensus.cc:3060] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.847041 28464 raft_consensus.cc:2804] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.847621 28464 raft_consensus.cc:697] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:45.848424 28464 consensus_queue.cc:237] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.852751 28270 raft_consensus.cc:2468] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:45.853240 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "275c778e0fa744829c0a18cda5b09484" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:45.853797 28196 leader_election.cc:290] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:45.855736 28092 catalog_manager.cc:5697] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 1 to 2, leader changed from 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3) to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.853884 28271 raft_consensus.cc:3060] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.856632 28345 raft_consensus.cc:2468] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:45.857888 28163 leader_election.cc:304] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.859151 28094 catalog_manager.cc:5697] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 1 to 2, leader changed from 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2) to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.860203 28464 raft_consensus.cc:2804] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.860913 28464 raft_consensus.cc:697] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:45.861757 28464 consensus_queue.cc:237] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.864425 28271 raft_consensus.cc:2468] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:45.873533 28094 catalog_manager.cc:5697] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 1 to 2, leader changed from 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3) to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.923738 28450 raft_consensus.cc:993] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906: : Instructing follower 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:45.924235 28406 raft_consensus.cc:1081] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Signalling peer 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:45.926007 28196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65ce1ade2c24457e8d95ecd97739fd25"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:45134
I20260709 13:22:45.926618 28196 raft_consensus.cc:493] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.926934 28196 raft_consensus.cc:3060] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.932192 28196 raft_consensus.cc:515] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.933867 28196 leader_election.cc:290] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:45.934755 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ce1ade2c24457e8d95ecd97739fd25" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:45.935087 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ce1ade2c24457e8d95ecd97739fd25" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:45.935420 28271 raft_consensus.cc:3055] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.935670 28345 raft_consensus.cc:3060] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.935799 28271 raft_consensus.cc:740] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:45.936580 28271 consensus_queue.cc:260] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.937582 28271 raft_consensus.cc:3060] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.940796 28345 raft_consensus.cc:2468] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:45.942373 28163 leader_election.cc:304] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:45.942878 28271 raft_consensus.cc:2468] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:45.943147 28464 raft_consensus.cc:2804] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:45.943758 28464 raft_consensus.cc:697] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:45.944720 28464 consensus_queue.cc:237] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.951782 28094 catalog_manager.cc:5697] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 1 to 2, leader changed from 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2) to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:45.984042 28392 raft_consensus.cc:993] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8: : Instructing follower 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:45.984596 28438 raft_consensus.cc:1081] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Signalling peer 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:45.986162 28271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db9437c1592a45089625cc516da0a6a7"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:22:45.986701 28271 raft_consensus.cc:493] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:45.987020 28271 raft_consensus.cc:3060] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.991987 28271 raft_consensus.cc:515] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.993593 28271 leader_election.cc:290] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:45.994542 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9437c1592a45089625cc516da0a6a7" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:45.994674 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9437c1592a45089625cc516da0a6a7" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:45.995241 28196 raft_consensus.cc:3060] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:45.995322 28345 raft_consensus.cc:3055] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:45.995777 28345 raft_consensus.cc:740] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:45.996569 28345 consensus_queue.cc:260] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:45.997637 28345 raft_consensus.cc:3060] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.001457 28196 raft_consensus.cc:2468] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:46.003060 28235 leader_election.cc:304] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:46.003995 28459 raft_consensus.cc:993] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910: : Instructing follower 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:46.003944 28406 raft_consensus.cc:2804] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:46.004454 28345 raft_consensus.cc:2468] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:46.004722 28406 raft_consensus.cc:697] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:46.005651 28459 raft_consensus.cc:1081] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Signalling peer 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:46.005741 28406 consensus_queue.cc:237] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:46.007490 28345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "261e51960d29420590eeeddef0a37f6c"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:55530
I20260709 13:22:46.008093 28345 raft_consensus.cc:493] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:46.008515 28345 raft_consensus.cc:3060] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.012686 28094 catalog_manager.cc:5697] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 1 to 2, leader changed from 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3) to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:46.014195 28345 raft_consensus.cc:515] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:46.016376 28345 leader_election.cc:290] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 2 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:46.016734 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261e51960d29420590eeeddef0a37f6c" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:46.017004 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261e51960d29420590eeeddef0a37f6c" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:46.017560 28196 raft_consensus.cc:3055] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:46.018750 28271 raft_consensus.cc:3060] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.019008 28196 raft_consensus.cc:740] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:46.019937 28196 consensus_queue.cc:260] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:46.021189 28196 raft_consensus.cc:3060] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:46.025847 28271 raft_consensus.cc:2468] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 2.
I20260709 13:22:46.026506 28196 raft_consensus.cc:2468] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 2.
I20260709 13:22:46.027062 28312 leader_election.cc:304] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:46.027911 28438 raft_consensus.cc:2804] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:46.028335 28438 raft_consensus.cc:697] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 2 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:46.029047 28438 consensus_queue.cc:237] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:46.036203 28094 catalog_manager.cc:5697] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 1 to 2, leader changed from 670a4825d5ed45f697754318dffa6910 (127.15.208.1) to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:46.169945 28345 raft_consensus.cc:1275] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.171309 28406 consensus_queue.cc:1048] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.179320 28196 raft_consensus.cc:1275] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.181205 28405 consensus_queue.cc:1048] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.285766 28345 raft_consensus.cc:1275] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.287030 28405 consensus_queue.cc:1048] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.294562 28196 raft_consensus.cc:1275] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.296511 28405 consensus_queue.cc:1048] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.298779 28271 raft_consensus.cc:1275] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.301249 28459 consensus_queue.cc:1048] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.313114 28346 raft_consensus.cc:1275] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.313385 28345 raft_consensus.cc:1275] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.314975 28395 consensus_queue.cc:1048] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.316321 28395 consensus_queue.cc:1048] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.323809 28271 raft_consensus.cc:1275] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.327536 28196 raft_consensus.cc:1275] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.327399 28395 consensus_queue.cc:1048] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.329386 28405 consensus_queue.cc:1048] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.338604 28345 raft_consensus.cc:1275] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.339133 28271 raft_consensus.cc:1275] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.340287 28405 consensus_queue.cc:1048] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.356168 28346 raft_consensus.cc:1275] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.357815 28270 raft_consensus.cc:1275] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.360668 28481 consensus_queue.cc:1048] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.362118 28479 consensus_queue.cc:1048] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.361425 28480 consensus_queue.cc:1048] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.376725 28345 raft_consensus.cc:1275] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.379658 28395 consensus_queue.cc:1048] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.424574 28195 raft_consensus.cc:1275] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.425868 28405 consensus_queue.cc:1048] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.430060 28196 raft_consensus.cc:1275] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.431483 28438 consensus_queue.cc:1048] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.434180 28345 raft_consensus.cc:1275] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.435673 28450 consensus_queue.cc:1048] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:46.444937 28271 raft_consensus.cc:1275] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:46.446997 28484 consensus_queue.cc:1048] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:48.628597 28095 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37758:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:48.630955 28095 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:22:48.658453 28143 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:48.679677 28186 tablet_service.cc:1511] Processing CreateTablet for tablet b02157fa2fab4254be0bb721f0b12224 (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:48.680563 28258 tablet_service.cc:1511] Processing CreateTablet for tablet b02157fa2fab4254be0bb721f0b12224 (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:48.681263 28186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b02157fa2fab4254be0bb721f0b12224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.681511 28330 tablet_service.cc:1511] Processing CreateTablet for tablet b02157fa2fab4254be0bb721f0b12224 (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:48.682003 28258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b02157fa2fab4254be0bb721f0b12224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.682880 28330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b02157fa2fab4254be0bb721f0b12224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.689399 28180 tablet_service.cc:1511] Processing CreateTablet for tablet fa4885758ce64d5bbdf46b0f5eaa3c9c (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:48.690871 28180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4885758ce64d5bbdf46b0f5eaa3c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.692343 28259 tablet_service.cc:1511] Processing CreateTablet for tablet fa4885758ce64d5bbdf46b0f5eaa3c9c (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:48.693686 28259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4885758ce64d5bbdf46b0f5eaa3c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.695885 28185 tablet_service.cc:1511] Processing CreateTablet for tablet 37bfcd2dcacb406880c8d972da5eda7b (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:48.697188 28185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bfcd2dcacb406880c8d972da5eda7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.697552 28255 tablet_service.cc:1511] Processing CreateTablet for tablet 37bfcd2dcacb406880c8d972da5eda7b (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:48.698807 28255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bfcd2dcacb406880c8d972da5eda7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.701804 28331 tablet_service.cc:1511] Processing CreateTablet for tablet fa4885758ce64d5bbdf46b0f5eaa3c9c (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:48.703169 28331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4885758ce64d5bbdf46b0f5eaa3c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.703984 28183 tablet_service.cc:1511] Processing CreateTablet for tablet ba4b3c113e8449f68633518c60c7834b (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:48.705312 28183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4b3c113e8449f68633518c60c7834b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.706058 28335 tablet_service.cc:1511] Processing CreateTablet for tablet 37bfcd2dcacb406880c8d972da5eda7b (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:48.707388 28335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bfcd2dcacb406880c8d972da5eda7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.720155 28254 tablet_service.cc:1511] Processing CreateTablet for tablet ba4b3c113e8449f68633518c60c7834b (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:48.721652 28254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4b3c113e8449f68633518c60c7834b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.724602 28329 tablet_service.cc:1511] Processing CreateTablet for tablet ba4b3c113e8449f68633518c60c7834b (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:48.726012 28329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4b3c113e8449f68633518c60c7834b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.726646 28182 tablet_service.cc:1511] Processing CreateTablet for tablet e9f59e84bbf444f4879c6f4bcf79008f (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:48.727982 28182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f59e84bbf444f4879c6f4bcf79008f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.742002 28257 tablet_service.cc:1511] Processing CreateTablet for tablet e9f59e84bbf444f4879c6f4bcf79008f (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:48.743453 28257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f59e84bbf444f4879c6f4bcf79008f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.746572 28333 tablet_service.cc:1511] Processing CreateTablet for tablet e9f59e84bbf444f4879c6f4bcf79008f (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:48.747884 28333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f59e84bbf444f4879c6f4bcf79008f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.748669 28332 tablet_service.cc:1511] Processing CreateTablet for tablet 985693424a0344c59bafdfaadf1cd437 (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:48.749900 28179 tablet_service.cc:1511] Processing CreateTablet for tablet 985693424a0344c59bafdfaadf1cd437 (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:48.752379 28256 tablet_service.cc:1511] Processing CreateTablet for tablet 985693424a0344c59bafdfaadf1cd437 (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:48.753679 28256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985693424a0344c59bafdfaadf1cd437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.754842 28328 tablet_service.cc:1511] Processing CreateTablet for tablet be72366bd2784a428f663c927a754752 (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:48.755198 28262 tablet_service.cc:1511] Processing CreateTablet for tablet be72366bd2784a428f663c927a754752 (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:48.756440 28262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be72366bd2784a428f663c927a754752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.757515 28184 tablet_service.cc:1511] Processing CreateTablet for tablet be72366bd2784a428f663c927a754752 (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:48.758785 28187 tablet_service.cc:1511] Processing CreateTablet for tablet 65422adf5a2b4e59850f23785c2ea90e (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:48.763306 28332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985693424a0344c59bafdfaadf1cd437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.765579 28328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be72366bd2784a428f663c927a754752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.766237 28495 tablet_bootstrap.cc:492] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:48.770268 28336 tablet_service.cc:1511] Processing CreateTablet for tablet 65422adf5a2b4e59850f23785c2ea90e (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:48.771560 28336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65422adf5a2b4e59850f23785c2ea90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.773229 28179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985693424a0344c59bafdfaadf1cd437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.773970 28184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be72366bd2784a428f663c927a754752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.776496 28187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65422adf5a2b4e59850f23785c2ea90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.785732 28495 tablet_bootstrap.cc:654] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.789239 28255 tablet_service.cc:1511] Processing CreateTablet for tablet 65422adf5a2b4e59850f23785c2ea90e (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:48.809851 28255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65422adf5a2b4e59850f23785c2ea90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.793763 28496 tablet_bootstrap.cc:492] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:48.815564 28181 tablet_service.cc:1511] Processing CreateTablet for tablet 8a99cb368c0c490791f108959bf8a0dc (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:48.816999 28181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a99cb368c0c490791f108959bf8a0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.816771 28258 tablet_service.cc:1511] Processing CreateTablet for tablet 8a99cb368c0c490791f108959bf8a0dc (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:48.818120 28258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a99cb368c0c490791f108959bf8a0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.823477 28334 tablet_service.cc:1511] Processing CreateTablet for tablet 8a99cb368c0c490791f108959bf8a0dc (DEFAULT_TABLE table=soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:48.824868 28334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a99cb368c0c490791f108959bf8a0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.830459 28497 tablet_bootstrap.cc:492] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:48.842146 28496 tablet_bootstrap.cc:654] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.849668 28495 tablet_bootstrap.cc:492] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:48.850220 28495 ts_tablet_manager.cc:1403] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.006s
I20260709 13:22:48.857344 28497 tablet_bootstrap.cc:654] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.859543 28495 raft_consensus.cc:359] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.861449 28495 raft_consensus.cc:385] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:48.861819 28495 raft_consensus.cc:740] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:48.862556 28495 consensus_queue.cc:260] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.864797 28495 ts_tablet_manager.cc:1434] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:22:48.865907 28495 tablet_bootstrap.cc:492] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:48.882907 28495 tablet_bootstrap.cc:654] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.892047 28496 tablet_bootstrap.cc:492] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:48.892566 28496 ts_tablet_manager.cc:1403] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.099s	user 0.019s	sys 0.000s
I20260709 13:22:48.893069 28495 tablet_bootstrap.cc:492] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:48.893632 28495 ts_tablet_manager.cc:1403] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 13:22:48.895511 28496 raft_consensus.cc:359] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.896307 28496 raft_consensus.cc:385] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:48.896495 28495 raft_consensus.cc:359] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.897564 28495 raft_consensus.cc:385] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:48.897955 28495 raft_consensus.cc:740] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:48.898885 28495 consensus_queue.cc:260] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.896607 28496 raft_consensus.cc:740] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:48.900383 28496 consensus_queue.cc:260] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.901535 28495 ts_tablet_manager.cc:1434] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:48.902603 28495 tablet_bootstrap.cc:492] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:48.902815 28496 ts_tablet_manager.cc:1434] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:22:48.903846 28496 tablet_bootstrap.cc:492] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:48.911859 28497 tablet_bootstrap.cc:492] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:48.912461 28497 ts_tablet_manager.cc:1403] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.006s
I20260709 13:22:48.914410 28496 tablet_bootstrap.cc:654] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.914861 28495 tablet_bootstrap.cc:654] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.915912 28497 raft_consensus.cc:359] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.916888 28497 raft_consensus.cc:385] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:48.917240 28497 raft_consensus.cc:740] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:48.918427 28497 consensus_queue.cc:260] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.921720 28497 ts_tablet_manager.cc:1434] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:48.923511 28497 tablet_bootstrap.cc:492] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:48.937242 28496 tablet_bootstrap.cc:492] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:48.938385 28496 ts_tablet_manager.cc:1403] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.020s
I20260709 13:22:48.942682 28495 tablet_bootstrap.cc:492] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:48.942322 28496 raft_consensus.cc:359] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.943212 28495 ts_tablet_manager.cc:1403] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.017s
I20260709 13:22:48.943233 28497 tablet_bootstrap.cc:654] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.943449 28496 raft_consensus.cc:385] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:48.944082 28496 raft_consensus.cc:740] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:48.944919 28496 consensus_queue.cc:260] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.946664 28495 raft_consensus.cc:359] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.947279 28496 ts_tablet_manager.cc:1434] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:48.947544 28495 raft_consensus.cc:385] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:48.947965 28495 raft_consensus.cc:740] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:48.948415 28496 tablet_bootstrap.cc:492] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:48.948802 28495 consensus_queue.cc:260] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.951761 28495 ts_tablet_manager.cc:1434] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:48.952912 28495 tablet_bootstrap.cc:492] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:48.955423 28496 tablet_bootstrap.cc:654] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.959906 28495 tablet_bootstrap.cc:654] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.966718 28497 tablet_bootstrap.cc:492] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:48.967319 28497 ts_tablet_manager.cc:1403] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.003s
I20260709 13:22:48.968286 28496 tablet_bootstrap.cc:492] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:48.968457 28495 tablet_bootstrap.cc:492] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:48.968859 28496 ts_tablet_manager.cc:1403] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:22:48.969033 28495 ts_tablet_manager.cc:1403] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 13:22:48.970335 28497 raft_consensus.cc:359] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.971079 28497 raft_consensus.cc:385] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:48.971372 28497 raft_consensus.cc:740] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:48.971400 28495 raft_consensus.cc:359] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.972255 28495 raft_consensus.cc:385] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:48.971879 28496 raft_consensus.cc:359] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.972568 28495 raft_consensus.cc:740] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:48.972720 28496 raft_consensus.cc:385] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:48.972256 28497 consensus_queue.cc:260] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.973160 28496 raft_consensus.cc:740] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:48.973438 28495 consensus_queue.cc:260] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.973990 28496 consensus_queue.cc:260] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:48.974968 28497 ts_tablet_manager.cc:1434] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:48.976653 28496 ts_tablet_manager.cc:1434] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:48.976907 28497 tablet_bootstrap.cc:492] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:48.977849 28496 tablet_bootstrap.cc:492] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:48.983851 28497 tablet_bootstrap.cc:654] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.984907 28496 tablet_bootstrap.cc:654] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.975848 28495 ts_tablet_manager.cc:1434] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:22:48.987859 28495 tablet_bootstrap.cc:492] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:48.994308 28495 tablet_bootstrap.cc:654] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.996575 28496 tablet_bootstrap.cc:492] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:48.997167 28496 ts_tablet_manager.cc:1403] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:22:49.000087 28496 raft_consensus.cc:359] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.000734 28496 raft_consensus.cc:385] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.001045 28496 raft_consensus.cc:740] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.001806 28497 tablet_bootstrap.cc:492] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:49.001701 28496 consensus_queue.cc:260] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.002457 28497 ts_tablet_manager.cc:1403] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 13:22:49.004002 28496 ts_tablet_manager.cc:1434] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:22:49.005112 28496 tablet_bootstrap.cc:492] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:49.008090 28497 raft_consensus.cc:359] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.009963 28497 raft_consensus.cc:385] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.010255 28497 raft_consensus.cc:740] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.011322 28497 consensus_queue.cc:260] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.013130 28496 tablet_bootstrap.cc:654] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.013517 28495 tablet_bootstrap.cc:492] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:49.013741 28497 ts_tablet_manager.cc:1434] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:22:49.014115 28495 ts_tablet_manager.cc:1403] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 13:22:49.014943 28497 tablet_bootstrap.cc:492] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:49.017486 28495 raft_consensus.cc:359] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.018363 28495 raft_consensus.cc:385] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.018725 28495 raft_consensus.cc:740] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.019534 28495 consensus_queue.cc:260] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.019703 28450 raft_consensus.cc:493] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.020720 28450 raft_consensus.cc:515] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.023051 28497 tablet_bootstrap.cc:654] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.023556 28450 leader_election.cc:290] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.025719 28496 tablet_bootstrap.cc:492] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:49.025692 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bfcd2dcacb406880c8d972da5eda7b" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:49.026541 28196 raft_consensus.cc:2468] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:49.026554 28496 ts_tablet_manager.cc:1403] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.012s
I20260709 13:22:49.028991 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bfcd2dcacb406880c8d972da5eda7b" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:49.031873 28496 raft_consensus.cc:359] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.032526 28497 tablet_bootstrap.cc:492] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:49.032648 28496 raft_consensus.cc:385] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:49.033070 28238 leader_election.cc:343] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.033129 28496 raft_consensus.cc:740] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.034160 28496 consensus_queue.cc:260] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.033097 28497 ts_tablet_manager.cc:1403] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:22:49.034991 28235 leader_election.cc:304] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:49.035913 28450 raft_consensus.cc:2804] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:49.036273 28450 raft_consensus.cc:493] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:49.036594 28450 raft_consensus.cc:3060] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.036664 28496 ts_tablet_manager.cc:1434] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:22:49.037873 28496 tablet_bootstrap.cc:492] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:49.037986 28497 raft_consensus.cc:359] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.038746 28497 raft_consensus.cc:385] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.039016 28497 raft_consensus.cc:740] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.039816 28497 consensus_queue.cc:260] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.042212 28497 ts_tablet_manager.cc:1434] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:22:49.034762 28495 ts_tablet_manager.cc:1434] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 13:22:49.043464 28495 tablet_bootstrap.cc:492] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:49.046260 28496 tablet_bootstrap.cc:654] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.050242 28495 tablet_bootstrap.cc:654] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.053565 28497 tablet_bootstrap.cc:492] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:49.059955 28450 raft_consensus.cc:515] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.062508 28450 leader_election.cc:290] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.063925 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bfcd2dcacb406880c8d972da5eda7b" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:49.064785 28346 raft_consensus.cc:3060] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.064194 28497 tablet_bootstrap.cc:654] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.065953 28496 tablet_bootstrap.cc:492] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:49.066094 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bfcd2dcacb406880c8d972da5eda7b" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:49.066488 28496 ts_tablet_manager.cc:1403] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.003s
I20260709 13:22:49.066799 28196 raft_consensus.cc:3060] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.071282 28496 raft_consensus.cc:359] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.072227 28496 raft_consensus.cc:385] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.072604 28496 raft_consensus.cc:740] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.073475 28496 consensus_queue.cc:260] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.075464 28196 raft_consensus.cc:2468] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:49.076257 28496 ts_tablet_manager.cc:1434] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:22:49.077033 28235 leader_election.cc:304] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:49.078689 28511 raft_consensus.cc:2804] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:49.079510 28511 raft_consensus.cc:697] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:49.080658 28511 consensus_queue.cc:237] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.092562 28496 tablet_bootstrap.cc:492] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:49.102120 28346 raft_consensus.cc:2468] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:49.105674 28497 tablet_bootstrap.cc:492] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:49.106364 28497 ts_tablet_manager.cc:1403] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.018s
I20260709 13:22:49.110004 28497 raft_consensus.cc:359] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.110822 28497 raft_consensus.cc:385] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.111227 28092 catalog_manager.cc:5697] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:49.112187 28496 tablet_bootstrap.cc:654] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.112732 28495 tablet_bootstrap.cc:492] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:49.113339 28495 ts_tablet_manager.cc:1403] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.020s
I20260709 13:22:49.111261 28497 raft_consensus.cc:740] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.114933 28497 consensus_queue.cc:260] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.117031 28497 ts_tablet_manager.cc:1434] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:49.116587 28495 raft_consensus.cc:359] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.118360 28497 tablet_bootstrap.cc:492] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:49.118630 28495 raft_consensus.cc:385] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.119071 28495 raft_consensus.cc:740] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.120121 28495 consensus_queue.cc:260] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.123934 28495 ts_tablet_manager.cc:1434] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:49.127483 28495 tablet_bootstrap.cc:492] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:49.127938 28497 tablet_bootstrap.cc:654] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.134575 28495 tablet_bootstrap.cc:654] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.135272 28496 tablet_bootstrap.cc:492] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:49.135347 28497 tablet_bootstrap.cc:492] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:49.135998 28496 ts_tablet_manager.cc:1403] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.008s
I20260709 13:22:49.136132 28497 ts_tablet_manager.cc:1403] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:22:49.138567 28496 raft_consensus.cc:359] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.139271 28496 raft_consensus.cc:385] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.139586 28496 raft_consensus.cc:740] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.139442 28497 raft_consensus.cc:359] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.140146 28484 raft_consensus.cc:493] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.140208 28497 raft_consensus.cc:385] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.140398 28496 consensus_queue.cc:260] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.141002 28497 raft_consensus.cc:740] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.140810 28484 raft_consensus.cc:515] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.141625 28495 tablet_bootstrap.cc:492] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:49.142280 28495 ts_tablet_manager.cc:1403] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.017s	user 0.001s	sys 0.012s
I20260709 13:22:49.141883 28497 consensus_queue.cc:260] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.143069 28496 ts_tablet_manager.cc:1434] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:49.144068 28496 tablet_bootstrap.cc:492] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:49.143959 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b02157fa2fab4254be0bb721f0b12224" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:49.144946 28196 raft_consensus.cc:2468] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
I20260709 13:22:49.146591 28395 raft_consensus.cc:493] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.147158 28395 raft_consensus.cc:515] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.150486 28496 tablet_bootstrap.cc:654] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.150342 28309 leader_election.cc:304] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:49.150887 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b02157fa2fab4254be0bb721f0b12224" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:49.151607 28271 raft_consensus.cc:2468] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
I20260709 13:22:49.152786 28270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f59e84bbf444f4879c6f4bcf79008f" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:49.153663 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f59e84bbf444f4879c6f4bcf79008f" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:49.154633 28395 leader_election.cc:290] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
W20260709 13:22:49.154985 28163 leader_election.cc:343] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.155946 28522 raft_consensus.cc:2804] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:49.156661 28522 raft_consensus.cc:493] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:49.157019 28522 raft_consensus.cc:3060] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.158214 28495 raft_consensus.cc:359] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.158938 28495 raft_consensus.cc:385] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.159214 28495 raft_consensus.cc:740] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.161350 28495 consensus_queue.cc:260] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
W20260709 13:22:49.163022 28163 leader_election.cc:343] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.163491 28163 leader_election.cc:304] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670a4825d5ed45f697754318dffa6910; no voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:49.164202 28484 leader_election.cc:290] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:49.164705 28395 raft_consensus.cc:2749] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:49.165007 28495 ts_tablet_manager.cc:1434] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:22:49.166703 28511 raft_consensus.cc:493] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.167512 28497 ts_tablet_manager.cc:1434] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 13:22:49.167225 28511 raft_consensus.cc:515] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.168588 28497 tablet_bootstrap.cc:492] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:49.169484 28511 leader_election.cc:290] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.171164 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4885758ce64d5bbdf46b0f5eaa3c9c" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:49.171882 28196 raft_consensus.cc:2468] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:49.172952 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4885758ce64d5bbdf46b0f5eaa3c9c" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:49.173628 28346 raft_consensus.cc:2468] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:49.175251 28497 tablet_bootstrap.cc:654] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.175300 28238 leader_election.cc:304] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:49.179721 28511 raft_consensus.cc:2804] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:49.179488 28522 raft_consensus.cc:515] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.180130 28511 raft_consensus.cc:493] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:49.180516 28511 raft_consensus.cc:3060] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.182717 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b02157fa2fab4254be0bb721f0b12224" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:49.183234 28395 raft_consensus.cc:493] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.184118 28395 raft_consensus.cc:515] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.185611 28270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b02157fa2fab4254be0bb721f0b12224" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:49.186303 28270 raft_consensus.cc:3060] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.186826 28395 leader_election.cc:290] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.183351 28196 raft_consensus.cc:3060] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.188374 28511 raft_consensus.cc:515] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.176409 28495 tablet_bootstrap.cc:492] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:49.191107 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4885758ce64d5bbdf46b0f5eaa3c9c" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:49.191676 28195 raft_consensus.cc:3060] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.195943 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:49.196933 28271 raft_consensus.cc:2468] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 0.
I20260709 13:22:49.199360 28163 leader_election.cc:304] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:49.199625 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:49.200215 28511 leader_election.cc:290] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.201372 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4885758ce64d5bbdf46b0f5eaa3c9c" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:49.201740 28495 tablet_bootstrap.cc:654] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.202003 28346 raft_consensus.cc:3060] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.205066 28395 raft_consensus.cc:2804] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:49.205279 28521 raft_consensus.cc:493] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.205834 28395 raft_consensus.cc:493] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:49.205911 28521 raft_consensus.cc:515] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.208585 28395 raft_consensus.cc:3060] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.210161 28521 leader_election.cc:290] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
W20260709 13:22:49.212363 28163 leader_election.cc:343] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.217357 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:49.222743 28195 raft_consensus.cc:2468] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:49.228005 28527 raft_consensus.cc:493] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.229971 28527 raft_consensus.cc:515] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.231578 28270 raft_consensus.cc:2468] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:49.223977 28346 raft_consensus.cc:2468] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:49.220994 28271 raft_consensus.cc:2468] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
I20260709 13:22:49.224735 28522 leader_election.cc:290] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:49.234788 28238 leader_election.cc:304] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:49.233911 28312 leader_election.cc:304] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:49.235903 28527 leader_election.cc:290] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.236733 28312 leader_election.cc:304] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:49.236546 28522 raft_consensus.cc:2804] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:49.237727 28521 raft_consensus.cc:2804] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:49.238081 28521 raft_consensus.cc:493] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:49.238400 28521 raft_consensus.cc:3060] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.238396 28522 raft_consensus.cc:697] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:49.239498 28522 consensus_queue.cc:237] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.224205 28196 raft_consensus.cc:2468] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:49.230367 28395 raft_consensus.cc:515] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.242933 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:49.249989 28484 raft_consensus.cc:493] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.250182 28495 tablet_bootstrap.cc:492] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:49.250727 28495 ts_tablet_manager.cc:1403] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.014s
I20260709 13:22:49.250638 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:49.250523 28484 raft_consensus.cc:515] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.253685 28495 raft_consensus.cc:359] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.257692 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be72366bd2784a428f663c927a754752" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:49.258368 28495 raft_consensus.cc:385] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.254649 28197 raft_consensus.cc:2468] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
I20260709 13:22:49.246043 28511 raft_consensus.cc:2804] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:49.255385 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be72366bd2784a428f663c927a754752" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:49.253852 28270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:49.259569 28270 raft_consensus.cc:2468] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 0.
I20260709 13:22:49.259565 28195 raft_consensus.cc:2468] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
I20260709 13:22:49.258656 28495 raft_consensus.cc:740] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.260178 28511 raft_consensus.cc:697] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:49.262076 28309 leader_election.cc:304] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:49.255667 28484 leader_election.cc:290] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:49.262441 28495 consensus_queue.cc:260] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.262415 28511 consensus_queue.cc:237] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.274849 28495 ts_tablet_manager.cc:1434] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 13:22:49.275926 28163 leader_election.cc:304] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:49.278321 28395 leader_election.cc:290] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
W20260709 13:22:49.273245 28312 leader_election.cc:343] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.275926 28495 tablet_bootstrap.cc:492] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906: Bootstrap starting.
I20260709 13:22:49.269677 28484 raft_consensus.cc:2804] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:49.279652 28484 raft_consensus.cc:493] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:49.280005 28484 raft_consensus.cc:3060] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.277462 28521 raft_consensus.cc:515] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.282364 28346 raft_consensus.cc:2393] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 670a4825d5ed45f697754318dffa6910 in current term 1: Already voted for candidate 68e60eb98fc641b49ff635562d526ed8 in this term.
I20260709 13:22:49.283226 28521 leader_election.cc:290] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:49.283861 28521 raft_consensus.cc:493] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.284737 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:49.285538 28497 tablet_bootstrap.cc:492] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:49.285794 28496 tablet_bootstrap.cc:492] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:49.291788 28496 ts_tablet_manager.cc:1403] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.148s	user 0.018s	sys 0.068s
I20260709 13:22:49.284289 28521 raft_consensus.cc:515] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.297881 28521 leader_election.cc:290] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:49.289578 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:49.290002 28271 raft_consensus.cc:3060] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.298636 28272 raft_consensus.cc:3060] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.299347 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985693424a0344c59bafdfaadf1cd437" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:49.300031 28495 tablet_bootstrap.cc:654] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:49.301021 28309 leader_election.cc:343] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.302476 28484 raft_consensus.cc:515] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.286115 28395 raft_consensus.cc:2804] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:49.290971 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:49.305919 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be72366bd2784a428f663c927a754752" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:49.306581 28195 raft_consensus.cc:3060] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.307255 28269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be72366bd2784a428f663c927a754752" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:49.295567 28496 raft_consensus.cc:359] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.297930 28512 raft_consensus.cc:493] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.306135 28497 ts_tablet_manager.cc:1403] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.024s
I20260709 13:22:49.310449 28450 raft_consensus.cc:493] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.308346 28496 raft_consensus.cc:385] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.294721 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:49.309573 28270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985693424a0344c59bafdfaadf1cd437" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
W20260709 13:22:49.309850 28163 leader_election.cc:343] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.310189 28512 raft_consensus.cc:515] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
W20260709 13:22:49.311205 28235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:39447, user_credentials={real_user=slave}} blocked reactor thread for 65860.1us
I20260709 13:22:49.310990 28450 raft_consensus.cc:515] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
W20260709 13:22:49.312184 28312 leader_election.cc:343] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.314121 28512 leader_election.cc:290] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.314496 28450 leader_election.cc:290] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.314814 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a99cb368c0c490791f108959bf8a0dc" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:49.309383 28395 raft_consensus.cc:493] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:49.315565 28395 raft_consensus.cc:3060] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.316592 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a99cb368c0c490791f108959bf8a0dc" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:49.317840 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f59e84bbf444f4879c6f4bcf79008f" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:49.319514 28194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f59e84bbf444f4879c6f4bcf79008f" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:49.320458 28194 raft_consensus.cc:2468] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:49.321921 28235 leader_election.cc:304] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:49.322404 28270 raft_consensus.cc:2468] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 0.
W20260709 13:22:49.322577 28238 leader_election.cc:343] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.323462 28450 raft_consensus.cc:2804] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:49.324016 28450 raft_consensus.cc:493] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:49.304631 28484 leader_election.cc:290] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:49.310992 28496 raft_consensus.cc:740] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.324769 28450 raft_consensus.cc:3060] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.323836 28312 leader_election.cc:304] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 670a4825d5ed45f697754318dffa6910
I20260709 13:22:49.325187 28496 consensus_queue.cc:260] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.326056 28484 raft_consensus.cc:2804] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:49.326463 28484 raft_consensus.cc:493] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:49.326776 28484 raft_consensus.cc:3060] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.328152 28496 ts_tablet_manager.cc:1434] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:22:49.329021 28197 raft_consensus.cc:2468] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:49.329021 28195 raft_consensus.cc:2468] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:49.331760 28497 raft_consensus.cc:359] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.309074 28271 raft_consensus.cc:2468] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:49.308027 28272 raft_consensus.cc:2468] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 1.
I20260709 13:22:49.329113 28496 tablet_bootstrap.cc:492] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910: Bootstrap starting.
I20260709 13:22:49.333127 28497 raft_consensus.cc:385] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.338860 28497 raft_consensus.cc:740] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.339591 28497 consensus_queue.cc:260] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.339715 28484 raft_consensus.cc:515] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.340667 28346 raft_consensus.cc:2468] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 0.
I20260709 13:22:49.342258 28238 leader_election.cc:304] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:49.342518 28497 ts_tablet_manager.cc:1434] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:22:49.343087 28512 raft_consensus.cc:2804] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:49.343462 28512 raft_consensus.cc:493] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:49.343781 28512 raft_consensus.cc:3060] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.343987 28497 tablet_bootstrap.cc:492] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:49.334676 28312 leader_election.cc:304] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:49.345660 28529 raft_consensus.cc:2804] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:49.346124 28529 raft_consensus.cc:697] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:49.346944 28529 consensus_queue.cc:237] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.335415 28309 leader_election.cc:304] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 48bda4cab7c541bf808d72bf4d8cb906
I20260709 13:22:49.349695 28521 raft_consensus.cc:2804] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:49.352299 28094 catalog_manager.cc:5697] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:49.356467 28496 tablet_bootstrap.cc:654] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.359133 28163 leader_election.cc:304] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:49.360541 28527 raft_consensus.cc:2804] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:49.361130 28527 raft_consensus.cc:697] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:49.361865 28527 consensus_queue.cc:237] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.368270 28094 catalog_manager.cc:5697] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:49.372207 28395 raft_consensus.cc:515] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.386125 28450 raft_consensus.cc:515] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.386690 28512 raft_consensus.cc:515] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.391812 28521 raft_consensus.cc:697] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:49.396355 28195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985693424a0344c59bafdfaadf1cd437" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:49.396816 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a99cb368c0c490791f108959bf8a0dc" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:49.396078 28521 consensus_queue.cc:237] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
W20260709 13:22:49.398309 28309 leader_election.cc:343] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.397733 28197 raft_consensus.cc:3060] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.403390 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985693424a0344c59bafdfaadf1cd437" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:49.404495 28272 raft_consensus.cc:3060] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.416460 28196 raft_consensus.cc:2393] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 68e60eb98fc641b49ff635562d526ed8 in current term 1: Already voted for candidate 670a4825d5ed45f697754318dffa6910 in this term.
I20260709 13:22:49.401055 28484 leader_election.cc:290] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:49.425877 28495 tablet_bootstrap.cc:492] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906: No bootstrap required, opened a new log
I20260709 13:22:49.426141 28497 tablet_bootstrap.cc:654] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.426462 28495 ts_tablet_manager.cc:1403] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent bootstrapping tablet: real 0.151s	user 0.030s	sys 0.019s
I20260709 13:22:49.427878 28512 leader_election.cc:290] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.431656 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a99cb368c0c490791f108959bf8a0dc" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:49.432807 28346 raft_consensus.cc:3060] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.432902 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:49.433943 28271 raft_consensus.cc:2393] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 670a4825d5ed45f697754318dffa6910 in current term 1: Already voted for candidate 68e60eb98fc641b49ff635562d526ed8 in this term.
I20260709 13:22:49.434866 28092 catalog_manager.cc:5697] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 0 to 1, leader changed from <none> to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:49.440600 28495 raft_consensus.cc:359] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.441440 28495 raft_consensus.cc:385] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.441808 28495 raft_consensus.cc:740] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.445663 28495 consensus_queue.cc:260] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.447772 28495 ts_tablet_manager.cc:1434] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:22:49.449867 28272 raft_consensus.cc:2468] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 1.
I20260709 13:22:49.452114 28312 leader_election.cc:304] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 670a4825d5ed45f697754318dffa6910
I20260709 13:22:49.453784 28529 raft_consensus.cc:2804] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:49.454267 28529 raft_consensus.cc:697] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:49.455106 28346 raft_consensus.cc:2468] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:49.455052 28529 consensus_queue.cc:237] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.456404 28238 leader_election.cc:304] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:49.457612 28528 raft_consensus.cc:2804] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:49.458098 28528 raft_consensus.cc:697] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:49.458995 28528 consensus_queue.cc:237] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.460485 28197 raft_consensus.cc:2468] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:49.464138 28450 leader_election.cc:290] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.465109 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f59e84bbf444f4879c6f4bcf79008f" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
W20260709 13:22:49.471613 28238 leader_election.cc:343] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:49.475706 28395 leader_election.cc:290] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.485100 28497 tablet_bootstrap.cc:492] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:49.485298 28496 tablet_bootstrap.cc:492] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910: No bootstrap required, opened a new log
I20260709 13:22:49.470355 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f59e84bbf444f4879c6f4bcf79008f" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:49.535286 28197 raft_consensus.cc:3060] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.532541 28094 catalog_manager.cc:5697] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:49.527969 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:49.525736 28497 ts_tablet_manager.cc:1403] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.010s
I20260709 13:22:49.544202 28163 leader_election.cc:304] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670a4825d5ed45f697754318dffa6910; no voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:49.545845 28527 raft_consensus.cc:2749] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:49.547708 28496 ts_tablet_manager.cc:1403] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910: Time spent bootstrapping tablet: real 0.219s	user 0.010s	sys 0.013s
I20260709 13:22:49.537456 28094 catalog_manager.cc:5697] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:49.547469 28497 raft_consensus.cc:359] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.551106 28497 raft_consensus.cc:385] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.551391 28497 raft_consensus.cc:740] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.553464 28496 raft_consensus.cc:359] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.553978 28197 raft_consensus.cc:2468] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 1.
I20260709 13:22:49.554687 28496 raft_consensus.cc:385] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.552253 28497 consensus_queue.cc:260] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.555073 28496 raft_consensus.cc:740] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.557421 28235 leader_election.cc:304] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:49.559016 28528 raft_consensus.cc:2804] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:49.559861 28528 raft_consensus.cc:697] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:49.560384 28497 ts_tablet_manager.cc:1434] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.003s
I20260709 13:22:49.560802 28496 consensus_queue.cc:260] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.561468 28528 consensus_queue.cc:237] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.562345 28497 tablet_bootstrap.cc:492] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8: Bootstrap starting.
I20260709 13:22:49.570732 28497 tablet_bootstrap.cc:654] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:49.575541 28496 ts_tablet_manager.cc:1434] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.003s
I20260709 13:22:49.577899 28092 catalog_manager.cc:5697] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:49.580333 28527 raft_consensus.cc:493] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.580878 28527 raft_consensus.cc:515] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.583665 28527 leader_election.cc:290] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.584976 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985693424a0344c59bafdfaadf1cd437" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:49.586159 28272 raft_consensus.cc:2393] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 670a4825d5ed45f697754318dffa6910 in current term 1: Already voted for candidate 68e60eb98fc641b49ff635562d526ed8 in this term.
I20260709 13:22:49.588585 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985693424a0344c59bafdfaadf1cd437" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68e60eb98fc641b49ff635562d526ed8" is_pre_election: true
I20260709 13:22:49.590281 28163 leader_election.cc:304] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670a4825d5ed45f697754318dffa6910; no voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:49.591583 28527 raft_consensus.cc:3060] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.592264 28497 tablet_bootstrap.cc:492] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8: No bootstrap required, opened a new log
I20260709 13:22:49.592818 28497 ts_tablet_manager.cc:1403] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.012s
I20260709 13:22:49.595983 28095 catalog_manager.cc:5697] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 1 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:49.596630 28497 raft_consensus.cc:359] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.597559 28497 raft_consensus.cc:385] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:49.597852 28497 raft_consensus.cc:740] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Initialized, Role: FOLLOWER
I20260709 13:22:49.598681 28497 consensus_queue.cc:260] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.602200 28497 ts_tablet_manager.cc:1434] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:22:49.603742 28527 raft_consensus.cc:2749] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:49.608219 28528 consensus_queue.cc:1048] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:49.609086 28092 catalog_manager.cc:5697] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:49.642644 28528 consensus_queue.cc:1048] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:49.676759 28529 consensus_queue.cc:1048] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:49.691396 28529 consensus_queue.cc:1048] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:49.744267 28529 consensus_queue.cc:1048] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:49.748781 28450 consensus_queue.cc:1048] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:49.759223 28484 consensus_queue.cc:1048] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:49.762948 28346 raft_consensus.cc:3060] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.777719 28395 consensus_queue.cc:1048] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:49.783972 28528 consensus_queue.cc:1048] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:49.787756 28395 consensus_queue.cc:1048] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:49.831471 28346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b02157fa2fab4254be0bb721f0b12224"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
mode: GRACEFUL
new_leader_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:55534
I20260709 13:22:49.832566 28346 raft_consensus.cc:606] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Received request to transfer leadership to TS 670a4825d5ed45f697754318dffa6910
I20260709 13:22:49.839563 28271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa4885758ce64d5bbdf46b0f5eaa3c9c"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
mode: GRACEFUL
new_leader_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:60486
I20260709 13:22:49.840057 28271 raft_consensus.cc:606] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Received request to transfer leadership to TS 670a4825d5ed45f697754318dffa6910
I20260709 13:22:49.845431 28271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37bfcd2dcacb406880c8d972da5eda7b"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
mode: GRACEFUL
new_leader_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:60486
I20260709 13:22:49.845916 28271 raft_consensus.cc:606] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Received request to transfer leadership to TS 670a4825d5ed45f697754318dffa6910
I20260709 13:22:49.850468 28484 consensus_queue.cc:1048] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:49.851791 28346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
mode: GRACEFUL
new_leader_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:55534
I20260709 13:22:49.852428 28346 raft_consensus.cc:606] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Received request to transfer leadership to TS 670a4825d5ed45f697754318dffa6910
I20260709 13:22:49.864612 28346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "985693424a0344c59bafdfaadf1cd437"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
mode: GRACEFUL
new_leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:55534
I20260709 13:22:49.865283 28346 raft_consensus.cc:606] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Received request to transfer leadership to TS 48bda4cab7c541bf808d72bf4d8cb906
I20260709 13:22:49.867532 28271 raft_consensus.cc:3060] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.871695 28346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be72366bd2784a428f663c927a754752"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
mode: GRACEFUL
new_leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:55534
I20260709 13:22:49.872332 28346 raft_consensus.cc:606] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Received request to transfer leadership to TS 48bda4cab7c541bf808d72bf4d8cb906
I20260709 13:22:49.877516 28197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
mode: GRACEFUL
new_leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:22:49.878062 28197 raft_consensus.cc:606] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Received request to transfer leadership to TS 48bda4cab7c541bf808d72bf4d8cb906
I20260709 13:22:49.878921 28484 consensus_queue.cc:1048] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:49.883836 28272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a99cb368c0c490791f108959bf8a0dc"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
mode: GRACEFUL
new_leader_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:60486
I20260709 13:22:49.884569 28272 raft_consensus.cc:606] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Received request to transfer leadership to TS 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:49.889724 28521 raft_consensus.cc:993] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8: : Instructing follower 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:49.890265 28521 raft_consensus.cc:1081] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Signalling peer 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:49.891994 28271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be72366bd2784a428f663c927a754752"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:22:49.892614 28271 raft_consensus.cc:493] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:49.892933 28271 raft_consensus.cc:3060] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:49.897756 28271 raft_consensus.cc:515] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.899518 28271 leader_election.cc:290] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:49.901278 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be72366bd2784a428f663c927a754752" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:49.901521 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be72366bd2784a428f663c927a754752" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:49.901863 28346 raft_consensus.cc:3055] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:49.902175 28197 raft_consensus.cc:3060] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:49.902213 28346 raft_consensus.cc:740] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:49.903268 28346 consensus_queue.cc:260] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.904569 28346 raft_consensus.cc:3060] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:49.908295 28197 raft_consensus.cc:2468] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:49.909760 28235 leader_election.cc:304] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:49.910638 28528 raft_consensus.cc:2804] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:49.910894 28346 raft_consensus.cc:2468] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:49.911140 28528 raft_consensus.cc:697] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:49.912266 28528 consensus_queue.cc:237] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.919230 28092 catalog_manager.cc:5697] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 1 to 2, leader changed from 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3) to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:49.924639 28521 raft_consensus.cc:493] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:49.925490 28521 raft_consensus.cc:515] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.927760 28521 leader_election.cc:290] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:49.928712 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f59e84bbf444f4879c6f4bcf79008f" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670a4825d5ed45f697754318dffa6910" is_pre_election: true
I20260709 13:22:49.928893 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f59e84bbf444f4879c6f4bcf79008f" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906" is_pre_election: true
I20260709 13:22:49.929611 28197 raft_consensus.cc:2393] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68e60eb98fc641b49ff635562d526ed8 in current term 1: Already voted for candidate 48bda4cab7c541bf808d72bf4d8cb906 in this term.
I20260709 13:22:49.930806 28309 leader_election.cc:304] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68e60eb98fc641b49ff635562d526ed8; no voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910
I20260709 13:22:49.931175 28528 consensus_queue.cc:1048] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:49.931648 28521 raft_consensus.cc:3060] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:49.941692 28521 raft_consensus.cc:2749] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:49.947599 28511 consensus_queue.cc:1048] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:49.956357 28511 consensus_queue.cc:1048] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:49.957168 28512 raft_consensus.cc:993] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906: : Instructing follower 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:49.957743 28528 raft_consensus.cc:1081] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Signalling peer 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:49.959597 28345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a99cb368c0c490791f108959bf8a0dc"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:55514
I20260709 13:22:49.960083 28345 raft_consensus.cc:493] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:49.960427 28345 raft_consensus.cc:3060] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:49.967700 28345 raft_consensus.cc:515] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.967933 28528 consensus_queue.cc:1048] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:49.970780 28345 leader_election.cc:290] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 2 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:49.974645 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a99cb368c0c490791f108959bf8a0dc" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:49.975128 28271 raft_consensus.cc:3055] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:49.975382 28271 raft_consensus.cc:740] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:49.976123 28271 consensus_queue.cc:260] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.977097 28271 raft_consensus.cc:3060] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:49.977285 28197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a99cb368c0c490791f108959bf8a0dc" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:49.978029 28197 raft_consensus.cc:3060] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:49.984863 28271 raft_consensus.cc:2468] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 2.
I20260709 13:22:49.986152 28312 leader_election.cc:304] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:49.987016 28521 raft_consensus.cc:2804] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:49.987463 28521 raft_consensus.cc:697] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 2 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:49.987687 28197 raft_consensus.cc:2468] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 2.
I20260709 13:22:49.988325 28521 consensus_queue.cc:237] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:49.995689 28094 catalog_manager.cc:5697] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 1 to 2, leader changed from 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2) to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 2 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:50.045238 28521 consensus_queue.cc:1048] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:50.051441 28521 consensus_queue.cc:1048] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:50.053777 28484 raft_consensus.cc:993] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8: : Instructing follower 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:50.054184 28484 raft_consensus.cc:1081] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Signalling peer 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:50.066548 28272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "985693424a0344c59bafdfaadf1cd437"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:22:50.067261 28272 raft_consensus.cc:493] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:50.067701 28272 raft_consensus.cc:3060] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.076380 28272 raft_consensus.cc:515] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.078584 28272 leader_election.cc:290] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:50.079377 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985693424a0344c59bafdfaadf1cd437" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:50.079914 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985693424a0344c59bafdfaadf1cd437" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:50.081105 28196 raft_consensus.cc:3060] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.081257 28345 raft_consensus.cc:3055] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:50.081741 28345 raft_consensus.cc:740] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:50.082666 28345 consensus_queue.cc:260] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.084184 28345 raft_consensus.cc:3060] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.086905 28196 raft_consensus.cc:2468] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:50.088061 28235 leader_election.cc:304] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:50.088734 28528 raft_consensus.cc:2804] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:50.089107 28345 raft_consensus.cc:2468] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:50.089296 28528 raft_consensus.cc:697] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:50.090348 28528 consensus_queue.cc:237] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.097246 28092 catalog_manager.cc:5697] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 1 to 2, leader changed from 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3) to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.155851 28528 raft_consensus.cc:993] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906: : Instructing follower 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:50.156461 28511 raft_consensus.cc:1081] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Signalling peer 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:50.158067 28196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37bfcd2dcacb406880c8d972da5eda7b"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:45134
I20260709 13:22:50.158522 28196 raft_consensus.cc:493] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:50.158815 28196 raft_consensus.cc:3060] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.163923 28196 raft_consensus.cc:515] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.165863 28196 leader_election.cc:290] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:50.167320 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bfcd2dcacb406880c8d972da5eda7b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:50.167310 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bfcd2dcacb406880c8d972da5eda7b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:50.168097 28346 raft_consensus.cc:3060] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.168493 28272 raft_consensus.cc:3055] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:50.168879 28272 raft_consensus.cc:740] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:50.169821 28272 consensus_queue.cc:260] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.171234 28272 raft_consensus.cc:3060] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.175666 28346 raft_consensus.cc:2468] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:50.176981 28163 leader_election.cc:304] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:50.177726 28527 raft_consensus.cc:2804] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:50.178049 28272 raft_consensus.cc:2468] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:50.178231 28527 raft_consensus.cc:697] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:50.179371 28527 consensus_queue.cc:237] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.186018 28092 catalog_manager.cc:5697] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 1 to 2, leader changed from 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2) to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.209836 28521 raft_consensus.cc:993] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8: : Instructing follower 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:50.210383 28484 raft_consensus.cc:1081] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Signalling peer 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:50.212088 28196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:45138
I20260709 13:22:50.212579 28196 raft_consensus.cc:493] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:50.212939 28196 raft_consensus.cc:3060] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.218150 28196 raft_consensus.cc:515] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.219866 28196 leader_election.cc:290] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:50.220392 28521 raft_consensus.cc:993] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8: : Instructing follower 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:50.220860 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:50.221096 28522 raft_consensus.cc:1081] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Signalling peer 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:50.221326 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:50.221481 28272 raft_consensus.cc:3060] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.221917 28346 raft_consensus.cc:3055] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:50.222254 28346 raft_consensus.cc:740] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:50.222973 28346 consensus_queue.cc:260] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.223768 28346 raft_consensus.cc:3060] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.227068 28272 raft_consensus.cc:2468] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:50.227916 28196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b02157fa2fab4254be0bb721f0b12224"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:45138
I20260709 13:22:50.228462 28395 raft_consensus.cc:993] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910: : Instructing follower 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:50.228582 28196 raft_consensus.cc:493] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:50.228636 28163 leader_election.cc:304] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:50.229007 28395 raft_consensus.cc:1081] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Signalling peer 48bda4cab7c541bf808d72bf4d8cb906 to start an election
I20260709 13:22:50.229161 28346 raft_consensus.cc:2468] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:50.229770 28527 raft_consensus.cc:2804] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:50.230396 28527 raft_consensus.cc:697] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:50.229835 28196 raft_consensus.cc:3060] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.231009 28272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:22:50.232035 28527 consensus_queue.cc:237] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.231711 28272 raft_consensus.cc:493] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:50.233166 28272 raft_consensus.cc:3060] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.237864 28196 raft_consensus.cc:515] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.239854 28196 leader_election.cc:290] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:50.241158 28272 raft_consensus.cc:515] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.241390 28092 catalog_manager.cc:5697] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 1 to 2, leader changed from 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3) to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.242230 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b02157fa2fab4254be0bb721f0b12224" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:50.242875 28271 raft_consensus.cc:3060] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.244145 28272 leader_election.cc:290] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:50.245106 28346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:50.245663 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e" candidate_uuid: "48bda4cab7c541bf808d72bf4d8cb906" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:50.246053 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b02157fa2fab4254be0bb721f0b12224" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:50.246455 28196 raft_consensus.cc:3055] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:50.246776 28345 raft_consensus.cc:3055] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:50.245697 28346 raft_consensus.cc:3060] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.247300 28345 raft_consensus.cc:740] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:50.248155 28345 consensus_queue.cc:260] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.249359 28345 raft_consensus.cc:3060] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.251648 28271 raft_consensus.cc:2468] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:50.252954 28163 leader_election.cc:304] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 670a4825d5ed45f697754318dffa6910; no voters: 
I20260709 13:22:50.246802 28196 raft_consensus.cc:740] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:50.253692 28526 raft_consensus.cc:2804] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:50.254181 28346 raft_consensus.cc:2468] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:50.254364 28196 consensus_queue.cc:260] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.254984 28526 raft_consensus.cc:697] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:50.255692 28345 raft_consensus.cc:2468] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:50.255735 28196 raft_consensus.cc:3060] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.255733 28238 leader_election.cc:304] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:50.256070 28526 consensus_queue.cc:237] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.257283 28511 raft_consensus.cc:2804] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:50.257802 28511 raft_consensus.cc:697] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Becoming Leader. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:50.258935 28511 consensus_queue.cc:237] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.262626 28196 raft_consensus.cc:2468] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bda4cab7c541bf808d72bf4d8cb906 in term 2.
I20260709 13:22:50.264613 28092 catalog_manager.cc:5697] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 1 to 2, leader changed from 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3) to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.267100 28093 catalog_manager.cc:5697] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 reported cstate change: term changed from 1 to 2, leader changed from 670a4825d5ed45f697754318dffa6910 (127.15.208.1) to 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "48bda4cab7c541bf808d72bf4d8cb906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.276775 28528 raft_consensus.cc:993] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906: : Instructing follower 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:50.277354 28511 raft_consensus.cc:1081] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Signalling peer 670a4825d5ed45f697754318dffa6910 to start an election
I20260709 13:22:50.278703 28196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa4885758ce64d5bbdf46b0f5eaa3c9c"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
 from {username='slave'} at 127.0.0.1:45134
I20260709 13:22:50.279103 28196 raft_consensus.cc:493] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:50.279336 28196 raft_consensus.cc:3060] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.284015 28196 raft_consensus.cc:515] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.285743 28196 leader_election.cc:290] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3:33095)
I20260709 13:22:50.286749 28272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4885758ce64d5bbdf46b0f5eaa3c9c" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:50.286927 28345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4885758ce64d5bbdf46b0f5eaa3c9c" candidate_uuid: "670a4825d5ed45f697754318dffa6910" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
I20260709 13:22:50.287528 28345 raft_consensus.cc:3060] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.287431 28272 raft_consensus.cc:3055] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:50.288003 28272 raft_consensus.cc:740] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:50.288702 28272 consensus_queue.cc:260] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.289800 28272 raft_consensus.cc:3060] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:50.293541 28345 raft_consensus.cc:2468] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:50.294713 28163 leader_election.cc:304] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:50.295051 28272 raft_consensus.cc:2468] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670a4825d5ed45f697754318dffa6910 in term 2.
I20260709 13:22:50.295526 28526 raft_consensus.cc:2804] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:50.296157 28526 raft_consensus.cc:697] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Becoming Leader. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:50.297181 28526 consensus_queue.cc:237] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:50.303894 28093 catalog_manager.cc:5697] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 reported cstate change: term changed from 1 to 2, leader changed from 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2) to 670a4825d5ed45f697754318dffa6910 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "670a4825d5ed45f697754318dffa6910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:50.397061 28345 raft_consensus.cc:1275] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.398514 28511 consensus_queue.cc:1048] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.406427 28196 raft_consensus.cc:1275] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.408659 28450 consensus_queue.cc:1048] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.460814 28196 raft_consensus.cc:1275] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.461979 28522 consensus_queue.cc:1048] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.469470 28271 raft_consensus.cc:1275] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.471031 28484 consensus_queue.cc:1048] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.587549 28345 raft_consensus.cc:1275] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.588740 28528 consensus_queue.cc:1048] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.592325 28271 raft_consensus.cc:1275] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.594010 28526 consensus_queue.cc:1048] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.595350 28345 raft_consensus.cc:1275] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.596978 28526 consensus_queue.cc:1048] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.601835 28196 raft_consensus.cc:1275] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.613381 28450 consensus_queue.cc:1048] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.650802 28345 raft_consensus.cc:1275] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.652038 28526 consensus_queue.cc:1048] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.659201 28271 raft_consensus.cc:1275] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.660825 28395 consensus_queue.cc:1048] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.672911 28271 raft_consensus.cc:1275] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.674307 28395 consensus_queue.cc:1048] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.686635 28345 raft_consensus.cc:1275] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.688283 28395 consensus_queue.cc:1048] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.720477 28196 raft_consensus.cc:1275] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.721743 28450 consensus_queue.cc:1048] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.731767 28345 raft_consensus.cc:1275] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 48bda4cab7c541bf808d72bf4d8cb906: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.734007 28450 consensus_queue.cc:1048] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.961491 28269 raft_consensus.cc:1275] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.968160 28527 consensus_queue.cc:1048] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:50.978005 28345 raft_consensus.cc:1275] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Refusing update from remote peer 670a4825d5ed45f697754318dffa6910: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:50.979624 28526 consensus_queue.cc:1048] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:51.845715 28126 debug-util.cc:398] Leaking SignalData structure 0x7b0800306ac0 after lost signal to thread 16195
W20260709 13:22:51.846951 28126 debug-util.cc:398] Leaking SignalData structure 0x7b080004e860 after lost signal to thread 28129
W20260709 13:22:51.848253 28126 debug-util.cc:398] Leaking SignalData structure 0x7b080029cdc0 after lost signal to thread 28221
W20260709 13:22:51.849412 28126 debug-util.cc:398] Leaking SignalData structure 0x7b08003910a0 after lost signal to thread 28296
W20260709 13:22:51.850412 28126 debug-util.cc:398] Leaking SignalData structure 0x7b08001be940 after lost signal to thread 28370
I20260709 13:22:52.932708 28093 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37758:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:52.955299 28093 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37758:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:52.986666 16192 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:53.127609 28602 tablet.cc:1724] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.190721 28605 tablet.cc:1724] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:53.242376 28223 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:b02157fa2fab4254be0bb721f0b12224)
W20260709 13:22:53.243391 28223 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:b02157fa2fab4254be0bb721f0b12224)
I20260709 13:22:53.227190 28622 tablet.cc:1724] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.282311 28626 tablet.cc:1724] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.289578 28625 tablet.cc:1724] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.295163 28624 tablet.cc:1724] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:53.311977 28298 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:985693424a0344c59bafdfaadf1cd437)
I20260709 13:22:53.334794 28622 tablet.cc:1724] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.354686 28635 tablet.cc:1724] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.358428 28631 tablet.cc:1724] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.382678 28632 tablet.cc:1724] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.391172 28627 tablet.cc:1724] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:53.394652 28608 log.cc:927] Time spent T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:22:53.400782 28626 tablet.cc:1724] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.419842 28633 tablet.cc:1724] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.437536 28268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
mode: GRACEFUL
new_leader_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:35270
I20260709 13:22:53.438405 28268 raft_consensus.cc:606] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Received request to transfer leadership to TS 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:53.462587 28630 tablet.cc:1724] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.466704 28625 tablet.cc:1724] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.401188 28605 tablet.cc:1724] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:53.473590 28628 log.cc:927] Time spent T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:22:53.483654 28622 tablet.cc:1724] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.492769 28602 tablet.cc:1724] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.507299 28624 tablet.cc:1724] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.510891 28626 tablet.cc:1724] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:53.548832 28309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.1:39447, user_credentials={real_user=slave}} blocked reactor thread for 125150us
I20260709 13:22:53.567787 28605 tablet.cc:1724] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.571382 28633 tablet.cc:1724] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.555894 28625 tablet.cc:1724] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.589140 28586 raft_consensus.cc:993] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906: : Instructing follower 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:53.589609 28196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
mode: GRACEFUL
new_leader_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:58008
I20260709 13:22:53.590370 28196 raft_consensus.cc:606] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Received request to transfer leadership to TS 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:53.589701 28586 raft_consensus.cc:1081] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Signalling peer 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:53.592518 16192 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:22:53.593118 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:22:53.573174 28312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.2:35003, user_credentials={real_user=slave}} blocked reactor thread for 80214.3us
I20260709 13:22:53.595445 28639 raft_consensus.cc:993] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910: : Instructing follower 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:53.595963 28639 raft_consensus.cc:1081] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Signalling peer 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:53.595999 28341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:55514
I20260709 13:22:53.596665 28341 raft_consensus.cc:493] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:53.597101 28341 raft_consensus.cc:3060] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:53.603384 28635 tablet.cc:1724] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.604277 28194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a"
dest_uuid: "670a4825d5ed45f697754318dffa6910"
mode: GRACEFUL
new_leader_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:58008
I20260709 13:22:53.611761 28194 raft_consensus.cc:606] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Received request to transfer leadership to TS 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:53.606295 28626 tablet.cc:1724] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.600524 28624 tablet.cc:1724] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.624106 28631 tablet.cc:1724] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:53.629469 28270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254"
dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
mode: GRACEFUL
new_leader_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:35270
I20260709 13:22:53.630239 28270 raft_consensus.cc:606] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Received request to transfer leadership to TS 68e60eb98fc641b49ff635562d526ed8
I20260709 13:22:53.637730 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:53.638494 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:53.643496 28341 raft_consensus.cc:515] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:53.644141 28340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:55530
I20260709 13:22:53.645838 28527 raft_consensus.cc:993] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910: : Instructing follower 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:53.653658 28340 raft_consensus.cc:493] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:53.653762 28527 raft_consensus.cc:1081] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Signalling peer 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:53.654131 28340 raft_consensus.cc:3060] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:53.655821 28343 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:55530
I20260709 13:22:53.656461 28343 raft_consensus.cc:493] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:53.656813 28343 raft_consensus.cc:3060] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:53.662268 28340 raft_consensus.cc:515] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:53.675765 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:53.676339 28196 raft_consensus.cc:3055] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:53.676601 28196 raft_consensus.cc:740] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:53.677397 28196 consensus_queue.cc:260] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:53.678408 28196 raft_consensus.cc:3060] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:53.666642 28343 raft_consensus.cc:515] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:53.681937 28271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:53.682523 28271 raft_consensus.cc:3060] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:53.686967 28196 raft_consensus.cc:2468] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 3.
I20260709 13:22:53.688522 28309 leader_election.cc:304] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:53.669533 28341 leader_election.cc:290] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 3 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:53.669639 28194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:53.672724 28270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65422adf5a2b4e59850f23785c2ea90e" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:53.690423 28194 raft_consensus.cc:3060] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:53.690740 28270 raft_consensus.cc:3055] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:53.691057 28270 raft_consensus.cc:740] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:53.691923 28270 consensus_queue.cc:260] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:53.689404 28522 raft_consensus.cc:2804] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:53.693115 28522 raft_consensus.cc:697] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 3 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:53.693958 28522 consensus_queue.cc:237] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:53.700273 28194 raft_consensus.cc:2468] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 3.
I20260709 13:22:53.702893 28340 leader_election.cc:290] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 3 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:53.703866 28309 leader_election.cc:304] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:53.706226 28270 raft_consensus.cc:3060] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:53.706614 28645 raft_consensus.cc:2804] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:53.707266 28645 raft_consensus.cc:697] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 3 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:53.708114 28645 consensus_queue.cc:237] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:53.712044 28094 catalog_manager.cc:5697] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 2 to 3, leader changed from 670a4825d5ed45f697754318dffa6910 (127.15.208.1) to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 3 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:53.714237 28268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b3c113e8449f68633518c60c7834b" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:53.714906 28268 raft_consensus.cc:3060] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:53.712605 28271 raft_consensus.cc:2468] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 3.
I20260709 13:22:53.722030 28268 raft_consensus.cc:2468] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 3.
I20260709 13:22:53.725751 28270 raft_consensus.cc:2468] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 3.
I20260709 13:22:53.726491 28312 leader_election.cc:304] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bda4cab7c541bf808d72bf4d8cb906, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:53.729528 28522 raft_consensus.cc:2804] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:53.727522 28343 leader_election.cc:290] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 3 election: Requested vote from peers 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003), 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447)
I20260709 13:22:53.728634 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aeacf1d6cd24a0b9f9cc37f7b7fdc0a" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:53.730347 28522 raft_consensus.cc:697] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 3 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:53.730965 28196 raft_consensus.cc:3055] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:53.731370 28196 raft_consensus.cc:740] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 670a4825d5ed45f697754318dffa6910, State: Running, Role: LEADER
I20260709 13:22:53.731554 28522 consensus_queue.cc:237] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:53.732180 28196 consensus_queue.cc:260] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:53.733349 28196 raft_consensus.cc:3060] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:53.734454 28093 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3: soft_deleted_table [id=abc2f77c0dad4b70abb2ca242929e1ff] alter complete (version 1)
I20260709 13:22:53.744407 28196 raft_consensus.cc:2468] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 3.
I20260709 13:22:53.757066 28092 catalog_manager.cc:5697] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 2 to 3, leader changed from 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2) to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 3 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:53.758682 28092 catalog_manager.cc:5697] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 2 to 3, leader changed from 670a4825d5ed45f697754318dffa6910 (127.15.208.1) to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 3 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:54.109076 28450 raft_consensus.cc:993] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906: : Instructing follower 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:54.109632 28450 raft_consensus.cc:1081] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Signalling peer 68e60eb98fc641b49ff635562d526ed8 to start an election
I20260709 13:22:54.111321 28343 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254"
dest_uuid: "68e60eb98fc641b49ff635562d526ed8"
 from {username='slave'} at 127.0.0.1:55514
I20260709 13:22:54.111902 28343 raft_consensus.cc:493] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:54.112255 28343 raft_consensus.cc:3060] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:54.119302 28343 raft_consensus.cc:515] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:54.122212 28196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "670a4825d5ed45f697754318dffa6910"
I20260709 13:22:54.122298 28343 leader_election.cc:290] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 3 election: Requested vote from peers 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447), 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003)
I20260709 13:22:54.122951 28196 raft_consensus.cc:3060] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:54.123415 28270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1760addd724c0f9fb552ee36ed6254" candidate_uuid: "68e60eb98fc641b49ff635562d526ed8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48bda4cab7c541bf808d72bf4d8cb906"
I20260709 13:22:54.124071 28270 raft_consensus.cc:3055] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:54.124359 28270 raft_consensus.cc:740] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48bda4cab7c541bf808d72bf4d8cb906, State: Running, Role: LEADER
I20260709 13:22:54.125504 28270 consensus_queue.cc:260] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:54.126546 28270 raft_consensus.cc:3060] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:54.130878 28196 raft_consensus.cc:2468] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 3.
I20260709 13:22:54.135670 28309 leader_election.cc:304] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670a4825d5ed45f697754318dffa6910, 68e60eb98fc641b49ff635562d526ed8; no voters: 
I20260709 13:22:54.136619 28522 raft_consensus.cc:2804] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:54.137176 28522 raft_consensus.cc:697] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 3 LEADER]: Becoming Leader. State: Replica: 68e60eb98fc641b49ff635562d526ed8, State: Running, Role: LEADER
I20260709 13:22:54.138103 28522 consensus_queue.cc:237] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } }
I20260709 13:22:54.141736 28270 raft_consensus.cc:2468] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68e60eb98fc641b49ff635562d526ed8 in term 3.
I20260709 13:22:54.151595 28092 catalog_manager.cc:5697] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 reported cstate change: term changed from 2 to 3, leader changed from 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2) to 68e60eb98fc641b49ff635562d526ed8 (127.15.208.3). New cstate: current_term: 3 leader_uuid: "68e60eb98fc641b49ff635562d526ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68e60eb98fc641b49ff635562d526ed8" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:54.162755 28196 raft_consensus.cc:1275] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:54.164351 28522 consensus_queue.cc:1048] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:54.171224 28196 raft_consensus.cc:1275] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:54.172528 28643 consensus_queue.cc:1048] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:54.185969 28270 raft_consensus.cc:1275] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:54.188748 28643 consensus_queue.cc:1048] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:22:54.203715 28268 raft_consensus.cc:1275] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:54.206017 28522 consensus_queue.cc:1048] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:54.259574 28268 raft_consensus.cc:1275] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:54.260917 28522 consensus_queue.cc:1048] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:54.275375 28194 raft_consensus.cc:1275] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:54.276782 28522 consensus_queue.cc:1048] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:54.618882 28195 raft_consensus.cc:1275] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:54.620102 28522 consensus_queue.cc:1048] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670a4825d5ed45f697754318dffa6910" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:54.635959 28268 raft_consensus.cc:1275] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Refusing update from remote peer 68e60eb98fc641b49ff635562d526ed8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:54.637789 28522 consensus_queue.cc:1048] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bda4cab7c541bf808d72bf4d8cb906" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:54.711437 16192 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:54.718283 16192 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:22:54.718719 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:54.724615 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:22:54.725056 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:55.760406 16192 tablet_server.cc:179] TabletServer@127.15.208.1:0 shutting down...
W20260709 13:22:55.788983 28309 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:22:55.792995 28309 consensus_peers.cc:597] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 -> Peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Couldn't send request to peer 670a4825d5ed45f697754318dffa6910. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:55.821532 28235 consensus_peers.cc:597] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 -> Peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Couldn't send request to peer 670a4825d5ed45f697754318dffa6910. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.822672 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:55.823730 16192 tablet_replica.cc:333] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.824797 16192 raft_consensus.cc:2243] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.825518 16192 raft_consensus.cc:2272] T ba4b3c113e8449f68633518c60c7834b P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.828857 16192 tablet_replica.cc:333] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.829921 16192 raft_consensus.cc:2243] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.830500 16192 raft_consensus.cc:2272] T be72366bd2784a428f663c927a754752 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.833293 16192 tablet_replica.cc:333] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.834052 16192 raft_consensus.cc:2243] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:55.834892 16192 raft_consensus.cc:2272] T 37bfcd2dcacb406880c8d972da5eda7b P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.837340 16192 tablet_replica.cc:333] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.837945 16192 raft_consensus.cc:2243] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.838416 16192 raft_consensus.cc:2272] T 65422adf5a2b4e59850f23785c2ea90e P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.840735 16192 tablet_replica.cc:333] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.841701 16192 raft_consensus.cc:2243] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.842240 16192 raft_consensus.cc:2272] T 8a1760addd724c0f9fb552ee36ed6254 P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:55.844594 28309 consensus_peers.cc:597] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 -> Peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Couldn't send request to peer 670a4825d5ed45f697754318dffa6910. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.845309 16192 tablet_replica.cc:333] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.845968 16192 raft_consensus.cc:2243] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.846422 16192 raft_consensus.cc:2272] T 8a99cb368c0c490791f108959bf8a0dc P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.848647 16192 tablet_replica.cc:333] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.849282 16192 raft_consensus.cc:2243] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:55.850185 16192 raft_consensus.cc:2272] T a39cf4769b79418cba18d42cf5b48f36 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.852413 16192 tablet_replica.cc:333] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.853032 16192 raft_consensus.cc:2243] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.853469 16192 raft_consensus.cc:2272] T 985693424a0344c59bafdfaadf1cd437 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.855872 16192 tablet_replica.cc:333] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.856892 16192 raft_consensus.cc:2243] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:55.857913 16192 raft_consensus.cc:2272] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.860862 16192 tablet_replica.cc:333] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.861519 16192 raft_consensus.cc:2243] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:55.861434 28235 consensus_peers.cc:597] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 -> Peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Couldn't send request to peer 670a4825d5ed45f697754318dffa6910. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.862329 16192 raft_consensus.cc:2272] T 8da56053dc834fdf8469e4c8a8e7c339 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.864720 16192 tablet_replica.cc:333] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.865365 16192 raft_consensus.cc:2243] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.865830 16192 raft_consensus.cc:2272] T db9437c1592a45089625cc516da0a6a7 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.868167 16192 tablet_replica.cc:333] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.868920 16192 raft_consensus.cc:2243] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.869356 16192 raft_consensus.cc:2272] T e9f59e84bbf444f4879c6f4bcf79008f P 670a4825d5ed45f697754318dffa6910 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.871578 16192 tablet_replica.cc:333] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.872308 16192 raft_consensus.cc:2243] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.872812 16192 raft_consensus.cc:2272] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 670a4825d5ed45f697754318dffa6910 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.875270 16192 tablet_replica.cc:333] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.875834 16192 raft_consensus.cc:2243] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:55.876658 16192 raft_consensus.cc:2272] T b02157fa2fab4254be0bb721f0b12224 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.878679 16192 tablet_replica.cc:333] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.879222 16192 raft_consensus.cc:2243] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.879765 16192 raft_consensus.cc:2272] T 8c82376d5a634b038bcf6ad535a9338b P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.882296 16192 tablet_replica.cc:333] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.882843 16192 raft_consensus.cc:2243] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:55.883702 16192 raft_consensus.cc:2272] T 65ce1ade2c24457e8d95ecd97739fd25 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.885982 16192 tablet_replica.cc:333] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.886490 16192 raft_consensus.cc:2243] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:55.887280 16192 raft_consensus.cc:2272] T 275c778e0fa744829c0a18cda5b09484 P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.889554 16192 tablet_replica.cc:333] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910: stopping tablet replica
I20260709 13:22:55.890079 16192 raft_consensus.cc:2243] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:55.890529 16192 raft_consensus.cc:2272] T 261e51960d29420590eeeddef0a37f6c P 670a4825d5ed45f697754318dffa6910 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:55.928385 16192 tablet_server.cc:196] TabletServer@127.15.208.1:0 shutdown complete.
W20260709 13:22:55.963632 28235 consensus_peers.cc:597] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 -> Peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Couldn't send request to peer 670a4825d5ed45f697754318dffa6910. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:39447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:55.966188 28235 consensus_peers.cc:597] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 -> Peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Couldn't send request to peer 670a4825d5ed45f697754318dffa6910. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:39447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.973726 16192 tablet_server.cc:179] TabletServer@127.15.208.2:0 shutting down...
W20260709 13:22:55.979123 28309 consensus_peers.cc:597] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 -> Peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Couldn't send request to peer 670a4825d5ed45f697754318dffa6910. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:39447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:56.006155 28312 consensus_peers.cc:597] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 -> Peer 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003): Couldn't send request to peer 48bda4cab7c541bf808d72bf4d8cb906. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:56.007495 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:56.008308 16192 tablet_replica.cc:333] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.009459 16192 raft_consensus.cc:2243] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.010033 16192 raft_consensus.cc:2272] T 65422adf5a2b4e59850f23785c2ea90e P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.012593 16192 tablet_replica.cc:333] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.013372 16192 raft_consensus.cc:2243] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.014156 16192 raft_consensus.cc:2272] T 985693424a0344c59bafdfaadf1cd437 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.016183 16192 tablet_replica.cc:333] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.016746 16192 raft_consensus.cc:2243] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.017278 16192 raft_consensus.cc:2272] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.019361 16192 tablet_replica.cc:333] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.019945 16192 raft_consensus.cc:2243] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.020414 16192 raft_consensus.cc:2272] T ba4b3c113e8449f68633518c60c7834b P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.022478 16192 tablet_replica.cc:333] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.022993 16192 raft_consensus.cc:2243] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.023730 16192 raft_consensus.cc:2272] T be72366bd2784a428f663c927a754752 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.025702 16192 tablet_replica.cc:333] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.026288 16192 raft_consensus.cc:2243] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.026721 16192 raft_consensus.cc:2272] T 37bfcd2dcacb406880c8d972da5eda7b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.028702 16192 tablet_replica.cc:333] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.029326 16192 raft_consensus.cc:2243] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.030140 16192 raft_consensus.cc:2272] T 8c82376d5a634b038bcf6ad535a9338b P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.032135 16192 tablet_replica.cc:333] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.032644 16192 raft_consensus.cc:2243] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.033145 16192 raft_consensus.cc:2272] T b02157fa2fab4254be0bb721f0b12224 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.035161 16192 tablet_replica.cc:333] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.035692 16192 raft_consensus.cc:2243] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.036489 16192 raft_consensus.cc:2272] T 8da56053dc834fdf8469e4c8a8e7c339 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.038434 16192 tablet_replica.cc:333] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.038978 16192 raft_consensus.cc:2243] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.039376 16192 raft_consensus.cc:2272] T 8a1760addd724c0f9fb552ee36ed6254 P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.041281 16192 tablet_replica.cc:333] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.041867 16192 raft_consensus.cc:2243] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.042660 16192 raft_consensus.cc:2272] T db9437c1592a45089625cc516da0a6a7 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.044798 16192 tablet_replica.cc:333] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.045382 16192 raft_consensus.cc:2243] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.045806 16192 raft_consensus.cc:2272] T 65ce1ade2c24457e8d95ecd97739fd25 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.047811 16192 tablet_replica.cc:333] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.048347 16192 raft_consensus.cc:2243] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.049170 16192 raft_consensus.cc:2272] T e9f59e84bbf444f4879c6f4bcf79008f P 48bda4cab7c541bf808d72bf4d8cb906 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.050923 16192 tablet_replica.cc:333] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.051429 16192 raft_consensus.cc:2243] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.051862 16192 raft_consensus.cc:2272] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 48bda4cab7c541bf808d72bf4d8cb906 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.053861 16192 tablet_replica.cc:333] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.054337 16192 raft_consensus.cc:2243] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.054740 16192 raft_consensus.cc:2272] T 261e51960d29420590eeeddef0a37f6c P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.056826 16192 tablet_replica.cc:333] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.057340 16192 raft_consensus.cc:2243] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.057760 16192 raft_consensus.cc:2272] T 275c778e0fa744829c0a18cda5b09484 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.059842 16192 tablet_replica.cc:333] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.060357 16192 raft_consensus.cc:2243] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.060858 16192 raft_consensus.cc:2272] T 8a99cb368c0c490791f108959bf8a0dc P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.062649 16192 tablet_replica.cc:333] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906: stopping tablet replica
I20260709 13:22:56.063125 16192 raft_consensus.cc:2243] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.063565 16192 raft_consensus.cc:2272] T a39cf4769b79418cba18d42cf5b48f36 P 48bda4cab7c541bf808d72bf4d8cb906 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.104351 16192 tablet_server.cc:196] TabletServer@127.15.208.2:0 shutdown complete.
W20260709 13:22:56.112052 28309 consensus_peers.cc:597] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 -> Peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Couldn't send request to peer 670a4825d5ed45f697754318dffa6910. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:39447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:56.140460 16192 tablet_server.cc:179] TabletServer@127.15.208.3:0 shutting down...
W20260709 13:22:56.160028 28312 consensus_peers.cc:597] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 -> Peer 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003): Couldn't send request to peer 48bda4cab7c541bf808d72bf4d8cb906. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:35003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:56.160449 28312 consensus_peers.cc:597] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 -> Peer 48bda4cab7c541bf808d72bf4d8cb906 (127.15.208.2:35003): Couldn't send request to peer 48bda4cab7c541bf808d72bf4d8cb906. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.2:35003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:56.173023 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:56.173868 16192 tablet_replica.cc:333] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.174520 16192 raft_consensus.cc:2243] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.175315 16192 raft_consensus.cc:2272] T 65422adf5a2b4e59850f23785c2ea90e P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.177241 16192 tablet_replica.cc:333] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.177840 16192 raft_consensus.cc:2243] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.178598 16192 raft_consensus.cc:2272] T ba4b3c113e8449f68633518c60c7834b P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.180765 16192 tablet_replica.cc:333] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.181403 16192 raft_consensus.cc:2243] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.181840 16192 raft_consensus.cc:2272] T 37bfcd2dcacb406880c8d972da5eda7b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.183844 16192 tablet_replica.cc:333] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.184392 16192 raft_consensus.cc:2243] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.184819 16192 raft_consensus.cc:2272] T be72366bd2784a428f663c927a754752 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.186776 16192 tablet_replica.cc:333] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.187374 16192 raft_consensus.cc:2243] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.187858 16192 raft_consensus.cc:2272] T fa4885758ce64d5bbdf46b0f5eaa3c9c P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.189812 16192 tablet_replica.cc:333] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.190341 16192 raft_consensus.cc:2243] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.190761 16192 raft_consensus.cc:2272] T 985693424a0344c59bafdfaadf1cd437 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.193696 16192 tablet_replica.cc:333] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.194363 16192 raft_consensus.cc:2243] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.194872 16192 raft_consensus.cc:2272] T 8c82376d5a634b038bcf6ad535a9338b P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:56.197732 28309 consensus_peers.cc:597] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 -> Peer 670a4825d5ed45f697754318dffa6910 (127.15.208.1:39447): Couldn't send request to peer 670a4825d5ed45f697754318dffa6910. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:39447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:56.197885 16192 tablet_replica.cc:333] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.198575 16192 raft_consensus.cc:2243] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.199072 16192 raft_consensus.cc:2272] T b02157fa2fab4254be0bb721f0b12224 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.201196 16192 tablet_replica.cc:333] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.201752 16192 raft_consensus.cc:2243] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.202521 16192 raft_consensus.cc:2272] T 8a1760addd724c0f9fb552ee36ed6254 P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.204596 16192 tablet_replica.cc:333] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.205219 16192 raft_consensus.cc:2243] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.205681 16192 raft_consensus.cc:2272] T db9437c1592a45089625cc516da0a6a7 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.207906 16192 tablet_replica.cc:333] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.208444 16192 raft_consensus.cc:2243] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.208968 16192 raft_consensus.cc:2272] T 8da56053dc834fdf8469e4c8a8e7c339 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.210978 16192 tablet_replica.cc:333] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.211560 16192 raft_consensus.cc:2243] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.212018 16192 raft_consensus.cc:2272] T 275c778e0fa744829c0a18cda5b09484 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.214183 16192 tablet_replica.cc:333] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.214761 16192 raft_consensus.cc:2243] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.215570 16192 raft_consensus.cc:2272] T 261e51960d29420590eeeddef0a37f6c P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.217864 16192 tablet_replica.cc:333] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.218407 16192 raft_consensus.cc:2243] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.219168 16192 raft_consensus.cc:2272] T 8a99cb368c0c490791f108959bf8a0dc P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.221216 16192 tablet_replica.cc:333] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.221763 16192 raft_consensus.cc:2243] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.222198 16192 raft_consensus.cc:2272] T a39cf4769b79418cba18d42cf5b48f36 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.224258 16192 tablet_replica.cc:333] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.224766 16192 raft_consensus.cc:2243] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.225222 16192 raft_consensus.cc:2272] T 65ce1ade2c24457e8d95ecd97739fd25 P 68e60eb98fc641b49ff635562d526ed8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.227242 16192 tablet_replica.cc:333] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.227746 16192 raft_consensus.cc:2243] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:56.228159 16192 raft_consensus.cc:2272] T e9f59e84bbf444f4879c6f4bcf79008f P 68e60eb98fc641b49ff635562d526ed8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.230063 16192 tablet_replica.cc:333] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8: stopping tablet replica
I20260709 13:22:56.230531 16192 raft_consensus.cc:2243] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.231292 16192 raft_consensus.cc:2272] T 7aeacf1d6cd24a0b9f9cc37f7b7fdc0a P 68e60eb98fc641b49ff635562d526ed8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.276743 16192 tablet_server.cc:196] TabletServer@127.15.208.3:0 shutdown complete.
I20260709 13:22:56.310387 16192 master.cc:562] Master@127.15.208.62:34997 shutting down...
I20260709 13:22:56.331725 16192 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:56.332310 16192 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:56.332670 16192 tablet_replica.cc:333] T 00000000000000000000000000000000 P 45c76608aa374f9795b9ae0776efabe3: stopping tablet replica
I20260709 13:22:56.372164 16192 master.cc:584] Master@127.15.208.62:34997 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12973 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:22:56.427642 16192 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.208.62:32939
I20260709 13:22:56.428686 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:56.434779 28669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:56.435243 28670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:56.435607 28672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:56.435981 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:56.436973 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:56.437155 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:56.437269 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603376437259 us; error 0 us; skew 500 ppm
I20260709 13:22:56.437693 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:56.440073 16192 webserver.cc:533] Webserver started at http://127.15.208.62:33387/ using document root <none> and password file <none>
I20260709 13:22:56.440477 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:56.440627 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:56.440888 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:56.441912 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/master-0-root/instance:
uuid: "e87850376a0c46d5809ab37440beba04"
format_stamp: "Formatted at 2026-07-09 13:22:56 on dist-test-slave-w3b1"
I20260709 13:22:56.446069 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:56.449368 28677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:56.450093 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:56.450333 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/master-0-root
uuid: "e87850376a0c46d5809ab37440beba04"
format_stamp: "Formatted at 2026-07-09 13:22:56 on dist-test-slave-w3b1"
I20260709 13:22:56.450557 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:56.460592 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:56.461783 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:56.499455 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.62:32939
I20260709 13:22:56.499584 28728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.62:32939 every 8 connection(s)
I20260709 13:22:56.503306 28729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.513825 28729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04: Bootstrap starting.
I20260709 13:22:56.518538 28729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.522846 28729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04: No bootstrap required, opened a new log
I20260709 13:22:56.525034 28729 raft_consensus.cc:359] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e87850376a0c46d5809ab37440beba04" member_type: VOTER }
I20260709 13:22:56.525431 28729 raft_consensus.cc:385] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.525687 28729 raft_consensus.cc:740] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87850376a0c46d5809ab37440beba04, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.526327 28729 consensus_queue.cc:260] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e87850376a0c46d5809ab37440beba04" member_type: VOTER }
I20260709 13:22:56.526794 28729 raft_consensus.cc:399] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:56.527016 28729 raft_consensus.cc:493] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:56.527288 28729 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.532174 28729 raft_consensus.cc:515] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e87850376a0c46d5809ab37440beba04" member_type: VOTER }
I20260709 13:22:56.532711 28729 leader_election.cc:304] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e87850376a0c46d5809ab37440beba04; no voters: 
I20260709 13:22:56.533957 28729 leader_election.cc:290] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:56.534392 28732 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:56.535800 28732 raft_consensus.cc:697] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 1 LEADER]: Becoming Leader. State: Replica: e87850376a0c46d5809ab37440beba04, State: Running, Role: LEADER
I20260709 13:22:56.536473 28732 consensus_queue.cc:237] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e87850376a0c46d5809ab37440beba04" member_type: VOTER }
I20260709 13:22:56.537022 28729 sys_catalog.cc:565] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:56.540639 28733 sys_catalog.cc:455] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e87850376a0c46d5809ab37440beba04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e87850376a0c46d5809ab37440beba04" member_type: VOTER } }
I20260709 13:22:56.541414 28733 sys_catalog.cc:458] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:56.541056 28734 sys_catalog.cc:455] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e87850376a0c46d5809ab37440beba04. Latest consensus state: current_term: 1 leader_uuid: "e87850376a0c46d5809ab37440beba04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e87850376a0c46d5809ab37440beba04" member_type: VOTER } }
I20260709 13:22:56.542107 28734 sys_catalog.cc:458] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:56.546197 28738 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:56.552699 28738 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:56.553850 16192 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:56.561442 28738 catalog_manager.cc:1383] Generated new cluster ID: 0b0606fba498465094680b6b85b1a143
I20260709 13:22:56.561735 28738 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:56.584161 28738 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:56.585690 28738 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:56.601576 28738 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04: Generated new TSK 0
I20260709 13:22:56.602212 28738 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:56.620651 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:56.626791 28750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:56.627854 28751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:56.630124 28753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:56.630198 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:56.631531 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:56.631758 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:56.631927 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603376631904 us; error 0 us; skew 500 ppm
I20260709 13:22:56.632433 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:56.634891 16192 webserver.cc:533] Webserver started at http://127.15.208.1:43291/ using document root <none> and password file <none>
I20260709 13:22:56.635426 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:56.635632 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:56.635893 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:56.637050 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-0-root/instance:
uuid: "50315581143f4831ac7a5c7ef9900319"
format_stamp: "Formatted at 2026-07-09 13:22:56 on dist-test-slave-w3b1"
I20260709 13:22:56.641606 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:22:56.645032 28758 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:56.645870 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:22:56.646195 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-0-root
uuid: "50315581143f4831ac7a5c7ef9900319"
format_stamp: "Formatted at 2026-07-09 13:22:56 on dist-test-slave-w3b1"
I20260709 13:22:56.646512 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:56.670724 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:56.671955 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:56.673436 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:56.675720 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:56.675941 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:56.676205 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:56.676393 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:56.721539 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.1:40539
I20260709 13:22:56.721676 28820 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.1:40539 every 8 connection(s)
I20260709 13:22:56.726418 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:56.733548 28825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:56.735556 28826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:56.738104 28828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:56.739243 16192 server_base.cc:1061] running on GCE node
I20260709 13:22:56.740024 28821 heartbeater.cc:344] Connected to a master server at 127.15.208.62:32939
I20260709 13:22:56.740461 28821 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:56.740495 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:56.740828 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:56.741034 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603376740999 us; error 0 us; skew 500 ppm
I20260709 13:22:56.741376 28821 heartbeater.cc:507] Master 127.15.208.62:32939 requested a full tablet report, sending...
I20260709 13:22:56.741628 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:56.743767 28694 ts_manager.cc:194] Registered new tserver with Master: 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539)
I20260709 13:22:56.744557 16192 webserver.cc:533] Webserver started at http://127.15.208.2:42191/ using document root <none> and password file <none>
I20260709 13:22:56.745293 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:56.745529 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:56.745827 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:56.746361 28694 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37598
I20260709 13:22:56.747408 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-1-root/instance:
uuid: "b7eaf45ade8d44d8b662b95708097db9"
format_stamp: "Formatted at 2026-07-09 13:22:56 on dist-test-slave-w3b1"
I20260709 13:22:56.752292 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:56.755576 28833 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:56.756387 16192 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:56.756695 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-1-root
uuid: "b7eaf45ade8d44d8b662b95708097db9"
format_stamp: "Formatted at 2026-07-09 13:22:56 on dist-test-slave-w3b1"
I20260709 13:22:56.757042 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:56.778211 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:56.779464 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:56.780989 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:56.783349 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:56.783574 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:56.783828 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:56.784001 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:56.823828 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.2:34621
I20260709 13:22:56.823938 28895 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.2:34621 every 8 connection(s)
I20260709 13:22:56.828745 16192 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:56.836248 28899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:56.837435 28900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:56.840221 16192 server_base.cc:1061] running on GCE node
W20260709 13:22:56.840730 28902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:56.841576 28896 heartbeater.cc:344] Connected to a master server at 127.15.208.62:32939
I20260709 13:22:56.841929 16192 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:56.842001 28896 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:56.842243 16192 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:56.842484 16192 hybrid_clock.cc:648] HybridClock initialized: now 1783603376842461 us; error 0 us; skew 500 ppm
I20260709 13:22:56.842937 28896 heartbeater.cc:507] Master 127.15.208.62:32939 requested a full tablet report, sending...
I20260709 13:22:56.843073 16192 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:56.845337 28694 ts_manager.cc:194] Registered new tserver with Master: b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:56.845953 16192 webserver.cc:533] Webserver started at http://127.15.208.3:36845/ using document root <none> and password file <none>
I20260709 13:22:56.846491 16192 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:56.846714 16192 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:56.846972 16192 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:56.846957 28694 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37600
I20260709 13:22:56.848740 16192 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-2-root/instance:
uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
format_stamp: "Formatted at 2026-07-09 13:22:56 on dist-test-slave-w3b1"
I20260709 13:22:56.853322 16192 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:56.856572 28907 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:56.857738 16192 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:22:56.857988 16192 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-2-root
uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
format_stamp: "Formatted at 2026-07-09 13:22:56 on dist-test-slave-w3b1"
I20260709 13:22:56.858227 16192 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task4ROets/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603004946521-16192-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:56.881502 16192 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:56.882809 16192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:56.884321 16192 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:56.886556 16192 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:56.886746 16192 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:56.887048 16192 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:56.887205 16192 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:56.927102 16192 rpc_server.cc:307] RPC server started. Bound to: 127.15.208.3:43697
I20260709 13:22:56.927219 28969 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.208.3:43697 every 8 connection(s)
I20260709 13:22:56.942600 28970 heartbeater.cc:344] Connected to a master server at 127.15.208.62:32939
I20260709 13:22:56.943135 28970 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:56.943986 28970 heartbeater.cc:507] Master 127.15.208.62:32939 requested a full tablet report, sending...
I20260709 13:22:56.945981 28694 ts_manager.cc:194] Registered new tserver with Master: fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:56.946252 16192 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01602999s
I20260709 13:22:56.947504 28694 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37602
I20260709 13:22:56.972398 28694 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37608:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:56.975311 28694 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:57.051951 28935 tablet_service.cc:1511] Processing CreateTablet for tablet 6c300961d77a49ffa8d1c428dc2ed841 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:57.053210 28933 tablet_service.cc:1511] Processing CreateTablet for tablet 433b9c6f78a34d03a0868a819d6197cc (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:57.053541 28935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c300961d77a49ffa8d1c428dc2ed841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.054836 28934 tablet_service.cc:1511] Processing CreateTablet for tablet b86fe15b142a4736ba19dd5b5ca4356e (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:57.056172 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86fe15b142a4736ba19dd5b5ca4356e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.057291 28933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 433b9c6f78a34d03a0868a819d6197cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.059055 28932 tablet_service.cc:1511] Processing CreateTablet for tablet f3e8aaa4249849b6864c20dbb553a2cb (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:57.060580 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e8aaa4249849b6864c20dbb553a2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.080643 28861 tablet_service.cc:1511] Processing CreateTablet for tablet 6c300961d77a49ffa8d1c428dc2ed841 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:57.082237 28861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c300961d77a49ffa8d1c428dc2ed841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.083308 28784 tablet_service.cc:1511] Processing CreateTablet for tablet 433b9c6f78a34d03a0868a819d6197cc (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:57.085969 28782 tablet_service.cc:1511] Processing CreateTablet for tablet 56b8817d457f4c5ea9a62fdcc8b756ff (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:57.088629 28859 tablet_service.cc:1511] Processing CreateTablet for tablet 433b9c6f78a34d03a0868a819d6197cc (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:57.090385 28859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 433b9c6f78a34d03a0868a819d6197cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.093514 28786 tablet_service.cc:1511] Processing CreateTablet for tablet 6c300961d77a49ffa8d1c428dc2ed841 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:57.096544 28785 tablet_service.cc:1511] Processing CreateTablet for tablet b86fe15b142a4736ba19dd5b5ca4356e (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:57.095608 28783 tablet_service.cc:1511] Processing CreateTablet for tablet f3e8aaa4249849b6864c20dbb553a2cb (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:57.099049 28784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 433b9c6f78a34d03a0868a819d6197cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.100723 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86fe15b142a4736ba19dd5b5ca4356e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.102584 28786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c300961d77a49ffa8d1c428dc2ed841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.104357 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e8aaa4249849b6864c20dbb553a2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.105237 28860 tablet_service.cc:1511] Processing CreateTablet for tablet b86fe15b142a4736ba19dd5b5ca4356e (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:57.107393 28860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86fe15b142a4736ba19dd5b5ca4356e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.109500 28858 tablet_service.cc:1511] Processing CreateTablet for tablet f3e8aaa4249849b6864c20dbb553a2cb (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:57.111382 28858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3e8aaa4249849b6864c20dbb553a2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.100373 28857 tablet_service.cc:1511] Processing CreateTablet for tablet 56b8817d457f4c5ea9a62fdcc8b756ff (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:57.115223 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b8817d457f4c5ea9a62fdcc8b756ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.116752 28782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b8817d457f4c5ea9a62fdcc8b756ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.128233 28985 tablet_bootstrap.cc:492] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:22:57.132151 28781 tablet_service.cc:1511] Processing CreateTablet for tablet f8684efda0df426eae166d3657400989 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:57.133965 28781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8684efda0df426eae166d3657400989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.134090 28856 tablet_service.cc:1511] Processing CreateTablet for tablet f8684efda0df426eae166d3657400989 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:57.135603 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8684efda0df426eae166d3657400989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.136713 28985 tablet_bootstrap.cc:654] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.140503 28780 tablet_service.cc:1511] Processing CreateTablet for tablet c716168074ec471191341541441dfbcb (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:57.142007 28780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c716168074ec471191341541441dfbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.149045 28985 tablet_bootstrap.cc:492] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:22:57.149868 28985 ts_tablet_manager.cc:1403] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.012s
I20260709 13:22:57.153088 28985 raft_consensus.cc:359] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.154008 28985 raft_consensus.cc:385] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.154772 28933 tablet_service.cc:1511] Processing CreateTablet for tablet 56b8817d457f4c5ea9a62fdcc8b756ff (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:57.155447 28932 tablet_service.cc:1511] Processing CreateTablet for tablet f8684efda0df426eae166d3657400989 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:57.156227 28933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b8817d457f4c5ea9a62fdcc8b756ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.156929 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8684efda0df426eae166d3657400989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.157539 28855 tablet_service.cc:1511] Processing CreateTablet for tablet c716168074ec471191341541441dfbcb (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:57.158867 28855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c716168074ec471191341541441dfbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.154374 28985 raft_consensus.cc:740] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.167411 28985 consensus_queue.cc:260] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.170214 28779 tablet_service.cc:1511] Processing CreateTablet for tablet 20a1dc8dbb1643fb947fd70d65f59628 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:57.171775 28779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a1dc8dbb1643fb947fd70d65f59628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.175408 28934 tablet_service.cc:1511] Processing CreateTablet for tablet c716168074ec471191341541441dfbcb (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:57.176883 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c716168074ec471191341541441dfbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.183220 28854 tablet_service.cc:1511] Processing CreateTablet for tablet 20a1dc8dbb1643fb947fd70d65f59628 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:57.184717 28854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a1dc8dbb1643fb947fd70d65f59628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.190215 28932 tablet_service.cc:1511] Processing CreateTablet for tablet 20a1dc8dbb1643fb947fd70d65f59628 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:57.191797 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a1dc8dbb1643fb947fd70d65f59628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.196697 28778 tablet_service.cc:1511] Processing CreateTablet for tablet ba72a4f311ef4c589ef49c92b8af7f93 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:57.198273 28778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba72a4f311ef4c589ef49c92b8af7f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.222178 28853 tablet_service.cc:1511] Processing CreateTablet for tablet ba72a4f311ef4c589ef49c92b8af7f93 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:57.223606 28853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba72a4f311ef4c589ef49c92b8af7f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.273577 28988 tablet_bootstrap.cc:492] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:22:57.278648 28985 ts_tablet_manager.cc:1434] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.128s	user 0.036s	sys 0.023s
I20260709 13:22:57.279721 28970 heartbeater.cc:499] Master 127.15.208.62:32939 was elected leader, sending a full tablet report...
I20260709 13:22:57.280030 28985 tablet_bootstrap.cc:492] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:22:57.285415 28989 tablet_bootstrap.cc:492] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:22:57.291728 28989 tablet_bootstrap.cc:654] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.293951 28933 tablet_service.cc:1511] Processing CreateTablet for tablet ba72a4f311ef4c589ef49c92b8af7f93 (DEFAULT_TABLE table=test-workload [id=8422010d61474901b0df51c2a1f2458f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:57.295332 28933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba72a4f311ef4c589ef49c92b8af7f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.305759 28985 tablet_bootstrap.cc:654] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.306763 28988 tablet_bootstrap.cc:654] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.325979 28989 tablet_bootstrap.cc:492] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:22:57.326594 28989 ts_tablet_manager.cc:1403] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.007s
I20260709 13:22:57.327375 28985 tablet_bootstrap.cc:492] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:22:57.328158 28985 ts_tablet_manager.cc:1403] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.001s
I20260709 13:22:57.329821 28989 raft_consensus.cc:359] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.330688 28989 raft_consensus.cc:385] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.331058 28989 raft_consensus.cc:740] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.332052 28989 consensus_queue.cc:260] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.330914 28985 raft_consensus.cc:359] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } }
I20260709 13:22:57.333962 28985 raft_consensus.cc:385] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.334306 28985 raft_consensus.cc:740] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.335222 28985 consensus_queue.cc:260] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } }
I20260709 13:22:57.337491 28985 ts_tablet_manager.cc:1434] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:22:57.338644 28985 tablet_bootstrap.cc:492] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:22:57.342478 28987 raft_consensus.cc:493] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.343060 28987 raft_consensus.cc:515] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.346539 28985 tablet_bootstrap.cc:654] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.354451 28987 leader_election.cc:290] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:57.359123 28896 heartbeater.cc:499] Master 127.15.208.62:32939 was elected leader, sending a full tablet report...
I20260709 13:22:57.359438 28989 ts_tablet_manager.cc:1434] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.032s	user 0.015s	sys 0.011s
I20260709 13:22:57.360692 28989 tablet_bootstrap.cc:492] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:22:57.363322 28988 tablet_bootstrap.cc:492] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:22:57.363863 28988 ts_tablet_manager.cc:1403] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.015s
I20260709 13:22:57.367125 28989 tablet_bootstrap.cc:654] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.369029 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
W20260709 13:22:57.370517 28911 leader_election.cc:343] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.371076 28988 raft_consensus.cc:359] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.380625 28988 raft_consensus.cc:385] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.381184 28988 raft_consensus.cc:740] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.382018 28989 tablet_bootstrap.cc:492] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:22:57.382388 28988 consensus_queue.cc:260] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.385854 28989 ts_tablet_manager.cc:1403] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 13:22:57.387007 28821 heartbeater.cc:499] Master 127.15.208.62:32939 was elected leader, sending a full tablet report...
I20260709 13:22:57.388319 28989 raft_consensus.cc:359] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.388976 28989 raft_consensus.cc:385] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.389227 28989 raft_consensus.cc:740] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.389904 28989 consensus_queue.cc:260] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.391831 28989 ts_tablet_manager.cc:1434] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:22:57.392765 28989 tablet_bootstrap.cc:492] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:22:57.399240 28989 tablet_bootstrap.cc:654] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.404148 28989 tablet_bootstrap.cc:492] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:22:57.404580 28989 ts_tablet_manager.cc:1403] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:22:57.406184 28988 ts_tablet_manager.cc:1434] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 13:22:57.407750 28988 tablet_bootstrap.cc:492] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:22:57.407552 28989 raft_consensus.cc:359] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.408416 28989 raft_consensus.cc:385] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.408772 28989 raft_consensus.cc:740] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.409732 28989 consensus_queue.cc:260] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.411201 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:22:57.412358 28989 ts_tablet_manager.cc:1434] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:22:57.413482 28989 tablet_bootstrap.cc:492] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:22:57.414911 28988 tablet_bootstrap.cc:654] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:57.415124 28910 leader_election.cc:343] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.415807 28910 leader_election.cc:304] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9
I20260709 13:22:57.420011 28989 tablet_bootstrap.cc:654] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.420722 28987 raft_consensus.cc:2749] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.420998 28985 tablet_bootstrap.cc:492] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:22:57.421504 28985 ts_tablet_manager.cc:1403] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.083s	user 0.033s	sys 0.026s
I20260709 13:22:57.421823 28987 raft_consensus.cc:493] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.422318 28987 raft_consensus.cc:515] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } }
I20260709 13:22:57.424526 28985 raft_consensus.cc:359] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.425272 28985 raft_consensus.cc:385] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.425251 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c300961d77a49ffa8d1c428dc2ed841" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:57.425797 28985 raft_consensus.cc:740] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
W20260709 13:22:57.426966 28911 leader_election.cc:343] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.428156 28987 leader_election.cc:290] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539)
I20260709 13:22:57.426751 28985 consensus_queue.cc:260] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.429312 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c300961d77a49ffa8d1c428dc2ed841" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:22:57.430601 28985 ts_tablet_manager.cc:1434] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260709 13:22:57.430954 28910 leader_election.cc:343] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.431502 28910 leader_election.cc:304] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9
W20260709 13:22:57.431959 28971 tablet.cc:2406] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:57.433571 28989 tablet_bootstrap.cc:492] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:22:57.434559 28988 tablet_bootstrap.cc:492] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:22:57.434823 28985 tablet_bootstrap.cc:492] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:22:57.434641 28989 ts_tablet_manager.cc:1403] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:22:57.435276 28988 ts_tablet_manager.cc:1403] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 13:22:57.438099 28989 raft_consensus.cc:359] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.438478 28988 raft_consensus.cc:359] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } }
I20260709 13:22:57.439038 28989 raft_consensus.cc:385] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.439352 28988 raft_consensus.cc:385] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.439452 28989 raft_consensus.cc:740] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.439834 28988 raft_consensus.cc:740] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.440568 28989 consensus_queue.cc:260] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.440807 28988 consensus_queue.cc:260] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } }
I20260709 13:22:57.441504 28985 tablet_bootstrap.cc:654] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.443379 28989 ts_tablet_manager.cc:1434] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:22:57.443414 28988 ts_tablet_manager.cc:1434] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:57.444746 28988 tablet_bootstrap.cc:492] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:22:57.444867 28989 tablet_bootstrap.cc:492] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:22:57.447028 28987 raft_consensus.cc:2749] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.449062 28997 raft_consensus.cc:493] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.449546 28997 raft_consensus.cc:515] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } }
I20260709 13:22:57.453418 28989 tablet_bootstrap.cc:654] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.453418 28985 tablet_bootstrap.cc:492] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:22:57.454313 28985 ts_tablet_manager.cc:1403] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:22:57.457876 28985 raft_consensus.cc:359] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.458879 28985 raft_consensus.cc:385] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.459322 28985 raft_consensus.cc:740] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.460415 28985 consensus_queue.cc:260] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.463833 28997 leader_election.cc:290] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:57.470748 28989 tablet_bootstrap.cc:492] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:22:57.471527 28989 ts_tablet_manager.cc:1403] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.000s
I20260709 13:22:57.474030 28985 ts_tablet_manager.cc:1434] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:22:57.475099 28985 tablet_bootstrap.cc:492] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:22:57.472739 28988 tablet_bootstrap.cc:654] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.477494 28989 raft_consensus.cc:359] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.478307 28989 raft_consensus.cc:385] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.478602 28989 raft_consensus.cc:740] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.479377 28989 consensus_queue.cc:260] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.481755 28989 ts_tablet_manager.cc:1434] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:57.482795 28989 tablet_bootstrap.cc:492] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:22:57.491851 28985 tablet_bootstrap.cc:654] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.492437 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c300961d77a49ffa8d1c428dc2ed841" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:57.493460 28945 raft_consensus.cc:2468] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 0.
I20260709 13:22:57.495045 28759 leader_election.cc:304] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:22:57.495967 28997 raft_consensus.cc:2804] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.496172 28988 tablet_bootstrap.cc:492] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:22:57.496460 28997 raft_consensus.cc:493] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.496178 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c300961d77a49ffa8d1c428dc2ed841" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:57.496969 28988 ts_tablet_manager.cc:1403] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.000s
I20260709 13:22:57.497064 28997 raft_consensus.cc:3060] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:57.498238 28762 leader_election.cc:343] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.499267 28989 tablet_bootstrap.cc:654] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.500375 28988 raft_consensus.cc:359] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.501269 28988 raft_consensus.cc:385] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.501551 28988 raft_consensus.cc:740] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.502493 28988 consensus_queue.cc:260] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.505614 28997 raft_consensus.cc:515] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } }
I20260709 13:22:57.508817 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c300961d77a49ffa8d1c428dc2ed841" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:57.509613 28945 raft_consensus.cc:3060] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.510691 28985 tablet_bootstrap.cc:492] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:22:57.511487 28985 ts_tablet_manager.cc:1403] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.006s
I20260709 13:22:57.515159 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c300961d77a49ffa8d1c428dc2ed841" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
W20260709 13:22:57.517377 28762 leader_election.cc:343] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.518177 28997 leader_election.cc:290] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Requested vote from peers fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:57.522277 28985 raft_consensus.cc:359] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.523420 28985 raft_consensus.cc:385] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.523795 28985 raft_consensus.cc:740] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.524820 28985 consensus_queue.cc:260] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.530459 28985 ts_tablet_manager.cc:1434] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:22:57.531888 28985 tablet_bootstrap.cc:492] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:22:57.527226 28945 raft_consensus.cc:2468] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 1.
I20260709 13:22:57.538499 28759 leader_election.cc:304] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: b7eaf45ade8d44d8b662b95708097db9
I20260709 13:22:57.540556 28993 raft_consensus.cc:493] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.541326 28993 raft_consensus.cc:515] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.542673 28985 tablet_bootstrap.cc:654] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.547242 28987 raft_consensus.cc:493] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.547829 28987 raft_consensus.cc:515] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.552393 28987 leader_election.cc:290] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:57.552902 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:22:57.553643 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:57.554544 28871 raft_consensus.cc:2468] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 0.
W20260709 13:22:57.555114 28910 leader_election.cc:343] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.556264 28911 leader_election.cc:304] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:22:57.557439 28987 raft_consensus.cc:2804] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.558041 28987 raft_consensus.cc:493] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.558535 28987 raft_consensus.cc:3060] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.562067 28993 leader_election.cc:290] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:57.563046 28997 raft_consensus.cc:2804] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.563796 28997 raft_consensus.cc:697] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Becoming Leader. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:22:57.564982 28997 consensus_queue.cc:237] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } }
W20260709 13:22:57.567143 28742 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:57.569753 28987 raft_consensus.cc:515] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.617584 28988 ts_tablet_manager.cc:1434] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.120s	user 0.021s	sys 0.041s
I20260709 13:22:57.632992 28988 tablet_bootstrap.cc:492] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:22:57.645414 28985 tablet_bootstrap.cc:492] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:22:57.652150 28985 ts_tablet_manager.cc:1403] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.121s	user 0.041s	sys 0.029s
I20260709 13:22:57.652642 28993 raft_consensus.cc:493] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.653281 28993 raft_consensus.cc:515] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.644529 28989 tablet_bootstrap.cc:492] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:22:57.655462 28989 ts_tablet_manager.cc:1403] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.173s	user 0.050s	sys 0.047s
I20260709 13:22:57.655596 28985 raft_consensus.cc:359] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.656598 28985 raft_consensus.cc:385] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.655499 28993 leader_election.cc:290] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:57.657025 28985 raft_consensus.cc:740] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.657974 28985 consensus_queue.cc:260] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.645394 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:22:57.659346 28691 catalog_manager.cc:5697] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50315581143f4831ac7a5c7ef9900319 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "50315581143f4831ac7a5c7ef9900319" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:57.659750 28871 raft_consensus.cc:3060] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.651242 28987 leader_election.cc:290] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:57.671689 28987 raft_consensus.cc:493] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.672228 28987 raft_consensus.cc:515] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.676995 28997 raft_consensus.cc:493] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.677142 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433b9c6f78a34d03a0868a819d6197cc" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:57.677693 28997 raft_consensus.cc:515] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.680428 28997 leader_election.cc:290] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:57.681569 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c716168074ec471191341541441dfbcb" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:57.680668 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:22:57.683095 28869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c716168074ec471191341541441dfbcb" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:57.683861 28869 raft_consensus.cc:2468] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 0.
I20260709 13:22:57.685057 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433b9c6f78a34d03a0868a819d6197cc" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
W20260709 13:22:57.685117 28759 leader_election.cc:343] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.685818 28796 raft_consensus.cc:2468] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 0.
I20260709 13:22:57.686479 28989 raft_consensus.cc:359] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.687251 28989 raft_consensus.cc:385] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.687544 28989 raft_consensus.cc:740] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.687777 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c716168074ec471191341541441dfbcb" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:57.687884 28987 leader_election.cc:290] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:57.689111 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8684efda0df426eae166d3657400989" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:57.689913 28945 raft_consensus.cc:2468] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
W20260709 13:22:57.690083 28911 leader_election.cc:343] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.690363 28762 leader_election.cc:304] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: fcadc1b39cec4f10aa074fc9d4e3862d
W20260709 13:22:57.691004 28834 leader_election.cc:343] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.694738 28997 raft_consensus.cc:2804] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.695223 28997 raft_consensus.cc:493] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.688359 28989 consensus_queue.cc:260] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.694295 28834 leader_election.cc:304] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:22:57.695744 28997 raft_consensus.cc:3060] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:57.687765 28910 leader_election.cc:343] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.703704 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8684efda0df426eae166d3657400989" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:22:57.704227 28993 raft_consensus.cc:2804] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.704715 28993 raft_consensus.cc:493] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.705163 28993 raft_consensus.cc:3060] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.705044 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c716168074ec471191341541441dfbcb" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
W20260709 13:22:57.710683 28836 leader_election.cc:343] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.711508 28910 leader_election.cc:304] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: b7eaf45ade8d44d8b662b95708097db9
I20260709 13:22:57.713095 29014 raft_consensus.cc:2804] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.713541 29014 raft_consensus.cc:493] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.713910 29014 raft_consensus.cc:3060] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.721071 28988 tablet_bootstrap.cc:654] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.696166 28871 raft_consensus.cc:2468] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
I20260709 13:22:57.726344 28911 leader_election.cc:304] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:22:57.726372 28985 ts_tablet_manager.cc:1434] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.074s	user 0.016s	sys 0.016s
I20260709 13:22:57.730983 28989 ts_tablet_manager.cc:1434] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.004s
I20260709 13:22:57.731616 29012 raft_consensus.cc:2804] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.732198 29012 raft_consensus.cc:697] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Leader. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:22:57.732327 28989 tablet_bootstrap.cc:492] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:22:57.733137 29012 consensus_queue.cc:237] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.739821 28993 raft_consensus.cc:515] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
W20260709 13:22:57.741277 28834 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47296.2us
I20260709 13:22:57.741920 28989 tablet_bootstrap.cc:654] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.742898 28985 tablet_bootstrap.cc:492] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:22:57.743175 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8684efda0df426eae166d3657400989" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
W20260709 13:22:57.744827 28836 leader_election.cc:343] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.756314 29014 raft_consensus.cc:515] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.760056 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8684efda0df426eae166d3657400989" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:57.761564 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433b9c6f78a34d03a0868a819d6197cc" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:22:57.762217 28871 raft_consensus.cc:3060] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.762534 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433b9c6f78a34d03a0868a819d6197cc" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:22:57.760361 28989 tablet_bootstrap.cc:492] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:22:57.763159 28796 raft_consensus.cc:3060] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.763347 28989 ts_tablet_manager.cc:1403] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.001s
I20260709 13:22:57.758072 28997 raft_consensus.cc:515] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.765885 28795 raft_consensus.cc:2393] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7eaf45ade8d44d8b662b95708097db9 in current term 1: Already voted for candidate 50315581143f4831ac7a5c7ef9900319 in this term.
I20260709 13:22:57.766563 28989 raft_consensus.cc:359] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } }
I20260709 13:22:57.767330 28989 raft_consensus.cc:385] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.760720 28945 raft_consensus.cc:3060] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.767596 28989 raft_consensus.cc:740] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.768271 28836 leader_election.cc:304] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9; no voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:22:57.771400 29017 raft_consensus.cc:3060] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.768514 28989 consensus_queue.cc:260] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } }
I20260709 13:22:57.770148 28871 raft_consensus.cc:2468] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
I20260709 13:22:57.773123 28911 leader_election.cc:304] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:22:57.773953 28987 raft_consensus.cc:493] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.774397 28987 raft_consensus.cc:515] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.775605 28945 raft_consensus.cc:2468] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:22:57.776532 28987 leader_election.cc:290] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:57.780519 28987 raft_consensus.cc:2804] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.777040 28834 leader_election.cc:304] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:22:57.771129 28988 tablet_bootstrap.cc:492] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:22:57.781842 28988 ts_tablet_manager.cc:1403] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.149s	user 0.024s	sys 0.007s
I20260709 13:22:57.779043 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a1dc8dbb1643fb947fd70d65f59628" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:57.782402 29017 raft_consensus.cc:2749] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.766572 28693 catalog_manager.cc:5697] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:57.784548 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c716168074ec471191341541441dfbcb" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
W20260709 13:22:57.785925 28759 leader_election.cc:343] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:57.786022 28911 leader_election.cc:343] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.779819 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a1dc8dbb1643fb947fd70d65f59628" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:22:57.787021 28796 raft_consensus.cc:2468] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
I20260709 13:22:57.787238 28988 raft_consensus.cc:359] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.781064 28987 raft_consensus.cc:697] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Leader. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:22:57.788012 28988 raft_consensus.cc:385] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.788342 28988 raft_consensus.cc:740] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.783775 29022 raft_consensus.cc:2804] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.788738 28987 consensus_queue.cc:237] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.789099 28988 consensus_queue.cc:260] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.789703 29022 raft_consensus.cc:697] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:22:57.790678 29022 consensus_queue.cc:237] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.791438 28988 ts_tablet_manager.cc:1434] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:22:57.770239 29014 leader_election.cc:290] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:57.781044 28989 ts_tablet_manager.cc:1434] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:22:57.792701 28985 tablet_bootstrap.cc:654] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.793263 28989 tablet_bootstrap.cc:492] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:22:57.784346 28997 leader_election.cc:290] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Requested vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
W20260709 13:22:57.794797 28910 leader_election.cc:343] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.795308 28910 leader_election.cc:304] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9
I20260709 13:22:57.796628 29014 raft_consensus.cc:2749] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.797178 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c716168074ec471191341541441dfbcb" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:22:57.798182 28993 leader_election.cc:290] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:57.800596 28989 tablet_bootstrap.cc:654] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.805883 28691 catalog_manager.cc:5697] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:57.809432 28989 tablet_bootstrap.cc:492] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:22:57.809461 28985 tablet_bootstrap.cc:492] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:22:57.810321 28989 ts_tablet_manager.cc:1403] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.006s
I20260709 13:22:57.810542 28985 ts_tablet_manager.cc:1403] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.012s
I20260709 13:22:57.813277 28989 raft_consensus.cc:359] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.813108 28693 catalog_manager.cc:5697] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:57.814070 28989 raft_consensus.cc:385] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.813825 28985 raft_consensus.cc:359] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.814489 28989 raft_consensus.cc:740] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.814754 28985 raft_consensus.cc:385] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.815174 28985 raft_consensus.cc:740] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.815418 28989 consensus_queue.cc:260] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.817190 28870 raft_consensus.cc:2468] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 1.
I20260709 13:22:57.817589 28989 ts_tablet_manager.cc:1434] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:57.817306 28985 consensus_queue.cc:260] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.818683 28989 tablet_bootstrap.cc:492] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:22:57.819173 28762 leader_election.cc:304] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:22:57.820070 28985 ts_tablet_manager.cc:1434] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:22:57.821171 28985 tablet_bootstrap.cc:492] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:22:57.823628 28988 tablet_bootstrap.cc:492] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:22:57.825179 28989 tablet_bootstrap.cc:654] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.826578 29017 raft_consensus.cc:493] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.827128 29017 raft_consensus.cc:515] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.827698 28985 tablet_bootstrap.cc:654] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.827812 28997 raft_consensus.cc:2804] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.828372 28997 raft_consensus.cc:697] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Becoming Leader. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:22:57.829298 28997 consensus_queue.cc:237] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.830356 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:22:57.832180 28988 tablet_bootstrap.cc:654] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:57.832684 28836 leader_election.cc:343] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.835034 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:57.835716 28945 raft_consensus.cc:2468] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
I20260709 13:22:57.837419 28834 leader_election.cc:304] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:22:57.838586 29022 raft_consensus.cc:2804] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.839105 29022 raft_consensus.cc:493] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.839496 29022 raft_consensus.cc:3060] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.842087 28985 tablet_bootstrap.cc:492] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:22:57.842715 28985 ts_tablet_manager.cc:1403] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
I20260709 13:22:57.847221 28988 tablet_bootstrap.cc:492] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:22:57.847880 28988 ts_tablet_manager.cc:1403] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 13:22:57.850175 28985 raft_consensus.cc:359] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.850695 29017 leader_election.cc:290] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:57.850945 28985 raft_consensus.cc:385] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.851284 28985 raft_consensus.cc:740] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.851974 28985 consensus_queue.cc:260] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.854427 28985 ts_tablet_manager.cc:1434] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:22:57.854182 29022 raft_consensus.cc:515] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.855388 28985 tablet_bootstrap.cc:492] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:22:57.857084 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
W20260709 13:22:57.858703 28836 leader_election.cc:343] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.858218 28988 raft_consensus.cc:359] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.861225 28988 raft_consensus.cc:385] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.861514 28988 raft_consensus.cc:740] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.861800 28985 tablet_bootstrap.cc:654] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.862612 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:57.863222 28945 raft_consensus.cc:3060] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.863309 29022 leader_election.cc:290] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:57.865561 28692 catalog_manager.cc:5697] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50315581143f4831ac7a5c7ef9900319 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "50315581143f4831ac7a5c7ef9900319" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:57.869441 28989 tablet_bootstrap.cc:492] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:22:57.870056 28989 ts_tablet_manager.cc:1403] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.006s
I20260709 13:22:57.873015 28985 tablet_bootstrap.cc:492] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:22:57.872885 28989 raft_consensus.cc:359] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.873590 28985 ts_tablet_manager.cc:1403] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:22:57.873701 28989 raft_consensus.cc:385] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.874079 28989 raft_consensus.cc:740] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.874905 28989 consensus_queue.cc:260] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.877094 28945 raft_consensus.cc:2468] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:22:57.878786 28985 raft_consensus.cc:359] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.880617 28985 raft_consensus.cc:385] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.880978 28985 raft_consensus.cc:740] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.881361 28834 leader_election.cc:304] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:22:57.881698 28985 consensus_queue.cc:260] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.882678 29022 raft_consensus.cc:2804] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.883144 29022 raft_consensus.cc:697] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:22:57.883832 28985 ts_tablet_manager.cc:1434] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.003s
I20260709 13:22:57.883949 29022 consensus_queue.cc:237] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.863183 28988 consensus_queue.cc:260] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.879467 28989 ts_tablet_manager.cc:1434] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:22:57.888069 28988 ts_tablet_manager.cc:1434] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.003s
I20260709 13:22:57.889575 28988 tablet_bootstrap.cc:492] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:22:57.896008 28988 tablet_bootstrap.cc:654] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.896788 28692 catalog_manager.cc:5697] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:57.901096 28988 tablet_bootstrap.cc:492] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:22:57.901572 28988 ts_tablet_manager.cc:1403] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:22:57.904229 28988 raft_consensus.cc:359] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.905004 28988 raft_consensus.cc:385] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.905351 28988 raft_consensus.cc:740] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.905988 28988 consensus_queue.cc:260] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.908087 28988 ts_tablet_manager.cc:1434] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:22:57.909085 28988 tablet_bootstrap.cc:492] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:22:57.913590 28997 raft_consensus.cc:493] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.914178 28997 raft_consensus.cc:515] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.915448 28988 tablet_bootstrap.cc:654] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.916440 28997 leader_election.cc:290] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:57.918033 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8684efda0df426eae166d3657400989" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:57.918438 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8684efda0df426eae166d3657400989" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:57.919193 28945 raft_consensus.cc:2393] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50315581143f4831ac7a5c7ef9900319 in current term 1: Already voted for candidate b7eaf45ade8d44d8b662b95708097db9 in this term.
I20260709 13:22:57.920644 28759 leader_election.cc:304] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319; no voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:22:57.921406 28997 raft_consensus.cc:3060] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.922079 29022 raft_consensus.cc:493] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.922399 28988 tablet_bootstrap.cc:492] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:22:57.922554 29022 raft_consensus.cc:515] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.922963 28988 ts_tablet_manager.cc:1403] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:22:57.924490 29022 leader_election.cc:290] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:57.925227 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b8817d457f4c5ea9a62fdcc8b756ff" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:22:57.926010 28988 raft_consensus.cc:359] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.926811 28988 raft_consensus.cc:385] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:57.926944 28836 leader_election.cc:343] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.927062 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b8817d457f4c5ea9a62fdcc8b756ff" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:57.927196 28988 raft_consensus.cc:740] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.927855 28945 raft_consensus.cc:2468] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
I20260709 13:22:57.928184 28988 consensus_queue.cc:260] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.928825 28834 leader_election.cc:304] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:22:57.929670 29022 raft_consensus.cc:2804] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.930043 29022 raft_consensus.cc:493] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.930388 29022 raft_consensus.cc:3060] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.930545 28997 raft_consensus.cc:2749] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.932567 28988 ts_tablet_manager.cc:1434] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.007s
I20260709 13:22:57.933804 28988 tablet_bootstrap.cc:492] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:22:57.940249 28988 tablet_bootstrap.cc:654] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.942044 29022 raft_consensus.cc:515] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.944222 29022 leader_election.cc:290] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:57.944952 28988 tablet_bootstrap.cc:492] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:22:57.944904 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b8817d457f4c5ea9a62fdcc8b756ff" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:22:57.945369 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b8817d457f4c5ea9a62fdcc8b756ff" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:57.945588 28988 ts_tablet_manager.cc:1403] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 13:22:57.946025 28945 raft_consensus.cc:3060] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:57.946173 28836 leader_election.cc:343] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.948494 28988 raft_consensus.cc:359] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.949203 28988 raft_consensus.cc:385] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.949460 28988 raft_consensus.cc:740] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.950147 28988 consensus_queue.cc:260] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.952214 28988 ts_tablet_manager.cc:1434] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:22:57.953213 28988 tablet_bootstrap.cc:492] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:22:57.954034 28945 raft_consensus.cc:2468] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:22:57.955253 28834 leader_election.cc:304] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:22:57.956050 29022 raft_consensus.cc:2804] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.956583 29022 raft_consensus.cc:697] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:22:57.957526 29022 consensus_queue.cc:237] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.958853 28988 tablet_bootstrap.cc:654] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.964192 28987 raft_consensus.cc:493] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.964927 28987 raft_consensus.cc:515] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.966979 28987 leader_election.cc:290] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:57.967229 28988 tablet_bootstrap.cc:492] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:22:57.967438 28997 raft_consensus.cc:493] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.967744 28988 ts_tablet_manager.cc:1403] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:22:57.967777 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c716168074ec471191341541441dfbcb" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:22:57.968039 28997 raft_consensus.cc:515] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.969321 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c716168074ec471191341541441dfbcb" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:57.970178 28870 raft_consensus.cc:2393] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcadc1b39cec4f10aa074fc9d4e3862d in current term 1: Already voted for candidate 50315581143f4831ac7a5c7ef9900319 in this term.
I20260709 13:22:57.971042 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:57.971129 28988 raft_consensus.cc:359] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.971349 28911 leader_election.cc:304] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9
I20260709 13:22:57.971961 28988 raft_consensus.cc:385] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.972262 28988 raft_consensus.cc:740] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.972743 28987 raft_consensus.cc:3060] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.967036 28691 catalog_manager.cc:5697] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:57.972887 28988 consensus_queue.cc:260] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:57.975335 28988 ts_tablet_manager.cc:1434] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:57.977047 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:57.976567 28997 leader_election.cc:290] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:57.978070 28945 raft_consensus.cc:2393] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50315581143f4831ac7a5c7ef9900319 in current term 1: Already voted for candidate b7eaf45ade8d44d8b662b95708097db9 in this term.
I20260709 13:22:57.979393 28759 leader_election.cc:304] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319; no voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:22:57.980238 28997 raft_consensus.cc:3060] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.982769 28987 raft_consensus.cc:2749] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.986989 28997 raft_consensus.cc:2749] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.024039 28997 raft_consensus.cc:493] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.024561 28997 raft_consensus.cc:515] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.026407 28997 leader_election.cc:290] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.027285 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a1dc8dbb1643fb947fd70d65f59628" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:58.027402 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a1dc8dbb1643fb947fd70d65f59628" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:58.027985 28871 raft_consensus.cc:2468] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 0.
I20260709 13:22:58.028056 28945 raft_consensus.cc:2468] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 0.
I20260709 13:22:58.029098 28762 leader_election.cc:304] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:22:58.029839 28997 raft_consensus.cc:2804] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.030216 28997 raft_consensus.cc:493] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.030505 28997 raft_consensus.cc:3060] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.035857 28997 raft_consensus.cc:515] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.037091 28871 raft_consensus.cc:3060] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.038384 28997 leader_election.cc:290] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Requested vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.038691 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a1dc8dbb1643fb947fd70d65f59628" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:22:58.039083 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a1dc8dbb1643fb947fd70d65f59628" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:58.039469 28870 raft_consensus.cc:3060] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.039659 28945 raft_consensus.cc:3060] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.044523 28997 consensus_queue.cc:1048] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.046722 28945 raft_consensus.cc:2468] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 1.
I20260709 13:22:58.048079 28759 leader_election.cc:304] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:22:58.048100 28870 raft_consensus.cc:2468] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 1.
I20260709 13:22:58.049000 28997 raft_consensus.cc:2804] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.050573 28997 raft_consensus.cc:697] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Becoming Leader. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:22:58.051391 28997 consensus_queue.cc:237] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.066051 28997 consensus_queue.cc:1048] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.068214 28691 catalog_manager.cc:5697] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50315581143f4831ac7a5c7ef9900319 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "50315581143f4831ac7a5c7ef9900319" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.104759 29022 raft_consensus.cc:493] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.105338 29022 raft_consensus.cc:515] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.106936 29022 leader_election.cc:290] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.107853 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba72a4f311ef4c589ef49c92b8af7f93" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:22:58.108031 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba72a4f311ef4c589ef49c92b8af7f93" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:58.108620 28796 raft_consensus.cc:2468] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
I20260709 13:22:58.108642 28945 raft_consensus.cc:2468] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
I20260709 13:22:58.109784 28836 leader_election.cc:304] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:22:58.110432 29022 raft_consensus.cc:2804] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.110776 29022 raft_consensus.cc:493] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.110994 29022 raft_consensus.cc:3060] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.115957 29022 raft_consensus.cc:515] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.117718 29022 leader_election.cc:290] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.118434 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba72a4f311ef4c589ef49c92b8af7f93" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:22:58.118687 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba72a4f311ef4c589ef49c92b8af7f93" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:58.119037 28796 raft_consensus.cc:3060] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.119283 28945 raft_consensus.cc:3060] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.119632 28997 raft_consensus.cc:493] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.120139 28997 raft_consensus.cc:515] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.122272 28997 leader_election.cc:290] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.123054 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:58.123955 28871 raft_consensus.cc:2393] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50315581143f4831ac7a5c7ef9900319 in current term 1: Already voted for candidate fcadc1b39cec4f10aa074fc9d4e3862d in this term.
I20260709 13:22:58.123829 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:58.126317 28796 raft_consensus.cc:2468] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:22:58.126387 28762 leader_election.cc:304] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319; no voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:22:58.126785 28945 raft_consensus.cc:2468] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:22:58.127421 28836 leader_election.cc:304] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:22:58.127696 28997 raft_consensus.cc:3060] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.128309 29022 raft_consensus.cc:2804] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.128831 29022 raft_consensus.cc:697] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:22:58.129591 29022 consensus_queue.cc:237] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.133558 28997 raft_consensus.cc:2749] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.137243 28691 catalog_manager.cc:5697] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.150600 28987 consensus_queue.cc:1048] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.160904 29014 consensus_queue.cc:1048] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.226418 29014 consensus_queue.cc:1048] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.227310 29012 consensus_queue.cc:1048] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.277976 28945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e"
dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
mode: GRACEFUL
new_leader_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:57322
I20260709 13:22:58.278615 28945 raft_consensus.cc:606] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Received request to transfer leadership to TS 50315581143f4831ac7a5c7ef9900319
I20260709 13:22:58.283614 28945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "433b9c6f78a34d03a0868a819d6197cc"
dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
mode: GRACEFUL
new_leader_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:57322
I20260709 13:22:58.284137 28945 raft_consensus.cc:606] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Received request to transfer leadership to TS 50315581143f4831ac7a5c7ef9900319
I20260709 13:22:58.291002 29022 consensus_queue.cc:1048] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.298981 28871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb"
dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
mode: GRACEFUL
new_leader_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:37084
I20260709 13:22:58.299618 28871 raft_consensus.cc:606] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Received request to transfer leadership to TS 50315581143f4831ac7a5c7ef9900319
I20260709 13:22:58.304705 28993 raft_consensus.cc:993] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9: : Instructing follower 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:22:58.305187 28993 raft_consensus.cc:1081] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Signalling peer 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:22:58.304783 29017 consensus_queue.cc:1048] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.307246 28796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb"
dest_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:35818
I20260709 13:22:58.310307 28796 raft_consensus.cc:493] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:58.310844 28796 raft_consensus.cc:3060] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.318806 28796 raft_consensus.cc:515] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.320935 28796 leader_election.cc:290] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Requested vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.322134 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:22:58.322824 28871 raft_consensus.cc:3055] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:58.323168 28871 raft_consensus.cc:740] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:22:58.324062 28871 consensus_queue.cc:260] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.325232 28871 raft_consensus.cc:3060] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.326712 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:58.327461 28945 raft_consensus.cc:3060] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.330610 28997 raft_consensus.cc:493] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.331184 28997 raft_consensus.cc:515] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.333282 28997 leader_election.cc:290] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.333603 28871 raft_consensus.cc:2468] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:22:58.335054 28762 leader_election.cc:304] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:22:58.335506 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b8817d457f4c5ea9a62fdcc8b756ff" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:22:58.336024 28997 raft_consensus.cc:2804] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:58.336395 28945 raft_consensus.cc:2468] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:22:58.337519 28997 raft_consensus.cc:697] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Becoming Leader. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:22:58.337463 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b8817d457f4c5ea9a62fdcc8b756ff" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:22:58.338191 29008 consensus_queue.cc:1048] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.338887 28944 raft_consensus.cc:2393] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50315581143f4831ac7a5c7ef9900319 in current term 1: Already voted for candidate b7eaf45ade8d44d8b662b95708097db9 in this term.
I20260709 13:22:58.338692 28997 consensus_queue.cc:237] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.340955 28759 leader_election.cc:304] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319; no voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:22:58.341748 29008 raft_consensus.cc:3060] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.344121 28796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c716168074ec471191341541441dfbcb"
dest_uuid: "50315581143f4831ac7a5c7ef9900319"
mode: GRACEFUL
new_leader_uuid: "b7eaf45ade8d44d8b662b95708097db9"
 from {username='slave'} at 127.0.0.1:35824
I20260709 13:22:58.345062 28796 raft_consensus.cc:606] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Received request to transfer leadership to TS b7eaf45ade8d44d8b662b95708097db9
I20260709 13:22:58.347965 28691 catalog_manager.cc:5697] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 reported cstate change: term changed from 1 to 2, leader changed from b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2) to 50315581143f4831ac7a5c7ef9900319 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "50315581143f4831ac7a5c7ef9900319" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.352541 29008 raft_consensus.cc:2749] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.354019 28796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20a1dc8dbb1643fb947fd70d65f59628"
dest_uuid: "50315581143f4831ac7a5c7ef9900319"
mode: GRACEFUL
new_leader_uuid: "b7eaf45ade8d44d8b662b95708097db9"
 from {username='slave'} at 127.0.0.1:35824
I20260709 13:22:58.354852 28796 raft_consensus.cc:606] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Received request to transfer leadership to TS b7eaf45ade8d44d8b662b95708097db9
I20260709 13:22:58.360529 29008 consensus_queue.cc:1048] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.362547 28871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba72a4f311ef4c589ef49c92b8af7f93"
dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
mode: GRACEFUL
new_leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
 from {username='slave'} at 127.0.0.1:37084
I20260709 13:22:58.364179 28871 raft_consensus.cc:606] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Received request to transfer leadership to TS fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:22:58.374388 28997 raft_consensus.cc:993] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319: : Instructing follower b7eaf45ade8d44d8b662b95708097db9 to start an election
I20260709 13:22:58.374989 28997 raft_consensus.cc:1081] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Signalling peer b7eaf45ade8d44d8b662b95708097db9 to start an election
I20260709 13:22:58.377796 28871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c716168074ec471191341541441dfbcb"
dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
 from {username='slave'} at 127.0.0.1:37082
I20260709 13:22:58.377718 29022 consensus_queue.cc:1048] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.378515 28871 raft_consensus.cc:493] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:58.378957 28871 raft_consensus.cc:3060] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.386202 28871 raft_consensus.cc:515] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.386855 29022 consensus_queue.cc:1048] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.388389 28871 leader_election.cc:290] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.389735 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c716168074ec471191341541441dfbcb" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:58.390439 28944 raft_consensus.cc:3060] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.394914 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c716168074ec471191341541441dfbcb" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:22:58.395649 28796 raft_consensus.cc:3055] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:58.397500 28993 consensus_queue.cc:1048] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.399571 28796 raft_consensus.cc:740] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:22:58.401054 28796 consensus_queue.cc:260] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.402421 28796 raft_consensus.cc:3060] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.398788 28944 raft_consensus.cc:2468] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 2.
I20260709 13:22:58.406368 28834 leader_election.cc:304] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:22:58.408648 28993 raft_consensus.cc:2804] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:58.409379 28993 raft_consensus.cc:697] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 2 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:22:58.410480 28796 raft_consensus.cc:2468] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 2.
I20260709 13:22:58.410594 28993 consensus_queue.cc:237] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.427225 29022 consensus_queue.cc:1048] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.427090 28691 catalog_manager.cc:5697] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 1 to 2, leader changed from 50315581143f4831ac7a5c7ef9900319 (127.15.208.1) to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.507858 29041 consensus_queue.cc:1048] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.514089 28997 raft_consensus.cc:993] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319: : Instructing follower b7eaf45ade8d44d8b662b95708097db9 to start an election
I20260709 13:22:58.514604 29008 raft_consensus.cc:1081] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Signalling peer b7eaf45ade8d44d8b662b95708097db9 to start an election
I20260709 13:22:58.516394 28870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20a1dc8dbb1643fb947fd70d65f59628"
dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
 from {username='slave'} at 127.0.0.1:37082
I20260709 13:22:58.517009 28870 raft_consensus.cc:493] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:58.517400 28870 raft_consensus.cc:3060] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.520360 29008 consensus_queue.cc:1048] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.523120 29064 consensus_queue.cc:1048] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.526245 28870 raft_consensus.cc:515] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.532615 28870 leader_election.cc:290] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.532815 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a1dc8dbb1643fb947fd70d65f59628" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:58.533537 28944 raft_consensus.cc:3060] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.535745 29064 raft_consensus.cc:993] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9: : Instructing follower fcadc1b39cec4f10aa074fc9d4e3862d to start an election
I20260709 13:22:58.536257 29064 raft_consensus.cc:1081] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Signalling peer fcadc1b39cec4f10aa074fc9d4e3862d to start an election
I20260709 13:22:58.538986 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a1dc8dbb1643fb947fd70d65f59628" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:22:58.539676 28794 raft_consensus.cc:3055] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:58.539986 28794 raft_consensus.cc:740] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:22:58.540763 28794 consensus_queue.cc:260] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.541291 28993 consensus_queue.cc:1048] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.542110 28794 raft_consensus.cc:3060] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.544124 28944 raft_consensus.cc:2468] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 2.
I20260709 13:22:58.544553 28943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba72a4f311ef4c589ef49c92b8af7f93"
dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
 from {username='slave'} at 127.0.0.1:57316
I20260709 13:22:58.545776 28834 leader_election.cc:304] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:22:58.546748 28993 raft_consensus.cc:2804] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:58.547232 28993 raft_consensus.cc:697] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 2 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:22:58.548074 28993 consensus_queue.cc:237] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.552342 28794 raft_consensus.cc:2468] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 2.
I20260709 13:22:58.556291 28943 raft_consensus.cc:493] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:58.556774 28943 raft_consensus.cc:3060] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.559669 28691 catalog_manager.cc:5697] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 1 to 2, leader changed from 50315581143f4831ac7a5c7ef9900319 (127.15.208.1) to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.564389 28943 raft_consensus.cc:515] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.570418 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba72a4f311ef4c589ef49c92b8af7f93" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:22:58.570932 28794 raft_consensus.cc:3060] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.576197 28794 raft_consensus.cc:2468] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 2.
I20260709 13:22:58.576788 28943 leader_election.cc:290] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 2 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:22:58.577441 28910 leader_election.cc:304] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:22:58.578220 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba72a4f311ef4c589ef49c92b8af7f93" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:22:58.578482 29014 raft_consensus.cc:2804] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:58.578907 28870 raft_consensus.cc:3055] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:58.579118 29014 raft_consensus.cc:697] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 LEADER]: Becoming Leader. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:22:58.579348 28870 raft_consensus.cc:740] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:22:58.580070 29014 consensus_queue.cc:237] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.580295 28870 consensus_queue.cc:260] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.581827 28870 raft_consensus.cc:3060] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.587073 28692 catalog_manager.cc:5697] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d reported cstate change: term changed from 1 to 2, leader changed from b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2) to fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3). New cstate: current_term: 2 leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:58.589623 28870 raft_consensus.cc:2468] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 2.
I20260709 13:22:58.710676 28987 raft_consensus.cc:993] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d: : Instructing follower 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:22:58.711212 29014 raft_consensus.cc:1081] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Signalling peer 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:22:58.712646 28794 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "433b9c6f78a34d03a0868a819d6197cc"
dest_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:35806
I20260709 13:22:58.713199 28794 raft_consensus.cc:493] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:58.713538 28794 raft_consensus.cc:3060] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.719985 28794 raft_consensus.cc:515] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.721815 28794 leader_election.cc:290] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Requested vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.722656 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433b9c6f78a34d03a0868a819d6197cc" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:22:58.723364 28870 raft_consensus.cc:3060] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.723296 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433b9c6f78a34d03a0868a819d6197cc" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:58.724212 28943 raft_consensus.cc:3055] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:58.724579 28943 raft_consensus.cc:740] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:22:58.725508 28943 consensus_queue.cc:260] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.726923 28943 raft_consensus.cc:3060] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.731594 28870 raft_consensus.cc:2468] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:22:58.733110 28762 leader_election.cc:304] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:22:58.733919 29008 raft_consensus.cc:2804] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:58.734462 29008 raft_consensus.cc:697] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Becoming Leader. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:22:58.734761 28945 raft_consensus.cc:1275] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:58.734623 28943 raft_consensus.cc:2468] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:22:58.735386 29008 consensus_queue.cc:237] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.736701 29041 consensus_queue.cc:1048] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:58.743424 28692 catalog_manager.cc:5697] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 reported cstate change: term changed from 1 to 2, leader changed from fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3) to 50315581143f4831ac7a5c7ef9900319 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "50315581143f4831ac7a5c7ef9900319" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.752509 28870 raft_consensus.cc:1275] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:58.754212 29059 consensus_queue.cc:1048] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:58.786898 29071 raft_consensus.cc:993] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d: : Instructing follower 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:22:58.787438 29014 raft_consensus.cc:1081] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Signalling peer 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:22:58.788921 28794 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e"
dest_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:35806
I20260709 13:22:58.789496 28794 raft_consensus.cc:493] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:58.789911 28794 raft_consensus.cc:3060] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.795077 28794 raft_consensus.cc:515] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.796886 28794 leader_election.cc:290] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Requested vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:22:58.797672 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:22:58.797937 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:22:58.798326 28870 raft_consensus.cc:3060] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.798717 28943 raft_consensus.cc:3055] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:58.799062 28943 raft_consensus.cc:740] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:22:58.799783 28943 consensus_queue.cc:260] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.800730 28943 raft_consensus.cc:3060] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:58.803578 28870 raft_consensus.cc:2468] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:22:58.804783 28762 leader_election.cc:304] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:22:58.805580 29059 raft_consensus.cc:2804] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:58.805996 29059 raft_consensus.cc:697] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Becoming Leader. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:22:58.806118 28943 raft_consensus.cc:2468] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:22:58.806854 29059 consensus_queue.cc:237] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:22:58.813922 28693 catalog_manager.cc:5697] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 reported cstate change: term changed from 1 to 2, leader changed from fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3) to 50315581143f4831ac7a5c7ef9900319 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "50315581143f4831ac7a5c7ef9900319" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.948820 28794 raft_consensus.cc:1275] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Refusing update from remote peer b7eaf45ade8d44d8b662b95708097db9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:58.950129 29017 consensus_queue.cc:1048] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:58.961378 28943 raft_consensus.cc:1275] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Refusing update from remote peer b7eaf45ade8d44d8b662b95708097db9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:58.962809 29022 consensus_queue.cc:1048] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:58.996779 28794 raft_consensus.cc:1275] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Refusing update from remote peer b7eaf45ade8d44d8b662b95708097db9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:58.998229 29022 consensus_queue.cc:1048] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:59.007412 28943 raft_consensus.cc:1275] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Refusing update from remote peer b7eaf45ade8d44d8b662b95708097db9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:59.008762 29022 consensus_queue.cc:1048] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:59.147365 28794 raft_consensus.cc:1275] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Refusing update from remote peer fcadc1b39cec4f10aa074fc9d4e3862d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:59.148883 29014 consensus_queue.cc:1048] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:59.156555 28870 raft_consensus.cc:1275] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Refusing update from remote peer fcadc1b39cec4f10aa074fc9d4e3862d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:59.159209 29071 consensus_queue.cc:1048] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:59.195919 28870 raft_consensus.cc:1275] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:59.197194 29059 consensus_queue.cc:1048] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:59.203622 28943 raft_consensus.cc:1275] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:59.205220 29059 consensus_queue.cc:1048] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:59.261401 28870 raft_consensus.cc:1275] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:59.262734 28997 consensus_queue.cc:1048] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:59.272078 28943 raft_consensus.cc:1275] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:59.274667 28997 consensus_queue.cc:1048] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:01.399262 28693 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37620:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:01.402344 28693 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:01.461990 28782 tablet_service.cc:1511] Processing CreateTablet for tablet 2e82016c61bc4ad38324abd7fb160226 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:01.463049 28854 tablet_service.cc:1511] Processing CreateTablet for tablet 2e82016c61bc4ad38324abd7fb160226 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:01.463984 28782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e82016c61bc4ad38324abd7fb160226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.464605 28854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e82016c61bc4ad38324abd7fb160226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.464810 28933 tablet_service.cc:1511] Processing CreateTablet for tablet 2e82016c61bc4ad38324abd7fb160226 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:01.466501 28933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e82016c61bc4ad38324abd7fb160226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.471024 28783 tablet_service.cc:1511] Processing CreateTablet for tablet 259cd0d23c5d4d6688517ad2681cc56b (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:01.472535 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259cd0d23c5d4d6688517ad2681cc56b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.473169 28853 tablet_service.cc:1511] Processing CreateTablet for tablet 259cd0d23c5d4d6688517ad2681cc56b (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:01.474602 28853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259cd0d23c5d4d6688517ad2681cc56b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.475330 28934 tablet_service.cc:1511] Processing CreateTablet for tablet 259cd0d23c5d4d6688517ad2681cc56b (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:01.476747 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259cd0d23c5d4d6688517ad2681cc56b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.481825 28856 tablet_service.cc:1511] Processing CreateTablet for tablet bc2bd23cfbfd48cead8919dbcb26f0f0 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:01.482312 28781 tablet_service.cc:1511] Processing CreateTablet for tablet bc2bd23cfbfd48cead8919dbcb26f0f0 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:01.483215 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2bd23cfbfd48cead8919dbcb26f0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.483771 28781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2bd23cfbfd48cead8919dbcb26f0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.487804 28778 tablet_service.cc:1511] Processing CreateTablet for tablet 7f27d02fa52543368edef331aeaec217 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:01.489845 28932 tablet_service.cc:1511] Processing CreateTablet for tablet bc2bd23cfbfd48cead8919dbcb26f0f0 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:01.491262 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2bd23cfbfd48cead8919dbcb26f0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.491858 28861 tablet_service.cc:1511] Processing CreateTablet for tablet 7f27d02fa52543368edef331aeaec217 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:01.492403 28785 tablet_service.cc:1511] Processing CreateTablet for tablet 511dd4a19da849b2b2557a1c982e59fc (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:01.493243 28861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f27d02fa52543368edef331aeaec217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.495015 28931 tablet_service.cc:1511] Processing CreateTablet for tablet 511dd4a19da849b2b2557a1c982e59fc (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:01.495111 28935 tablet_service.cc:1511] Processing CreateTablet for tablet 7f27d02fa52543368edef331aeaec217 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:01.496496 28931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 511dd4a19da849b2b2557a1c982e59fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.497262 28779 tablet_service.cc:1511] Processing CreateTablet for tablet 1148e114823d4f52bc18a8e2f53e7195 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:01.499099 28778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f27d02fa52543368edef331aeaec217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.499477 28859 tablet_service.cc:1511] Processing CreateTablet for tablet 511dd4a19da849b2b2557a1c982e59fc (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:01.500864 28859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 511dd4a19da849b2b2557a1c982e59fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.502082 28855 tablet_service.cc:1511] Processing CreateTablet for tablet 1148e114823d4f52bc18a8e2f53e7195 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:01.503582 28855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1148e114823d4f52bc18a8e2f53e7195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.506397 28935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f27d02fa52543368edef331aeaec217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.507167 28930 tablet_service.cc:1511] Processing CreateTablet for tablet 1148e114823d4f52bc18a8e2f53e7195 (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:01.508698 28930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1148e114823d4f52bc18a8e2f53e7195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.509222 28780 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6a7db07f6843f389bdc1f58fe1962d (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:01.511379 28784 tablet_service.cc:1511] Processing CreateTablet for tablet 8b195b9fbf144c72b1a54a00e34ebb4f (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:01.512975 28779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1148e114823d4f52bc18a8e2f53e7195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.514426 28929 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6a7db07f6843f389bdc1f58fe1962d (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:01.515849 28929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6a7db07f6843f389bdc1f58fe1962d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.517773 28785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 511dd4a19da849b2b2557a1c982e59fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.521556 28784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b195b9fbf144c72b1a54a00e34ebb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.525513 28780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6a7db07f6843f389bdc1f58fe1962d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.507647 28857 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6a7db07f6843f389bdc1f58fe1962d (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:01.534343 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6a7db07f6843f389bdc1f58fe1962d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.535919 28860 tablet_service.cc:1511] Processing CreateTablet for tablet 8b195b9fbf144c72b1a54a00e34ebb4f (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:01.537616 28860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b195b9fbf144c72b1a54a00e34ebb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.551566 28928 tablet_service.cc:1511] Processing CreateTablet for tablet 8b195b9fbf144c72b1a54a00e34ebb4f (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:01.552531 28786 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6a77e282a04e739610c5f9a83eb77d (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:01.553104 28928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b195b9fbf144c72b1a54a00e34ebb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.553980 28786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6a77e282a04e739610c5f9a83eb77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.559108 28858 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6a77e282a04e739610c5f9a83eb77d (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:01.560542 28858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6a77e282a04e739610c5f9a83eb77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:01.572213 28927 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6a77e282a04e739610c5f9a83eb77d (DEFAULT_TABLE table=soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:01.573778 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6a77e282a04e739610c5f9a83eb77d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:23:01.620770 28742 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:01.654019 29087 tablet_bootstrap.cc:492] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:23:01.678290 29087 tablet_bootstrap.cc:654] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.683583 29086 tablet_bootstrap.cc:492] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:23:01.687971 29088 tablet_bootstrap.cc:492] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:23:01.698161 29087 tablet_bootstrap.cc:492] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:23:01.698870 29087 ts_tablet_manager.cc:1403] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.006s
I20260709 13:23:01.700521 29086 tablet_bootstrap.cc:654] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.702545 29088 tablet_bootstrap.cc:654] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.702876 29087 raft_consensus.cc:359] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.704056 29087 raft_consensus.cc:385] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.704483 29087 raft_consensus.cc:740] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.705482 29087 consensus_queue.cc:260] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.709447 29086 tablet_bootstrap.cc:492] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:23:01.710232 29086 ts_tablet_manager.cc:1403] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 13:23:01.712001 29087 ts_tablet_manager.cc:1434] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:23:01.713531 29087 tablet_bootstrap.cc:492] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:23:01.713631 29086 raft_consensus.cc:359] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.714561 29086 raft_consensus.cc:385] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.714927 29086 raft_consensus.cc:740] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.715833 29086 consensus_queue.cc:260] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.718631 29086 ts_tablet_manager.cc:1434] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:23:01.719879 29086 tablet_bootstrap.cc:492] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:23:01.722671 29087 tablet_bootstrap.cc:654] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.729151 29088 tablet_bootstrap.cc:492] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:23:01.729709 29088 ts_tablet_manager.cc:1403] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.012s
I20260709 13:23:01.730474 29086 tablet_bootstrap.cc:654] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.732826 29088 raft_consensus.cc:359] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.733673 29088 raft_consensus.cc:385] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.734066 29088 raft_consensus.cc:740] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.735069 29088 consensus_queue.cc:260] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.738415 29088 ts_tablet_manager.cc:1434] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.006s
I20260709 13:23:01.739565 29088 tablet_bootstrap.cc:492] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:23:01.746547 29088 tablet_bootstrap.cc:654] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.748514 29087 tablet_bootstrap.cc:492] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:23:01.748795 29086 tablet_bootstrap.cc:492] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:23:01.749457 29087 ts_tablet_manager.cc:1403] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.004s
I20260709 13:23:01.749571 29086 ts_tablet_manager.cc:1403] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.006s
I20260709 13:23:01.753360 29087 raft_consensus.cc:359] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.754316 29087 raft_consensus.cc:385] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.754122 29086 raft_consensus.cc:359] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.755347 29086 raft_consensus.cc:385] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.755749 29086 raft_consensus.cc:740] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.754856 29087 raft_consensus.cc:740] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.756598 29086 consensus_queue.cc:260] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.757565 29087 consensus_queue.cc:260] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.758987 29088 tablet_bootstrap.cc:492] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:23:01.759629 29088 ts_tablet_manager.cc:1403] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:23:01.760402 29087 ts_tablet_manager.cc:1434] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:23:01.761643 29087 tablet_bootstrap.cc:492] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:23:01.762599 29088 raft_consensus.cc:359] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.763616 29088 raft_consensus.cc:385] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.763973 29088 raft_consensus.cc:740] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.764937 29088 consensus_queue.cc:260] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.767838 29088 ts_tablet_manager.cc:1434] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:23:01.768955 29088 tablet_bootstrap.cc:492] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:23:01.763979 29086 ts_tablet_manager.cc:1434] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:23:01.770058 29086 tablet_bootstrap.cc:492] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:23:01.770895 29087 tablet_bootstrap.cc:654] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.776646 29086 tablet_bootstrap.cc:654] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.779088 29087 tablet_bootstrap.cc:492] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:23:01.779805 29087 ts_tablet_manager.cc:1403] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:23:01.786551 29087 raft_consensus.cc:359] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.787214 29088 tablet_bootstrap.cc:654] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.787569 29087 raft_consensus.cc:385] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.788033 29087 raft_consensus.cc:740] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.788794 29086 tablet_bootstrap.cc:492] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:23:01.788864 29087 consensus_queue.cc:260] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.789562 29086 ts_tablet_manager.cc:1403] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 13:23:01.791674 29087 ts_tablet_manager.cc:1434] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:23:01.792740 29087 tablet_bootstrap.cc:492] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:23:01.792906 29086 raft_consensus.cc:359] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.793706 29086 raft_consensus.cc:385] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.794049 29086 raft_consensus.cc:740] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.796394 29086 consensus_queue.cc:260] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.801553 29087 tablet_bootstrap.cc:654] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.806442 29088 tablet_bootstrap.cc:492] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:23:01.807371 29088 ts_tablet_manager.cc:1403] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.007s
I20260709 13:23:01.813899 29086 ts_tablet_manager.cc:1434] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.010s
I20260709 13:23:01.815227 29086 tablet_bootstrap.cc:492] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:23:01.816563 29088 raft_consensus.cc:359] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.817590 29088 raft_consensus.cc:385] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.817965 29088 raft_consensus.cc:740] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.818881 29088 consensus_queue.cc:260] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.824461 29086 tablet_bootstrap.cc:654] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.830683 29088 ts_tablet_manager.cc:1434] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:23:01.833700 29087 tablet_bootstrap.cc:492] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:23:01.834343 29087 ts_tablet_manager.cc:1403] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.003s
I20260709 13:23:01.835659 29086 tablet_bootstrap.cc:492] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:23:01.836411 29086 ts_tablet_manager.cc:1403] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:23:01.837742 29088 tablet_bootstrap.cc:492] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:23:01.837471 29087 raft_consensus.cc:359] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.840317 29087 raft_consensus.cc:385] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.840737 29086 raft_consensus.cc:359] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.840756 29087 raft_consensus.cc:740] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.842692 29086 raft_consensus.cc:385] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.843060 29086 raft_consensus.cc:740] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.843263 29087 consensus_queue.cc:260] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.843783 29086 consensus_queue.cc:260] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.846189 29086 ts_tablet_manager.cc:1434] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:23:01.846525 29087 ts_tablet_manager.cc:1434] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:23:01.847262 29086 tablet_bootstrap.cc:492] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:23:01.847625 29087 tablet_bootstrap.cc:492] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:23:01.850358 28997 raft_consensus.cc:493] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.850916 28997 raft_consensus.cc:515] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.853224 28997 leader_election.cc:290] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:01.854708 29086 tablet_bootstrap.cc:654] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.854434 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259cd0d23c5d4d6688517ad2681cc56b" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:01.855180 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259cd0d23c5d4d6688517ad2681cc56b" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:23:01.855917 28871 raft_consensus.cc:2468] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 0.
W20260709 13:23:01.857005 28759 leader_election.cc:343] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.857714 28762 leader_election.cc:304] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:23:01.859079 28997 raft_consensus.cc:2804] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:01.859444 28997 raft_consensus.cc:493] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:01.859761 28997 raft_consensus.cc:3060] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.861433 29022 raft_consensus.cc:493] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.862118 29022 raft_consensus.cc:515] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.867673 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bd23cfbfd48cead8919dbcb26f0f0" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:23:01.867897 28997 raft_consensus.cc:515] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.868575 28795 raft_consensus.cc:2468] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
I20260709 13:23:01.870833 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259cd0d23c5d4d6688517ad2681cc56b" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:01.870931 28836 leader_election.cc:304] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:23:01.846203 29088 tablet_bootstrap.cc:654] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.871520 28871 raft_consensus.cc:3060] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.872686 29098 raft_consensus.cc:2804] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:01.873308 29098 raft_consensus.cc:493] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:01.873728 29098 raft_consensus.cc:3060] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.877306 29087 tablet_bootstrap.cc:654] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.882226 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259cd0d23c5d4d6688517ad2681cc56b" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:23:01.883479 28871 raft_consensus.cc:2468] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 1.
W20260709 13:23:01.883852 28759 leader_election.cc:343] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.884335 28997 leader_election.cc:290] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Requested vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:01.885044 29022 leader_election.cc:290] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:01.885846 28762 leader_election.cc:304] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:23:01.886483 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bd23cfbfd48cead8919dbcb26f0f0" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:01.887163 28997 raft_consensus.cc:2804] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:01.887234 29087 tablet_bootstrap.cc:492] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:23:01.888026 29087 ts_tablet_manager.cc:1403] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.005s
W20260709 13:23:01.888159 28834 leader_election.cc:343] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.893770 29098 raft_consensus.cc:515] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.897944 29087 raft_consensus.cc:359] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.899327 29087 raft_consensus.cc:385] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.899772 29087 raft_consensus.cc:740] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.900799 29087 consensus_queue.cc:260] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.899008 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bd23cfbfd48cead8919dbcb26f0f0" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:01.905603 28795 raft_consensus.cc:3060] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.913419 29087 ts_tablet_manager.cc:1434] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.004s
I20260709 13:23:01.917346 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bd23cfbfd48cead8919dbcb26f0f0" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
W20260709 13:23:01.919576 28834 leader_election.cc:343] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.921579 29087 tablet_bootstrap.cc:492] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:23:01.931720 29087 tablet_bootstrap.cc:654] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.934580 29098 leader_election.cc:290] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:01.939010 28997 raft_consensus.cc:697] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Becoming Leader. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:23:01.940515 28997 consensus_queue.cc:237] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.942919 29086 tablet_bootstrap.cc:492] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:23:01.943794 29086 ts_tablet_manager.cc:1403] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.097s	user 0.029s	sys 0.061s
I20260709 13:23:01.946693 29088 tablet_bootstrap.cc:492] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:23:01.947363 29088 ts_tablet_manager.cc:1403] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.110s	user 0.022s	sys 0.016s
I20260709 13:23:01.947806 29086 raft_consensus.cc:359] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.948625 29086 raft_consensus.cc:385] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.948967 29086 raft_consensus.cc:740] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.949095 29087 tablet_bootstrap.cc:492] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:23:01.949209 29071 raft_consensus.cc:493] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.949638 29087 ts_tablet_manager.cc:1403] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 13:23:01.949821 29086 consensus_queue.cc:260] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.949992 29071 raft_consensus.cc:515] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.951923 28795 raft_consensus.cc:2468] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:23:01.953433 29087 raft_consensus.cc:359] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.954438 29087 raft_consensus.cc:385] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.956185 29087 raft_consensus.cc:740] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.953866 28836 leader_election.cc:304] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:23:01.957050 29087 consensus_queue.cc:260] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.960778 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511dd4a19da849b2b2557a1c982e59fc" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:23:01.961690 29087 ts_tablet_manager.cc:1434] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:23:01.962538 29098 raft_consensus.cc:2804] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:01.962888 29087 tablet_bootstrap.cc:492] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:23:01.963207 29098 raft_consensus.cc:697] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:23:01.963671 29086 ts_tablet_manager.cc:1434] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:23:01.969523 29071 leader_election.cc:290] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:01.972004 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511dd4a19da849b2b2557a1c982e59fc" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:23:01.971355 29098 consensus_queue.cc:237] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.972756 29087 tablet_bootstrap.cc:654] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:01.973893 28911 leader_election.cc:343] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.974896 29086 tablet_bootstrap.cc:492] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:23:01.981141 29088 raft_consensus.cc:359] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.982126 29088 raft_consensus.cc:385] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.985074 29088 raft_consensus.cc:740] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.985915 29088 consensus_queue.cc:260] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.986487 29087 tablet_bootstrap.cc:492] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:23:01.987181 29087 ts_tablet_manager.cc:1403] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.007s
I20260709 13:23:01.988304 28691 catalog_manager.cc:5697] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:01.989059 29088 ts_tablet_manager.cc:1434] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 13:23:01.988986 28692 catalog_manager.cc:5697] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50315581143f4831ac7a5c7ef9900319 (127.15.208.1). New cstate: current_term: 1 leader_uuid: "50315581143f4831ac7a5c7ef9900319" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:01.990522 29088 tablet_bootstrap.cc:492] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:23:01.991104 29087 raft_consensus.cc:359] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.991946 29087 raft_consensus.cc:385] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.992275 29087 raft_consensus.cc:740] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.993225 29087 consensus_queue.cc:260] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:01.995505 29087 ts_tablet_manager.cc:1434] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:23:02.002930 29087 tablet_bootstrap.cc:492] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:23:02.004882 29086 tablet_bootstrap.cc:654] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.999477 29088 tablet_bootstrap.cc:654] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.999469 28795 raft_consensus.cc:2468] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 0.
I20260709 13:23:02.011768 29087 tablet_bootstrap.cc:654] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.012274 28910 leader_election.cc:304] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: b7eaf45ade8d44d8b662b95708097db9
I20260709 13:23:02.013742 29071 raft_consensus.cc:2804] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.014217 29071 raft_consensus.cc:493] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.014741 29071 raft_consensus.cc:3060] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.026394 29087 tablet_bootstrap.cc:492] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:23:02.027038 29087 ts_tablet_manager.cc:1403] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 13:23:02.027760 29071 raft_consensus.cc:515] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.029999 29087 raft_consensus.cc:359] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.030742 29087 raft_consensus.cc:385] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.031011 29087 raft_consensus.cc:740] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.031913 29087 consensus_queue.cc:260] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.034227 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511dd4a19da849b2b2557a1c982e59fc" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:02.034992 29086 tablet_bootstrap.cc:492] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:23:02.034938 28795 raft_consensus.cc:3060] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.035241 29088 tablet_bootstrap.cc:492] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:23:02.035542 29086 ts_tablet_manager.cc:1403] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.003s
I20260709 13:23:02.035907 29088 ts_tablet_manager.cc:1403] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.012s
I20260709 13:23:02.037549 29087 ts_tablet_manager.cc:1434] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:23:02.038578 29087 tablet_bootstrap.cc:492] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9: Bootstrap starting.
I20260709 13:23:02.038314 29086 raft_consensus.cc:359] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.039214 29086 raft_consensus.cc:385] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.039537 29086 raft_consensus.cc:740] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.040303 29086 consensus_queue.cc:260] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.042815 29086 ts_tablet_manager.cc:1434] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:02.044066 29086 tablet_bootstrap.cc:492] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:23:02.046769 29087 tablet_bootstrap.cc:654] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.051695 29088 raft_consensus.cc:359] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.058027 29086 tablet_bootstrap.cc:654] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.058296 29087 tablet_bootstrap.cc:492] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9: No bootstrap required, opened a new log
I20260709 13:23:02.058832 29087 ts_tablet_manager.cc:1403] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:23:02.059547 29098 raft_consensus.cc:493] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.060135 29098 raft_consensus.cc:515] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.052750 29088 raft_consensus.cc:385] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.061010 29088 raft_consensus.cc:740] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.061874 29088 consensus_queue.cc:260] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.062466 29098 leader_election.cc:290] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.062484 29087 raft_consensus.cc:359] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.063689 29087 raft_consensus.cc:385] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.064110 29087 raft_consensus.cc:740] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.065465 29088 ts_tablet_manager.cc:1434] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:23:02.066573 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b195b9fbf144c72b1a54a00e34ebb4f" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:23:02.067032 29088 tablet_bootstrap.cc:492] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:23:02.065304 29087 consensus_queue.cc:260] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.069659 29086 tablet_bootstrap.cc:492] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:23:02.069468 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b195b9fbf144c72b1a54a00e34ebb4f" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:02.070264 29086 ts_tablet_manager.cc:1403] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 13:23:02.070897 29087 ts_tablet_manager.cc:1434] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:23:02.071760 29107 raft_consensus.cc:493] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.072260 29107 raft_consensus.cc:515] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.074376 29107 leader_election.cc:290] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:02.074956 29086 raft_consensus.cc:359] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.075525 29088 tablet_bootstrap.cc:654] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.075608 29086 raft_consensus.cc:385] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.077016 29086 raft_consensus.cc:740] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.077642 29086 consensus_queue.cc:260] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.078240 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6a7db07f6843f389bdc1f58fe1962d" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:23:02.078997 28871 raft_consensus.cc:2468] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 0.
I20260709 13:23:02.079730 29086 ts_tablet_manager.cc:1434] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.001s
I20260709 13:23:02.080752 29086 tablet_bootstrap.cc:492] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:23:02.080493 28911 leader_election.cc:304] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:02.080518 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6a7db07f6843f389bdc1f58fe1962d" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:23:02.081884 29107 raft_consensus.cc:2804] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.082297 29107 raft_consensus.cc:493] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.082633 29107 raft_consensus.cc:3060] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.083210 29088 tablet_bootstrap.cc:492] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
W20260709 13:23:02.083078 28910 leader_election.cc:343] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.083837 29088 ts_tablet_manager.cc:1403] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:23:02.070762 28945 raft_consensus.cc:2468] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
I20260709 13:23:02.088811 29088 raft_consensus.cc:359] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
W20260709 13:23:02.070292 28836 leader_election.cc:343] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.089805 29088 raft_consensus.cc:385] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.090291 29088 raft_consensus.cc:740] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.091238 29088 consensus_queue.cc:260] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.089422 29086 tablet_bootstrap.cc:654] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.093014 29098 raft_consensus.cc:493] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.093546 29098 raft_consensus.cc:515] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.094558 29107 raft_consensus.cc:515] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.095736 29098 leader_election.cc:290] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.096697 29107 leader_election.cc:290] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:02.092434 28834 leader_election.cc:304] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:23:02.097468 29088 ts_tablet_manager.cc:1434] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:23:02.097595 29098 raft_consensus.cc:2804] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.098125 29098 raft_consensus.cc:493] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.098668 29098 raft_consensus.cc:3060] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.098733 29088 tablet_bootstrap.cc:492] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:23:02.099077 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e82016c61bc4ad38324abd7fb160226" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:02.099782 28943 raft_consensus.cc:2468] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
I20260709 13:23:02.102257 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6a7db07f6843f389bdc1f58fe1962d" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
W20260709 13:23:02.104336 28910 leader_election.cc:343] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.105396 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6a7db07f6843f389bdc1f58fe1962d" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:02.105885 29098 raft_consensus.cc:515] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.106547 28871 raft_consensus.cc:3060] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.108773 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b195b9fbf144c72b1a54a00e34ebb4f" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:02.109900 28795 raft_consensus.cc:2468] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
W20260709 13:23:02.110306 28836 leader_election.cc:343] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.110939 29088 tablet_bootstrap.cc:654] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.114156 29098 leader_election.cc:290] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.112872 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511dd4a19da849b2b2557a1c982e59fc" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:02.115083 28870 raft_consensus.cc:3060] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.115453 29086 tablet_bootstrap.cc:492] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:23:02.115931 29086 ts_tablet_manager.cc:1403] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.009s
I20260709 13:23:02.119001 29086 raft_consensus.cc:359] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.119638 29086 raft_consensus.cc:385] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.119881 29086 raft_consensus.cc:740] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.120486 29086 consensus_queue.cc:260] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.102231 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e82016c61bc4ad38324abd7fb160226" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:23:02.122960 29086 ts_tablet_manager.cc:1434] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:02.121490 28796 raft_consensus.cc:2468] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
I20260709 13:23:02.124934 28910 leader_election.cc:304] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:02.126118 29107 raft_consensus.cc:2804] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.126585 29107 raft_consensus.cc:697] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Leader. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:23:02.126657 28834 leader_election.cc:304] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:02.111078 29071 leader_election.cc:290] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:02.127431 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b195b9fbf144c72b1a54a00e34ebb4f" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:23:02.128345 28943 raft_consensus.cc:3060] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.129886 28870 raft_consensus.cc:2468] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
I20260709 13:23:02.131148 29098 raft_consensus.cc:2804] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.131553 29098 raft_consensus.cc:493] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.131880 29098 raft_consensus.cc:3060] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.127475 29107 consensus_queue.cc:237] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.135918 29086 tablet_bootstrap.cc:492] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d: Bootstrap starting.
I20260709 13:23:02.143043 29086 tablet_bootstrap.cc:654] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.147490 28871 raft_consensus.cc:2468] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
I20260709 13:23:02.154335 28911 leader_election.cc:304] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:23:02.156252 29086 tablet_bootstrap.cc:492] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d: No bootstrap required, opened a new log
I20260709 13:23:02.156904 29086 ts_tablet_manager.cc:1403] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.008s
I20260709 13:23:02.156951 29071 raft_consensus.cc:2804] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.157833 29071 raft_consensus.cc:697] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Leader. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:23:02.158749 29071 consensus_queue.cc:237] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.160408 29107 raft_consensus.cc:493] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.160917 29086 raft_consensus.cc:359] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.161864 29086 raft_consensus.cc:385] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.161996 29123 raft_consensus.cc:493] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.162292 29086 raft_consensus.cc:740] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.162591 29123 raft_consensus.cc:515] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.161098 29107 raft_consensus.cc:515] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.163206 29022 raft_consensus.cc:493] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.163209 29086 consensus_queue.cc:260] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.165637 29022 raft_consensus.cc:515] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.165000 29107 leader_election.cc:290] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:02.156666 29098 raft_consensus.cc:515] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.168576 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1148e114823d4f52bc18a8e2f53e7195" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:23:02.168596 29086 ts_tablet_manager.cc:1434] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:23:02.169304 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e82016c61bc4ad38324abd7fb160226" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:02.169883 28795 raft_consensus.cc:3060] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:02.170012 28836 leader_election.cc:343] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.170261 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6a77e282a04e739610c5f9a83eb77d" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:23:02.171339 29022 leader_election.cc:290] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.175506 28870 raft_consensus.cc:2468] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 0.
I20260709 13:23:02.172724 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1148e114823d4f52bc18a8e2f53e7195" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:02.177850 29098 leader_election.cc:290] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.178393 28945 raft_consensus.cc:2468] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
I20260709 13:23:02.174264 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6a77e282a04e739610c5f9a83eb77d" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:23:02.178936 28911 leader_election.cc:304] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:02.178983 28796 raft_consensus.cc:2468] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 0.
I20260709 13:23:02.179638 28834 leader_election.cc:304] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:23:02.180049 29126 raft_consensus.cc:2804] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.180301 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e82016c61bc4ad38324abd7fb160226" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:23:02.180487 29126 raft_consensus.cc:493] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.180579 29098 raft_consensus.cc:2804] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.181177 29126 raft_consensus.cc:3060] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.181200 28945 raft_consensus.cc:3060] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.165000 29123 leader_election.cc:290] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:02.156639 28943 raft_consensus.cc:2468] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:23:02.177493 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259cd0d23c5d4d6688517ad2681cc56b" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:23:02.171123 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259cd0d23c5d4d6688517ad2681cc56b" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:23:02.186797 28871 raft_consensus.cc:2393] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fcadc1b39cec4f10aa074fc9d4e3862d in current term 1: Already voted for candidate 50315581143f4831ac7a5c7ef9900319 in this term.
I20260709 13:23:02.186918 28834 leader_election.cc:304] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:23:02.170766 28692 catalog_manager.cc:5697] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:02.188308 29022 raft_consensus.cc:2804] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.177197 28795 raft_consensus.cc:2468] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:23:02.188350 29126 raft_consensus.cc:515] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.189723 28836 leader_election.cc:304] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:23:02.190768 29126 leader_election.cc:290] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:02.181371 29098 raft_consensus.cc:493] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.193053 29098 raft_consensus.cc:3060] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.193691 28910 leader_election.cc:304] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9
I20260709 13:23:02.195996 29123 raft_consensus.cc:3060] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.196326 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6a77e282a04e739610c5f9a83eb77d" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:02.198873 28795 raft_consensus.cc:3060] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.197578 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6a77e282a04e739610c5f9a83eb77d" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:02.201627 28870 raft_consensus.cc:3060] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.201973 29088 tablet_bootstrap.cc:492] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:23:02.202592 29088 ts_tablet_manager.cc:1403] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.041s
I20260709 13:23:02.207054 29088 raft_consensus.cc:359] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.207841 29088 raft_consensus.cc:385] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.208207 29088 raft_consensus.cc:740] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.208971 29088 consensus_queue.cc:260] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.211069 28945 raft_consensus.cc:2468] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:23:02.213311 29088 ts_tablet_manager.cc:1434] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:23:02.215670 28997 raft_consensus.cc:493] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.228133 28997 raft_consensus.cc:515] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.229066 29088 tablet_bootstrap.cc:492] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:23:02.230547 28997 leader_election.cc:290] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.224339 29098 raft_consensus.cc:515] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.235198 29098 leader_election.cc:290] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.216478 28692 catalog_manager.cc:5697] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:02.223657 28870 raft_consensus.cc:2468] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
I20260709 13:23:02.241796 29022 raft_consensus.cc:697] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:23:02.216614 29123 raft_consensus.cc:2749] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:02.243937 28911 leader_election.cc:304] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:02.236563 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1148e114823d4f52bc18a8e2f53e7195" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:02.237985 29131 raft_consensus.cc:2804] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.240265 29088 tablet_bootstrap.cc:654] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:02.240109 28836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.208.1:40539, user_credentials={real_user=slave}} blocked reactor thread for 50477.5us
I20260709 13:23:02.240561 29129 raft_consensus.cc:493] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.226897 28795 raft_consensus.cc:2468] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
I20260709 13:23:02.243407 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1148e114823d4f52bc18a8e2f53e7195" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:23:02.250887 28943 raft_consensus.cc:3060] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.254999 29022 consensus_queue.cc:237] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.248713 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1148e114823d4f52bc18a8e2f53e7195" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:23:02.257302 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1148e114823d4f52bc18a8e2f53e7195" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:02.257989 28794 raft_consensus.cc:3060] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.257952 29129 raft_consensus.cc:515] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.259156 28943 raft_consensus.cc:2468] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:23:02.260092 29088 tablet_bootstrap.cc:492] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:23:02.260697 29088 ts_tablet_manager.cc:1403] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.002s
I20260709 13:23:02.261257 29129 leader_election.cc:290] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.261451 29126 raft_consensus.cc:493] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.262079 29126 raft_consensus.cc:515] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.264804 28795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f27d02fa52543368edef331aeaec217" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:23:02.263497 29088 raft_consensus.cc:359] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.265278 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f27d02fa52543368edef331aeaec217" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:23:02.265610 28795 raft_consensus.cc:2468] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 0.
I20260709 13:23:02.266058 28871 raft_consensus.cc:2468] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 0.
I20260709 13:23:02.265596 29088 raft_consensus.cc:385] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.266952 29088 raft_consensus.cc:740] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.267087 28910 leader_election.cc:304] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:02.263933 29126 leader_election.cc:290] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:02.268137 29071 raft_consensus.cc:2804] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.261418 28834 leader_election.cc:304] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:02.268631 29071 raft_consensus.cc:493] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.269172 29071 raft_consensus.cc:3060] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.244767 29123 raft_consensus.cc:2804] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.270635 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f27d02fa52543368edef331aeaec217" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:02.267625 29088 consensus_queue.cc:260] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.271183 29123 raft_consensus.cc:697] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Leader. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:23:02.272073 29123 consensus_queue.cc:237] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.273072 29088 ts_tablet_manager.cc:1434] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:23:02.257522 28870 raft_consensus.cc:2393] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50315581143f4831ac7a5c7ef9900319 in current term 1: Already voted for candidate b7eaf45ade8d44d8b662b95708097db9 in this term.
I20260709 13:23:02.273665 29022 raft_consensus.cc:2804] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.274078 29022 raft_consensus.cc:697] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:23:02.274780 29022 consensus_queue.cc:237] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.278481 29131 raft_consensus.cc:697] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:23:02.279059 28692 catalog_manager.cc:5697] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.279858 29131 consensus_queue.cc:237] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.285861 29071 raft_consensus.cc:515] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.286872 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f27d02fa52543368edef331aeaec217" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319" is_pre_election: true
I20260709 13:23:02.286928 29088 tablet_bootstrap.cc:492] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319: Bootstrap starting.
I20260709 13:23:02.291141 28943 raft_consensus.cc:2393] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7eaf45ade8d44d8b662b95708097db9 in current term 1: Already voted for candidate fcadc1b39cec4f10aa074fc9d4e3862d in this term.
I20260709 13:23:02.291857 28762 leader_election.cc:304] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319; no voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:23:02.284371 28794 raft_consensus.cc:2468] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 1.
I20260709 13:23:02.296005 28997 raft_consensus.cc:2749] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:02.287637 28796 raft_consensus.cc:2468] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 0.
I20260709 13:23:02.300045 29071 leader_election.cc:290] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:02.300230 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f27d02fa52543368edef331aeaec217" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:02.301920 28870 raft_consensus.cc:3060] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.300668 28836 leader_election.cc:304] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:23:02.300889 28794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f27d02fa52543368edef331aeaec217" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:02.309238 28794 raft_consensus.cc:3060] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.313302 28870 raft_consensus.cc:2468] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
I20260709 13:23:02.313918 29129 raft_consensus.cc:2764] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:23:02.315826 29088 tablet_bootstrap.cc:654] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.316491 28794 raft_consensus.cc:2468] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
I20260709 13:23:02.316747 28692 catalog_manager.cc:5697] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.317986 28910 leader_election.cc:304] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:02.319250 29123 raft_consensus.cc:2804] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.318681 28692 catalog_manager.cc:5697] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 1 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.320160 29123 raft_consensus.cc:697] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Leader. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:23:02.321218 29123 consensus_queue.cc:237] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.324534 29088 tablet_bootstrap.cc:492] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319: No bootstrap required, opened a new log
I20260709 13:23:02.325126 29088 ts_tablet_manager.cc:1403] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.004s
I20260709 13:23:02.323760 28693 catalog_manager.cc:5697] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:02.328015 29088 raft_consensus.cc:359] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.328708 29088 raft_consensus.cc:385] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.329064 29088 raft_consensus.cc:740] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.329891 29088 consensus_queue.cc:260] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.331939 29088 ts_tablet_manager.cc:1434] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:23:02.345394 28692 catalog_manager.cc:5697] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d reported cstate change: term changed from 0 to 1, leader changed from <none> to fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3). New cstate: current_term: 1 leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:02.384505 28870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e82016c61bc4ad38324abd7fb160226"
dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
mode: GRACEFUL
new_leader_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:37084
I20260709 13:23:02.385246 28870 raft_consensus.cc:606] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Received request to transfer leadership to TS 50315581143f4831ac7a5c7ef9900319
I20260709 13:23:02.392510 28870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc2bd23cfbfd48cead8919dbcb26f0f0"
dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
mode: GRACEFUL
new_leader_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:37084
I20260709 13:23:02.393039 28870 raft_consensus.cc:606] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Received request to transfer leadership to TS 50315581143f4831ac7a5c7ef9900319
I20260709 13:23:02.397714 28943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f27d02fa52543368edef331aeaec217"
dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
mode: GRACEFUL
new_leader_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:57322
I20260709 13:23:02.398291 28943 raft_consensus.cc:606] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Received request to transfer leadership to TS 50315581143f4831ac7a5c7ef9900319
I20260709 13:23:02.403410 28943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "511dd4a19da849b2b2557a1c982e59fc"
dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
mode: GRACEFUL
new_leader_uuid: "b7eaf45ade8d44d8b662b95708097db9"
 from {username='slave'} at 127.0.0.1:57322
I20260709 13:23:02.403968 28943 raft_consensus.cc:606] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Received request to transfer leadership to TS b7eaf45ade8d44d8b662b95708097db9
I20260709 13:23:02.411324 28943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e6a7db07f6843f389bdc1f58fe1962d"
dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
mode: GRACEFUL
new_leader_uuid: "b7eaf45ade8d44d8b662b95708097db9"
 from {username='slave'} at 127.0.0.1:57322
I20260709 13:23:02.411887 28943 raft_consensus.cc:606] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Received request to transfer leadership to TS b7eaf45ade8d44d8b662b95708097db9
I20260709 13:23:02.419358 28997 consensus_queue.cc:1048] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.430563 29105 consensus_queue.cc:1048] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:02.469731 29105 raft_consensus.cc:493] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.470170 29105 raft_consensus.cc:515] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.471832 29105 leader_election.cc:290] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.472579 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b195b9fbf144c72b1a54a00e34ebb4f" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:23:02.472772 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b195b9fbf144c72b1a54a00e34ebb4f" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:02.473592 28943 raft_consensus.cc:2393] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50315581143f4831ac7a5c7ef9900319 in current term 1: Already voted for candidate b7eaf45ade8d44d8b662b95708097db9 in this term.
I20260709 13:23:02.474488 28759 leader_election.cc:304] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319; no voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:23:02.475154 29105 raft_consensus.cc:3060] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.480432 29105 raft_consensus.cc:2749] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:02.480530 29104 raft_consensus.cc:493] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.481120 29104 raft_consensus.cc:515] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.482748 29104 leader_election.cc:290] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.483644 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6a7db07f6843f389bdc1f58fe1962d" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:23:02.483793 28943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6a7db07f6843f389bdc1f58fe1962d" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:02.484470 28870 raft_consensus.cc:2393] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50315581143f4831ac7a5c7ef9900319 in current term 1: Already voted for candidate fcadc1b39cec4f10aa074fc9d4e3862d in this term.
I20260709 13:23:02.485471 28762 leader_election.cc:304] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319; no voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:23:02.486238 29104 raft_consensus.cc:3060] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.488581 29131 consensus_queue.cc:1048] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.492878 29104 raft_consensus.cc:2749] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:02.495954 29129 raft_consensus.cc:993] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9: : Instructing follower 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:23:02.496510 29098 raft_consensus.cc:1081] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Signalling peer 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:23:02.501364 28943 raft_consensus.cc:3060] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.501526 28796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc2bd23cfbfd48cead8919dbcb26f0f0"
dest_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:35818
I20260709 13:23:02.502300 28796 raft_consensus.cc:493] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:02.502664 28796 raft_consensus.cc:3060] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.508471 29098 consensus_queue.cc:1048] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:02.510251 28796 raft_consensus.cc:515] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.513080 28796 leader_election.cc:290] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Requested vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.513335 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bd23cfbfd48cead8919dbcb26f0f0" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:02.514266 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bd23cfbfd48cead8919dbcb26f0f0" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:23:02.521215 28945 raft_consensus.cc:3060] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.521291 28870 raft_consensus.cc:3055] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:02.521756 28870 raft_consensus.cc:740] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:23:02.523102 28870 consensus_queue.cc:260] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.524585 28870 raft_consensus.cc:3060] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.525575 29123 consensus_queue.cc:1048] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.528820 28945 raft_consensus.cc:2468] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:23:02.532827 28870 raft_consensus.cc:2468] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:23:02.534278 28762 leader_election.cc:304] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:23:02.536165 29104 raft_consensus.cc:2804] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:02.537909 29104 raft_consensus.cc:697] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Becoming Leader. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:23:02.539426 29104 consensus_queue.cc:237] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.547899 29071 consensus_queue.cc:1048] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.554281 28692 catalog_manager.cc:5697] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 reported cstate change: term changed from 1 to 2, leader changed from b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2) to 50315581143f4831ac7a5c7ef9900319 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "50315581143f4831ac7a5c7ef9900319" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.555532 29107 raft_consensus.cc:993] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d: : Instructing follower b7eaf45ade8d44d8b662b95708097db9 to start an election
I20260709 13:23:02.556160 29071 raft_consensus.cc:1081] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Signalling peer b7eaf45ade8d44d8b662b95708097db9 to start an election
I20260709 13:23:02.557768 28870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "511dd4a19da849b2b2557a1c982e59fc"
dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
 from {username='slave'} at 127.0.0.1:37076
I20260709 13:23:02.558400 28870 raft_consensus.cc:493] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:02.558754 28870 raft_consensus.cc:3060] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.566136 28870 raft_consensus.cc:515] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.568490 28870 leader_election.cc:290] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.569471 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511dd4a19da849b2b2557a1c982e59fc" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:02.569886 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511dd4a19da849b2b2557a1c982e59fc" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:23:02.570272 28796 raft_consensus.cc:3060] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.570523 28945 raft_consensus.cc:3055] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:02.570879 28945 raft_consensus.cc:740] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:23:02.571692 28945 consensus_queue.cc:260] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.572932 28945 raft_consensus.cc:3060] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.578150 28796 raft_consensus.cc:2468] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 2.
I20260709 13:23:02.579370 28836 leader_election.cc:304] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:23:02.579910 28945 raft_consensus.cc:2468] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 2.
I20260709 13:23:02.580077 29098 raft_consensus.cc:2804] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:02.580722 29098 raft_consensus.cc:697] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 2 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:23:02.581638 29098 consensus_queue.cc:237] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.587894 28692 catalog_manager.cc:5697] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 1 to 2, leader changed from fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3) to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.675348 29098 consensus_queue.cc:1048] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.683326 29071 consensus_queue.cc:1048] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.686784 29128 consensus_queue.cc:1048] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:02.694226 29107 consensus_queue.cc:1048] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:02.702487 29128 consensus_queue.cc:1048] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.720512 29126 consensus_queue.cc:1048] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.731496 29128 consensus_queue.cc:1048] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.748044 29126 consensus_queue.cc:1048] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.749001 29128 consensus_queue.cc:1048] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.765337 29126 raft_consensus.cc:993] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d: : Instructing follower b7eaf45ade8d44d8b662b95708097db9 to start an election
I20260709 13:23:02.765844 29126 raft_consensus.cc:1081] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Signalling peer b7eaf45ade8d44d8b662b95708097db9 to start an election
I20260709 13:23:02.766227 29131 raft_consensus.cc:993] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9: : Instructing follower 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:23:02.766803 29098 raft_consensus.cc:1081] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Signalling peer 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:23:02.768492 28795 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e82016c61bc4ad38324abd7fb160226"
dest_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:35818
I20260709 13:23:02.771240 28795 raft_consensus.cc:493] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:02.771684 28795 raft_consensus.cc:3060] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.771502 29128 consensus_queue.cc:1048] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.779598 28795 raft_consensus.cc:515] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.791832 28870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e6a7db07f6843f389bdc1f58fe1962d"
dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
 from {username='slave'} at 127.0.0.1:37076
I20260709 13:23:02.796136 29126 consensus_queue.cc:1048] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:02.798591 28870 raft_consensus.cc:493] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:02.801745 28870 raft_consensus.cc:3060] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.811810 28870 raft_consensus.cc:515] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.817798 28870 leader_election.cc:290] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:02.818864 28945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6a7db07f6843f389bdc1f58fe1962d" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:23:02.819530 28945 raft_consensus.cc:3055] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:02.819840 28945 raft_consensus.cc:740] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:23:02.822014 28945 consensus_queue.cc:260] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.823982 28945 raft_consensus.cc:3060] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.833894 28945 raft_consensus.cc:2468] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 2.
I20260709 13:23:02.835155 28834 leader_election.cc:304] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:02.836135 29128 raft_consensus.cc:2804] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:02.836653 29128 raft_consensus.cc:697] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 2 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:23:02.837658 29128 consensus_queue.cc:237] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:02.986254 28796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6a7db07f6843f389bdc1f58fe1962d" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:02.986924 28796 raft_consensus.cc:3060] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.994743 28796 raft_consensus.cc:2468] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 2.
I20260709 13:23:03.000765 29071 consensus_queue.cc:1048] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.009364 29123 raft_consensus.cc:993] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d: : Instructing follower 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:23:03.009866 29071 raft_consensus.cc:1081] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Signalling peer 50315581143f4831ac7a5c7ef9900319 to start an election
I20260709 13:23:03.010449 28795 leader_election.cc:290] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Requested vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:03.011479 28793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f27d02fa52543368edef331aeaec217"
dest_uuid: "50315581143f4831ac7a5c7ef9900319"
 from {username='slave'} at 127.0.0.1:35806
I20260709 13:23:03.011581 28944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e82016c61bc4ad38324abd7fb160226" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:23:03.012261 28793 raft_consensus.cc:493] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:03.012401 28944 raft_consensus.cc:3060] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.012714 28793 raft_consensus.cc:3060] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.019089 28943 raft_consensus.cc:1275] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.019985 28793 raft_consensus.cc:515] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:03.020869 28997 consensus_queue.cc:1048] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:03.022766 28793 leader_election.cc:290] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Requested vote from peers b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:03.024187 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f27d02fa52543368edef331aeaec217" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:23:03.024878 28942 raft_consensus.cc:3055] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:03.025161 28942 raft_consensus.cc:740] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:23:03.025837 28942 consensus_queue.cc:260] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:03.026925 28942 raft_consensus.cc:3060] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.027638 28944 raft_consensus.cc:2468] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:23:03.031375 28759 leader_election.cc:304] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:03.035696 29104 raft_consensus.cc:2804] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.036016 28870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e82016c61bc4ad38324abd7fb160226" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:03.036206 28942 raft_consensus.cc:2468] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:23:03.036288 29104 raft_consensus.cc:697] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Becoming Leader. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:23:03.044940 29104 consensus_queue.cc:237] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:03.036700 28870 raft_consensus.cc:3055] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:03.037761 28871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f27d02fa52543368edef331aeaec217" candidate_uuid: "50315581143f4831ac7a5c7ef9900319" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:03.048043 28870 raft_consensus.cc:740] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:23:03.048219 28871 raft_consensus.cc:3060] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.049093 28870 consensus_queue.cc:260] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:03.040194 28868 raft_consensus.cc:1275] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.053161 28870 raft_consensus.cc:3060] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.055514 28871 raft_consensus.cc:2468] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:23:03.039705 28944 raft_consensus.cc:1275] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Refusing update from remote peer b7eaf45ade8d44d8b662b95708097db9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.051395 28691 catalog_manager.cc:5697] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 1 to 2, leader changed from fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3) to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 2 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.057793 28762 leader_election.cc:304] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9; no voters: 
I20260709 13:23:03.057878 29128 consensus_queue.cc:1048] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:03.058730 29105 raft_consensus.cc:2804] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.059216 29105 raft_consensus.cc:697] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Becoming Leader. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:23:03.057600 29104 consensus_queue.cc:1048] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:03.060034 29105 consensus_queue.cc:237] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:03.068024 28793 raft_consensus.cc:1275] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Refusing update from remote peer b7eaf45ade8d44d8b662b95708097db9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.069569 28870 raft_consensus.cc:2468] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50315581143f4831ac7a5c7ef9900319 in term 2.
I20260709 13:23:03.069501 29129 consensus_queue.cc:1048] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:03.074702 28692 catalog_manager.cc:5697] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 reported cstate change: term changed from 1 to 2, leader changed from b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2) to 50315581143f4831ac7a5c7ef9900319 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "50315581143f4831ac7a5c7ef9900319" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.094300 28692 catalog_manager.cc:5697] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 reported cstate change: term changed from 1 to 2, leader changed from fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3) to 50315581143f4831ac7a5c7ef9900319 (127.15.208.1). New cstate: current_term: 2 leader_uuid: "50315581143f4831ac7a5c7ef9900319" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.259256 28793 raft_consensus.cc:1275] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Refusing update from remote peer b7eaf45ade8d44d8b662b95708097db9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.260663 29129 consensus_queue.cc:1048] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:03.268314 28942 raft_consensus.cc:1275] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Refusing update from remote peer b7eaf45ade8d44d8b662b95708097db9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.270090 29022 consensus_queue.cc:1048] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:03.520239 28944 raft_consensus.cc:1275] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.521633 29104 consensus_queue.cc:1048] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:03.531374 28871 raft_consensus.cc:1275] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.532714 29104 consensus_queue.cc:1048] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:03.548139 28944 raft_consensus.cc:1275] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.549880 29104 consensus_queue.cc:1048] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:03.557361 28871 raft_consensus.cc:1275] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Refusing update from remote peer 50315581143f4831ac7a5c7ef9900319: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:03.559548 28997 consensus_queue.cc:1048] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:03.907572 28817 debug-util.cc:398] Leaking SignalData structure 0x7b0800361160 after lost signal to thread 16195
W20260709 13:23:03.908727 28817 debug-util.cc:398] Leaking SignalData structure 0x7b080018e920 after lost signal to thread 28728
W20260709 13:23:03.909965 28817 debug-util.cc:398] Leaking SignalData structure 0x7b080020f3c0 after lost signal to thread 28820
W20260709 13:23:03.911048 28817 debug-util.cc:398] Leaking SignalData structure 0x7b080012e420 after lost signal to thread 28895
W20260709 13:23:03.912055 28817 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd3a0 after lost signal to thread 28969
I20260709 13:23:05.425109 28692 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37620:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:23:05.450986 28692 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37620:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:23:05.475405 16192 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:05.666195 29199 tablet.cc:1724] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:05.671905 29196 tablet.cc:1724] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:23:05.680416 29183 log.cc:927] Time spent T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:23:05.689086 29182 log.cc:927] Time spent T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:23:05.700987 28834 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.208.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 67261.8us
I20260709 13:23:05.742627 29199 tablet.cc:1724] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:05.785465 29210 tablet.cc:1724] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:05.821965 28871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56b8817d457f4c5ea9a62fdcc8b756ff"
dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
mode: GRACEFUL
new_leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
 from {username='slave'} at 127.0.0.1:37144
I20260709 13:23:05.822995 28871 raft_consensus.cc:606] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Received request to transfer leadership to TS fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:23:05.919361 29225 tablet.cc:1724] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:05.866052 29215 tablet.cc:1724] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:05.948525 29222 tablet.cc:1724] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:05.957093 29226 tablet.cc:1724] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:05.977316 29199 tablet.cc:1724] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:05.984689 29209 tablet.cc:1724] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.007620 29128 raft_consensus.cc:993] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9: : Instructing follower fcadc1b39cec4f10aa074fc9d4e3862d to start an election
I20260709 13:23:06.008190 29128 raft_consensus.cc:1081] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Signalling peer fcadc1b39cec4f10aa074fc9d4e3862d to start an election
I20260709 13:23:06.016492 28938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56b8817d457f4c5ea9a62fdcc8b756ff"
dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
 from {username='slave'} at 127.0.0.1:57316
I20260709 13:23:06.021893 28938 raft_consensus.cc:493] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:06.022867 28938 raft_consensus.cc:3060] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:06.023012 29196 tablet.cc:1724] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:05.995416 29225 tablet.cc:1724] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.036444 29231 tablet.cc:1724] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.040952 29224 tablet.cc:1724] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.055145 29232 tablet.cc:1724] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.043895 29210 tablet.cc:1724] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.058310 29226 tablet.cc:1724] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.062129 29225 tablet.cc:1724] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.067301 29222 tablet.cc:1724] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.079773 29196 tablet.cc:1724] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.043375 28938 raft_consensus.cc:515] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:06.058684 29215 tablet.cc:1724] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.070374 29234 tablet.cc:1724] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.099036 28938 leader_election.cc:290] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 2 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:06.101509 28866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b8817d457f4c5ea9a62fdcc8b756ff" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:06.102270 28866 raft_consensus.cc:3055] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:06.102602 28866 raft_consensus.cc:740] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:23:06.084555 29199 tablet.cc:1724] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.103439 28866 consensus_queue.cc:260] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:06.092208 29224 tablet.cc:1724] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.093416 28793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e"
dest_uuid: "50315581143f4831ac7a5c7ef9900319"
mode: GRACEFUL
new_leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
 from {username='slave'} at 127.0.0.1:59106
I20260709 13:23:06.109310 28793 raft_consensus.cc:606] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Received request to transfer leadership to TS fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:23:06.110181 28866 raft_consensus.cc:3060] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:06.111130 16192 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:06.111940 16192 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:06.126843 29222 tablet.cc:1724] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.130182 29232 tablet.cc:1724] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.136655 29225 tablet.cc:1724] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:06.145969 28866 raft_consensus.cc:2468] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 2.
I20260709 13:23:06.155474 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b8817d457f4c5ea9a62fdcc8b756ff" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:06.165421 28792 raft_consensus.cc:3060] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:06.165643 28911 leader_election.cc:304] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:06.167032 29107 raft_consensus.cc:2804] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:06.167531 29107 raft_consensus.cc:697] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 LEADER]: Becoming Leader. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:23:06.168437 29107 consensus_queue.cc:237] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:06.191195 28792 raft_consensus.cc:2468] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 2.
I20260709 13:23:06.204769 28694 catalog_manager.cc:6242] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04: soft_deleted_table [id=6d58d8ce40184e2ba3efbff44770b65c] alter complete (version 1)
I20260709 13:23:06.217887 28691 catalog_manager.cc:5697] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d reported cstate change: term changed from 1 to 2, leader changed from b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2) to fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3). New cstate: current_term: 2 leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:06.336225 29228 raft_consensus.cc:993] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319: : Instructing follower fcadc1b39cec4f10aa074fc9d4e3862d to start an election
I20260709 13:23:06.336906 29186 raft_consensus.cc:1081] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Signalling peer fcadc1b39cec4f10aa074fc9d4e3862d to start an election
I20260709 13:23:06.338538 28942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e"
dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
 from {username='slave'} at 127.0.0.1:57308
I20260709 13:23:06.339145 28942 raft_consensus.cc:493] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:06.339529 28942 raft_consensus.cc:3060] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:06.345590 28942 raft_consensus.cc:515] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:06.348018 28942 leader_election.cc:290] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:06.348553 28792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50315581143f4831ac7a5c7ef9900319"
I20260709 13:23:06.348649 28866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86fe15b142a4736ba19dd5b5ca4356e" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:06.349406 28792 raft_consensus.cc:3055] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:06.349644 28866 raft_consensus.cc:3060] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:06.349866 28792 raft_consensus.cc:740] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50315581143f4831ac7a5c7ef9900319, State: Running, Role: LEADER
I20260709 13:23:06.350835 28792 consensus_queue.cc:260] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:06.352437 28792 raft_consensus.cc:3060] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:06.355302 28866 raft_consensus.cc:2468] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 3.
I20260709 13:23:06.356506 28911 leader_election.cc:304] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:06.357221 29107 raft_consensus.cc:2804] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:06.357645 29107 raft_consensus.cc:697] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 3 LEADER]: Becoming Leader. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:23:06.358557 29107 consensus_queue.cc:237] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:06.360235 28792 raft_consensus.cc:2468] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 3.
I20260709 13:23:06.369670 28691 catalog_manager.cc:5697] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d reported cstate change: term changed from 2 to 3, leader changed from 50315581143f4831ac7a5c7ef9900319 (127.15.208.1) to fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3). New cstate: current_term: 3 leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:06.663081 28792 raft_consensus.cc:1275] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Refusing update from remote peer fcadc1b39cec4f10aa074fc9d4e3862d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:06.664394 29107 consensus_queue.cc:1048] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:06.675213 28866 raft_consensus.cc:1275] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Refusing update from remote peer fcadc1b39cec4f10aa074fc9d4e3862d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:06.677207 29213 consensus_queue.cc:1048] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:06.868993 28792 raft_consensus.cc:1275] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 3 FOLLOWER]: Refusing update from remote peer fcadc1b39cec4f10aa074fc9d4e3862d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:06.870260 29107 consensus_queue.cc:1048] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:06.884595 28866 raft_consensus.cc:1275] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 3 FOLLOWER]: Refusing update from remote peer fcadc1b39cec4f10aa074fc9d4e3862d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:06.886186 29213 consensus_queue.cc:1048] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:23:07.180070 16192 tablet_server.cc:179] TabletServer@127.15.208.1:0 shutting down...
W20260709 13:23:07.183790 28836 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 13:23:07.199744 28836 consensus_peers.cc:597] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:07.224838 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:07.225996 16192 tablet_replica.cc:333] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
W20260709 13:23:07.226955 28836 consensus_peers.cc:597] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:07.227010 16192 raft_consensus.cc:2243] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.228027 16192 raft_consensus.cc:2272] T 5e6a7db07f6843f389bdc1f58fe1962d P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.230640 16192 tablet_replica.cc:333] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.231576 16192 raft_consensus.cc:2243] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.232075 16192 raft_consensus.cc:2272] T 8b195b9fbf144c72b1a54a00e34ebb4f P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:07.232883 28910 consensus_peers.cc:597] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:07.234177 16192 tablet_replica.cc:333] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.234846 16192 raft_consensus.cc:2243] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.235293 16192 raft_consensus.cc:2272] T 1148e114823d4f52bc18a8e2f53e7195 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.237334 16192 tablet_replica.cc:333] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.237900 16192 raft_consensus.cc:2243] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:07.238715 16192 raft_consensus.cc:2272] T 7f27d02fa52543368edef331aeaec217 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.240533 16192 tablet_replica.cc:333] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.241273 16192 raft_consensus.cc:2243] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.241705 16192 raft_consensus.cc:2272] T 511dd4a19da849b2b2557a1c982e59fc P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.244107 16192 tablet_replica.cc:333] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.244810 16192 raft_consensus.cc:2243] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.245363 16192 raft_consensus.cc:2272] T c716168074ec471191341541441dfbcb P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.247608 16192 tablet_replica.cc:333] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.248351 16192 raft_consensus.cc:2243] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:07.249207 16192 raft_consensus.cc:2272] T 259cd0d23c5d4d6688517ad2681cc56b P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.251330 16192 tablet_replica.cc:333] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.252355 16192 raft_consensus.cc:2243] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.252913 16192 raft_consensus.cc:2272] T 56b8817d457f4c5ea9a62fdcc8b756ff P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:07.253816 28910 consensus_peers.cc:597] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:07.256556 16192 tablet_replica.cc:333] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.257246 16192 raft_consensus.cc:2243] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:07.258000 16192 raft_consensus.cc:2272] T bc2bd23cfbfd48cead8919dbcb26f0f0 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.259886 16192 tablet_replica.cc:333] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.260577 16192 raft_consensus.cc:2243] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:07.261382 16192 raft_consensus.cc:2272] T 2e82016c61bc4ad38324abd7fb160226 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.263183 16192 tablet_replica.cc:333] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.263716 16192 raft_consensus.cc:2243] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.264129 16192 raft_consensus.cc:2272] T b86fe15b142a4736ba19dd5b5ca4356e P 50315581143f4831ac7a5c7ef9900319 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.267138 16192 tablet_replica.cc:333] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.267795 16192 raft_consensus.cc:2243] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:07.268596 16192 raft_consensus.cc:2272] T f3e8aaa4249849b6864c20dbb553a2cb P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.270982 16192 tablet_replica.cc:333] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.271636 16192 raft_consensus.cc:2243] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.272117 16192 raft_consensus.cc:2272] T 8e6a77e282a04e739610c5f9a83eb77d P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.273916 16192 tablet_replica.cc:333] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.274453 16192 raft_consensus.cc:2243] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.274873 16192 raft_consensus.cc:2272] T ba72a4f311ef4c589ef49c92b8af7f93 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.276990 16192 tablet_replica.cc:333] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.277478 16192 raft_consensus.cc:2243] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.277884 16192 raft_consensus.cc:2272] T f8684efda0df426eae166d3657400989 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.280072 16192 tablet_replica.cc:333] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.280573 16192 raft_consensus.cc:2243] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:07.281078 16192 raft_consensus.cc:2272] T 20a1dc8dbb1643fb947fd70d65f59628 P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.283227 16192 tablet_replica.cc:333] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.283699 16192 raft_consensus.cc:2243] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:07.284467 16192 raft_consensus.cc:2272] T 433b9c6f78a34d03a0868a819d6197cc P 50315581143f4831ac7a5c7ef9900319 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:07.295326 16192 tablet_replica.cc:333] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319: stopping tablet replica
I20260709 13:23:07.296285 16192 raft_consensus.cc:2243] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:07.297504 16192 raft_consensus.cc:2272] T 6c300961d77a49ffa8d1c428dc2ed841 P 50315581143f4831ac7a5c7ef9900319 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:07.355840 28836 consensus_peers.cc:597] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:07.365835 28836 consensus_peers.cc:597] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:07.444629 28836 consensus_peers.cc:597] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:07.463521 28910 consensus_peers.cc:597] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:07.512526 28910 consensus_peers.cc:597] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:07.522806 28836 consensus_peers.cc:597] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:07.736770 28836 consensus_peers.cc:597] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 -> Peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Couldn't send request to peer 50315581143f4831ac7a5c7ef9900319. Status: Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:08.228441 29107 raft_consensus.cc:493] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50315581143f4831ac7a5c7ef9900319)
I20260709 13:23:08.229135 29107 raft_consensus.cc:515] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.231565 29107 leader_election.cc:290] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:08.232808 28866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
W20260709 13:23:08.235903 28910 leader_election.cc:336] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111)
I20260709 13:23:08.236322 28910 leader_election.cc:304] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9
I20260709 13:23:08.237066 29107 raft_consensus.cc:2749] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:23:08.237963 29251 raft_consensus.cc:493] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50315581143f4831ac7a5c7ef9900319)
I20260709 13:23:08.238556 29251 raft_consensus.cc:515] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.240517 29251 leader_election.cc:290] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:08.241750 28938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:08.242519 28938 raft_consensus.cc:2468] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 2.
I20260709 13:23:08.243645 28834 leader_election.cc:304] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:08.244423 29251 raft_consensus.cc:2804] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:23:08.244903 29251 raft_consensus.cc:493] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 50315581143f4831ac7a5c7ef9900319)
I20260709 13:23:08.245314 29251 raft_consensus.cc:3060] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:23:08.247102 28836 leader_election.cc:336] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111)
I20260709 13:23:08.252689 29251 raft_consensus.cc:515] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.254678 29251 leader_election.cc:290] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 3 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:08.255836 28938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3e8aaa4249849b6864c20dbb553a2cb" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d"
I20260709 13:23:08.256458 28938 raft_consensus.cc:3060] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:23:08.259058 28836 leader_election.cc:336] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111)
I20260709 13:23:08.263301 28938 raft_consensus.cc:2468] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7eaf45ade8d44d8b662b95708097db9 in term 3.
I20260709 13:23:08.264462 28834 leader_election.cc:304] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:23:08.265249 29251 raft_consensus.cc:2804] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:08.265746 29251 raft_consensus.cc:697] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 3 LEADER]: Becoming Leader. State: Replica: b7eaf45ade8d44d8b662b95708097db9, State: Running, Role: LEADER
I20260709 13:23:08.266640 29251 consensus_queue.cc:237] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.276070 28691 catalog_manager.cc:5697] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 reported cstate change: term changed from 2 to 3, leader changed from 50315581143f4831ac7a5c7ef9900319 (127.15.208.1) to b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2). New cstate: current_term: 3 leader_uuid: "b7eaf45ade8d44d8b662b95708097db9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:08.284291 29251 raft_consensus.cc:493] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50315581143f4831ac7a5c7ef9900319)
I20260709 13:23:08.285002 29251 raft_consensus.cc:515] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.289237 28938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259cd0d23c5d4d6688517ad2681cc56b" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:08.290619 29251 leader_election.cc:290] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
W20260709 13:23:08.294021 28836 leader_election.cc:336] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111)
I20260709 13:23:08.294590 28836 leader_election.cc:304] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9; no voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d
I20260709 13:23:08.295511 29251 raft_consensus.cc:2749] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:08.349320 16192 tablet_server.cc:196] TabletServer@127.15.208.1:0 shutdown complete.
I20260709 13:23:08.360133 29223 raft_consensus.cc:493] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50315581143f4831ac7a5c7ef9900319)
I20260709 13:23:08.360877 29223 raft_consensus.cc:515] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.362154 29107 raft_consensus.cc:493] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50315581143f4831ac7a5c7ef9900319)
I20260709 13:23:08.362648 29107 raft_consensus.cc:515] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.364032 29223 leader_election.cc:290] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3:43697)
I20260709 13:23:08.364271 28938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bd23cfbfd48cead8919dbcb26f0f0" candidate_uuid: "b7eaf45ade8d44d8b662b95708097db9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" is_pre_election: true
I20260709 13:23:08.365269 29107 leader_election.cc:290] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:08.365810 29107 raft_consensus.cc:493] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50315581143f4831ac7a5c7ef9900319)
I20260709 13:23:08.366263 29107 raft_consensus.cc:515] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.366545 28866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "433b9c6f78a34d03a0868a819d6197cc" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
I20260709 13:23:08.368144 29107 leader_election.cc:290] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:08.369369 28866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259cd0d23c5d4d6688517ad2681cc56b" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9" is_pre_election: true
W20260709 13:23:08.369949 28910 leader_election.cc:336] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111)
I20260709 13:23:08.370078 28866 raft_consensus.cc:2468] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 1.
I20260709 13:23:08.370474 28910 leader_election.cc:304] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9
I20260709 13:23:08.371543 28911 leader_election.cc:304] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 
I20260709 13:23:08.372452 29213 raft_consensus.cc:2749] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:23:08.373301 29213 raft_consensus.cc:2804] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:08.373656 29213 raft_consensus.cc:493] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 50315581143f4831ac7a5c7ef9900319)
W20260709 13:23:08.373713 28836 leader_election.cc:336] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111)
I20260709 13:23:08.374025 29213 raft_consensus.cc:3060] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:08.374203 28836 leader_election.cc:304] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9; no voters: 50315581143f4831ac7a5c7ef9900319, fcadc1b39cec4f10aa074fc9d4e3862d
W20260709 13:23:08.374402 28910 leader_election.cc:336] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111)
I20260709 13:23:08.374939 29223 raft_consensus.cc:2749] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:23:08.379870 29213 raft_consensus.cc:515] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.381989 29213 leader_election.cc:290] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 2 election: Requested vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:08.383265 28866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259cd0d23c5d4d6688517ad2681cc56b" candidate_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7eaf45ade8d44d8b662b95708097db9"
I20260709 13:23:08.383939 28866 raft_consensus.cc:3060] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:08.386264 28910 leader_election.cc:336] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111)
I20260709 13:23:08.390403 28866 raft_consensus.cc:2468] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcadc1b39cec4f10aa074fc9d4e3862d in term 2.
I20260709 13:23:08.391520 28911 leader_election.cc:304] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7eaf45ade8d44d8b662b95708097db9, fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319
I20260709 13:23:08.392182 29213 raft_consensus.cc:2804] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:08.392748 29213 raft_consensus.cc:697] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 LEADER]: Becoming Leader. State: Replica: fcadc1b39cec4f10aa074fc9d4e3862d, State: Running, Role: LEADER
I20260709 13:23:08.393774 29213 consensus_queue.cc:237] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.394555 16192 tablet_server.cc:179] TabletServer@127.15.208.2:0 shutting down...
I20260709 13:23:08.400030 29107 raft_consensus.cc:493] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50315581143f4831ac7a5c7ef9900319)
I20260709 13:23:08.400619 29107 raft_consensus.cc:515] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.405526 29107 leader_election.cc:290] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
I20260709 13:23:08.407699 28691 catalog_manager.cc:5697] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d reported cstate change: term changed from 1 to 2, leader changed from 50315581143f4831ac7a5c7ef9900319 (127.15.208.1) to fcadc1b39cec4f10aa074fc9d4e3862d (127.15.208.3). New cstate: current_term: 2 leader_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } health_report { overall_health: HEALTHY } } }
W20260709 13:23:08.408927 28911 leader_election.cc:336] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:23:08.410686 28910 leader_election.cc:336] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111)
I20260709 13:23:08.411226 28910 leader_election.cc:304] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9
I20260709 13:23:08.412106 29107 raft_consensus.cc:2749] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:23:08.421329 28911 consensus_peers.cc:597] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d -> Peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Couldn't send request to peer b7eaf45ade8d44d8b662b95708097db9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:08.432570 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:08.433409 16192 tablet_replica.cc:333] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.434036 16192 raft_consensus.cc:2243] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.434875 16192 raft_consensus.cc:2272] T 5e6a7db07f6843f389bdc1f58fe1962d P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.436818 16192 tablet_replica.cc:333] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.437438 16192 raft_consensus.cc:2243] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.438256 16192 raft_consensus.cc:2272] T 511dd4a19da849b2b2557a1c982e59fc P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.440109 16192 tablet_replica.cc:333] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.440644 16192 raft_consensus.cc:2243] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.441437 16192 raft_consensus.cc:2272] T 1148e114823d4f52bc18a8e2f53e7195 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.443239 16192 tablet_replica.cc:333] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.443789 16192 raft_consensus.cc:2243] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.444223 16192 raft_consensus.cc:2272] T 7f27d02fa52543368edef331aeaec217 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.446122 16192 tablet_replica.cc:333] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.446659 16192 raft_consensus.cc:2243] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.447408 16192 raft_consensus.cc:2272] T 8b195b9fbf144c72b1a54a00e34ebb4f P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.449404 16192 tablet_replica.cc:333] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.450158 16192 raft_consensus.cc:2243] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.451081 16192 raft_consensus.cc:2272] T c716168074ec471191341541441dfbcb P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.453866 16192 tablet_replica.cc:333] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.454424 16192 raft_consensus.cc:2243] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.454871 16192 raft_consensus.cc:2272] T 259cd0d23c5d4d6688517ad2681cc56b P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.456732 16192 tablet_replica.cc:333] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.457357 16192 raft_consensus.cc:2243] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.458108 16192 raft_consensus.cc:2272] T 20a1dc8dbb1643fb947fd70d65f59628 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.460352 16192 tablet_replica.cc:333] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.461237 16192 raft_consensus.cc:2243] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.461839 16192 raft_consensus.cc:2272] T 6c300961d77a49ffa8d1c428dc2ed841 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.464260 16192 tablet_replica.cc:333] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.464810 16192 raft_consensus.cc:2243] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.465286 16192 raft_consensus.cc:2272] T 433b9c6f78a34d03a0868a819d6197cc P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.467425 16192 tablet_replica.cc:333] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.468057 16192 raft_consensus.cc:2243] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.468495 16192 raft_consensus.cc:2272] T 8e6a77e282a04e739610c5f9a83eb77d P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.470652 16192 tablet_replica.cc:333] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
W20260709 13:23:08.470805 28911 consensus_peers.cc:597] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d -> Peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Couldn't send request to peer b7eaf45ade8d44d8b662b95708097db9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:08.471359 16192 raft_consensus.cc:2243] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.471935 16192 raft_consensus.cc:2272] T ba72a4f311ef4c589ef49c92b8af7f93 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.474097 16192 tablet_replica.cc:333] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.474635 16192 raft_consensus.cc:2243] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.475077 16192 raft_consensus.cc:2272] T bc2bd23cfbfd48cead8919dbcb26f0f0 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.477216 16192 tablet_replica.cc:333] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.477824 16192 raft_consensus.cc:2243] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.478240 16192 raft_consensus.cc:2272] T 56b8817d457f4c5ea9a62fdcc8b756ff P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.480139 16192 tablet_replica.cc:333] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.480672 16192 raft_consensus.cc:2243] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.481518 16192 raft_consensus.cc:2272] T f8684efda0df426eae166d3657400989 P b7eaf45ade8d44d8b662b95708097db9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.483528 16192 tablet_replica.cc:333] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.484043 16192 raft_consensus.cc:2243] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.484506 16192 raft_consensus.cc:2272] T b86fe15b142a4736ba19dd5b5ca4356e P b7eaf45ade8d44d8b662b95708097db9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.486449 16192 tablet_replica.cc:333] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.486938 16192 raft_consensus.cc:2243] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.487362 16192 raft_consensus.cc:2272] T 2e82016c61bc4ad38324abd7fb160226 P b7eaf45ade8d44d8b662b95708097db9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.489172 16192 tablet_replica.cc:333] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9: stopping tablet replica
I20260709 13:23:08.489635 16192 raft_consensus.cc:2243] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.490276 16192 pending_rounds.cc:70] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9: Trying to abort 1 pending ops.
I20260709 13:23:08.490491 16192 pending_rounds.cc:77] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639478348709888 op_type: NO_OP noop_request { }
I20260709 13:23:08.490792 16192 raft_consensus.cc:2889] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:23:08.491063 16192 raft_consensus.cc:2272] T f3e8aaa4249849b6864c20dbb553a2cb P b7eaf45ade8d44d8b662b95708097db9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.492651 29107 raft_consensus.cc:493] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 50315581143f4831ac7a5c7ef9900319)
I20260709 13:23:08.493290 29107 raft_consensus.cc:515] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50315581143f4831ac7a5c7ef9900319" member_type: VOTER last_known_addr { host: "127.15.208.1" port: 40539 } } peers { permanent_uuid: "b7eaf45ade8d44d8b662b95708097db9" member_type: VOTER last_known_addr { host: "127.15.208.2" port: 34621 } } peers { permanent_uuid: "fcadc1b39cec4f10aa074fc9d4e3862d" member_type: VOTER last_known_addr { host: "127.15.208.3" port: 43697 } }
I20260709 13:23:08.495455 29107 leader_election.cc:290] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539), b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621)
W20260709 13:23:08.498670 28911 leader_election.cc:336] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b7eaf45ade8d44d8b662b95708097db9 (127.15.208.2:34621): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:23:08.499771 28910 leader_election.cc:336] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 50315581143f4831ac7a5c7ef9900319 (127.15.208.1:40539): Network error: Client connection negotiation failed: client connection to 127.15.208.1:40539: connect: Connection refused (error 111)
I20260709 13:23:08.500211 28910 leader_election.cc:304] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fcadc1b39cec4f10aa074fc9d4e3862d; no voters: 50315581143f4831ac7a5c7ef9900319, b7eaf45ade8d44d8b662b95708097db9
I20260709 13:23:08.500869 29107 raft_consensus.cc:2749] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:23:08.522564 16192 tablet_server.cc:196] TabletServer@127.15.208.2:0 shutdown complete.
I20260709 13:23:08.555817 16192 tablet_server.cc:179] TabletServer@127.15.208.3:0 shutting down...
I20260709 13:23:08.585213 16192 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:08.586081 16192 tablet_replica.cc:333] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.587083 16192 raft_consensus.cc:2243] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.587688 16192 raft_consensus.cc:2272] T 7f27d02fa52543368edef331aeaec217 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.589705 16192 tablet_replica.cc:333] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.590267 16192 raft_consensus.cc:2243] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.590664 16192 raft_consensus.cc:2272] T 8b195b9fbf144c72b1a54a00e34ebb4f P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.592497 16192 tablet_replica.cc:333] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.593238 16192 raft_consensus.cc:2243] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.593650 16192 raft_consensus.cc:2272] T 5e6a7db07f6843f389bdc1f58fe1962d P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.595505 16192 tablet_replica.cc:333] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.596006 16192 raft_consensus.cc:2243] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.596781 16192 raft_consensus.cc:2272] T 8e6a77e282a04e739610c5f9a83eb77d P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.598824 16192 tablet_replica.cc:333] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.599385 16192 raft_consensus.cc:2243] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.600152 16192 raft_consensus.cc:2272] T ba72a4f311ef4c589ef49c92b8af7f93 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.602373 16192 tablet_replica.cc:333] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.602857 16192 raft_consensus.cc:2243] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.603250 16192 raft_consensus.cc:2272] T bc2bd23cfbfd48cead8919dbcb26f0f0 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.605195 16192 tablet_replica.cc:333] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.605701 16192 raft_consensus.cc:2243] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.606451 16192 raft_consensus.cc:2272] T 56b8817d457f4c5ea9a62fdcc8b756ff P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.608465 16192 tablet_replica.cc:333] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.609037 16192 raft_consensus.cc:2243] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.609402 16192 raft_consensus.cc:2272] T 20a1dc8dbb1643fb947fd70d65f59628 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.611420 16192 tablet_replica.cc:333] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.611931 16192 raft_consensus.cc:2243] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.612498 16192 pending_rounds.cc:70] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d: Trying to abort 1 pending ops.
I20260709 13:23:08.612646 16192 pending_rounds.cc:77] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7305639478872682496 op_type: NO_OP noop_request { }
I20260709 13:23:08.613010 16192 raft_consensus.cc:2889] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:23:08.613247 16192 raft_consensus.cc:2272] T 259cd0d23c5d4d6688517ad2681cc56b P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.615484 16192 tablet_replica.cc:333] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.616010 16192 raft_consensus.cc:2243] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.616403 16192 raft_consensus.cc:2272] T c716168074ec471191341541441dfbcb P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.618335 16192 tablet_replica.cc:333] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.618789 16192 raft_consensus.cc:2243] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.619149 16192 raft_consensus.cc:2272] T f8684efda0df426eae166d3657400989 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.620962 16192 tablet_replica.cc:333] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.621430 16192 raft_consensus.cc:2243] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.621791 16192 raft_consensus.cc:2272] T 2e82016c61bc4ad38324abd7fb160226 P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.623529 16192 tablet_replica.cc:333] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.623963 16192 raft_consensus.cc:2243] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.624342 16192 raft_consensus.cc:2272] T f3e8aaa4249849b6864c20dbb553a2cb P fcadc1b39cec4f10aa074fc9d4e3862d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.626199 16192 tablet_replica.cc:333] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.626638 16192 raft_consensus.cc:2243] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.627349 16192 raft_consensus.cc:2272] T b86fe15b142a4736ba19dd5b5ca4356e P fcadc1b39cec4f10aa074fc9d4e3862d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.629136 16192 tablet_replica.cc:333] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.629597 16192 raft_consensus.cc:2243] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.629971 16192 raft_consensus.cc:2272] T 433b9c6f78a34d03a0868a819d6197cc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.632157 16192 tablet_replica.cc:333] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.632594 16192 raft_consensus.cc:2243] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.633013 16192 raft_consensus.cc:2272] T 6c300961d77a49ffa8d1c428dc2ed841 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.634783 16192 tablet_replica.cc:333] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.635205 16192 raft_consensus.cc:2243] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.635584 16192 raft_consensus.cc:2272] T 1148e114823d4f52bc18a8e2f53e7195 P fcadc1b39cec4f10aa074fc9d4e3862d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.637313 16192 tablet_replica.cc:333] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d: stopping tablet replica
I20260709 13:23:08.637715 16192 raft_consensus.cc:2243] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:08.638072 16192 raft_consensus.cc:2272] T 511dd4a19da849b2b2557a1c982e59fc P fcadc1b39cec4f10aa074fc9d4e3862d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.677321 16192 tablet_server.cc:196] TabletServer@127.15.208.3:0 shutdown complete.
I20260709 13:23:08.708963 16192 master.cc:562] Master@127.15.208.62:32939 shutting down...
I20260709 13:23:08.732028 16192 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:08.732568 16192 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:08.732956 16192 tablet_replica.cc:333] T 00000000000000000000000000000000 P e87850376a0c46d5809ab37440beba04: stopping tablet replica
I20260709 13:23:08.759487 16192 master.cc:584] Master@127.15.208.62:32939 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12382 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25356 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (383692 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:23:08.813791 16192 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 476 messages since previous log ~15 seconds ago
I20260709 13:23:08.814002 16192 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 483 messages since previous log ~15 seconds ago
I20260709 13:23:08.814144 16192 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 482 messages since previous log ~15 seconds ago
I20260709 13:23:08.814296 16192 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:23:08.814441 16192 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:23:08.814601 16192 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~149 seconds ago
I20260709 13:23:08.814821 16192 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 45 messages since previous log ~1 seconds ago
I20260709 13:23:08.815043 16192 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
